AI is making us write more code.
-
AI is making us write more code. That's the problem.
I analyzed research papers on AI-generated code quality. The findings:
→ 1.7x more issues than human-written code
→ 30-41% increase in technical debt
→ 39% increase in cognitive complexity
→ Initial speed gains disappear within a few monthsWe're building the wrong thing faster and calling it productivity.
Amen to that, brother…
-
AI is making us write more code. That's the problem.
I analyzed research papers on AI-generated code quality. The findings:
→ 1.7x more issues than human-written code
→ 30-41% increase in technical debt
→ 39% increase in cognitive complexity
→ Initial speed gains disappear within a few monthsWe're building the wrong thing faster and calling it productivity.
@mlevison so true, it astounds me people didn't see this coming from the start. Also there's the cognitive deterioration double whammy.
-
AI is making us write more code. That's the problem.
I analyzed research papers on AI-generated code quality. The findings:
→ 1.7x more issues than human-written code
→ 30-41% increase in technical debt
→ 39% increase in cognitive complexity
→ Initial speed gains disappear within a few monthsWe're building the wrong thing faster and calling it productivity.
That's my experience too.
Dave Farley's. MSE channe, which I usually respect,l recently claimed the opposite though, based on a study they took part in.
-
AI is making us write more code. That's the problem.
I analyzed research papers on AI-generated code quality. The findings:
→ 1.7x more issues than human-written code
→ 30-41% increase in technical debt
→ 39% increase in cognitive complexity
→ Initial speed gains disappear within a few monthsWe're building the wrong thing faster and calling it productivity.
@mlevison Goodhart's law in action. Actually, I'm not sure it even is an example of Goodhart's law. Raw quantity of code output would never have correlated strongly with quality. What do they think they're doing‽
-
AI is making us write more code. That's the problem.
I analyzed research papers on AI-generated code quality. The findings:
→ 1.7x more issues than human-written code
→ 30-41% increase in technical debt
→ 39% increase in cognitive complexity
→ Initial speed gains disappear within a few monthsWe're building the wrong thing faster and calling it productivity.
@mlevison I use LLMs to help me with basic code writing tasks, generating the structural frameworks, saving me a lot of typing time. However, I never rely on that code out of the box, I always review it thoroughly and often just snip and prune. I would never attempt to give an LLM a complicated set of instructions, it's going to fail every time.
-
@mlevison I use LLMs to help me with basic code writing tasks, generating the structural frameworks, saving me a lot of typing time. However, I never rely on that code out of the box, I always review it thoroughly and often just snip and prune. I would never attempt to give an LLM a complicated set of instructions, it's going to fail every time.
-
AI is making us write more code. That's the problem.
I analyzed research papers on AI-generated code quality. The findings:
→ 1.7x more issues than human-written code
→ 30-41% increase in technical debt
→ 39% increase in cognitive complexity
→ Initial speed gains disappear within a few monthsWe're building the wrong thing faster and calling it productivity.
@mlevison I hear you. I am seeing it first hand. And I am being hammered for pointing this out and encouraging caution, while others are being rewarded for shipping
“because AI”.Just call me ‘Cassandra’
️ -
@mlevison This talk on AI productivity from a Stanford researcher goes into detail on this. Really interesting and gels with what you're saying: the actual productivity gains tended to be with simple (low-complexity, greenfield) tasks rather than anything bigger or more complex. https://youtu.be/tbDDYKRFjhk?si=AM5DPcJGeg_3ignp
-
@crackhappy @mlevison Jetbrains vanilla Intellisense was pretty good even before the latest epidemic of AI psychosis.
-
@crackhappy @mlevison Jetbrains vanilla Intellisense was pretty good even before the latest epidemic of AI psychosis.
@thirstybear @mlevison I refuse to call what we currently have "Artificial Intelligence" because it is not. It's a fundamentally clever implementation of Markov chains with way way too much power applied.
-
R ActivityRelay shared this topic
