Reposting a question for Ed Zitron, I'll forward responses.
-
Reposting a question for Ed Zitron, I'll forward responses. He asked on Bluesky and will get sub-Mastodon-tier answers:
"This is a serious question and I would be delighted if I only hear great things but, software engineers: both before and after LLMs, how often in your professional lives have you run into software engineers that seem completely useless or lacking in basic knowledge? I hope the answer is rarely"
@ludicity I would say for GCC, the difference is NOT pre-LLM vs post-LLM when it comes to software engineers that seems completely useless or lacking in basic knowledge.
In fact I would say the difference for GCC bug reports it would be when it became more common knowledge that there is undefined behavior in C/C++.
Since there is so much more things written about how signed integer overflow is undefined behavior and much more written about C/C++ aliasing rules; there have been much push back at their code having undefined behavior in it.
GCC seemly gets less and less bug reports that need to be closed as invalid for having undefined behavior in it. In the last 2 months, GCC has got around 3 or 4 that has had undefined behavior in it. Around 10 years ago, it would have been closer to 12 or so for a 2 month span.
These days my bug triaging is more about bug reports that have been already filed rather than invalid ones.
(been doing this for 20+ years now too so I have noticed trends like this). -
Reposting a question for Ed Zitron, I'll forward responses. He asked on Bluesky and will get sub-Mastodon-tier answers:
"This is a serious question and I would be delighted if I only hear great things but, software engineers: both before and after LLMs, how often in your professional lives have you run into software engineers that seem completely useless or lacking in basic knowledge? I hope the answer is rarely"
@ludicity oh boy. Pre, regulary, absolutely. LLM do not seem to have made that much of an inroads yet into our field, except Juniors getting led astray and eventually coming back very confused.
-
Reposting a question for Ed Zitron, I'll forward responses. He asked on Bluesky and will get sub-Mastodon-tier answers:
"This is a serious question and I would be delighted if I only hear great things but, software engineers: both before and after LLMs, how often in your professional lives have you run into software engineers that seem completely useless or lacking in basic knowledge? I hope the answer is rarely"
@ludicity I worked for most of my career at a place that had a very good interview process, and pretty much everyone was competent on all the right axes. But at one point we started using some contractors from an agency and quickly realised we had to do our own screening of them. I usually asked them to code FizzBuzz in their choice of language and explain what they were doing as they did it. 20% couldn't do it at all. 30% struggled to explain their reasoning or listen to hints.
-
Reposting a question for Ed Zitron, I'll forward responses. He asked on Bluesky and will get sub-Mastodon-tier answers:
"This is a serious question and I would be delighted if I only hear great things but, software engineers: both before and after LLMs, how often in your professional lives have you run into software engineers that seem completely useless or lacking in basic knowledge? I hope the answer is rarely"
@ludicity all I am learning here is I better brush up on FizzBuzz if I want to do an interview again.
Will send you a better answer privately, maybe.
-
-
Reposting a question for Ed Zitron, I'll forward responses. He asked on Bluesky and will get sub-Mastodon-tier answers:
"This is a serious question and I would be delighted if I only hear great things but, software engineers: both before and after LLMs, how often in your professional lives have you run into software engineers that seem completely useless or lacking in basic knowledge? I hope the answer is rarely"
@ludicity you can spot club members because they wear a badge with "IBM" written on it.
-
Reposting a question for Ed Zitron, I'll forward responses. He asked on Bluesky and will get sub-Mastodon-tier answers:
"This is a serious question and I would be delighted if I only hear great things but, software engineers: both before and after LLMs, how often in your professional lives have you run into software engineers that seem completely useless or lacking in basic knowledge? I hope the answer is rarely"
@ludicity i'm a bit worried about confirmation bias here, though of course incompetence has existed and will continue to exist. the difference between a competent and incompetent engineer isn't decided by the tools that they have access to but the time they choose / are afforded to develop competency and how well they have learned-to-learn.
that said, while there isn't a quantitative difference in incompetence engineers, there is a qualitative difference in incompetent engineering. expensive AI licenses move wealth from labour to capital and give management hacks a license to demand specific things from engineers at a specific rate. some of the heaviest AI users ive seen are the junior enggs and interns, and while they werent able to answer questions about what they wrote pre-LLMs either, now it's buried in an amount of noise and unaccountability that makes it hard to catch these pitfalls during code reviews.
LLMs dont make people incompetent the moment you touch them. they change the amount of code, plausibly functional code mind you, that you can create in a given amount of time. this reduces the amount of time seniors can spend in design, reviewing, and talent building, and hinders the processes that (sometimes) build competence out of incompetence. i'm not a full-time-hater of LLMs, but i do worry about the real damage they do to enterprise engineering processes moreso than the engineers themselves.
-
Reposting a question for Ed Zitron, I'll forward responses. He asked on Bluesky and will get sub-Mastodon-tier answers:
"This is a serious question and I would be delighted if I only hear great things but, software engineers: both before and after LLMs, how often in your professional lives have you run into software engineers that seem completely useless or lacking in basic knowledge? I hope the answer is rarely"
@ludicity I can't think of any. A few who weren't very good; a couple who spammed the codebase with buggy code that took considerable effort to clean up; and one or two who were good at day-to-day programming but didn't know much computer science, so sometimes wrote code with terrible big-O. But nobody who was "completely lacking in basic knowledge". I've interviewed a few candidates who appeared not to be able to code, but maybe they just couldn't code *in interviews*?
-
@buherator @ludicity I have run into security engineers a couple of times matching that description.
-
@ludicity For the record, I work at a software company that employs ~10k developers.
Before LLMs, I'd encounter such engineers a couple of times a month, but I interact with a lot of engineers, specifically the ones that need help or are new at the company or industry at large, so it's a selected sample. Even the most inexperienced ones are willing and able to learn with some guidance.
After LLMs, there's been a significant uptick, and these new ones are grossly incompetent, incurious, impatient, and behave like addicts if their supply of tokens is at all interrupted. If they run out of prompt credits, its an emergency because they claim they can't do any work at all. They can't even explain the architecture of what they are making anymore, and can't even file tickets or send emails without an LLM writing it for them, and they certainly lack in any kind of reading comprehension.
It's bleak and depressing, and makes me want to quit the industry altogether.
@drikanis @ludicity Similar experience here. More and more people cannot function without an LLM prompt ready to answer to them, they totally lost any autonomy. If you ask anything to them, they will basically give you the output of their LLM, instead of formulating an answer by themselves, even when they know the answer. It’s pure cocaine.
-
@ludicity For the record, I work at a software company that employs ~10k developers.
Before LLMs, I'd encounter such engineers a couple of times a month, but I interact with a lot of engineers, specifically the ones that need help or are new at the company or industry at large, so it's a selected sample. Even the most inexperienced ones are willing and able to learn with some guidance.
After LLMs, there's been a significant uptick, and these new ones are grossly incompetent, incurious, impatient, and behave like addicts if their supply of tokens is at all interrupted. If they run out of prompt credits, its an emergency because they claim they can't do any work at all. They can't even explain the architecture of what they are making anymore, and can't even file tickets or send emails without an LLM writing it for them, and they certainly lack in any kind of reading comprehension.
It's bleak and depressing, and makes me want to quit the industry altogether.
-
Reposting a question for Ed Zitron, I'll forward responses. He asked on Bluesky and will get sub-Mastodon-tier answers:
"This is a serious question and I would be delighted if I only hear great things but, software engineers: both before and after LLMs, how often in your professional lives have you run into software engineers that seem completely useless or lacking in basic knowledge? I hope the answer is rarely"
@ludicity Completely useless? Not a lot, either pre/post, but I mostly worked in safety related industries. There were/are quite a few, which seemed to lack any kind of foresight or initiative.
AI use is picking up steam though, and I do see people outsourcing their thinking, sometimes live during a meeting (and getting obsolete data because of that).People that are unable to see risks in software will use GenAI to generate a lot of security issues. Not looking forward to cleaning those up.
-
-
Reposting a question for Ed Zitron, I'll forward responses. He asked on Bluesky and will get sub-Mastodon-tier answers:
"This is a serious question and I would be delighted if I only hear great things but, software engineers: both before and after LLMs, how often in your professional lives have you run into software engineers that seem completely useless or lacking in basic knowledge? I hope the answer is rarely"
@ludicity bear in mind a lot of tech companies are casually relocating PM talent into SWE. Happened at the huge huge tech co I work for. All of a sudden I'm expected to start building things. Never been a coder. But it's fine because AI will help, right? Everyone needs to pay their mortgage and the job market is hard right now. So here we are.
-
Reposting a question for Ed Zitron, I'll forward responses. He asked on Bluesky and will get sub-Mastodon-tier answers:
"This is a serious question and I would be delighted if I only hear great things but, software engineers: both before and after LLMs, how often in your professional lives have you run into software engineers that seem completely useless or lacking in basic knowledge? I hope the answer is rarely"
@ludicity I'd say "occasionally", and the rate at which it occurs is notably distinct between different kinds of workplaces. The more enterprisey, the more likely.
Also, interview candidates seem disproportionately more likely to be terrible, but that at least makes sense--the less competent folks are more likely to be interviewing, right?
I wouldn't say I've noticed much different pre- and post-LLMs, but I HAVE noticed that post-LLM, you've got a lot of people uncritically drinking the Kool-Aid.
-
Reposting a question for Ed Zitron, I'll forward responses. He asked on Bluesky and will get sub-Mastodon-tier answers:
"This is a serious question and I would be delighted if I only hear great things but, software engineers: both before and after LLMs, how often in your professional lives have you run into software engineers that seem completely useless or lacking in basic knowledge? I hope the answer is rarely"
We must welcome folks with no experience, and not deride them as being “useless”.
Lack of compassion and human engagement, and the capitalists dream of the 10x hero programmer got us into this mess.
It’s your job to develop your team. Train them. Believe in them. Support them.
It’s not a pissing contest.
-
Reposting a question for Ed Zitron, I'll forward responses. He asked on Bluesky and will get sub-Mastodon-tier answers:
"This is a serious question and I would be delighted if I only hear great things but, software engineers: both before and after LLMs, how often in your professional lives have you run into software engineers that seem completely useless or lacking in basic knowledge? I hope the answer is rarely"
@ludicity I've worked with people of a wide range of abilities, but not sure I can describe any of my former or present colleagues as completely useless. I've seen managers who were useless or worse than useless for sure though
-
Reposting a question for Ed Zitron, I'll forward responses. He asked on Bluesky and will get sub-Mastodon-tier answers:
"This is a serious question and I would be delighted if I only hear great things but, software engineers: both before and after LLMs, how often in your professional lives have you run into software engineers that seem completely useless or lacking in basic knowledge? I hope the answer is rarely"
@ludicity pretty often
-
Reposting a question for Ed Zitron, I'll forward responses. He asked on Bluesky and will get sub-Mastodon-tier answers:
"This is a serious question and I would be delighted if I only hear great things but, software engineers: both before and after LLMs, how often in your professional lives have you run into software engineers that seem completely useless or lacking in basic knowledge? I hope the answer is rarely"
@ludicity fortunately none so far. It's still a relatively short career though
-
Reposting a question for Ed Zitron, I'll forward responses. He asked on Bluesky and will get sub-Mastodon-tier answers:
"This is a serious question and I would be delighted if I only hear great things but, software engineers: both before and after LLMs, how often in your professional lives have you run into software engineers that seem completely useless or lacking in basic knowledge? I hope the answer is rarely"
@ludicity I have fortunately increased my distance from Silicon Valley startups nowadays, otherwise I might have a more pertinent answer RE "after LLMs", but in web dev, the truth is there have already been numerous inflection points in the before times. Examples:
- Mid-late 2000s: Back-end engineers write tons of awful front-end code because organizations refuse to hire specialists as they fail to appreciate how distinct and deep of a discipline semantic HTML, accessibility, CSS, and client-side scripting have become.
- Mid-late 2010s: The advent of various JS frameworks (e.g. React, Next, Tailwind) lead to more and more _front-end_ engineers who _also_ don't understand any of the things I listed above, when that should literally be their damn job.(Edit: dates indicate when these problems started. They haven't stopped.)
Of course, because LLMs "learn from" all of the mountains of bad code already output via these prior layers of dysfunction, that will only multiply the pain further...
Perhaps more related to the "after LLMs" bucket, though, is just how many OSS projects my work has depended on that have accepted vibe-coded PRs, which I find deeply unsettling, especially given the context of findings like this: https://cyberplace.social/@GossiTheDog/116080909947754833
️
