You’ve accurately described why having LLMs cobble together code is a terrible idea. With all the vibe-coded nonsense finding its way into production code because the amount of code generated in a short amount of time inevitably overwhelms human oversight, I wouldn’t want to work in cybersec these days.
That said, I do see applications for LLMs in areas where mistakes will not get people hurt or systems breached: they can
provide a first layer of customer and tech support to solve the really stupid stuff that needs no human attention (“Have you made sure that the device is plugged in? Have you tried turning it off and on again?”). This can be particularly useful when paired with a source of truth it can draw from.
do tedious tasks involving large amounts of text processing, e.g. automated translation, cross-referencing of legal texts.
provide pre-college learners with a tutor that is available 24/7, can explain simple academic subject matters and answer questions that naturally arise as part of every learning process. Again, pair with a source of truth for more reliable results.
You’ve accurately described why having LLMs cobble together code is a terrible idea. With all the vibe-coded nonsense finding its way into production code because the amount of code generated in a short amount of time inevitably overwhelms human oversight, I wouldn’t want to work in cybersec these days.
That said, I do see applications for LLMs in areas where mistakes will not get people hurt or systems breached: they can