Posted 2/25/2024, 12:00:11 PM
Generative AI's Brittle Foundations Exposed by Coding Bug Causing Gibberish
- Generative AI can appear eloquent on the surface, but the inner workings are often brittle with poor software engineering
- A coding bug caused ChatGPT to produce gibberish, revealing brittleness
- Words get converted to numeric tokens for AI processing; bugs can scramble the tokens
- As generative AI becomes more ubiquitous, its brittleness could cause societal problems
- AI innovations often start in labs with little software engineering rigor
- Generative AI's movement from labs to daily life requires more reliable software
- Can use one AI to double check another AI's outputs for errors
- Need to avoid anthropomorphizing AI as having "strokes" or "breakdowns" when bugs occur
- Aim for generative AI that is resilient rather than brittle as it becomes deeply embedded