Posted 3/20/2024, 12:00:51 PM
New 'Inner Monologue' Training Boosts AI's Reasoning Abilities
- Researchers developed a new training method called "Quiet-STaR" that gives AI an "inner monologue" to improve reasoning
- It works by having the AI generate multiple internal rationales in parallel before responding
- Quiet-STaR was tested on an AI called Mistral 7B and improved its reasoning test score from 36.3% to 47.2%
- The method helped the AI learn by discarding incorrect rationales after verifying with humans
- Researchers believe techniques like Quiet-STaR can reduce the gap between AI and human reasoning