Amazon's AI Model Displays Surprising Abilities Without Explicit Training
-
Amazon researchers built an AI model called BASE TTS that exhibits "emergent abilities" like understanding punctuation and emotions, without being explicitly trained on those tasks.
-
BASE TTS was one of 3 models trained on different amounts of speech data - 1,000 hours, 10,000 hours, and 100,000 hours.
-
The 10,000 hour model scored the highest on natural language tasks, exhibiting abilities like transcribing non-words and internet shorthand.
-
The researchers say BASE TTS was never explicitly told to produce some of its more surprising or challenging outputs.
-
While not AGI yet, the findings could have implications for progress towards general intelligence without massive datasets.