AI Struggles to Match Humans in Learning to Play Complex Video Game
-
Researchers in China and Singapore developed an AI agent called CRADLE to play Red Dead Redemption 2 (RDR2) and test general computer control skills.
-
CRADLE has 6 modules to take in visual, audio, and gameplay cues to mimic human control. It was moderately successful at progressing through RDR2's storyline.
-
The AI struggled with spatial awareness, object recognition, understanding UI elements, and open-ended tasks. Researchers blamed limitations of the GPT-4V vision system.
-
The goal was to evaluate if AIs can learn complex computer control skills from scratch like humans, without access to internal game states or APIs.
-
CRADLE's flexible design means it could potentially be used to control other video games or software, expanding AI capabilities.