Posted 3/13/2024, 2:05:28 PM
Google Creates AI Agent That Plays 3D Video Games and Understands Instructions
- Google DeepMind created an AI agent called SIMA that can play multiple 3D video games and understand human instructions
- SIMA was trained on gameplay videos to learn associations between visuals, actions, and objectives
- It can generalize knowledge across games, although games with unique mechanics pose a challenge
- The goal is for SIMA to be a more natural, cooperative co-op gaming companion than pre-programmed NPCs
- SIMA uses imitation learning rather than rewards to enable open-ended goals, unlike simulator training