Google Creates AI Agent That Plays Video Games Via Voice Commands
• Google DeepMind developed SIMA, an AI agent that can play video games based on natural language commands • SIMA was trained on 8 different games and can carry out over 600 basic in-game skills and actions • A benefit is that SIMA doesn't need access to game code or APIs, just the game visuals and player commands • Limitations are that SIMA struggles with more complex, multi-step actions that require intuition • Potential real-world use cases are increasing gaming accessibility and automating repetitive gameplay tasks