AI generates video game levels and characters from text prompts
Summary
A simple generative AI model that uses small datasets can quickly create video game maps, character models, and emojis based on one-sentence prompts.
Topics
Posted 9/1/2023, 2:00:01 PM
newscientist.com
Relevant topic timeline:
The main topic of the passage is the startup Inworld and its use of generative AI to create dynamic dialogue in gaming. The key points include:
- Inworld uses multiple machine learning models to mimic human communication in games.
- The AI tools allow developers to create lifelike and immersive gaming experiences by linking dialogue and voice generation to animation and rigging systems.
- NPCs powered by Inworld's tech can learn, adapt, initiate goals, and perform actions autonomously.
- Users can create personalities for NPCs and control their knowledge and behavior.
- Inworld has safety tech to control profanity, bias, and toxicity in character dialogue.
- The startup has received significant investments and partnerships from venture capital firms, brands, and organizations.
- Inworld's tools integrate with popular game engines like Unity and Unreal Engine.
- The company plans to launch an open-source version of its character creation tool in the future.
- Inworld aims to expand beyond gaming into marketing campaigns, customer service agents, and broader entertainment.
- The startup is positioned to create novel user experiences and seize opportunities in the intersection of gaming and AI.
Code Llama, Meta's AI large language model, assists with writing computer code by generating text and providing coding assistance for various programming languages.
Recent advancements in generative AI have led to the development of text-to-image models that can create highly realistic images using text prompts, but refining these models to generate specific content can be challenging; however, researchers have introduced an image prompt adapter called IP-Adapter that improves the controllability and compatibility of these models.
AI-powered tools like Claude AI, PinwheelGPT, Reimagine, Tome, Whisper Memos, and Eleven Labs are providing helpful and creative functionalities such as explaining and summarizing text, providing kid-friendly chats, animating old photos, creating compelling visuals, transcribing voice memos with accuracy, and generating AI voices.
Generative artificial intelligence, particularly large language models, has the potential to revolutionize various industries and add trillions of dollars of value to the global economy, according to experts, as Chinese companies invest in developing their own AI models and promoting their commercial use.
Researchers from MIT and the MIT-IBM Watson AI Lab have developed a technique that uses computer-generated data to improve the concept understanding of vision and language models, resulting in a 10% increase in accuracy, which has potential applications in video captioning and image-based question-answering systems.
Generative AI has the potential to understand and learn the language of nature, enabling scientific advancements such as predicting dangerous virus variants and extreme weather events, according to Anima Anandkumar, Bren Professor at Caltech and senior director of AI research at NVIDIA.
Generative AI is set to revolutionize game development, allowing developers like King to create more levels and content for games like Candy Crush, freeing up artists and designers to focus on their creative skills.
Conversational AI and generative AI are two branches of AI with distinct differences and capabilities, but they can also work together to shape the digital landscape by enabling more natural interactions and creating new content.
Artificial intelligence (AI) is being increasingly used in game development, with AI-generated characters and dialogues creating more immersive experiences, although its limitations mean that humans still play a crucial role, and game developers believe AI will never be able to replace the unique combination of story, art, sound, and overall experience that games offer, while the use of AI in translation tasks in the gaming industry is leading to lower pay for translators and a decline in translation quality, causing concerns among professionals in the field.
Researchers at Stanford University and Google have created a virtual world called Smallville, populated with 25 AI-powered characters known as generative agents, in order to study their behavior and interactions. The agents, powered by AI language models, have memory streams that contain information about their identity and environment, allowing them to engage in dialogue and make plans. The researchers hope that this technology can be used for a variety of applications, including NPCs in video games and simulations for social theories and policies. The AI agents exhibited emergent behaviors such as information diffusion and group coordination.
Generative AI tools like GPT-4 and Dall-E 2 can revolutionize the gaming industry by creating thousands of unique assets for game worlds, improving immersion and reducing costs for developers.