Microsoft Research has created Muse, a first-of-its-kind generative AI model that can generate a game environment based on visuals or players’ controller actions. It understands a 3D game world and game physics and can react to how players interact with a game.

Microsoft Corp. unveiled artificial intelligence tools that can create video-game scenes that would normally have to be programmed and animated by a human, a model it built using data collected from Xbox gamers and their controllers.

Microsoft debuts Muse, a world and human action model that uses generative AI to put together gameplay snippets.

Microsoft views the Muse AI model more as a tool for game preservation and concept brainstorming than a way to replace human-made video games.

Microsoft Research and Ninja Theory teamed up to build Muse, a generative AI model capable of generating gameplay.

In a new blog post on Wednesday, Microsoft’s research department debuted a new generative AI model called Muse that it describes as a “breakthrough” for gameplay ideation.

Muse is Microsoft's new generative AI for game development that promises to be a gameplay concept tool – it will ideate playable ideas, building game visuals, controller inputs and more. It sounds groundbreaking but Muse feels like a tech experiment rather than the game development revolution Microsoft is pitching.

Microsoft’s Muse is built on the World and Human Action Model (WHAM) and is intended to enhance developers’ creativity.

Microsoft Research has introduced Muse, a new AI model that can create controller actions and images for video games. On