Source: Google Deepmind Genie

Google DeepMind has once again captivated the world with its groundbreaking creation: Genie. This revolutionary model takes text, sketches, or even photos and transforms them into playable video games reminiscent of classic 2D platformers like Super Mario Bros through ImageGen2. But there’s a twist; these games run at a leisurely one frame per second, offering a unique and contemplative gaming experience.

What’s Google Genie About?

Genie is like the next step from other cool creations like OpenAi’s Sora and Nvidia’s GameGAN. But, what makes Genie different is that it doesn’t need lots of extra work to learn. It watches videos of games and figures out how they work all by itself. This means it can learn from a lot more videos, expanding the pool of available training data.

Read More: From ByteDance to Breakthrough: Sora AI’s Reign Over Video Content

How Genie Works

Besides, Genie learns by watching 200,000 hours of game videos from 2D platform games. It pays attention to what happens when players do things like jump or move around. Then, when you play with the game it creates, it reacts just like a real game. If you press a button to jump, Genie makes it happen in the game, offering a seamless gaming experience.

Making Games Faster and Better

While Genie currently runs at one frame per second, the Google DeepMind team assures us that faster iterations are on the horizon. With advancements in inference speed, the possibility of reaching 30 frames per second opens up new horizons for gameplay fluidity and immersion.

Going Beyond Games: The Big Picture

Genie isn’t just about playing games. It’s also about learning and solving problems. Imagine if robots could learn from watching videos, just like Genie does with games. They could figure out how to do tasks and help us in the real world. That’s the big dream behind Genie.

Conclusion

Genie is like a magical genie granting wishes, but instead of wishes, it turns ideas into games. It’s opening up a whole new world of fun and learning. With Genie, the future looks brighter, and the possibilities are endless!