Is the Augmented Reality Military the Future of Defence?

Options like this allow me to work far more comfortably in some ways than when we were in a traditional office. Builder Bot is currently the best visual representation of how Meta AI will create the future of the Metaverse. The tool employs meta builder bot Meta’s self-learning AI platform to generate instant virtual environments. What follows is a painstaking construction of a scene your mum might have pinned on the fridge after a particularly uninspired session with the coloured pencils.

Additionally, Meta AI developments will continue to innovate how individuals and groups use augmented, virtual, and mixed reality (AR/VR/MR) hardware, and software by introducing AI-driven contextual digital assistants. The Meta CEO explained that as this tech advances, it will allow users to create nuanced worlds with just their voices. Mark Zuckerberg’s metaverse is being designed to offer a second Internet that users will be able to play, work and relax in.

About The Project

Our AI labs are already making advancements in research and development as part of a long-term effort to enable the next era of computing. Prepare for the years ahead with 100+ lessons, tactics, tools and frameworks with our full learning database. Join 298,793 Trend Hunters with special access to premium content, topic tracking and customizable tools through our AI-powered Dashboard. The bot can also work on simple and complex commands such as “add altocumulus clouds” or “let’s get some sounds of waves and seagulls.”

Basically, what the Builder Bot should do is allow users to describe a world and then it would generate aspects of that world. In the demo, Zuckerberg and another Meta employee created a basic beach scene with a picnic table and clouds and added some sound effects of seagulls and ocean waves. With Horizon Worlds, Meta is already trying to lower the barriers to creating VR experiences. Like Rec Room and , Worlds lets you build inside VR by using your controllers to place & manipulate shapes and using a visual scripting system to add dynamic functionality. But not everyone is comfortable using console-like controllers to navigate intricate menu systems. Concepts like Builder Bot hint at a potential future where just like in Star Trek, anyone can create their own virtual worlds with just their voice.

Meta shows an AI bot that allows users to create VR worlds in the metaverse using voice

Meta announced Project CAIRoke, a model designed for developing smart chat bots that operate in the metaverse. Zuckerberg demonstrated directing a robot called Builder Bot to create new features in the metaverse by instructing the CAIRoke-powered system using voice commands. “Let’s add an island over there.” An island with moss-covered rocks pops up in the distance. One industry that has seen incredible innovation in digital accessibility is gaming, which shares many of the same foundational technologies and design considerations as the metaverse. Of course, accessibility in gaming enables better experiences for the largest audience possible, making it a key business goal in the fight for consumer attention. Playground Games, the developers behind racing game Forza Horizon 5, have done incredible work to develop features including American and British Sign Language support in cinematics, a color blindness mode and controller remapping.

This project, according to Zuckerberg, is central to his metaverse visions. We’re sharing advances we’ve made in AI technology that will help us build for the metaverse, from inclusive translation systems to a new AI model for chatting with virtual assistants. Shown off at a recent AI showcase, Meta CEO Mark Zuckerberg revealed an essential tool for the company’s metaverse project.

A Meta prototype lets you build virtual worlds by describing them

The developments come after Meta announced its Super Cluster AI supercomputer in January, which aims to become the world’s fastest supercomputer, namely for natural language processing, computer vision processing, and deep learning research. Meta expanded upon much of its research during its online event by outlining developer opportunities and potential public use cases. Now, we can only speculate as to how this technology will be accessible to the VR world. Okay, we know that Mark Zuckerberg has been really re-orienting his efforts into Meta , and now, Engadget reports about a new tool the company is building for the metaverse. Instead of placing objects from a user interface with controllers, Builder Bot is shown to let you create by simply describing out loud what you want. In the demo, Mark Zuckerberg asks for a beach, then for a specific type of clouds, then props like trees and a picnic.

Also, TorchRec enables Meta to provide large-scale benchmark tests, using public datasets, to show AI performance at a far greater scale to speed up research and developments (R&D) times and improve the contextual power of Project CAIRoake. In July last year, Meta, then Facebook, partnered with AI and spatial data company Matterport to “help change the way we work and live” with a Habitat-Matterport 3D Research Dataset database of digital twins of indoor spaces. Additionally, the AI platform scans a user’s environment to improve the identification of real-world items and the role each plays in their routines. In terms of XR, Meta plans to employ Project CAIRaoke digital assistants into its upcoming Project Nazare AR smart glasses – the firm also suggests integration into future VR headsets. Many of the announcements fall into the firm’s ongoing vision to provide a leading Metaverse experience with its Horizon Worlds platform. During the online event, the CEO and other Meta execs announced a trove of new AI technology for solutions ready to try today and for upcoming ones.

An AI that can understand abstraction could complete an image just from a few pieces of visual information, or generate the next frame of a video it’s never seen. It could also build a visually pleasing virtual world with only your words to guide it. It’s unclear if Builder Bot will ever become a true part of the burgeoning Metaverse, but its skill with real-time language processing and understanding how parts of the environment should go together is clearly informed by the work Meta is doing. The development of Builder Bot is part of a larger AI initiative called Project CAIRaeoke, which is an end-to-end neural model for building on-device assistance. “Let’s add some clouds,” the legless Zuckerberg intoned as some pixelated clouds filled the would-be sky.

• In less than 2 minutes of building time, a fairly complete picnic-at-the-beach scene was created.
• Zuckerberg describes Builder Bot as a “concept”, warning that “there are a lot of challenges we still need to solve”.
• That is the potential of this tool to enhance creativity when designing as well as increase the ability to create digital user-generated environments.
• In addition to adding objects, the voice-activated bot also adds sound effects and music to immerse a user in digital environments.

A groundbreaking addition to this toolkit is being developed and could be available soon to Quest 2 VR enthusiasts. Mark Zuckerberg may still be explaining exactly what the metaverse is, but the Meta CEO just showed off another technology he says will be crucial to the company’s vision of creating immersive environments. Meta’s AI researchers are working on a voice-powered bot that allows users to change their virtual surroundings with voice commands. For now though, the technology seems to be in a relatively early stage. The environment Zuckerberg generated looked much flatter and lower-res than past metaverse demos, though his legless avatar was present much like other recent demos. “As we advance this technology further, you’re going to be able to create nuanced worlds to explore and share experiences with others with just your voice,” he said.

How the metaverse is making experiences more accessible for disabled and impaired people

Hopefully, all of the tools in development will be used for the betterment of human kind. Meta’s Metaverse AI Builder Bot is just one small part of the company’s massive suite of AI tools. Backed by a top-of-the-line supercomputer designed entirely around AI, the company is putting a substantial amount of money into new AI technologies. Get inspired with our 4,140 innovation strategy articles, keynote, videos and innovation tools. Meta admits this early stage of the bots development means its creations are rather basic. However, the technology is hugely impressive, and that comes from a card carrying believer the Metaverse is a bad thing.