Meta Connect 2024: Why You Should Pay Attention to Meta AI Now

As someone who’s been working with AI since August 2021, I haven’t been very impressed with Meta AI so far. However, at this year’s Meta Connect Mark Zuckerberg flexed his Meta AI muscles and it got my attention! He shared some cool new innovations in AI, mixed reality, and the Metaverse. In this article, I’ll give you a quick rundown of what caught my attention. Meta, which many of us have always seen as a social media company, has proven that it’s a serious tech innovator. If you haven’t been paying attention to Meta, now’s the time to start.

Here are some key announcements that got me excited about what’s coming, but I recommend you watch the replay of Meta Connect Demand.

The New Oculus 3s Headset and NPC Avatars

Meta’s latest Oculus 3s headset made a splash with its low price of $299 (affiliate link), making mixed reality more accessible than ever. The passthrough as shown on their live demo was pretty impressive. You can watch movies, play games, and work remotely with team members around the world using Horizon Workrooms, connect with friends on social apps like Horizon Worlds, all while using the multiscreen feature. The price is two hundred dollars cheaper than the Oculus 3. It’s an even BIGGER savings when compared to Apple Vision ($3200 SAVINGS!).

Besides the hardware, what really grabbed my attention was the future potential of the AI Ecosystem in mixed reality. Meta AI is already available for testing, but two years ago I asked someone from Meta how far were we from being able to ask AI to create something for us using only our voice. During Connect, they showed an example of someone asking Meta AI to make a generator in their virtual space, and it did it within seconds. They also gave us a sneak peek of AI-powered NPC avatars (Non-Player Characters) in Horizon Worlds, their VR social platform.

Picture this: NPCs that can interact with visitors, answer questions, and guide folks through virtual spaces like your virtual office, store, or, in our case, our virtual studio.

At Killer Bee Studios, we host live virtual events, and we’re planning to integrate NPC avatars to assist visitors between shows. These avatars could give tours of the studio, share information, and direct people to our website if they have further questions. I would also love it if these NPCs could alert us when they can’t answer a visitor’s question. I am excited to see how this feature will be used once it’s available.

Oh, and I can’t forget to mention- Meta is also dropping new avatars for Horizon Worlds on October 1st, taking personalization in VR to the next level.

Meta AI: The Next Level

Meta AI isn’t just catching up- it’s taking off like a rocket ship! Zuck started off by introducing Natural Voice technology that makes interactions with AI feel more fluid and human. Instead of typing out commands, Natural Voice lets you chat straight with AI, making conversations and interactions feel more natural. This voice interaction simplifies everything from asking questions to generating content, giving users a more seamless and engaging experience. Meta AI is also expanding its image creation capabilities. With Llama 3.2 multimodal, Meta AI can recognize images. You can use imagine edit to add things to the photo you upload. Here’s an image of my son. I uploaded the original, asked Meta AI to put him in a brown leather jacket and change his fedora to white, then change his jeans to black.

But it doesn’t stop there. What really got my attention was what Don Allen Stevenson III created using AI Studio. He created his own AI assistant. Imagine tapping into AI to communicate in your voice and even generate content that fits your brand, whether it’s sending DMs, responding to questions, creating captions, or handling threads, your AI can be customized to speak and create just like you would. I highly recommend you check this out! (see video below)

Meta AI Translation: Mind-Blowing Possibilities

Another exciting announcement was Meta AI Translation. Meta is incorporating translation for Reels. And the coolest part? It can adjust your lip syncing to match the language you’re speaking. So, it’s not just translating what you say, it’ll actually look like you’re speaking the language. This is big news for global content creators, as it opens doors to new audiences with content that feels more genuine.

Meta Ray-Bans: Smarter Glasses with Meta AI Features

Meta’s Ray-Ban smart glasses are getting some cool upgrades with more Meta AI features. They’re not just for snapping pics or recording moments anymore. Now, they can read text, scan QR codes, and more. You can even have real-time translated chats with someone else wearing Meta Ray-Bans. You can also use Meta AI on the Ray-Bans to help you identify objects, read signs, and even remind yourself of important tasks, such as where you parked or what you need to pick up at the store- it’s a smooth blend of AI into daily life.

Orion Glasses: A Glimpse of the Future

And finally, Meta unveiled what could be the most futuristic product of all: Orion Glasses. Zuckerberg revealed that Meta has been working on this technology for over a decade, and now it’s closer to reality. These glasses aren’t just about augmented reality—they incorporate holograms and a neural interface. With a simple gesture, (tapping your index finger and thumb together) you can control the glasses. It’s like stepping into a world where teleportation and time travel feel just around the corner.

Meta currently has a working developer version, and while it’s not quite ready for consumers, Zuckerberg promised they’re working to get the size down and the price more accessible. These glasses represent a glimpse into the future, and I’m excited to see how they evolve.

Final Thoughts: Meta AI Is a Force to Be Reckoned With

Meta is clearly stepping up as a major player in the AI arena. With innovative tools like NPC avatars, AI Studio, and the revolutionary Ray-Ban smart glasses, Meta AI is transforming into a versatile, forward-thinking platform that’s capturing the spotlight. Businesses and creators should definitely keep an eye on this exciting evolution!

If you missed Meta Connect, I recommend catching the replay to check out these amazing innovations yourself. The future of AI and mixed reality is unfolding now, with Meta leading the way. Keep an eye on how these advancements can transform your creative and business projects.