The multimodal additions are powered by Meta’s Llama AI models and intended to make Meta AI and its other AI products “more fun, useful and capable,” according to Meta this week.
Meta reports that over 400 million people are using Meta AI monthly, with 185 million people using it across its products each week.
The company also says it is seeing “strong adoption” of its business generative AI ad tools, with more than one million advertisers using the tools and 15 million ads created with them in the last month. On average, Meta reports that ad campaigns using its GenAI ad features resulted in an 11% higher click-through rate and 7.6% higher conversion rate compared to campaigns that didn’t use the features.
AI for Companies
Meta is expanding its business AI to thousands of companies using click-to-message ads on WhatsApp and Messenger in English to set up AI that can talk to their customers, offer support and facilitate commerce.
The business AI is designed to help companies engage with more customers and increase sales, from answering common customer questions to discussing products and finalizing a purchase.
AI-Generated Content in Feeds
Meta says it is testing Meta AI-generated content in Facebook and Instagram feeds based on user interests or trends. Users can tap a suggested prompt to “take the content in a new direction” or swipe to imagine new content in real-time.
AI Voice
Users can talk to Meta AI on Messenger, Facebook, WhatsApp and Instagram DM, and the AI will speak back.
As the feature rolls out, users can choose from different voices for their assistant, including the AI voices of Awkwafina, Dame Judi Dench, John Cena, Keegan Michael Key and Kristen Bell.
Photo Questions and Editing With AI
Users can share photos in their chats with Meta AI, and the AI can understand what it’s looking at and answer questions about it.
To edit photos, users can send an image in a chat with Meta AI and tell the AI what they want added, removed or changed in the photo, such as changing the outfit and replacing the background.
If users want to re-share a photo from their feed as an Instagram Story, Meta AI’s backgrounds feature can look at the photo, understand what’s in the image and generate a background for the story.
AI Translation for Creators
Meta says it is testing a Meta AI translation tool that will automatically translate the audio of Reels by creators to reach more audiences. Using automatic dubbing and lip syncing, Meta AI will simulate the speaker’s voice in another language and sync their lips to match.
The company is starting with “small tests” on Instagram and Facebook, translating some creator videos from the U.S. and Latin America in English and Spanish. It plans to expand the tool to more creators and languages.
AI Imagine
With expanded Meta AI Imagine features, users can imagine themself as a superhero, for example, or “anything else” in their feed, Stories and Facebook profile picture, and Meta AI can also suggest captions for their Stories.
Customizing Chat
With AI, users can further personalize their chat themes in Messenger and Instagram DMs.