Meta’s AI translation remakes Reels in your language

11 hours ago 5

(Image credit: Meta AI)

Meta AI now translates, dubs, and lip-syncs Reels in English, Spanish, Hindi, and Portuguese
The new tool lets creators reach new audiences without localization tools
Viewers have control over language settings, with labels for translated Reels

Meta just made Reels speak your language, even if they started in a different one. The company has deployed Meta AI to translate, dub, and lip-sync Reels across Facebook and Instagram in English, Spanish, Hindi, and Portuguese.

So you might watch a cooking guide filmed in Brazil sound like it was recorded in your own kitchen, or an English translation of the lyrics playing during a dance video shot in Delhi. Meta AI can mimic a creator's tone, cadence, and voice in another language, with optional lip-sync to add a layer of realism that even high-budget content used to struggle with.

You might not be able to do the same with your own videos unless you've gone mildly viral yourself. The translation tools are free for creators on Facebook with at least 1,000 followers and for all public Instagram accounts in countries where Meta AI is available. Meta says the idea is to make short-form content more accessible and enjoyable across cultures.

International Reels

And while the Reels translated by Meta AI are clearly labeled, so you won’t mistake a dubbed voice for the original, viewers can also toggle translations off, opt out of lip sync, or stick with the video’s original language if they prefer.

This isn’t the first time Meta has tried to cross language borders. Auto-captions, subtitled Stories, and global hashtag campaigns have been around for years. But this is the first time the company is leaning into AI for voice cloning and lip-movement matching.

This also gives Meta an edge as the world of AI-created and AI-assisted videos explodes. YouTube has long offered captions and subtitles, but real-time voice dubbing with lip sync isn’t yet widely available there. TikTok has experimented with translation overlays but not with full voice cloning or lip-syncing. If Meta can pull this off smoothly across more languages, it could be the go-to for international content.

So if it seems like you're getting a lot of Latin American and Indian creators speaking fluent English popping up on your Reels, it might be because of some AI translation help. You'll have to look for the“Translated with Meta AI” label in the corner, to be sure.

Eric Hal Schwartz is a freelance writer for TechRadar with more than 15 years of experience covering the intersection of the world and technology. For the last five years, he served as head writer for Voicebot.ai and was on the leading edge of reporting on generative AI and large language models. He's since become an expert on the products of generative AI models, such as OpenAI’s ChatGPT, Anthropic’s Claude, Google Gemini, and every other synthetic media tool. His experience runs the gamut of media, including print, digital, broadcast, and live events. Now, he's continuing to tell the stories people want and need to hear about the rapidly evolving AI space and its impact on their lives. Eric is based in New York City.

Read Entire Article