Meta rolls out AI-powered translations to creators globally, starting with English and Spanish

Meta has announced the global rollout of an innovative AI-powered voice translation feature for users on Facebook and Instagram. This new functionality aims to empower creators by translating their content into various languages, thus broadening their audience reach. Initially unveiled at Meta's Connect developer conference, the feature enables automatic translation of creators’ voices in reels across both platforms. Utilizing advanced technology, the AI translations replicate the sound and tone of the creator's original voice, ensuring that the dubbed audio remains authentic in the new language. Additionally, a lip sync option is available, allowing creators to match their translations with their lip movements, enhancing the natural feel of the content. Currently, the translation feature supports English and Spanish, with plans to expand to additional languages in the future. It's accessible to Facebook creators who have at least 1,000 followers and to all public Instagram accounts globally. To use the feature, creators simply select the "Translate your voice with Meta AI" option before publishing their reels. They can choose to enable translations and lip syncing, which will then be applied automatically once they share their content. Before making their reels public, creators can preview the translations and lip syncs, with the flexibility to toggle either option off at any point—a choice that does not affect the original reel. Viewers of the translated reels will see a notification indicating that Meta AI facilitated the translation. For those who prefer not to view translated reels in certain languages, an option to disable this feature is available in the settings. Moreover, creators will now have access to enhanced analytics in their Insights panel, allowing them to track viewership by language. This will be particularly useful as more languages are incorporated into the translation tool. Meta encourages creators to record content with clear audio, minimal background noise, and to face the camera directly to optimize the translation quality. The feature supports translations for up to two speakers, provided they do not speak over each other. In an effort to further engage diverse audiences, Facebook creators can upload up to 20 of their own dubbed audio tracks to a reel, expanding their outreach beyond English and Spanish-speaking viewers. This functionality is found in the "Closed captions and translations" section of the Meta Business Suite, allowing for added translations both pre- and post-publication. The addition of this AI feature comes amidst Meta's ongoing restructuring of its AI division to concentrate on pivotal areas such as research and product development. Instagram head Adam Mosseri emphasized the importance of breaking down language barriers, stating that enhancing communication across cultures can significantly help creators grow their audiences and increase their value on the platform.