Microsoft is bringing real-time video translation to its Edge browser to provide AI-generated dubbing and subtitling to users in a limited number of languages. The announcement was shared at last month's Build conference.
Microsoft hasn’t shared many details about the new feature, other than to say it will be available “soon.” In the list of announcements made at the conference, Microsoft stated: "Real-time video translation in Microsoft Edge, coming soon, will use AI to translate videos across multiple video websites into users’ language of choice in real-time through dubbing and/or subtitles."
The new capability will soon be available on LinkedIn and YouTube as well as news sites such as Reuters, CNBC News, Bloomberg, Coursera and more. When it is released, it will be able to translate from Spanish to English and from English to Spanish, German, Hindi, Italian and Russian. Other languages will be added down the line.
Where Video Fits in the Workplace
Real-time translation has always been high on the digital workplace wishlist, going back to the emergence of the first document management systems in the late 1990s. The lack of success in this area to date can be attributed largely to the vast amount of data required to drive such tools and applications, although many very powerful and effective online translation tools have emerged in the ensuing years.
Microsoft isn't alone in pursuing improved translation capabilities. OpenAI in its mid-May “spring update” also provided a live translation demo, in which the company’s CTO Mira Murati spoke to GPT-4o in Italian, which then provided a real-time summary in English. Google also demoed something similar at its I/O conference in 2022 but has largely fallen silent on the smart glasses front, although its Google Translate lives on.
With OpenAI now looking at an accessible, affordable real-time translator there is real hope that such a tool will emerge soon. It also puts pressure on Microsoft and while not the principal driver behind its decision to embed real-time video translation into the Edge browser, making it accessible to everyone in the workplace.
It's hard to overestimate the importance of video in today's workplace. Research by Wyzowl from late 2023 showed video is being used across the entire workplace for a range of tasks. While the top use case was in marketing at 39%, video is also used for:
- Explainer videos (38%).
- Presentation videos (34%).
- Social media videos (34%).
- Product demos (32%).
- Employee onboarding (25%).
- Training (22%).
- App demos (22%).
Related Article: The Future of Video in the Virtual Collaboration Market
Real-Time Translation Changes the Collaboration Game
The Edge browser integration could be a game changer, Chase Hughes, founder and CEO of ProAI, told us. "This can be a game-changer for video as a work tool," he said. "It is designed to globalize access to information thereby enabling communication with non-native speakers who may find it difficult to understand the content. In cross-border teams, language barriers pose significant limits to collaboration and productivity.”
He believes the biggest impact will be to the learning and development area. With real-time translation, employees will be able to consume instructional materials in their native language, which is critical for effective learning and retention. Hughes also believes it will promote inclusivity in global organizations, as all team members can participate equally in a video meeting or training session, regardless of their level of English.
He also sees big implications for technology and research. “We envisage a future where a digital workplace transcends language so that it becomes truly global," he added. "As a result, this technology not only enhances user involvement but also makes way for intercultural creativity as well as knowledge transfer.”
Related Article: Meta's SeamlessM4T Speaks to the Future of AI Translation in the Workplace
A First, Promising Step to Opening Up the Digital Workplace
The potential of in-browser real-time video transcription will help to open the digital workplace, Gary Warner, a marketing manager at global logistics automation company Joloda, told Reworked.
While it is being marketed as an accessibility feature, the big pull for global businesses is the ability for multilingual people to translate video content into their primary language, allowing them to focus on the content being delivered without the extra step of having to translate for themselves at the same time.
However he noted that the feature is still in the testing stage, with reports suggesting the user experience is a bit clunky and there are still bugs to be ironed out. There are also reports that the translation doesn't always work on the first attempt.
Warner acknowledges that while the translation will be limited to text only and only in a few languages, it still will open vast amounts of content where language would previously have been a barrier. Even more excitingly, the rumors are that real-time AI voice translation will be next on the horizon.
“Overall, it is looking promising and as it rolls out improvements will no doubt continue to be made,” Warner said.
Related Article: Global Intranets Aren't Just Big Versions of Normal Intranets
Efficiency Gains Across Operations
The real-time translation feature will enable remote and distributed teams and global organizations to engage with video-based information, training and communication more effectively, said SpanishVIP CEO Connor Ondriska. Employees who previously struggled to understand video content due to language barriers can now participate and contribute fully.
“By removing language barriers, the real-time translation feature can increase employee engagement with video content,” he said. "Employees will be able to actively participate and contribute to discussions, leading to greater knowledge retention, higher productivity, and a more engaged workforce.”
The elimination of the need for manual translation or subtitling of video content can result in significant cost savings for organizations too, Ondriska noted. The resources this frees up can then be allocated to other strategic initiatives, further enhancing the overall operational efficiency of the digital workplace.