Feature
With Meta pivoting its investment toward generative AI, the future of the metaverse as Zuckerberg had been imagining it has been brought into question.
What the debate seemed to have missed, however, is these technologies aren't mutually exclusive. Augmented reality (AR), virtual reality (VR), mixed reality (MR) and now generative AI can, in fact, operate together so businesses can better create entirely new, interactive experiences.
Granted, the jury is still out on whether this blurring of lines between the physical and virtual worlds is a good or a bad thing. But for the purposes of the digital workplace specifically, organizations should be aware of the potential opportunities provided by the merging of these technologies to help them meet targets and achieve productivity gains.
Unlocking the Potential for the Digital Workplace
Rob Petrosino, head of emerging tech and innovation at IT consultancy PeakActivity, pointed to two major inflection points with AI and extended reality (XR, the umbrella term for anything AR, VR or MR): 3D world building and 3D object building. Both of these AI generative outputs are vital for any XR experience.
NVIDIA, for instance, has integrated OpenAI's ChatGPT into its system so NVIDIA OmniVerse users can type the 3D models they would like to occupy a space within a 3D environment. The output is made possible by using the company's sourced catalog of 3D model databases to fill a space.
Another example is Skybox. The company, Petrosino said, is using generative AI to create customized worlds based on text inputs. A user can generate a 360-degree world based on a text-based prompt entered directly into the tool.
“Generative AI, specifically large language models (LLMs), unlocks a wealth of opportunities for organizations to transition from developers leading the timing cycles to launch a solution, to non-technical users leading the charge,” he said. “LLMs allow non-technical users to communicate an idea in plain text to build an augmented or virtual reality experience."
When these two concepts are applied to the workforce, Petrosino said, we can expect to see a massive shift in training and experience expectations.
On the training side, he said, we will see users able to augment an experience to fit their needs. From an experience perspective, with a few spoken words, using OpenAI's Whisper API or Meta's new MMS, for instance, users will be able to change, review or augment the experience in areas they find lacking.
Related Article: How Copilot in SharePoint Could Extend Its Workplace Reach
AI Enabling New Experiences
Chelsea Donovan, senior manager of corporate digital experience at Genentech, said that AR and VR technologies are like two sides of a coin. AR overlays digital information onto our physical world, while VR creates fully immersive digital environments.
Mixed reality bridges the gap between the two to create a new hybrid experience.
Then, there's newcomer generative AI. Donovan said the arrival of the technology is “truly groundbreaking” because it creates interactive experiences that are so seamless, it's difficult to tell where the real world ends and the digital one begins.
It makes the possibilities for the digital workplace nearly endless, she said. Collaborating on projects, for instance, could be as simple as stepping into a shared virtual space, with AI generating the necessary tools or information when needed.
“It's safe to say that the fusion of generative AI with AR and VR is no longer just the stuff of sci-fi. It's here and revolutionizing how we work, play and interact with the world around us,” she said.
From a leadership perspective, it's also important to understand the impact these technologies will have on employee engagement and productivity, said Jonathan Westover, professor of organizational leadership and chair of the department at Utah Valley University.
With the ability to overlay digital information on top of the physical environment, employees can access real-time information and guidance to help make better decisions and work more efficiently.
However, he said, these technologies of course come with challenges. Some employees may feel overwhelmed or distracted by the constant flow of digital information. As a leader, it is important to find a balance between using them to enhance productivity and ensuring that employees are not overburdened by them.
When dealing with change management — especially a change of this magnitude — it is important to provide training and support for employees as they adapt. This may include providing resources to help employees develop the skills they need to use these technologies effectively and creating a culture of continuous learning and innovation.
Related Article: How Generative AI and Low-Code Can Work Together
Improving Collaboration and the Future of Work
Paul Tomlinson is creative scientist at software company Mural, where he focuses on designing and building collaborative intelligence such as using AI to assist with the high-touch process of facilitation, VR software onboarding and general navigation assistance within experiences. He said many of the examples where AI interfaces with VR have to do with the possibility of creating artwork and assets, or modifying the environment.
This is true in the sense that users are going to be able to speak entire worlds into being by doing little more than expressing the desire to do so. But where he sees the greatest value with the interfacing of the technologies is in creating a psychologically safe ally to aid in navigating, comprehending and acting within those forthcoming mixed realities.
Webinar
Sep
25
CMS Briefing: A Live Look at What’s Next in AI-Driven Platforms
Learn how leading organizations are using AI‑driven tools to publish faster, personalize smarter and stay secure.
Register
Webinar
On demand
Ready or Not: How Data-First Organizations Are Unlocking Agentforce Potential
Learn how to cut through the noise, activate Agentforce and build a Salesforce AI strategy that actually delivers.
Watch Now
Webinar
On demand
AI in Customer Service: Faster Resolutions, Happier Customers
Don’t let rising demand burn out your team. See how to build a smarter, more resilient support org.
Watch Now
Webinar
On demand
From Hype to High-Impact CX Strategies That Actually Scale
Turn buzzworthy AI and outsourcing trends into measurable CX wins with fresh 2025 data.
Watch Now
Webinar
On demand
Insights to Action Rethinking the Contact Center for Real Business Impact
Join our exclusive webinar to hear CX executives share their innovative strategies for transforming service delivery.
Watch Now
Webinar
On demand
Accelerating Healthcare Ops with AI
Sign up to see how your peers are putting AI to work — and making it stick.
Watch Now
“A personable, egoless, infinitely patient agent working on a user's behalf to make sense of a complex world, AI will act as the perfectly tailored custom interface,” he said.
Within MR and VR, AI has access to semantic understanding of the scene: where things are, how they relate to each other, what purposes or programs they provide along with other issues. Tomlinson said this will help close gaps by combining that understanding with user telemetry — the identity, location and interaction cues of an individual — to infer intent, respond to queries and receive instruction and delegation.
“Empowering users to understand, connect with and express their ideas in a more natural way — and thereby connect us with each other in a richer, more effective collaboration,” he said.