Immersive Media

Immersive media refers to digital technology that creates or enhances an environment, either to simulate the physical world or to create something completely new. This type of media offers a more intense and interactive experience than traditional media and engages users on various sensory levels. 

In this video, UX Design Consultant Frank Spillers talks about the difference between immersive media and more traditional media like film.

Immersive Media vs. Traditional Media: What’s the Difference? 

Immersive media and traditional media differ in a variety of ways. For example, how it engages an audience and the kind of experiences it offers. Here are some key differences:

User Experience and Interaction

Traditional Media: This includes television, radio, newspapers, and standard non-interactive films and videos. The audience is typically a passive consumer of the content, with no control over the narrative or environment.

Immersive Media: Characterized by its interactive nature. Users can actively participate and influence the experience. For instance, in VR, users can explore a virtual world, interact with objects, and even alter the course of a narrative. AR adds digital elements to the real world, which allows users to perceive and interact with a blend of reality and digital enhancements.

Sensory Engagement

Traditional Media: Primarily engages with sight and sound. For example, watching a movie or listening to music involves these two senses, but doesn't typically extend beyond that.

Immersive Media: It engages multiple senses, often including sight, sound, and sometimes touch (through haptic feedback). The aim is to create a more lifelike experience and make the user feel as if they are part of the media environment.

Technology and Equipment

Traditional Media: Can be accessed through more common and less specialized devices like televisions, radios, or basic computers and smartphones.

Immersive Media: Requires specific technology such as VR headsets, AR glasses, or advanced computer systems to create and display the content.

Content and Narrative Structure

Traditional Media: Usually follows a linear narrative. Whether it's a book, a film, or a music album, the content is presented in a predetermined sequence with no user influence on its progression.

Immersive Media: Often nonlinear and allows users to choose their own paths or actions, which can lead to multiple outcomes. The narrative might change based on user interaction.

Purpose and Usage

Traditional Media: Primarily used for entertainment, information, and education, but in a more conventional and less interactive manner.

Immersive Media: Used not only for entertainment but also extensively for education, training (like simulations for medical or military training), and therapy (such as VR exposure therapy in psychology).

Ultimately, immersive media offers a more interactive, engaging, and multi-sensory experience compared to traditional media, which is generally more passive and limited in sensory engagement.

Different Types of Immersive Media

Immersive media is used in various fields, such as entertainment, education, training, marketing, and healthcare, offering unique, engaging experiences that can’t be afforded by traditional media. 

Virtual Reality (VR): With VR headsets or Head Mounted Displays (HMDs), VR creates a simulated environment that can be interactively explored. Users can feel as if they are in a completely different world, with 360-degree views and the ability to move around.

Augmented Reality (AR): This technology overlays digital information onto the real world. Through devices like smartphones or AR glasses, users can see digital images, information, or enhancements projected over what they see in the real world.

In this video, UX Design Consultant and Founder of Experience Dynamics, Frank Spillers, explores spatial cognition in AR.

Mixed Reality (MR): MR allows for the creation of environments where physical and digital objects co-exist and that users can interact with in real-time.

360-Degree Videos: These are videos that capture a scene in every direction. They allow users to look around in every direction, often through a VR headset, giving the feeling of being 'inside' the video. 

Google Arts and Culture has a collection of videos that allow viewers to explore art, architecture, sculpture, natural history and more in 360 degrees. In this video, step into the Orion Nebula. 

Interactive Media: This can include a range of media types that respond to user input, such as video games, interactive storytelling, or educational software. Platforms like Oculus Story Studio and the National Film Board of Canada have produced interactive documentaries where viewers can engage with the content in a non-linear fashion, often impacting the narrative based on their choices.

Extended Reality (XR) is an all-encompassing term that includes Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR), as well as 360-degree videos and interactive media. It represents the spectrum of media that modify our perception of reality, from fully immersive VR environments to AR's real-world digital enhancements and MR's combination of both.

How to Apply UX Design to Immersive Media

Immersive media is unlikely to be successful without effective UX design. It determines not only how users interact with these technologies, but also how they perceive and emotionally connect with them. A well-crafted user experience can transform a novel technology into an intuitive, engaging, and memorable experience. It bridges the gap between the digital and physical worlds, which makes these advanced technologies accessible and enjoyable for a diverse audience.

The following UX design considerations will help to ensure a good user experience and a successful immersive media design. 

Understand the Audience

Thorough user research is fundamental. This includes understanding the demographic, psychographic, and behavioral characteristics of a target audience. For instance, gamers might prioritize responsiveness and immersion, while educational users might value clarity and interactivity.

The Oculus Rift's development is a prime example of the benefits of user research in immersive media. The design of the Oculus Rift emphasized features like a lightweight build and intuitive head-tracking controls to gain an understanding and meet the specific needs and preferences of VR users. These user-centric features ensured comfort and ease of use, which made the VR experience both accessible and immersive. This approach demonstrates how effective user research can directly influence the success of a product by aligning its design with the actual needs and desires of its target audience.

Check out Oculus Rift’s Kickstarter campaign launch video to learn more about the device and its story. 

Natural and Intuitive Interaction

Interactions that mimic real-world behavior are intuitive and thus, the most user-friendly. The design could involve gesture-based controls or voice commands, which make the experience as natural as possible.

The Valve Index's hand-tracking technology is an outstanding example of natural and intuitive interaction in immersive media. It employs advanced sensors to accurately track the movements and positions of the user's hands and fingers, allowing for more realistic and precise control within the virtual environment. This technology significantly enhances the user experience in VR, as it closely mirrors real-world hand movements, making interactions feel more natural and intuitive. This alignment with natural human behavior is crucial in immersive media, as it reduces the learning curve for new users and increases the overall sense of presence and immersion in the virtual world. The Valve Index's approach exemplifies how leveraging natural human movements can greatly improve the usability and accessibility of immersive technologies.

Comfort and Ergonomics

Designers should address physical comfort and safety, particularly for devices worn for extended periods. This includes considerations of weight, balance, and adjustable fittings.

The ergonomic design of the PlayStation VR (PSVR) is centered on user comfort and adaptability, and features an adjustable headband and a balanced weight to accommodate various head sizes. In its second iteration, PSVR 2, Sony further enhanced comfort with a lens adjustment feature and a slimmer design, despite adding new elements like an in-built motor for feedback. Additionally, a unique vent design was incorporated to prevent lens fog to ensure comfort during extended use. These design choices reflect Sony's focus on ergonomic improvement, aiming to provide a comfortable and immersive VR experience.

Multisensory Engagement and Realism

Immersive media should utilize visual, auditory, and tactile stimuli to enhance realism. This can range from high-quality graphics to haptic feedback that mimics real-world sensations.

The VOID is a pioneering venture in immersive media—it offers multisensory VR experiences that go beyond sight and sound to include touch and even smell. The VOID blends virtual and physical elements to create hyper-realistic experiences by creating physical environments that users can interact with while wearing VR headsets. This integration enhances the overall sense of presence and immersion that makes users feel as if they are truly part of the virtual world. Elements like heat, cold, and scents are synchronized with the visual and audio components of the experience to deepen the level of engagement. This approach to immersive media demonstrates how multisensory stimulation can significantly enrich VR experiences to make them more compelling and realistic.

This video demonstrates The VOID’s potential.

Accessibility and Inclusivity

Designers must ensure that immersive experiences cater to a broad range of abilities. This involves adaptable control schemes and content that is accessible to users with various disabilities.

The Xbox Adaptive Controller by Microsoft is a groundbreaking example of accessibility and inclusion in the gaming and immersive media industry. Specifically designed to meet the needs of gamers with limited mobility, the controller features a highly customizable interface with large programmable buttons and connects to a range of external devices like switches, buttons, mounts, and joysticks. This flexibility allows it to be adapted to a wide variety of physical needs to ensure that more people can enjoy gaming regardless of their mobility or dexterity. Xbox collaborated with organizations like The AbleGamers Charity, SpecialEffect, and Warfighter Engaged for the development of the Xbox Adaptive Controller. This highlights Microsoft's commitment to making gaming and immersive experiences more inclusive. The Xbox Adaptive Controller is a significant step forward in ensuring that everyone, regardless of physical ability, can participate in the immersive world of gaming.

Learn more about the Xbox Adaptive Controller in this video.

Emotional Connection Through Narrative

Use storytelling to create a deeper emotional connection. This can be achieved through immersive narratives that allow users to be part of the story.

Dear Angelica by Oculus Story Studio is a poignant example of how storytelling in immersive media can forge deep emotional connections. This VR experience combines hand-drawn artistry with immersive 3D technology and allows users to step into a visually stunning narrative world. The story, told from a daughter's perspective about her relationship with her actress mother, utilizes the immersive nature of VR to envelop the viewer in a personal, emotionally resonant journey. This blend of innovative VR technology with a heartfelt narrative exemplifies the power of immersive media to create deeply affecting storytelling experiences, and ultimately demonstrates VR's unique ability to connect with users on an emotional level.

Watch the trailer for Dear Angelica in the next video.

Spatial Awareness in AR and MR

In XR, it’s essential to understand the physical environment and integrate with it. This includes using spatial data to overlay digital information accurately onto the real world.

Pokémon GO's use of AR technology exemplifies spatial awareness in immersive media. By overlaying virtual Pokémon characters onto real-world environments through players' smartphone cameras, the game creates an engaging mixed reality experience. It uses GPS to map virtual elements in real locations, which encourages players to explore their physical surroundings to find Pokémon. This integration of digital and physical worlds is a key aspect of spatial awareness in AR and makes the game a leading example of how AR can blend virtual experiences seamlessly with the real world.

Technical and Performance Considerations

Designers should stay up-to-date with technological advancements, such as increasing network speeds or processing capabilities, to enhance the smoothness and responsiveness of the experience.

The advent of 5G technology is set to significantly impact AR and VR technologies, particularly in terms of technical performance and user experience. 5G's higher bandwidth and lower latency enable more data to be transmitted at faster speeds, which reduces the lag that can disrupt immersive experiences. This improvement in speed and responsiveness is crucial for AR and VR applications, which require real-time processing of complex visual and sensory data to maintain immersion. Additionally, 5G facilitates more sophisticated AR and VR experiences, and supports higher-resolution graphics and more complex interactive environments..

Safety and Ethical Practices

Both physical safety and ethical implications are crucial for immersive media. Designers must consider user privacy, the psychological impact of immersive environments and other factors.

Ubisoft's VR escape games demonstrate effective safety and ethical practices in immersive media by ensuring a secure and comfortable environment for players. Escape games are created and optimized for venues like VR arcades and escape rooms. They employ physical space mapping to match the virtual environment, which minimizes the risk of collisions or accidents. This is crucial in VR where users are visually cut off from the real world. The design of these rooms typically includes safeguards like ample space for movement, clear instructions for safe navigation, and mechanisms to prevent users from inadvertently leaving the designated safe area. Such measures are essential to maintain physical safety while providing an engaging and immersive virtual experience.

Iterative Design and User Feedback

Immersive media requires an iterative design process to incorporate user feedback and to refine and improve the experience continually. 

Beat Saber is a popular VR rhythm game and a prime example of how iterative design and user feedback can shape the development of immersive media. Initially released with a set of core features, the game has continually evolved based on community input. Players have been instrumental in highlighting aspects they enjoy, as well as identifying areas for improvement. This feedback has led to numerous updates, including new songs, enhanced gameplay mechanics, and user interface improvements. The developers have also embraced the modding community to integrate popular modifications to enrich the game's content and user experience. This iterative process, driven by active community engagement, ensures that Beat Saber remains fresh, relevant, and aligned with its users' preferences. This example showcases the dynamic and evolving nature of game development in the realm of immersive media.

If designers integrate these elements, they can create immersive media experiences that are not only technologically advanced but also deeply resonant with users. The focus on user-centric design, coupled with a commitment to innovation and inclusivity, is what elevates immersive media from a niche technology to a widely accessible and transformative medium.

Learn More about Immersive Media

Go deeper into immersive media and how to design user-friendly experiences in our courses,  UX Design for Augmented Reality and UX Design for Virtual Reality. 

Read XR Today’s article, What is Immersive Media: An Introduction.

Check out some more immersive media examples in this LinkedIn article, What is immersive media? | 6 Examples from different industries.

Discover the impact of immersive media in this World Economic Forum report, Immersive Media Technologies: The Acceleration of Augmented and Virtual Reality in the Wake of COVID-19.