Watch how a mixed reality app transforms a space into a haunted house

Watch the unveiling of Meta's Quest 3S mixed reality headset

Meta's social apps like Facebook and Instagram are the most high-profile part of its business, but the company has sought building out a hardware line of peripherals like the Quest headset, which combines virtual and augmented reality.

Mixed reality devices can turn digital information into 3D experiences

Described as "wearing a theme park on your face," devices like Microsoft's HoloLens project images into users' eyes so that their brains believe virtual objects are actually there. The bulkiness and physical limitations of existing headsets are expected to lessen over time, mimicking the evolution of early headphones.

Meta's Quest and other mixed reality devices can make learning new skills easier

PianoVision utilizes the passthrough visibility of a headset to illuminate which keys to play on a real piano or keyboard, providing an immersive, software-based learning alternative to human instruction. Similar apps also offer virtual model replacements for physical devices, such as a virtual piano, to practice with.

Virtual and augmented realities are paving the way for a more immersive future

Tech companies like Apple, Meta, and Microsoft invest heavily in immersive technologies such as virtual, augmented, and mixed reality. While VR transports users to a fully digital space and AR adds digital elements to the real world, mixed reality allows interaction with both at once.

Mark Zuckerberg demos the Quest 3 VR headset

Meta, back when the company was still known as Facebook, once tried and failed to launch a smartphone. With the arrival of the mixed reality era, the company decided to make another hardware play again—and this time, it's having better luck. Meta's aggressively priced Quest headsets offer VR for the masses, and here CEO Mark Zuckerberg shows off the new mixed reality experiences and more available with the latest version, the Quest 3.

A fictional glimpse into the future of AR

Hyper-Reality is a project that presents a provocative and kaleidoscopic new vision of the future, where physical and virtual realities have merged, and the city is saturated in media. Watch this six-minute video to experience the vision.

What is mixed reality?

Mixed reality is a technology that blends the physical and digital worlds, allowing virtual and real objects to coexist and interact in real-time. It combines elements of both virtual reality and augmented reality, enabling users to perceive and manipulate digital content as if it were part of their physical environment.

Watch a first-person demo of Microsoft's HoloLens

The headset enables users to interact with projected objects in augmented reality by combining Windows Mixed Reality with eye- and head-tracking sensors, a hand-operated controller, and a microphone that can pick up voice commands.

Integrating mixed reality has made art galleries and museums more interactive and accessible

The technology bridges the gap between history and modernity in such spaces by attracting new, younger audiences while preserving cultural heritage through risk-free immersion. Mixed reality experiences, such as visiting reconstructed historical scenes or seeing virtual twins of lost paintings, can be programmed with software features for visitors with disabilities.

Immersive technologies include virtual reality, augmented reality, and mixed reality

Virtual reality relies on technologies that use screens to generate every pixel, immersing a user in an entirely digital world. In contrast, augmented reality overlays digital content onto views of the real world. Mixed reality combines both to allow real-time interaction with virtual objects.

Mixed reality may help onboard manufacturing workers more efficiently

Mixed reality headsets can facilitate hands-on education by providing immersive guides overlaid onto their field of vision, showing users how to complete complex tasks.

Mixed reality devices and other wearables may usurp smartphones

The integration of smartphone features into watches, glasses, and even clothing suggests future technology may be geared toward working independently in the background. Mixed reality technologies are expected to facilitate this ambient computing world by seamlessly and proactively displaying real-time content without physical interactions solely in the real world.

Sets incorporating immersive mixed reality have transformed weather reporting

The technology enables presenters to step into virtual environments that incorporate 3D models and real-time data, providing more engaging and interactive forecasting. They have also facilitated the development of educational segments where meteorologists use virtual models to explain complex weather phenomena.

Medical professionals have experimented with using mixed reality headsets

Devices like the Apple Vision Pro have helped doctors develop surgical plans for hip and knee replacements using software that provides 3D models and other tools. Virtual screens displayed by mixed reality devices can provide information related to surgical progress, a patient's vitals, and more.

A 1992 failed parachute test provided the hardware for the first mixed reality system

The Virtual Fixtures platform was developed to improve human dexterity by merging physical and virtual objects with haptic feedback from an upper-body exoskeleton. Tight budgeting and significant equipment needs nearly canceled the project, were it not for salvaging and repairing cameras and sensors from a smashed experimental parachute rig.

Limited battery life and increasing discomfort prevent extensive use of mixed reality headsets

Spending 24 hours wearing Apple's Vision Pro highlights some of the challenges facing MR technology, which are compounded by an increasing number of bugs when software is run in nonideal conditions. However, practical and entertainment benefits include placing multiple midair timers when cooking and experiencing immersive multimedia, such as astronomical flythroughs.

Mixed reality technology helped make repairs to a quantum physics facility in space

In 2021, astronaut Megan McArthur used a HoloLens to work alongside Earth-based engineers and make hardware replacements to the International Space Station's Cold Atom Lab, the first quantum science facility in Earth orbit. The facility cools atoms to near absolute zero to perform quantum chemistry experiments in a microgravity environment.

Immersive technologies are increasingly being used in medicine, retail, and education

More accessible devices and user-friendly tools have increased the adoption of these technologies, which provide interactive, 3D environments that facilitate natural human learning. In 2018, Walmart purchased 17,000 VR headsets to train over a million employees in areas such as customer service and Black Friday preparation.

The perception of haunted places is influenced by psychology, setting and suggestion

Gothic architecture and tragic histories contribute to the perception of hauntings. Infrasound and black mold can cause experiences reminiscent of paranormal phenomena. Although paranormal investigators use technology to seek natural explanations, many paranormal experiences remain non-falsifiable.

Mixed reality technologies may help treat depression

A study led by a team from Stanford University showed that MR can help people with depression by providing pathways to engage in activities such as digital board games and dancing. Participants saw reduced symptoms of depression that made their overall treatment plans more successful.

The virtual reality era has finally arrived

The smartphone era has driven a large share of the consumer electronics market for almost 20 years now. But what comes next? Dominant computing platforms come and go over time, and there’s reason to believe that mixed reality devices like headsets and glasses might be the form factor that eventually replaces smartphones. This article presents a snapshot of where we are right now in the VR era, and what the future holds.

Playing around with an AR sandbox

The white sand acts as a projector screen and a topographic map image is projected on the surface. An XBOX Kinect is positioned to read the contours of the sand and draw new topographic lines according to how the sand is moved.

Watch a review of Meta's Ray-Ban smart glasses

Combining smartphone features with a luxury eyeglass brand, Meta's peripheral provides discreet recording, audio, and AI-powered functions. They represent an ongoing effort by the company to develop hardware for the augmented and mixed reality market.

Simulations incorporating mixed reality have improved trainee certification rates

Such software provides immersive, risk-free environments where students can manipulate digital re-creations to optimize the training experience without producing waste. One meta-analysis showed that MR in welding training boosted passing rates on certification exams by 41.6% versus traditional training methods.

What does the metaverse actually look like?

An emerging virtual world could change how we work, play, and do business. This five-minute video shows you what it looks like and the potential it holds.

The security and privacy risks of augmented reality

One of the most serious perceived risks of augmented reality is the loss of privacy. Because AR technology can see what users are doing, user privacy is jeopardized. AR collects far more information about who users are and what they are doing than...

A virtual reality experience of Machu Picchu

If you can’t make it to the Andes, this virtual-reality experience—created using 360-degree cameras, and 3D modeling and sound design—is the next best thing. It lets you explore all the site’s major landmarks, including the Sun Temple and the Temple of the Condor, while listening to the sound of the wind whipping through the ruins, birdsong, and audio commentaries from expert guides.

Turning 2D illustrations into 3D models with AR

Coloring books capture the imagination of children and provide them with one of their earliest opportunities for creative expression. This two-minute video shows an augmented reality coloring book app in which children color characters in a printed coloring book, their drawing is detected and tracked, and the video stream is augmented with an animated 3-D version of the character that is textured according to the child's coloring.

Explore persistent 3D environments with Marble

Marble is a spatial AI system built by World Labs, a San Francisco startup focusing on world models (rather than large language models). Using a text prompt (or a single image or video), users can generate a "world" and move through it, edit it, or export it. The company and project are part of the broader spatial intelligence area of AI, where AI can simulate environments.

Engineer explains VR at five levels of complexity

While its possible to grab a virtual reality headset and hop into an immersive world with little effort, a significant amount of technical and biological science has gone into creating the effect of a 3D world. This video breaks down the technology in five layers of increasing complexity.

Pepsi uses augmented reality to prank people at a bus shelter

Commuters at a London bus stop have seen alien invasions, monsters from the sewers grabbing pedestrians and tigers running down the street as part of an elaborate advertising campaign.

Is using VR as a tool to enhance empathy ethical?

This research paper explores whether virtual reality should be used as a tool for improving our moral character — and, if not, what ethical alternatives could be.

The medical uses of VR

Virtual healthcare simulations are bridging the gap between traditional classroom learning and real clinical experience, improving the safety, effectiveness and efficiency of healthcare services.

How Google's Tilt Brush brings artists' creations to life

Google has been working closely with more than 60 artists to help them explore their style in virtual reality as part of the Tilt Brush Artist in Residence program.

A guide to what you need to get started in VR

From Oculus Rift to Google Daydream, VR is getting plenty of hype. But what system should you buy? And what should you play?

Could this pseudo-psychedelic VR experience decrease symptoms of depression?

Researchers report that virtual reality and psychedelics may be leave users with similar insights and therapeutic benefits. Try out this free psychedelic virtual reality experience to see if this holds true for you. According to the program’s creators, a study into the efficacy of this 45-minute experience indicates it may help alleviate symptoms of mild to moderate depression.

A virtual art gallery in the mode of 'Doom'

One of the earliest video games to use 3D interfaces, 1993's "Doom" was a first-person shooter set on the moons of Mars which ended in hell. It became one of the most critically and commercially successful games of all time. Now, you can wander virtually in an art gallery in the mode of the game, sipping wine and perusing pixelated versions of classic works of art.

An AI-built pixel map reimagines New York City as a video game

Isometric NYC is a zoomable pixel-art map that renders the city in game-style perspective (think SimCity), helpfully clarifying the dense geography and architecture. The makers built the project tile-by-tile using satellite data and generative AI. Zoom into building-level views or out to see all five boroughs.

Nvidia Omniverse can be used to accelerate 3D workflows and explore creative ideas

This video explores different apps available within Nvidia Omniverse that artists can use to create cinematic, virtual worlds. Some of the tools are AI-powered, like a feature that converts spoken audio into a video of a character speaking.

America's most haunted restaurants

If you're seeking a ghost encounter to go with your meal, consult this list from Infatuation that presents some of the most haunted restaurants and bars in the US. Depending on your mood, make a visit to a casual sports bar, fine dining establishment, or eerie mansion, and potentially witness a spirit. Some might mess with the electricity, some might prank you, and some may simply wander around as you enjoy bites and sips.

Why VR/AR gets farther away as it comes into focus

Thirteen years after XR devices became a big tech obsession, VR/AR devices are not just behind schedule, they still seem far away. This article provides an overview of the hardware realities getting in the way of the vision.

Experience the Apollo 11 mission in VR

Take one small step today and experience the historic moon-landing through VR. This video showcases how VR is allowing the public to travel through space through the eyes of those who lived through it.

How AR could reshape construction

Wired's Grant Imahara visits Los Angeles, where he witnesses how augmented reality will be a key component of how builders will do their jobs in the future.

A deep dive on everything you need to know about virtual reality

In the wake of Facebook’s purchase of Oculus VR, can the revolutionary technology triumph anew? These interactive articles chart the rise and fall — and rise again — of VR.

A fascinating look at how a journalist spends 24 hours in the metaverse

A Wall Street Journal strapped on a VR headset for a full day. Here's what happened when she went to work meetings, hung out with new avatar friends and attended shows — all in the metaverse.

Wish you could experience life on the Western Front of WWI?

Virtual reality offers a new perspective on World War I in this nearly 14-minute video. National WWI Museum and Memorial Public Program Specialist James Taub demonstrates the War Remains VR experience side by side with what he sees through the headset. A grim and detailed simulation of trench warfare combined with Taub's observations and insights.

The science of fear

The Hidden Brain podcast team explores the science of fear by traveling to a haunted house curated by a scientist to investigate what scares us, and why some people enjoy this sensation more than others.

Explore the metaverse with this mind map

The metaverse is a complex concept that involves interlocking and rapidly evolving parts, including Web3, augmented reality, and trademark law. It's easy to get overwhelmed when faced with the new legal, financial, ethical, and creative intersections of our reality and its virtual echo. This mind map details the metaverse and its implications for various fields that interact and overlap. Click through the map to read and listen to topic summaries or explore more in-depth resources.

Horror video games rely on terrifying sound design

Horror has become a popular gaming genre, which designers say is due, in large part, to the games' soundtracks. Don Veca, the audio director for the game Dead Space, said, “Sound and music prepare the player to be scared – it’s all about the buildup, the tension, and then the release when something jumps out at you.”

See this first-person virtual reality view of vertigo

This video shows a virtual reality environment view of what benign paroxysmal positional vertigo will look like, from a first-person view. It includes a virtual rendering of eye spinning associated with the condition. (Warning: Watching this may make some users feel a bit nauseous.)