Simulations incorporating mixed reality have improved trainee certification rates

Mixed reality may help onboard manufacturing workers more efficiently

Mixed reality headsets can facilitate hands-on education by providing immersive guides overlaid onto their field of vision, showing users how to complete complex tasks.

The medical uses of VR

Virtual healthcare simulations are bridging the gap between traditional classroom learning and real clinical experience, improving the safety, effectiveness and efficiency of healthcare services.

Medical professionals have experimented with using mixed reality headsets

Devices like the Apple Vision Pro have helped doctors develop surgical plans for hip and knee replacements using software that provides 3D models and other tools. Virtual screens displayed by mixed reality devices can provide information related to surgical progress, a patient's vitals, and more.

Mixed reality technologies may help treat depression

A study led by a team from Stanford University showed that MR can help people with depression by providing pathways to engage in activities such as digital board games and dancing. Participants saw reduced symptoms of depression that made their overall treatment plans more successful.

What is mixed reality?

Mixed reality is a technology that blends the physical and digital worlds, allowing virtual and real objects to coexist and interact in real-time. It combines elements of both virtual reality and augmented reality, enabling users to perceive and manipulate digital content as if it were part of their physical environment.

Immersive technologies are increasingly being used in medicine, retail, and education

More accessible devices and user-friendly tools have increased the adoption of these technologies, which provide interactive, 3D environments that facilitate natural human learning. In 2018, Walmart purchased 17,000 VR headsets to train over a million employees in areas such as customer service and Black Friday preparation.

Integrating mixed reality has made art galleries and museums more interactive and accessible

The technology bridges the gap between history and modernity in such spaces by attracting new, younger audiences while preserving cultural heritage through risk-free immersion. Mixed reality experiences, such as visiting reconstructed historical scenes or seeing virtual twins of lost paintings, can be programmed with software features for visitors with disabilities.

Virtual and augmented realities are paving the way for a more immersive future

Tech companies like Apple, Meta, and Microsoft invest heavily in immersive technologies such as virtual, augmented, and mixed reality. While VR transports users to a fully digital space and AR adds digital elements to the real world, mixed reality allows interaction with both at once.

Meta's Quest and other mixed reality devices can make learning new skills easier

PianoVision utilizes the passthrough visibility of a headset to illuminate which keys to play on a real piano or keyboard, providing an immersive, software-based learning alternative to human instruction. Similar apps also offer virtual model replacements for physical devices, such as a virtual piano, to practice with.

An analysis on using VR to help train orthopedic surgeons

Virtual reality simulation provides surgical trainees with an immersive 3D experience that allows them to practice skills and operations in a safe yet realistic environment.

Sets incorporating immersive mixed reality have transformed weather reporting

The technology enables presenters to step into virtual environments that incorporate 3D models and real-time data, providing more engaging and interactive forecasting. They have also facilitated the development of educational segments where meteorologists use virtual models to explain complex weather phenomena.

Immersive technologies include virtual reality, augmented reality, and mixed reality

Virtual reality relies on technologies that use screens to generate every pixel, immersing a user in an entirely digital world. In contrast, augmented reality overlays digital content onto views of the real world. Mixed reality combines both to allow real-time interaction with virtual objects.

Mixed reality devices can turn digital information into 3D experiences

Described as "wearing a theme park on your face," devices like Microsoft's HoloLens project images into users' eyes so that their brains believe virtual objects are actually there. The bulkiness and physical limitations of existing headsets are expected to lessen over time, mimicking the evolution of early headphones.

A 1992 failed parachute test provided the hardware for the first mixed reality system

The Virtual Fixtures platform was developed to improve human dexterity by merging physical and virtual objects with haptic feedback from an upper-body exoskeleton. Tight budgeting and significant equipment needs nearly canceled the project, were it not for salvaging and repairing cameras and sensors from a smashed experimental parachute rig.

The potential of virtual reality in healthcare

Virtual reality (VR) is carving new frontiers in healthcare, from aiding in stroke recovery to training medical professionals. This article in Time Magazine highlights the innovative uses of VR in medical settings, including its potential and current limitations.

Limited battery life and increasing discomfort prevent extensive use of mixed reality headsets

Spending 24 hours wearing Apple's Vision Pro highlights some of the challenges facing MR technology, which are compounded by an increasing number of bugs when software is run in nonideal conditions. However, practical and entertainment benefits include placing multiple midair timers when cooking and experiencing immersive multimedia, such as astronomical flythroughs.

Virtual platform lets surgeons train remotely and in real time

Advancements in health tech are breaking barriers, as trainee surgeons can now virtually join live operations without stepping into the operating room. This 6-minute video from BBC takes a look at Proximi's cloud-based platform, which enables...

Just as large language models are trained on text to enable generative AI systems to mimic natural language, automated AI robotic systems are trained in virtual environments to help them 'learn' about the properties of reality.

Mixed reality devices and other wearables may usurp smartphones

The integration of smartphone features into watches, glasses, and even clothing suggests future technology may be geared toward working independently in the background. Mixed reality technologies are expected to facilitate this ambient computing world by seamlessly and proactively displaying real-time content without physical interactions solely in the real world.

Mixed reality technology helped make repairs to a quantum physics facility in space

In 2021, astronaut Megan McArthur used a HoloLens to work alongside Earth-based engineers and make hardware replacements to the International Space Station's Cold Atom Lab, the first quantum science facility in Earth orbit. The facility cools atoms to near absolute zero to perform quantum chemistry experiments in a microgravity environment.

After 25 people used virtual reality headsets to practice flying with virtual wings—flapping their arms—their visual cortex responded to the wings almost as if they were real arms, treating them as body parts.

Is using VR as a tool to enhance empathy ethical?

This research paper explores whether virtual reality should be used as a tool for improving our moral character — and, if not, what ethical alternatives could be.

Early testing of the US Army's mixed reality headsets made soldiers perform worse

Soldiers involved in testing the Integrated Visual Augmentation System reported headaches, nausea, limited peripheral vision, and concerns about security due to the display backlighting, which could be viewed from hundreds of meters away. The difficulties led the Department of Defense to transfer the program's contract from Microsoft to Anduril Industries.

Watch how a mixed reality app transforms a space into a haunted house

"Hauntify" incorporates a user's physical surroundings into the gameplay. Available via the Meta Quest app store, the software utilizes the mixed reality device's cameras and sensors to map a user's environment, from which evil spirits that must be repelled appear to emerge suddenly.

How the rise of surgical robots affects medical education

Today's medical students are training in tools their predecessors may have only dreamed of or found locked in the pages of science fiction novels. This article explores the rising popularity and use of surgical robots and how these robots are...

Digital twins create real-time 3D models of smart cities

These re-creations allow city planners to track changes and manage infrastructure more easily by testing strategies in virtual environments. Geospatial technologies, such as mobile mapping and satellite imaging, help cities assess urban layouts, plan for disasters, and manage resources more efficiently.

Wish you could experience life on the Western Front of WWI?

Virtual reality offers a new perspective on World War I in this nearly 14-minute video. National WWI Museum and Memorial Public Program Specialist James Taub demonstrates the War Remains VR experience side by side with what he sees through the headset. A grim and detailed simulation of trench warfare combined with Taub's observations and insights.

Could this pseudo-psychedelic VR experience decrease symptoms of depression?

Researchers report that virtual reality and psychedelics may be leave users with similar insights and therapeutic benefits. Try out this free psychedelic virtual reality experience to see if this holds true for you. According to the program’s creators, a study into the efficacy of this 45-minute experience indicates it may help alleviate symptoms of mild to moderate depression.

Some medical schools have phased out human cadavers for digital alternatives

AI-based anatomy tools and digital cadavers are increasingly used to teach students, bypassing the ethical and consent concerns around the use of real bodies. Digital cadavers have also become less expensive than real ones, though the tactile and sensory experiences of real dissection may be irreplaceable.

Engineer explains VR at five levels of complexity

While its possible to grab a virtual reality headset and hop into an immersive world with little effort, a significant amount of technical and biological science has gone into creating the effect of a 3D world. This video breaks down the technology in five layers of increasing complexity.

How AR could reshape construction

Wired's Grant Imahara visits Los Angeles, where he witnesses how augmented reality will be a key component of how builders will do their jobs in the future.

Watch the unveiling of Meta's Quest 3S mixed reality headset

Meta's social apps like Facebook and Instagram are the most high-profile part of its business, but the company has sought building out a hardware line of peripherals like the Quest headset, which combines virtual and augmented reality.

AI-generated avatars allow users to create deepfakes in real time

Synthetic media tools can map voices and faces to make individuals appear as someone else. Although they open the door to new opportunities in immersive education and entertainment, they also raise concerns about the misuse of personal identity.

Watch a first-person demo of Microsoft's HoloLens

The headset enables users to interact with projected objects in augmented reality by combining Windows Mixed Reality with eye- and head-tracking sensors, a hand-operated controller, and a microphone that can pick up voice commands.

Can brain scans help with processing trauma?

MRIs and brain monitoring therapies are becoming increasingly popular for those looking to process trauma and address mental health conditions, including PTSD and depression. This article details how these therapies quantify mental health, giving users another way to measure and manage their mental and emotional needs through brain mapping and other methods.

The security and privacy risks of augmented reality

One of the most serious perceived risks of augmented reality is the loss of privacy. Because AR technology can see what users are doing, user privacy is jeopardized. AR collects far more information about who users are and what they are doing than...

A fictional glimpse into the future of AR

Hyper-Reality is a project that presents a provocative and kaleidoscopic new vision of the future, where physical and virtual realities have merged, and the city is saturated in media. Watch this six-minute video to experience the vision.

Medical imaging allows 3D printers to create patient-matched devices

With imaging data on a person's anatomy, external prostheses and implants, such as cranial plates or hip joints, can be custom-printed to better match a patient's body. Fabrication of porous structures can promote bone growth, leading to longer-lasting implants.

Use this day trading simulator to practice buying and selling stocks while leveraging real-time data and trading charts

Want to try day trading but don't want to risk losing cash? This simulator gives users access to "unlimited" fake money, as well as the option to convert their simulation accounts to the real deal later on.

By 2022, Meta was betting strongly on a metaverse strategy for its products

Moving beyond the controversies over fueling misinformation, division, and harm worldwide, Mark Zuckerberg expressed optimism about technology's role in connecting people. Meta's multibillion-dollar investments in integrative AR and VR technologies have further evolved its founder's vision.

Why VR/AR gets farther away as it comes into focus

Thirteen years after XR devices became a big tech obsession, VR/AR devices are not just behind schedule, they still seem far away. This article provides an overview of the hardware realities getting in the way of the vision.

Explore persistent 3D environments with Marble

Marble is a spatial AI system built by World Labs, a San Francisco startup focusing on world models (rather than large language models). Using a text prompt (or a single image or video), users can generate a "world" and move through it, edit it, or export it. The company and project are part of the broader spatial intelligence area of AI, where AI can simulate environments.

Inside Australia's National Sea Simulator, scientists are cross-breeding coral species and using CRISPR to genetically engineer heat-resistant corals to withstand warming reefs worldwide.

The virtual reality era has finally arrived

The smartphone era has driven a large share of the consumer electronics market for almost 20 years now. But what comes next? Dominant computing platforms come and go over time, and there’s reason to believe that mixed reality devices like headsets and glasses might be the form factor that eventually replaces smartphones. This article presents a snapshot of where we are right now in the VR era, and what the future holds.

Neuralink brain implants have enabled a paralyzed person to play video games

As one of twelve test subjects in Neuralink's PRIME study, Rob Greiner's implant translates his brain's activity into digital commands for the 'Battlefield 6' game. He can now also design 3D models and 3D-print objects using his thoughts.

AI tools that generate images, audio, video, and 3D models rely on diffusion models, which begin with random data, such as visual noise, and gradually refine it into the requested media.

Mark Zuckerberg demos the Quest 3 VR headset

Meta, back when the company was still known as Facebook, once tried and failed to launch a smartphone. With the arrival of the mixed reality era, the company decided to make another hardware play again—and this time, it's having better luck. Meta's aggressively priced Quest headsets offer VR for the masses, and here CEO Mark Zuckerberg shows off the new mixed reality experiences and more available with the latest version, the Quest 3.

Nvidia’s RTX graphics chips support ray tracing, which, the company says, can boost performance in games by 25%

Ray tracing allows developers to add more realistic-looking lighting and shadows to video games, and Nvidia continues to improve the tech in newer chips. Rendering light realistically in video games requires immense computing power, and ray tracing “cheats” the process with a little guesswork.

Deepfake potential ranges from destabilizing democracies to improving accessibility

The technology can revolutionize education, medicine, and art through actions such as helping a disabled person express themselves. However, fictional audio and video can also jeopardize a person's reputation and life or quickly spread misinformation, even without content being flawless recreations.

Longer-duration space missions may amplify astronaut motion sickness

NASA is using the Kraken, a 50-foot-long, 100-ton US Navy research device, to simulate space motion sickness and vertigo and test possible recovery strategies, including testing out different, specific head movements. The Kraken, located at Wright-Patterson Air Force Base near Dayton, Ohio, can rotate participants at exposures of up to 3G.