Sets incorporating immersive mixed reality have transformed weather reporting

Immersive technologies include virtual reality, augmented reality, and mixed reality

Virtual reality relies on technologies that use screens to generate every pixel, immersing a user in an entirely digital world. In contrast, augmented reality overlays digital content onto views of the real world. Mixed reality combines both to allow real-time interaction with virtual objects.

Virtual and augmented realities are paving the way for a more immersive future

Tech companies like Apple, Meta, and Microsoft invest heavily in immersive technologies such as virtual, augmented, and mixed reality. While VR transports users to a fully digital space and AR adds digital elements to the real world, mixed reality allows interaction with both at once.

Immersive technologies are increasingly being used in medicine, retail, and education

More accessible devices and user-friendly tools have increased the adoption of these technologies, which provide interactive, 3D environments that facilitate natural human learning. In 2018, Walmart purchased 17,000 VR headsets to train over a million employees in areas such as customer service and Black Friday preparation.

Simulations incorporating mixed reality have improved trainee certification rates

Such software provides immersive, risk-free environments where students can manipulate digital re-creations to optimize the training experience without producing waste. One meta-analysis showed that MR in welding training boosted passing rates on certification exams by 41.6% versus traditional training methods.

Medical professionals have experimented with using mixed reality headsets

Devices like the Apple Vision Pro have helped doctors develop surgical plans for hip and knee replacements using software that provides 3D models and other tools. Virtual screens displayed by mixed reality devices can provide information related to surgical progress, a patient's vitals, and more.

Mixed reality may help onboard manufacturing workers more efficiently

Mixed reality headsets can facilitate hands-on education by providing immersive guides overlaid onto their field of vision, showing users how to complete complex tasks.

Integrating mixed reality has made art galleries and museums more interactive and accessible

The technology bridges the gap between history and modernity in such spaces by attracting new, younger audiences while preserving cultural heritage through risk-free immersion. Mixed reality experiences, such as visiting reconstructed historical scenes or seeing virtual twins of lost paintings, can be programmed with software features for visitors with disabilities.

Mixed reality devices can turn digital information into 3D experiences

Described as "wearing a theme park on your face," devices like Microsoft's HoloLens project images into users' eyes so that their brains believe virtual objects are actually there. The bulkiness and physical limitations of existing headsets are expected to lessen over time, mimicking the evolution of early headphones.

What is mixed reality?

Mixed reality is a technology that blends the physical and digital worlds, allowing virtual and real objects to coexist and interact in real-time. It combines elements of both virtual reality and augmented reality, enabling users to perceive and manipulate digital content as if it were part of their physical environment.

Explore an interactive global weather map, with overlays depicting real-time data on temperature, precipitation, wind, humidity, and pressure, which enable the tracking and monitoring of extreme weather events.

Watch how a mixed reality app transforms a space into a haunted house

"Hauntify" incorporates a user's physical surroundings into the gameplay. Available via the Meta Quest app store, the software utilizes the mixed reality device's cameras and sensors to map a user's environment, from which evil spirits that must be repelled appear to emerge suddenly.

The medical uses of VR

Virtual healthcare simulations are bridging the gap between traditional classroom learning and real clinical experience, improving the safety, effectiveness and efficiency of healthcare services.

Visualize real-time and historical atmospheric conditions from around the world

This tool provides live maps of wind, rain, thunderstorms, and other atmospheric phenomena overlayed on an interactive map of the Earth. Users can enter their location to explore local atmospheric dynamics and review historical weather conditions dating back to 1979.

Digital twins create real-time 3D models of smart cities

These re-creations allow city planners to track changes and manage infrastructure more easily by testing strategies in virtual environments. Geospatial technologies, such as mobile mapping and satellite imaging, help cities assess urban layouts, plan for disasters, and manage resources more efficiently.

The weather time machine

A fun interactive on how old ships’ logs are giving scientists new insights into the past and future of the Earth’s changing climate (w/maps and pictures).

A 1992 failed parachute test provided the hardware for the first mixed reality system

The Virtual Fixtures platform was developed to improve human dexterity by merging physical and virtual objects with haptic feedback from an upper-body exoskeleton. Tight budgeting and significant equipment needs nearly canceled the project, were it not for salvaging and repairing cameras and sensors from a smashed experimental parachute rig.

AI-powered models can provide low-cost, localized and accurate weather forecasting

These models can run on standard laptops, reducing the need for expensive supercomputers and expanding access to developing regions. AI forecasts can help farmers make informed planting decisions, improving crop yields and reducing costs.

Meta's Quest and other mixed reality devices can make learning new skills easier

PianoVision utilizes the passthrough visibility of a headset to illuminate which keys to play on a real piano or keyboard, providing an immersive, software-based learning alternative to human instruction. Similar apps also offer virtual model replacements for physical devices, such as a virtual piano, to practice with.

The ingredients that make up severe weather

A seven-minute video illustrating how a storm is made. These factors—moisture, instability, lift, and shear—are explained through a series of data sets and creative, descriptive diagrams.

Limited battery life and increasing discomfort prevent extensive use of mixed reality headsets

Spending 24 hours wearing Apple's Vision Pro highlights some of the challenges facing MR technology, which are compounded by an increasing number of bugs when software is run in nonideal conditions. However, practical and entertainment benefits include placing multiple midair timers when cooking and experiencing immersive multimedia, such as astronomical flythroughs.

A fictional glimpse into the future of AR

Hyper-Reality is a project that presents a provocative and kaleidoscopic new vision of the future, where physical and virtual realities have merged, and the city is saturated in media. Watch this six-minute video to experience the vision.

Mixed reality devices and other wearables may usurp smartphones

The integration of smartphone features into watches, glasses, and even clothing suggests future technology may be geared toward working independently in the background. Mixed reality technologies are expected to facilitate this ambient computing world by seamlessly and proactively displaying real-time content without physical interactions solely in the real world.

Explore Earth's future climate under different levels of warming

An incredible interactive project showing how global warming is projected to affect the world, from temperatures to rainfall, droughts and flooding, and more.

Engineer explains VR at five levels of complexity

While its possible to grab a virtual reality headset and hop into an immersive world with little effort, a significant amount of technical and biological science has gone into creating the effect of a 3D world. This video breaks down the technology in five layers of increasing complexity.

Explore Earth's atmosphere and what its layers contain in this interactive adventure

In this interactive, users can move from Earth's surface up through its atmosphere, exploring the natural phenomena found in each layer, including atmospheric rivers, auroras, and meteor showers. Artificial structures such as weather balloons and the International Space Station can also be found on the adventure.

The potential of virtual reality in healthcare

Virtual reality (VR) is carving new frontiers in healthcare, from aiding in stroke recovery to training medical professionals. This article in Time Magazine highlights the innovative uses of VR in medical settings, including its potential and current limitations.

How AR could reshape construction

Wired's Grant Imahara visits Los Angeles, where he witnesses how augmented reality will be a key component of how builders will do their jobs in the future.

Explore hindcasting on climate models published since 1972

Hindcasting tests model forecasts against observational data to determine their accuracy. In this interactive, you can learn about the differences between eight climate models and evaluate them against available climate data.

Tornado chasers include scientists conducting field projects

Research teams use drones, mobile weather stations, and radar systems to capture real-time meteorological data, better understand conditions that favor tornado formation, and improve forecasting models. As of 2022, model limitations result in roughly 70% of tornado warnings being false alarms.

An analysis on using VR to help train orthopedic surgeons

Virtual reality simulation provides surgical trainees with an immersive 3D experience that allows them to practice skills and operations in a safe yet realistic environment.

Mixed reality technologies may help treat depression

A study led by a team from Stanford University showed that MR can help people with depression by providing pathways to engage in activities such as digital board games and dancing. Participants saw reduced symptoms of depression that made their overall treatment plans more successful.

Take a series of virtual tours of Biosphere 2

The videos provide a 360-degree view of the indoor rainforest, ocean ecosystem, Landscape Evolution Observatory, and underground technosphere. A Google Maps Street View option is available to explore additional biomes, with each associated with a different floor level on the bottom right.

The virtual reality era has finally arrived

The smartphone era has driven a large share of the consumer electronics market for almost 20 years now. But what comes next? Dominant computing platforms come and go over time, and there’s reason to believe that mixed reality devices like headsets and glasses might be the form factor that eventually replaces smartphones. This article presents a snapshot of where we are right now in the VR era, and what the future holds.

Mixed reality technology helped make repairs to a quantum physics facility in space

In 2021, astronaut Megan McArthur used a HoloLens to work alongside Earth-based engineers and make hardware replacements to the International Space Station's Cold Atom Lab, the first quantum science facility in Earth orbit. The facility cools atoms to near absolute zero to perform quantum chemistry experiments in a microgravity environment.

See the news with AI-generated data visualizations

Realtime uses generative AI to create immediate data visualizations of news items on its regularly-updated feed, pulling from public data feeds. Peruse stories around sports, economics, politics, and more with the helpful aid of charts and graphs. See the shape of the news with this clever AI tool here.

Global climate models simulate Earth system interactions and how human activity impacts climate

By splitting the planet into tiny 3D grid cells, supercomputers can run thousands of equations for each cell to determine the movement of energy, moisture, and other elements across Earth. The equations can also incorporate greenhouse gases to determine how humans affect the climate.

Wish you could experience life on the Western Front of WWI?

Virtual reality offers a new perspective on World War I in this nearly 14-minute video. National WWI Museum and Memorial Public Program Specialist James Taub demonstrates the War Remains VR experience side by side with what he sees through the headset. A grim and detailed simulation of trench warfare combined with Taub's observations and insights.

Just as large language models are trained on text to enable generative AI systems to mimic natural language, automated AI robotic systems are trained in virtual environments to help them 'learn' about the properties of reality.

Watch a first-person demo of Microsoft's HoloLens

The headset enables users to interact with projected objects in augmented reality by combining Windows Mixed Reality with eye- and head-tracking sensors, a hand-operated controller, and a microphone that can pick up voice commands.

Particle detection has evolved from cloud and bubble chambers to digital 3D displays

As invisible particles passed through cloud and bubble chambers, they disrupted supersaturated vapor and superheated liquid, respectively, creating trails that served as proxies for cosmic rays. The transition from photographed events to digital sensors enhanced data collection and accuracy.

Virtual platform lets surgeons train remotely and in real time

Advancements in health tech are breaking barriers, as trainee surgeons can now virtually join live operations without stepping into the operating room. This 6-minute video from BBC takes a look at Proximi's cloud-based platform, which enables...

View the 55 ECVs used to describe Earth's atmospheric conditions

Essential climate variables include physical, chemical, and biological variables that meaningfully contribute to Earth's climate and how it changes with time. Many of these variables influence one another through feedback mechanisms across Earth's atmosphere, hydrosphere, cryosphere, biosphere, and geosphere.

Chaos theory—informally known as the butterfly effect—is the reason why weather forecasts are presented with probabilities rather than certainties.

Learn all about different types of extreme weather

Find out in more detail about different types of extreme weather, from flooding to thunderstorms, from tropical cyclones to sandstorms, and more (w/ helpful videos).

Climatologists use past data and advanced models to forecast future climate trends

Unlike meteorology, which focuses on weather forecasting over several days, climatology identifies trends in data over periods of 30 or more years. This data can go back millions of years and help refine models to forecast centuries into the future.

Create digital maps of Earth with custom sketches and labels

In this interactive, users can apply layers to various base maps to display natural and human features, including geological activity, biomes, ocean currents, population densities, and light pollution. Custom legends, markers, and drawings can be used to highlight prominent features.

Climate models use complex equations and supercomputers to predict future climate

The equations apply the laws of thermodynamics, fluid motion, and radiative transfer to a 3D grid along Earth's surface. After solving them for each cell in the grid over a time interval, the results carry over to neighboring cells, and the process repeats into the future.

Clouds' subtle climate effects require significant computational power to simulate

Responsible for reflecting sunlight and preventing thermal energy from entering the Earth system while also trapping energy and keeping it in the system, clouds are understood to substantially influence climate predictions. Because even supercomputers struggle to accurately model their dynamic behavior, researchers have used AI to indirectly incorporate clouds into climate models.

Simulate the effects of government policies on climate projections

The En-ROADS tool lets you role-play as a global decision maker to explore the long-term effects of various policy ideas on climate. More than 341,000 people worldwide, including over 130 members of Congress, have used the simulation.

Watch how scientists learn about hurricanes by flying into them

A specialized fleet of Air Force planes is built to fly into hurricanes and gather critical data from inside the storm. Beyond radar and microwave sensors, the planes are equipped with dropsondes—small instruments dropped into storms to measure pressure, temperature, and wind.