Visualizing a synaesthetic soundscape

Individuals with synesthesia experience involuntarily overlapping sensations

Tasting words or seeing colors in music results from the brain retaining extrasensory connections from infancy. While most lose these neural pathways during development, about 4% of people are synesthetes, maintaining them without realizing it's unusual.

Examining self-diagnosed synesthesia

A growing number of people on social media claim to have a perceptual condition that lets them smell colors, see music, or taste sounds. But do they really?

Synesthesia: when sensation in one sense triggers an unrelated sense in the brain

The first reported clinical case of synesthesia dates back to the early 1800s, though the perceptual phenomenon may be much older than surviving records imply. This article by researcher Richard Cytowic details the scientific history of synesthesia, a neurological trait that causes some senses to overlap, giving color to numbers and flavors to names.

Brain implants can help colorblind people hear colors

Colorblind artist Neil Harbisson was born into a world of grey. In 2004, he had a chip installed connected to an external color frequency sensor. Once the sensor "reads" a color, it sends a signal to the chip and plays an associated sound both in and outside Harbisson's head.

Listen to a jazz composition triggered by the New York City Subway

A creative coder created a (synthetic) jazz ensemble that uses the locations of the city's trains to determine its performance. It's both a fascinating bit of internet culture and a fitting homage to New York, one of jazz's major hubs.

50 years of research has focused on unraveling the relationship between music and frisson

One insight reveals that musical passages with surprising volume changes or unexpected harmonies and beauty are more likely to trigger frisson, perhaps because they upend listeners' expectations.

An interactive sound map of 8,000 locations around the world

Cities and Memory's global sound map covers 140 countries, featuring paired recordings: original field captures of a moment in time and an artist's recomposition built from the same source. The structure treats every location as both document and raw material, giving 2,500 contributors the same prompt with unpredictable results.

Listen to samples of 'sounds' produced in the sun's interior, created from the sonification of internal vibrations detected by the Parker Solar Probe.

Arnold Schoenberg, a pioneer of modern music, and painter Wassily Kandinsky, a pioneer of abstract art, were close friends who inspired one another's work.

How the brain processes a calendar year

When most of us picture a calendar year, we have a foggy image in our minds of the months, in rough, calendar-like grids. But for some folks, that picture is a whole lot more clear. Around 1 percent of the population has a strange ability known as "calendar synaesthesia," which means they're able to visualize in crisp detail an elaborate calendar of the months of the year. Learn how it works here.

Explore a visual and auditory guide to wave properties and waveforms to learn how every sound imaginable can be created by combining multiple vibrations of air.

Humans experience the world subjectively. What does that mean for scientific research?

When you close your eyes, do you see static or colorful patterns or an "intrinsic grey" known as Eigengrau in German? This variation of our internal experiences is just the tip of the iceberg, one that scientists are increasingly studying and...

Listen to the 'sounds' of the universe with this sonification library, where astronomers have transformed certain astronomical data sets into audio for broader engagement.

The psychedelic playlist inspired by a Johns Hopkins experiment

Dating back to 1967, the playlist is over seven hours long and organized in such a manner as to echo users’ experiences as their trips rise, crest, and fall. According to the initial creator of the playlist, the music is a “nonverbal support system” that keeps users from prematurely returning to normal consciousness.

Psychedelic compounds: a visual library

However psychedelic experiences manifest, they all begin with the presence of psychoactive compounds. Learn about their various chemical compositions in this structural library of psychedelic compounds. Clicking on an entry will take readers to a new page where they can learn about the chemistry and pharmacology of each compound, as well as the drug's possible applications.

Color originates from the brain processing light of varying wavelengths

Various geometric models, including Newton's color circle of hue and saturation and the horseshoe-shaped XYZ space for mixing colors via vector mathematics, have been proposed to describe colors accurately. However, these models do not encapsulate the variety of psychological effects that cause perceived colors to differ from mathematical representations.

By igniting flammable gas in a tube filled with holes and playing music into it, the fire will take the shape of the sound waves, enabling the visualization of audio.

Wearing a 'schizophrenia simulator,' designed to build empathy for patients, CNN's Anderson Cooper finds he struggles to function

Donning headphones that play a track mimicking the auditory hallucinations common in schizophrenia, Cooper finds he is very distracted, disconcerted, and frustrated. The auditory track aims to help listeners build empathy with patient populations by understanding the challenges they face in daily life.

When processing light, the brain can perceive colors with no natural wavelength

While some animals are sensitive to many forms of light, humans possess receptors that are sensitive to red, green, and blue wavelengths. These receptors send signals to the brain, which are processed and mixed to produce the array of colors we observe, including magenta, pink, and "supercolors" that lack a corresponding natural wavelength in the visible spectrum.

Playing music enhances the creation, storage, and retrieval of memories

Scans of the brains of individuals who play instruments have shown enhanced connectivity between multiple brain regions—visual, auditory, and motor cortices—and the corpus callosum, which connects the two brain hemispheres. These complex connections are strengthened through practice and then used in other activities that involve both logic and creativity. The brains of musicians also appear to give experiences multiple types of memory tags, such as audio, emotional, and conceptual, improving their processing.

The brains of people who experience frisson have unique neural pathways

A small 2016 study aimed to investigate the behavioral and neural differences between 10 individuals who experience goose bumps when listening to music and 10 who typically don’t. Scientists reported that individuals experiencing musical chills had greater white matter connectivity in specific auditory, emotional, and social processing areas of the brain.

View a collection of sound animations, which depict how a source of sound waves pushes against particles to carry energy away without matter being displaced.

An ear doctor with hearing loss seeks to help those with hearing loss enjoy music

Alex Chern, an ear doctor who has hearing loss himself, dreams of restoring the ability to experience "all the richness and the beauty of the sound of music" for patients—not just functional hearing. Hearing aids amplify sound waves and aren't designed to work well with music that may have varied pitch and volume. Chern is studying how hearing loss and engaging with music may affect cognitive decline.

Physiological changes to the brain on LSD can be captured via MRI

Psychedelics like LSD often take users on novel experiences that can result in lasting shifts in perspective and behavior. See how LSD affects brain activity in this video that details how scientists visually captured the psychedelic's effect for the first time.

Arnold Schoenberg expanded the confines of music by abandoning traditional chords and embracing dissonance.

Scientists are learning to guide your dreams using sound and touch.

When common sounds become disturbing

Misophonia causes certain sounds to feel violating, triggering a "very visceral kind of experience" filled with extremely unpleasant emotions, including annoyance, anger, and disgust. A 2017 study found that people with misophonia have elevated activity in the brain's anterior insula—a region associated with interoception, emotional processing, and behavioral responses—when exposed to trigger sounds. Ongoing research suggests trigger sound context affects the severity and manifestation of the condition.

The aesthetics of the James Webb images

The highly popular images produced by the James Webb Space Telescope are an artful collaboration between data science and visual designers. The raw data reflects real physical aspects of space, but it arrives without visual representation. Visual experts assign colors to specific wavelengths, crop and orient images in an accessible way, and consider the emotional impact of images as they incorporate design principles into the final product. Learn the fascinating details here.

Colorizers convert Hubble's gray scale images into color composites of different wavelengths

The near-infrared and ultraviolet light captured by the space telescope is not visible to human eyes, but observational data of these types of light can be filtered and modified into visible colors. Many detailed images of astronomical objects are the result of combining these artificially colored images into layers.

Philip Glass was once an assistant to Ravi Shankar, the Indian music legend who introduced the Beatles to Eastern music.

Misfired motor signals may explain why many people with schizophrenia hear voices

Up to 80% of schizophrenia patients may have auditory hallucinations. Recent research concluded that this symptom may be from misfired motor signals that feed into each other, essentially failing to suppress certain sensory neural activities and that resulting overexcitment fuels hallucinations. The finding suggests that, one day, magnetic pulses might be used to stimulate specific nerves to better regulate the errant signals and reduce or stop hallucinations. (Some users may encounter a paywall.)

The ideas of Einstein and Freud combined in 'The Persistence of Memory'

The Persistence of Memory was painted on a canvas roughly the size of a sheet of paper, depicting a desolate landscape with melting clocks, ants, and a distorted figure. The piece incorporates Freud and Einstein's ideas, resulting in a haunting composition symbolizing time's fluidity and Dalí's personal anxieties.

Explore a visualization of the data behind Ben & Jerry's legendary ice cream flavors.

Philip Glass' collaboration with electronic producer Aphex Twin found the two music icons bonding over their desire to push the limits of modern music.

Widespread use of LSD sparked a counter-cultural artistic movement in the 1960s

The trippy visuals often associated with LSD flourished in the 1960s as the drug became more widespread. Psychedelic design, defined by its undulating text and graphics, ultimately grew beyond just visuals, spawning psychedelia, a term that includes art, music, and cultural experiences based on psychedelic experiences.

One classical musician arranged a work specifically for yoga

In the middle of a yoga class, Ellen Fishman noticed that sitting closer to a speaker allowed her to feel the music in her body, enhancing her overall experience. She arranged music for a string ensemble with a yoga session in mind. The group, StringFlo, now performs the work live in yoga classes.

Jean-Paul Sartre was amazed by American jazz

The French philosopher wrote about a 1947 trip to a New York jazz club as a transcendent experience, describing the magic of the relationship between performer and audience: "You shout, they shriek, they whistle, they are possessed, you are possessed."

Interacting sound waves can create regions where the pressure from each wave combines, allowing objects to levitate in place against gravity or be manipulated for touch-free construction.

Listen to found cassette tapes from around the world

A growing catalog collects tapes discovered in Barcelona, New York, and other locations, featuring digitized audio for easy listening alongside any accompanying visuals or notes. Some audio fragments include voice memos and mixtapes as well.

Tetrachromacy allows humans to observe 10 times the normal amount of colors

Resulting from a mutation on the X chromosome, the rare genetic condition causes individuals to possess an additional type of photoreceptor cell, typically sensitive to the orange range, located between the standard red and green cones. This enables the perception of approximately 100 million colors.

Finding delight through your five senses

Digging into your immediate senses is shown to benefit your overall psychological well-being, from the happy memories evoked by familiar scents or through the transformative power of birdsong. This episode from the Science of Happiness podcast highlights insights from Gretchen Rubin, an author who has written books on the importance of engaging your senses for a happy life.

Misophonia is a neurological disorder where sounds trigger strong emotions

The phenomenon is characterized by decreased tolerance to specific sounds, such as heavy breathing, pen clicking, and water dripping, which trigger a fight-or-flight response. The resulting emotions, which can range from irritation and disgust to anxiety and fear, can be overwhelming and uncontrollable.

Visualize the components of fireworks

This article provides animated diagrams depicting how different parts of fireworks function. The elements work together through timed mechanisms to produce desired effects.

Create flute, saxophone, trumpet, or violin reproductions of any 15-second piece of audio using machine learning.

Why patterns in art are so pleasing

Repeated visual cues like shapes or lines derive from the brain's innate compulsion to identify faces, places, bodies, and more. With repeated shapes, the brain seeks out resolution to the subtle variations between them. See examples in art and music.

Music was a profound inspiration for Basquiat

The prolific artist loved music, obsessing over David Bowie, Aretha Franklin, and numerous jazz figures. Many of his favorites appeared in his paintings, creating a body of work that also acts as a glossary of influences. Below is a 1984 portrait of Max Roach, the jazz drummer. (Some readers may experience a paywall.)

Can music alter your memories?

You’re familiar with music’s ability to transport you to a past experience, but new research suggests that music can even alter how you remember your past experiences. A team of psychology researchers and music experts recently published a study that demonstrates how music can help shift our emotional recollection of a memory. Read to learn more about the study’s findings and how it could influence therapy practices.

Sleep is no longer considered a binary state—scientists are seeking to map a variety of liminal states between sleep and waking, including the hypnagogic state associated with boosts of creativity.

Breaking down the music theory of Hitchcock's 'Psycho'

One of the defining features of Hitchcock’s film “Psycho” (1960) is the music, especially the sounds you hear during some particularly grisly scenes. This analysis from The Music Professor analyzes how that music complements the film, highlighting the way strings match the intensity of the film’s screenplay and black-and-white cinematography.

Music may give some of us the chills and goose bumps—perhaps because it shocks us

The science is still unsettled about why music can trigger a chill down your spine, formally known as frisson, but one theory is that anything surprising to the nervous system—including sudden beat drops or unexpected harmonies—stimulates a type of alarm response that gives rise to this feeling.