Using AI to restore speech 30 years after a stroke

Brain implants are restoring movement and communication in early human trials

Several companies developing brain-computer interfaces have begun testing on humans with promising results. These implants have helped reanimate paralyzed limbs and enable communication, though ethical concerns remain about data privacy.

Interface device implanted into ALS patients restored some of their abilities

Most people with amyotrophic lateral sclerosis, or Lou Gehrig's disease, require assistance with daily life due to loss of motor control. The electrode-coated, stent-like device used motor mapping data and machine learning to translate brain activity into actions.

Computer systems create artificial voices by stitching together phonemes—individual sounds that make up speech, such as 't,' 'long a,' and 'k' to say 'take.'

Brain-reading devices are helping paralyzed people to touch

In clinical trials, implanted brain-computer interfaces are allowing dozens of individuals with paralysis to control prosthetics that are restoring a range of skills, including drinking coffee and feeding oneself. One area of related prosthetic research is creating a synthetic sense of touch—coupling the brain implant with pressure sensors in prosthetic robotic fingertips to enable an approximation of a sense of touch.

The journalist who let AI speak with his voice

Journalist Evan Ratliff became the object of his own story: He opted to clone his voice, feed it into an AI chatbot, and have it do the talking. What could seem like a fun experiment ended up revealing just how far the capacity of artificial intelligence can go in imitating our identities. Hear the ins and outs of how Ratliff achieved this in this fun and thought-provoking episode.

Neuralink brain implants have enabled a paralyzed person to play video games

As one of twelve test subjects in Neuralink's PRIME study, Rob Greiner's implant translates his brain's activity into digital commands for the 'Battlefield 6' game. He can now also design 3D models and 3D-print objects using his thoughts.

Create professional-quality spoken audio from text

Generative AI now makes it possible to create everything from computer-generated written content to beautiful imagery and hyper-realistic videos in seconds from a user’s simple text prompt. Add to that list: High-quality spoken audio, which the AI software company ElevenLabs specializes in. Its natural-sounding speech synthesis and text-to-speech tech can produce human-like speech that mimics a variety of different tones, styles, and accents.

A brain scientist's experience with a stroke

What happens when a leading brain scientist has a stroke of her own? Dr. Jill Bolte Taylor recounts moment by moment watching her brain function slow and then cease, followed by a prolonged recovery. Through this experience, she details what she learned about the phenomenon of stroke and how it has impacted her research ever since.

Mind-controlled bionic arms use nerve implants to restore sensation and movement

Unlike traditional prosthetics that rely on surface electrodes or mechanical parts, this system uses implanted titanium and nerve-connected electrodes to enable a seamless brain-to-arm connection. Patients train in virtual reality with their implanted signals before using the physical prosthesis.

Using brain implants to restore vision

Several companies are attempting to create brain-computer interfaces that skip over retinas and optic nerves to allow visual input to go straight to the brain, potentially restoring some sight to the blind. Clinical trial findings suggest restored sight is sparse and manifests differently than a sighted person might expect, appearing as specks of "light" clusters called phosphenes to help differentiate one's surroundings.

The first neural devices were cochlear implants, designed to treat hearing loss

Neural interfaces connect with our nervous system to restore or enhance abilities, such as hearing or movement. These neuroprostheses have enabled the restoration of mobility, communication, and activities of daily living that might otherwise require a caregiver.

Brain-computer interfaces create a direct link between the brain and external devices

The technology enables users to control prosthetics, computers, or even games using only their thoughts. In 2021, a monkey played table tennis using only its brain, thanks to a Neuralink device, marking a major milestone before human trials began in 2024.

An essay exploring how living day-to-day with a brain implant helps restore a sense of identity

Companies like Neuralink are experimenting with volunteers who have lost control over their bodies. Many of the program's participants claim the most significant benefit from the tool is the ability to perform simple, mundane tasks, such as playing video games or shaking hands, rather than more obvious milestones like walking or eating. This essay explores what it's like, day to day, to use a brain implant.

Audio deepfake tools can now impersonate anyone in real time

A cybersecurity company developed a tool that mimics a person's voice with no noticeable delay using only publicly available software, hardware, and voice samples, allowing users to have seemingly authentic conversations while pretending to be someone else.

Artificial intelligence may improve organ donation systems—and even organ health

Mayo Clinic transplant experts suggest that artificial intelligence could potentially improve organ donation systems in several ways, including better identifying patients most at risk for organ rejection, enhancing donor-recipient matching, and helping to avoid organ transplant needs by identifying health issues earlier.

How Stephen Hawking’s voice became iconic

Stephen Hawking relied on a voice synthesizer after losing the ability to speak due to complications with ALS. Despite technological advances, he refused to change the "Perfect Paul" voice, making it a cornerstone of his public identity.

Transformer architecture was the breakthrough that made AI chatbots possible

It changed how text was translated from a sequential, "one word at a time" method to one where every word in a text is processed in parallel. Advances in positional encoding and self-attention also helped models recognize context and word order better.

AI gained mainstream attention with tools like IBM Watson and Apple’s Siri

With the release of ChatGPT in 2022, which drew over 100 million weekly users in just two months, natural language processing and understanding could be achieved at scale via machine learning. Unlike earlier artificial intelligence that could pull stored knowledge, generative AI produces text, images, or sounds.

AI griefbots that generate text or even video avatars of the dead are controversial and could conceivably change how we mourn.

Audio deepfakes have fooled voice biometrics at banks

Limitations in facial and body movements as well as mismatches between audio and lip movements can sometimes help flag a video as a deepfake, but removal of the video component significantly improves AI mimicry.

Decoding the hype around AI

2022 was the year AI broke onto the scene, with applications like ChatGPT amazing users with its ability to generate realistic-sounding answers. Technologist Arvind Narayanan presents a clear-eyed view of what the technologies can (and can't) do.

Open brain surgery is not required for BCIs inserted via blood vessel injection

Synchron's brain-computer interface, the Synchron Switch, takes advantage of preexisting medical devices, such as stents and catheters. Cells grow over the device over a 90-day period, incorporating it into the vessel wall and minimizing clots.

AI-generated avatars allow users to create deepfakes in real time

Synthetic media tools can map voices and faces to make individuals appear as someone else. Although they open the door to new opportunities in immersive education and entertainment, they also raise concerns about the misuse of personal identity.

The AI that creates any picture you want and how it works

Since January 2021, advances in AI research produced a plethora of deep-learning models capable of generating original images from simple text prompts. Researchers at OpenAI, Google, Facebook, and others have developed yet to be released text-to-image tools, and similar models have proliferated online. This video is a primer on how we got here, how the technology works, and its implications.

Stephen Wolfram on AI's rapid progress & the "Post-Knowledge Work" era

AI, as a concept, has been around since at least the 1950s, but it's only in the last year or so that the technology has been able to equal humans at many tasks -- and in many cases surpass humans. In this podcast, mathematician and computer scientist Stephen Wolfram provides an AI 101, explaining how we got here, how highly advanced chatbots like ChatGPT work, and what our world is in store for next.

AI can aid fertility treatments, from helping select egg candidates to laboratory automation

Reproductive AI technologies are already here, from processing vast amounts of data to helping clinicians identify the healthiest embryos for implantation. It could be a boon to the fertility industry, and help mitigate the shortage of experienced embryologists.

Pig brain cellular activity was restarted hours after death in study published in 2019

Yale University scientists restored basic cellular activity and circulatory function in pig brains about four hours after death with a synthetic cocktail of preservatives and nutrients. This work— which didn't restart electricity activity in the brain or consciousness—could help advance future human stroke and brain injury treatments.

Predictive brain implants raise ethical concerns about patient autonomy after surgery

These devices can accurately forecast neurological events like seizures and suggest or even automatically deliver responses. Their constant monitoring and prescriptive functions may blur the line between patient choice and device influence.

Deep brain stimulation helps manage movement in patients with neurological disorders

DBS is a surgical procedure that uses implanted electrodes to send electrical signals to targeted areas in the brain, interrupting abnormal neural activity. It may be implemented when medications lose effectiveness or cause disruptive side effects.

In a first, eye prosthesis has restored sight to macular generation patients

In a clinical trial, 27 of 32 participants with advanced macular degeneration regained enough vision to read books, food labels, and subway signs about a year after receiving a prosthetic retina device. This is the first device to restore functional vision to patients with incurable vision loss, though in this case they can only see in black and white, with no shades in between.

Teaching a robot to laugh

Researchers have designed a shared-laughter AI system that responds to human laughter in order to build a sense of empathy into dialogue. Learn how they did it with this explainer.

An expert recreates the voice of a 3,000-year-old mummy

Ear, nose, and throat expert David Howard discusses how his research team extracts vocal folds from preserved human tissue, which allows them to model the deceased person's larynx. From there, they can create a synthetic voice based on the organ's geometry.

A physician with a rare and deadly disease saved his own life by identifying an existing medication that he repurposed for his condition, and now he's using AI to try to do the same for other patients.

Listen to how bionic limbs are reshaping what it means to live as an amputee in this award-winning 2022 podcast series covering the stories of two amputees who struggled with shortcomings in prosthetic technology.

Microsoft has integrated AI across its software products with Copilot

It utilizes an underlying model from OpenAI—makers of ChatGPT—to assist users in creating documents, writing code, locating files, and more across Windows, Microsoft 365, Bing search and WhatsApp on desktop and mobile devices. Copilot Voice and Vision offer accessibility features for users who prefer not to use mouse/keyboard navigation.

You can draft a will designed to block AI resurrection—but the request may be ignored

Ars Technica spoke with legal experts about how—and if—people could design their wills to prevent AI resurrection. Though this is not yet a common request, one lawyer suggested that people worried about living on in an AI format can draft a power of attorney and a will that prevents those in charge of one's estate from submitting any texts, voice, image, writings, or other personal information to any AI tools.

Stem cell therapy has shown promise in treating spinal injuries in an early-stage clinical trial.

Researchers use the brain's ability to edit memories to explore memory deletion

Scientists have successfully implanted false memories in mice after studying how the editing process works in the brain. Beyond potentially deleting memories in those with PTSD, upcoming research may allow clinicians to forecast the onset of neurodegenerative diseases.

Left versus right brain strokes vary significantly in long-term effects

Due to the high complexity of the brain, the aftereffects of a stroke can have widely different manifestations, ranging from minor temporary impairments to rapid death. Whether a stroke results in paralysis, speech impairments, loss of bodily function, or death will depend on whether it occurs in the left or right hemispheres or the brain stem.

Research suggests the brain maintains connections to lost limbs

Decades-old research suggested brain reorganization after amputations, but brain scans show unchanged limb representations. Phantom limb pain may result from such unchanged brain maps, which may enhance prosthetic limb control in brain-computer interface technology.

An estimated 2 million brain cells die each minute a stroke goes untreated

Modern stroke treatment is a delicate balance between obtaining an accurate diagnosis and delivering treatment quickly. Each stroke has its own cause, and the appropriate treatment must be paired with the correct diagnosis to prevent further harm. Typical treatments pair emergency surgery to relieve the affected area and long-term regimens to avoid recurrence.

After 25 people used virtual reality headsets to practice flying with virtual wings—flapping their arms—their visual cortex responded to the wings almost as if they were real arms, treating them as body parts.

Why surgeons implant teeth into eyes

What if the thing that restored your vision… was your own tooth? That’s exactly what happened to Brent Chapman. After 20 years without sight, a bizarre surgery using his tooth as a lens restored his vision.

A cochlear implant stimulates parts of the cochlea directly, with limited pitch and timbre capabilities

People with these devices have to learn or relearn how to train their brains to interpret nerve signals as sound. The range of the type of sounds that the brain can distinguish with a cochlear implant is limited and consequently it's difficult to understand a tonal language or distinguish individual speakers in a crowd.

Neural interfaces offer major medical potential but raise serious ethical concerns

Although brain-computer interfaces can help people recover lost functions and allow direct brain-to-computer communication in the future, surveys have shown little public support for using them to boost abilities like memory or focus in healthy people.

Watch video samples created by AI

Sora, OpenAI's video generation tool, can create up to 60 seconds of photorealistic video footage featuring highly detailed scenes, complex camera motion, and multiple characters with vibrant emotions from a text prompt.

Anthropic's interpretability team discusses how AI models' thinking mimics biology

Just as humans engage in complex behaviors to survive and reproduce, teams of experts in neuroscience, virology, mathematics, and other disciplines argue that large language models develop complex mechanisms to achieve their goals. These mechanisms can be manipulated to assess how they modify outputs—much like stimulating individual neurons—to uncover how LLMs "think."

Losing a brain-computer interface can trigger lasting psychological distress

A clinical trial participant with severe epilepsy described becoming “one” with her implant after it gave her unprecedented control over her seizures. When the device was removed due to the company shutting down, she experienced deep emotional trauma and a sense of personal loss.

Research suggests using AI for schoolwork may harm critical thinking skills

An MIT study finds lower brain engagement in students who used ChatGPT, resulting in consistent underperformance in neural, linguistic and behavioral levels. AI users struggled to recall their own essays, while the brain-only group showed the highest neural connectivity and satisfaction.

Chat with famous, historical, and fantasy figures with this chatbot

Character.ai—a generative AI-based chatbot platform—allows you to have free-flowing conversations with a wide range of people. From celebrities to famous figures from the past, the platform relies on a neural language model to process huge amounts of text, learning from conversations with users to develop responses. A number of observers have referred to the platform as "making AI fun," with user time on site surpassing a whopping two hours per day.