The Download: AI bottleneck debates, and BCI trials take off

Casey Harrell has had a set of electrodes embedded in his brain for almost three years. Harrell, who has amyotrophic lateral sclerosis (ALS) and is paralyzed, first used his brain-computer interface (BCI) to “speak” sentences with the help of a research team in 2023.

Since then, Harrell has clocked thousands of hours of use. He can use the device largely independently, once he’s been “plugged in” with the help of a carer. His team has added new features to it, and Harrell also uses it to surf the web and perform his job.

“Living with a disease like ALS, you are supposed to have diminished dreams. I do not,” Harrell tells MIT Technology Review . “Any one of these things would be an absolute godsend of improvement. To have all of them, and many, many more, is truly revolutionary.”

Within the first 22.6 months after the device was implanted, Harrell had used it for more than 3,800 hours at home without any researchers present, the team reported today in the journal Nature Medicine . “He’s the first power user of a speech BCI,” says team member Sergey Stavisky, a neuroengineer at the University of California, Davis.

Decoding speech

Three years ago, Harrell entrusted David Brandman, an associate professor of neurological surgery at the University of California, Davis, and his colleagues with his brain. Harrell, who was 45 at the time, had already been diagnosed with ALS, a degenerative disease that robs people of the use of their muscles.

Harrell was dependent on others to control his wheelchair and to dress and feed him. He had difficulty speaking; people struggled to understand what he was saying. Then Brandman and his colleagues asked if he’d like to trial a brain implant that might help him communicate. “The industry was [on the] cusp of a transformation, and I wanted to be part of it,” says Harrell. He signed up.

In July 2023, during a five-hour operation, doctors implanted four arrays of 64 electrodes each into his brain. Each pair of arrays was wired to a “pedestal” connection point—creating two docking locations on the exterior of his skull to connect the electrodes to a computer.

The team had long been working on developing algorithms to decode brain activity into speech. Their system works by recording activity from the speech motor cortex—a region of the brain responsible for the movements that allow us to speak.

“There are 39 phonemes that make up all the sounds in the [American] English language,” says Nicholas Card, a neuroengineer at UC Davis and member of the team. Mapping neural activity related to producing each of those phonemes can allow the team to create a personalized speech decoder and software that can “speak” those words. “We first go from brain data to phonemes, and then from phonemes to words,” he says.

They started using the device around a month after the surgery. The team got Harrell’s speech decoder working on the first day , says Card. On that day in August, Harrell used the device to speak with a 50-word vocabulary, and 99.6% of the words were as he’d intended. That vocabulary was later expanded to 125,000 words with 97.5% accuracy.

At the time, it was unclear how long the device might last. Brain-computer interfaces are still new—not many people have had them implanted for long periods of time. Scar tissue can form around electrodes in a person’s brain, interfering with their ability to pick up neural activity, for example. But that doesn’t seem to be the case for Harrell.

Power user

In another advance, Harrell is now able to use the device more independently. In 2023, members of the research team would have to visit Harrell at his home and physically connect and disconnect him from the device on the days he wanted to use it. Not anymore. The team has since automated more of the system—today, Harrell’s care partner can don and doff it for him. “He’ll wake up, get plugged in, and just get going,” says Stavisky.

This is important, says Mariska Vansteesel, a BCI researcher at Utrecht Medical Center who was not involved in the trial. “For these technologies to be relevant for patients, we really need to test them in settings in which they will eventually be used … to demonstrate that it has value, that it’s usable, and that it functions well without the constant involvement of a research team,” she says.

Casey Harrell uses his BCI to speak in "private mode."

The team has also worked to improve the system itself. It is now 99% accurate, says Stavisky. Harrell can also control a cursor—a game changer that enables him to use his personal computer to send text messages and emails, surf the web, and keep up with his job as an environmental activist.

Over the years, the team has updated the system to accommodate specific requests from Harrell. He is now able to switch on a “privacy mode”—when active, any decoded text will be automatically deleted. He can also opt to use a “profanity filter” while he’s talking to his young daughter.

“We have been able to add on to the software sid…