AI Technology Revives the Voice of Renowned Israeli Journalist Moshe Nussbaum
In a remarkable turn of events, Moshe Nussbaum, a celebrated Israeli TV journalist, is making a triumphant return to the airwaves despite losing his ability to speak clearly due to ALS. Known affectionately to his audience as “Nussi,” Nussbaum’s career seemed to be at an end when he was diagnosed with amyotrophic lateral sclerosis, a progressive disease that affects nerve cells controlling muscles. However, thanks to cutting-edge artificial intelligence software, Nussbaum’s distinctive gravelly voice has been recreated, allowing him to continue his work in journalism.
The Impact of ALS on Nussbaum’s Career
Nussbaum, now 71, received his ALS diagnosis two years ago. The disease, also known as Lou Gehrig’s disease, progressively attacks nerve cells, leading to muscle degeneration. Despite the challenges, Nussbaum pledged to his viewers on Israel’s Channel 12 News that he would continue working as long as he was physically able. Over time, however, the disease made it increasingly difficult for him to perform his duties.
For over four decades, Nussbaum had been a stalwart in Israeli journalism, covering significant events such as suicide bombings, wars in Gaza and Lebanon, and high-profile political scandals. His inability to report from the field during the recent conflict in Gaza, following Hamas’ attack on October 7, 2023, marked the first time he had missed covering a war in his career.
Adapting to New Challenges
Despite his physical limitations, Nussbaum continued to contribute by interviewing injured soldiers in Israeli hospitals. Although his speech was slow and halting, he persevered through the first half of the war. As speaking became more challenging, his interviews became less frequent, leading to concerns about his future in journalism.
The AI Solution
In a surprising announcement, Channel 12 revealed plans to bring Nussbaum back as a commentator with the help of AI technology. This innovative approach involves Nussbaum writing his stories, which are then voiced by an AI program trained to replicate his unique vocal characteristics. The technology also adjusts his lip movements to match the spoken words, creating a seamless presentation.
Traditional text-to-speech technology has long been used by individuals with speech disorders, but these systems often produce robotic and emotionless voices. In contrast, AI technology can mimic the intonations and phrasing of a person’s voice, offering a more natural and expressive output. Nussbaum’s extensive career in TV and radio provided thousands of hours of recordings, which were instrumental in training the AI to replicate his voice.
Concerns and Limitations
While Nussbaum is excited about the possibilities this technology offers, he also expresses concern about its potential misuse. The ease with which AI can be used to spread misinformation and create fake news is a significant worry. Currently, the technology is not suitable for live broadcasts, meaning Nussbaum will focus on commentary and analysis rather than field reporting, which he admits is his favorite part of the job.
A New Era in Broadcasting
Channel 12 has released a preview showcasing the AI-enhanced Nussbaum. The transformation is striking, with the AI version speaking quickly and emphatically, much like the original Nussbaum. The preview captures Nussbaum in the studio, his familiar bushy eyebrows moving expressively as he delivers his report.
“Honestly, this is my first time sitting here in the studio after more than a year,” AI Nussbaum remarks in the preview. “It feels a bit strange, and mostly, it tugs my heart.”
The Broader Implications of AI Voice Cloning
AI-powered voice cloning has seen rapid advancements in recent years. Experts have raised alarms about its potential to amplify phone scams, disrupt democratic elections, and violate the dignity of individuals who have not consented to have their voices replicated. The technology has been used to create deepfake robocalls mimicking President Joe Biden and to generate fake audio clips of public figures making controversial statements.
However, the technology also holds promise for individuals who have lost their ability to speak. A U.S. congresswoman with speech difficulties due to Parkinson’s disease has used a similar AI program to deliver a speech on the House floor. Additionally, a young woman who lost her voice due to a tumor has benefited from this technology.
Nussbaum’s Perspective and Future
Channel 12 has not disclosed which AI program is being used for Nussbaum’s voice cloning. Reflecting on his journey, Nussbaum had feared that ALS would end his career. He had told his managers at Channel 12 not to feel obligated to keep him on out of pity. “The day you come to the conclusion that this is it — tell me. I’ll know how to accept it without a problem,” he said.
Now, Nussbaum views his AI-enabled persona as a “magic trick” that has facilitated his comeback. He hopes it will raise awareness in Israel about the potential for individuals with disabilities, particularly progressive ones, to continue working. “The fact that Channel 12 and my news managers are allowing me to reinvent myself anew, that is one of the most important medicines I can get in my fight with this disease,” he stated.
Conclusion
Moshe Nussbaum’s story is a testament to the power of technology to transform lives. While AI voice cloning presents ethical challenges and potential risks, it also offers hope and new opportunities for those facing significant obstacles. As Nussbaum embarks on this new chapter, his experience underscores the importance of balancing innovation with responsibility.
Originally Written by: MELANIE LIDMAN
