AI Technology Revives the Voice of Renowned Israeli Journalist Moshe Nussbaum
In a remarkable turn of events, Moshe Nussbaum, a celebrated Israeli TV journalist, is making a triumphant return to the airwaves despite losing his ability to speak clearly due to ALS. Known affectionately as “Nussi” by his audience, Nussbaum’s career seemed to be at a standstill after his diagnosis. However, thanks to cutting-edge artificial intelligence software, his distinctive gravelly voice is being brought back to life, allowing him to continue his work in journalism.
At 71, Nussbaum was diagnosed with amyotrophic lateral sclerosis (ALS), a progressive neurodegenerative disease also known as Lou Gehrig’s disease. This condition attacks nerve cells responsible for muscle control, leading to significant physical challenges. Despite these obstacles, Nussbaum pledged to his viewers on Israel’s Channel 12 News that he would keep working as long as he could. Over time, however, the disease made it increasingly difficult for him to perform his duties.
For over four decades, Nussbaum has been a stalwart in Israeli journalism, covering pivotal events from the front lines of wars in Gaza and Lebanon to the aftermath of suicide bombings. His reporting extended to political scandals and high-profile court cases, making him a household name. Yet, the October 7, 2023, attack by Hamas, which led to the war in Gaza, marked the first conflict he could not cover from the field, a significant moment in his career.
Despite his physical limitations, Nussbaum initiated a segment where he interviewed injured soldiers in Israeli hospitals. Although his speech was slow and labored, he persevered through the early stages of the war. As his condition worsened, these interviews became less frequent, leading to a pause in his on-air presence.
In a surprising development, Channel 12 announced that Nussbaum would return as a commentator, utilizing AI technology to recreate his voice. “It took me a few moments to absorb it and to understand that it is me speaking now,” Nussbaum shared with The Associated Press via text message. “Slowly, slowly, I’m understanding the incredible meaning of this device for everyone with disabilities, including me.”
The AI program allows Nussbaum to write his stories, which are then vocalized using his recreated voice. He will be filmed as if presenting, with his lips digitally adjusted to match the spoken words. This technology, unlike traditional text-to-speech systems, captures the nuances of Nussbaum’s voice, thanks to the extensive archive of his recordings from his long career in TV and radio.
While Nussbaum is excited about the opportunities this technology presents, he also expresses concern about its potential misuse. The ease with which AI can be used to spread misinformation and create fake news is a significant worry for him.
Currently, the technology does not support live broadcasts, meaning Nussbaum will not be able to report from the field, a part of the job he deeply cherishes. Instead, he will focus on providing commentary and analysis on crime and national security, areas where he has extensive expertise.
Channel 12 has released a preview showcasing Nussbaum’s transformation. The clip contrasts his current, garbled speech with the AI-generated voice, which closely resembles his original tone and delivery. In the preview, AI Nussbaum remarks, “Honestly, this is my first time sitting here in the studio after more than a year. It feels a bit strange, and mostly, it tugs my heart.”
The rise of AI-powered voice cloning has been rapid, with experts warning of its potential to facilitate scams, disrupt democratic processes, and infringe on personal dignity. Instances of misuse include deepfake robocalls mimicking President Joe Biden and a fake audio clip of a school principal making racist remarks.
However, the technology also holds promise for those who have lost their ability to speak. A U.S. congresswoman with speech difficulties due to Parkinson’s and a related palsy has used similar AI technology to deliver a speech on the House floor. Additionally, a young woman who lost her voice to a tumor has benefited from this innovation.
Channel 12 has not disclosed which AI program is being used for Nussbaum’s voice recreation. Nussbaum, who feared ALS would end his career, expressed gratitude for the opportunity to continue working. He told Channel 12, “Don’t feel like you’re pitying me, doing me a favor. The day you come to the conclusion that this is it — tell me. I’ll know how to accept it without a problem.”
He describes his AI-enabled comeback as a “magic trick” and hopes it will raise awareness in Israel about how people with disabilities can remain active in their professions. “The fact that Channel 12 and my news managers are allowing me to reinvent myself anew, that is one of the most important medicines I can get in my fight with this disease,” he said.
Originally Written by: The Associated Press
