OpenAI Unveils Voice-Cloning Tool – OpenAI has introduced a voice-cloning tool that it intends to closely regulate until measures are in position to prevent deceptive audio manipulations designed to deceive listeners. Dubbed “Voice Engine,” the model can replicate an individual’s speech using just a 15-second audio snippet, as detailed in an OpenAI blog post disclosing outcomes from a limited trial of the technology.
“We recognize that generating speech that resembles people’s voices has serious risks, which are especially top of mind in an election year,” the San Francisco-based company said. “We are engaging with U.S. and international partners from across government, media, entertainment, education, civil society and beyond to ensure we are incorporating their feedback as we build.”
People Also Read: Elon Musk Announces Free Premium Features for Verified X Accounts
Researchers studying disinformation express concerns about the widespread abuse of AI-driven tools during a crucial election year, owing to the increasing availability of voice cloning technologies that are affordable, user-friendly, and difficult to trace. Acknowledging these problems, OpenAI said it was “taking a cautious and informed approach to a broader release due to the potential for synthetic voice misuse.”
The cautious unveiling followed a revelation made a few months earlier, when a political consultant affiliated with a lesser-known Democratic presidential contender confessed to orchestrating a robocall impersonating President Joe Biden. Crafted using AI technology, the call, conceived by an aide to Congressman Dean Phillips of Minnesota, mimicked Biden’s voice, urging individuals not to participate in the New Hampshire primary held in January.
This incident triggered concern among experts, who anticipate a surge of AI-powered deepfake disinformation campaigns during the 2024 White House race and other pivotal elections worldwide this year. In response to these apprehensions, OpenAI stated that partners involved in testing the Voice Engine tool have agreed to adhere to specific guidelines.
People Also Read: EU Begins Investigating Meta, Apple and Google Under New Tech Law
These guidelines include obtaining explicit and informed consent from individuals whose voices are replicated using the technology. Furthermore, OpenAI emphasized the necessity of transparently informing audiences when they are listening to AI-generated voices. “We have implemented a set of safety measures, including watermarking to trace the origin of any audio generated by Voice Engine, as well as proactive monitoring of how it’s being used,” OpenAI said.