AI speech startup ElevenLabs has reported a rising number of "voice cloning misuse cases" on its platform for creating synthetic voices.

 






AI speech startup ElevenLabs has reported a rising number of "voice cloning misuse cases" on its platform for creating synthetic voices. 

The improper use comes about a week after ElevenLabs introduced a beta version of the text-to-speech platform, which can clone existing voices and create new ones.


  • Reports traced the "misuse" to clips created by 4chan users. The clips featured fake celebrity voices making false and "homophobic, transphobic, violent, and racist" statements, according to PCMag.
  • According to Vice's Motherboard, one 4Chan post featured a cloned voice of actress Emma Watson reading Hitler's "Mein Kampf."
  • As a result, ElevenLabs said it's looking into solutions such as added account verification or manually verifying each voice cloning request. The software remains freely available as of today.
  • Piotr Dabkowski, a former Google software engineer, and Mati Staniszewski, a former Palantir deployment strategist, co-founded ElevenLabs in 2022.

Post a Comment

Previous Next

Contact Form