AI speech startup ElevenLabs has reported a rising number of "voice cloning misuse cases" on its platform for creating synthetic voices.
The improper use comes about a week after ElevenLabs introduced a beta version of the text-to-speech platform, which can clone existing voices and create new ones.
- Reports traced the "misuse" to clips created by 4chan users. The clips featured fake celebrity voices making false and "homophobic, transphobic, violent, and racist" statements, according to PCMag.
- According to Vice's Motherboard, one 4Chan post featured a cloned voice of actress Emma Watson reading Hitler's "Mein Kampf."
- As a result, ElevenLabs said it's looking into solutions such as added account verification or manually verifying each voice cloning request. The software remains freely available as of today.
- Piotr Dabkowski, a former Google software engineer, and Mati Staniszewski, a former Palantir deployment strategist, co-founded ElevenLabs in 2022.