What Is AI Voice Cloning? How It Works and the Consent Problem

Updated · By Viviai

AI voice cloning creates a synthetic voice that sounds like a specific person, using a sample of their speech. The technology is powerful, but using someone's voice without consent raises serious ethical and often legal problems.

The short answer

A model learns the characteristics of a voice from audio samples and then generates new speech the person never actually said.

How it works in plain terms

  1. Audio samples of the target voice are collected.
  2. The model learns pitch, tone, rhythm, and pronunciation.
  3. A text script is converted into speech in that voice.
  4. The result can be edited for emotion and pacing.

Legitimate uses

A cloned voice can be used to:

The person whose voice is used should generally give informed consent, and the terms of use should be clear.

How to protect yourself

Key takeaways

Read next: what speech-to-text is and how to detect deepfakes.

Sources

  1. https://www.gartner.co.jp/ja/articles/ai-agents

Learn by doing

Read a guide, then practice with bite-sized AI lessons you can take offline.

Start learning free