Chapter ADeepfakes and synthetic mediaPage 4 of 8

Deepfakes and synthetic media

Consent and impersonation harms

The central harm is often not that media is artificial, but that someone’s identity, dignity, or authority is used without meaningful permission.

~14 minHuman impact

Before you start

Why this matters

A nonprofit asks a volunteer to record several sentences for an accessibility project. Months later, the volunteer hears their synthetic voice in a fundraising advertisement they never reviewed. The advertisement is clearly labeled “AI-generated,” so viewers are unlikely to mistake it for a raw recording. Is disclosure enough?

No. Disclosure helps the audience understand the artifact, but it does not answer whether the speaker agreed to that purpose. The nonprofit obtained recordings for one project and reused the person’s identity for another. Transparency to viewers and consent from the represented person solve different problems.

1Learn the idea

Read

Likeness is more than a face

Identity can be conveyed through a face, voice, body, name, mannerisms, clothing, location, or a combination of clues. A generated character that does not exactly copy one photograph may still be recognizable as a particular person.

This is important for impersonation. A scam may use a cloned voice without video. A fake account may combine a real person’s name with generated photographs. A humiliating image may imply a person’s identity through context even if facial resemblance is imperfect.

Ask whether a reasonable audience could identify the person and attribute speech, conduct, or endorsement to them. Technical claims that “the pixels are new” do not settle the human question.

Read

Categories of harm

Fraud and operational harm occur when borrowed authority prompts payments, credential disclosure, account changes, or unsafe instructions.

Reputational harm occurs when media falsely associates someone with statements, behavior, or products. Corrections may not reach everyone who saw the original.

Dignitary and sexual harm occur when a person is placed into intimate or degrading material without consent. The harm includes loss of control, humiliation, harassment, and fear, whether or not every viewer believes the media is authentic.

Privacy harm occurs when source material was collected or reused beyond expectations, or when synthetic content reveals sensitive inferences and personal context.

Opportunity harm occurs when fabricated media affects employment, education, housing, relationships, or public participation.

Collective harm can affect communities through targeted stereotypes, intimidation, or confusion about public events. People with less access to legal, technical, or media support may carry greater recovery costs.

These harms can overlap. A fake voice message may create financial loss, workplace discipline, and emotional distress at the same time.

Read

Disclosure is necessary but not magical

A prominent label can reduce audience confusion. It should appear before or during exposure, use plain language, and survive likely formats such as screenshots or clipped reposts where feasible. “Created with AI” may be too broad when viewers need to know that a real person’s voice was simulated.

Yet labeling does not authorize harmful use. A labeled fabricated endorsement still trades on someone’s identity. A labeled non-consensual intimate image remains non-consensual. A tiny footer does not cure a misleading headline.

Think of disclosure as one control alongside consent, purpose limits, access restrictions, review, complaint channels, and removal processes.

Read

Responding to a targeted person

If someone reports impersonation or non-consensual synthetic media, begin with their safety and agency. Do not demand that they repeatedly view or publicly prove the material. Preserve only the evidence needed for reporting, according to safe procedures. Avoid forwarding the content except to authorized support, platform, legal, or law-enforcement channels when appropriate.

Document URLs, account names, dates, and relevant communications. Use platform reporting routes for impersonation, privacy, harassment, or non-consensual intimate imagery. In a workplace, involve the designated security, HR, legal, or safeguarding contact rather than improvising a public confrontation.

Do not blame the targeted person for having public photographs or recordings. The misuse is the responsibility of the person or organization that created, distributed, or exploited it.

Read

Designing for lower harm

Organizations can reduce risk before publication:

  • use fictional identities when no real person is needed;
  • collect purpose-specific permission in understandable language;
  • restrict access to voice and likeness assets;
  • prohibit sensitive or deceptive uses contractually and technically;
  • require review before public release;
  • make disclosure prominent and durable;
  • provide a fast contact for correction, removal, and appeal;
  • delete source material and derived assets according to a clear schedule.

The safest asset is often the one never collected. A team that needs a generic narrator does not need to clone a customer or employee.

Checking tutor…

Continue learning · glossary & guides