Chapter 2: AI & Human Rights
AI & Human Rights
AI deepfakes have raised growing concerns about their potential impact on human rights, particularly in areas such as privacy, reputation, safety, and freedom of expression. Because synthetic media can realistically imitate a person’s face or voice without their consent, individuals may become targets of harassment, identity misuse, or reputational damage.
One of the most widely documented harms is the creation of non-consensual deepfake pornography, which disproportionately targets women and can cause significant psychological and social harm.
United Nations Office of the High Commissioner also warn that deepfakes can be used to silence journalists, activists, or political opponents by fabricating compromising content or spreading disinformation about them. These risks highlight how emerging AI technologies intersect with fundamental rights, including the rights to dignity, privacy, and protection from defamation.
Privacy & Non-Consensual Sexual Exploitation
One of the most widely documented human rights concerns related to deepfakes is the creation of non-consensual sexual imagery. Deepfake technology can digitally place a person’s face onto explicit material without their consent, violating privacy and personal dignity. Research shows that the overwhelming majority of deepfake pornography targets women.
A 2019 analysis by the AI company Sensity found that about 96% of deepfake videos online were non-consensual pornography, almost all involving female victims. Victims often experience harassment, reputational damage, and psychological harm, while removal of the content can be extremely difficult once it spreads online.
Human rights advocates argue that these harms intersect with rights to privacy, safety, and protection from gender-based violence in digital spaces
Case study: 2023 AI-Generation of Fake Images
A widely discussed example occurred in January 2024, when explicit AI-generated deepfake images of Taylor Swiftspread rapidly on social media platforms such as X (formerly Twitter) and 4chan. One of the posts containing the images reportedly received over 47 million views before it was removed, demonstrating how quickly synthetic media can circulate online. The incident sparked global outrage, prompted temporary restrictions on searches for Swift’s name on X, and led to calls from policymakers and advocacy groups for stronger regulations against non-consensual deepfake pornography. The controversy highlighted how generative AI tools can be used to violate privacy and dignity at a massive scale, even when the content is entirely fabricated.
-
Our downloads have everything you need to supplement this course.