A shocking case of deepfake revenge porn has rocked social media in India, highlighting the alarming potential misuse of generative AI technology. An Instagram account, “Babydoll Archi,” amassed over a million followers with seductive photos and videos, even appearing alongside adult film star Kendra Lust.
The Unraveling Truth
The online persona, however, was entirely fabricated. The images and videos were deepfakes created using the likeness of an unsuspecting homemaker, whom we’ll call Sanchi, from Dibrugarh, Assam. Her ex-boyfriend, Pratim Bora, a self-taught AI enthusiast, allegedly used her private photos and AI tools like ChatGPT and Dzine to orchestrate this elaborate scheme.
A Calculated Act of Revenge
Police investigations reveal that Bora, driven by a desire for revenge after a falling out with Sanchi, meticulously crafted the fake profile. Starting in 2020, he initially morphed existing photos of Sanchi before transitioning to fully AI-generated content. The account gained significant traction from April 2023, leading to media reports speculating about Babydoll Archi’s potential entry into the porn industry.
The Impact and Investigation
Sanchi, who is not on social media, was unaware of the account until the mainstream media began profiling her fabricated alter ego. The revelation caused her significant distress, and she is now receiving counseling with her family. Police arrested Bora, seizing his devices and bank documents. They believe he earned around 1 million rupees (approximately $12,000 USD) from the account, with 300,000 rupees earned in just the five days before his arrest.
Legal Ramifications and Broader Concerns
Bora faces charges of sexual harassment, distribution of obscene material, defamation, forgery, and cybercrime, potentially leading to a 10-year prison sentence. This case raises serious questions about the ethical implications of AI technology and the need for stronger safeguards against misuse. While existing laws cover aspects of this crime, experts debate whether new legislation specifically targeting generative AI is necessary.
The Future of Deepfakes and Online Safety
- The incident highlights the growing threat of deepfakes and their potential for malicious use.
- It underscores the need for greater awareness and education regarding online safety and privacy.
- The case calls for a broader discussion on the regulation and responsible development of generative AI technologies.
Conclusion
The Babydoll Archi case serves as a stark reminder of the potential dangers lurking in the digital age. As AI technology becomes increasingly sophisticated, the lines between reality and fabrication blur, making it crucial to develop strategies to combat malicious deepfake usage and protect individuals from online exploitation.
#deepfakes #AIethics #onlinesafety