Civitai and the Rise of Deepfake Exploitation

Civitai, an online marketplace for AI-generated content, has become a hub for the creation and distribution of deepfakes, particularly those targeting women. Research from Stanford and Indiana University highlights that a staggering 90% of user requests for custom AI instruction files, known as LoRAs, are aimed at producing deepfake content of women. This alarming trend raises significant concerns about privacy and the potential for harassment, as these deepfakes can be used to manipulate images and videos for malicious purposes. Despite the growing awareness of these risks, Civitai continues to operate without stringent regulations or safeguards, leaving many vulnerable to exploitation. As the marketplace expands, the implications of deepfake technology on societal norms and individual rights remain profound and troubling.