OpenAI’s Chief Technology Officer, Mira Murati, has sparked discussions surrounding the company’s upcoming video generator, Sora, specifically on its capacity to generate nudity and the ethical implications thereof. As sophisticated AI capabilities continue to advance, OpenAI is not yet ruling out the inclusion of nudity in its Sora video generator. Murati’s recent interview with The Wall Street Journal reveals that OpenAI is actively engaging with artists and creators to discern the appropriate scope and limitations of such sensitive content within its technology.
This dialogue comes amid growing concerns over the misuse of AI for generating deepfake pornography and non-consensual nudes, as evidenced by incidents like the AI-generated pornographic images of Taylor Swift and the arrests of Florida middle schoolers for creating deepfakes of classmates. The implications of this technology raise substantial concerns, reflected in a recent poll by the AI Policy Institute, which found overwhelming support among U.S. voters for incorporating safety guardrails to prevent AI misuse.
The conversation about Sora’s potential for nudity is nested in a larger debate about AI ethics and the responsibility of tech companies to self-regulate and protect against the harmful deployment of their technology. Daniel Colson, founder and executive director of AIPI, commented on the public’s serious perception of AI technology’s power and their lack of trust in tech companies to responsibly manage it. He also emphasized the need for proactive rather than reactive regulation, highlighting the potential for AI video generators to be exploited by cybercriminals.
OpenAI is taking precautions by testing Sora with red teamers—domain experts focused on misinformation, hateful content, and bias—and developing tools to detect misleading content, including videos generated by Sora. The company is also considering implementing watermarks and content provenance metadata to signal AI-generated media.
As Sora nears its public release, set for 2024, the intricate balance between fostering creativity and preventing abuse remains a contentious topic. While Sora currently lacks sound and is undergoing continuous improvement for errors in video generation, the anticipation of its impact on various industries, including potentially the adult film industry, is palpable.
Murati’s noncommittal stance on nudity within Sora-generated videos and the acknowledgement of pornography’s economic scale signal that OpenAI is carefully weighing the benefits and risks. The company’s partnership with Shutterstock for training data also comes into focus, with OpenAI declining to specify further details on the data sources.
In the face of these challenges, U.S. regulation has yet to catch up, with no current legislation around AI-generated deepfakes or non-consensual porn, contrary to the European Union’s Artificial Intelligence Act. As OpenAI forges ahead with Sora’s development, the looming question remains: How will the company, and the industry at large, navigate the intersection of AI advancement and ethical responsibility? The answer may set a precedent for the future of generative AI and its societal impact.
Relevant articles:
– OpenAI’s video generator Sora might allow nudity. Experts are worried
– OpenAI’s Sora will one day add audio, editing, and may allow nudity in content, TechRadar, Wed, 13 Mar 2024 19:33:46 GMT
– OpenAI Says Sora Will Launch in 2024 and Nude Videos Aren’t Off the Table, Gizmodo, Wed, 13 Mar 2024 14:10:00 GMT
– OpenAI’s Sora text-to-video AI model will be available later this year, BGR, Wed, 13 Mar 2024 20:05:00 GMT