SECURITYMALWAREBYTES LABS
ChatGPT produced graphic violent images that shocked researchers
A British AI security firm, Mindgard, discovered a method to manipulate ChatGPT into generating graphic violent and sexual imagery by altering prompts. The technique bypassed ChatGPT's safety filters, producing disturbing content like images of dead women, despite OpenAI's stated safeguards. Other AI models, such as xAI’s Grok, also face similar vulnerabilities, with reports of explicit imagery generation.
Mentioned
Related Signal
Adjacent reporting
- ChatGPT can be made to generate sexualised and violent images, researchers find
- Anthropic says ‘evil’ portrayals of AI were responsible for Claude’s blackmail attempts
- AI deepfakes of dozens of Canadian women in violent and sexual images shared online
- Warning after British girls are duped into sharing explicit pics then blackmailed into carrying out 'extreme' degrading abuse on camera by 'sexual sadist'