Over Half of Custom ChatGPT Assistants Violate OpenAI Policies, Study Finds

What happened

An international study led by Universidad Politécnica de Madrid found that 58.7% of custom ChatGPT assistants violate OpenAI's usage policies, enabling academic fraud, forming inappropriate romantic relationships, and providing sensitive cybersecurity instructions. The findings highlight significant moderation challenges and led to the removal of some offending assistants from the GPT Store.

Reported impact

Affected parties

Not publicly disclosed

Harm type

Not publicly disclosed

Scale

Not publicly disclosed

Financial impact

Not publicly disclosed

Regulatory action

Not publicly disclosed

Classification

Organization

Not publicly disclosed

AI system

Not publicly disclosed

Industry

Not publicly disclosed

Country

Not publicly disclosed

Provider

Not publicly disclosed

Incident type

Not publicly disclosed

Relevant governance controls

Governance control mapping is not available for this record.

• No controls mappedNot publicly disclosed

Control mapping is analytical. It does not state that any control would have prevented the incident.

Sources and evidence