Tag Cyber Security

The Double-Edged Sword: When ChatGPT is Used to Create Surveillance Tools

OpenAI has terminated the accounts of several Chinese users who were found to be using ChatGPT to develop large-scale surveillance tools. According to the company’s security report, these individuals, linked to the Chinese government, used the AI to generate plans for monitoring Western social media platforms (like Facebook, X, and YouTube) to identify political, religious, or extremist content. Other reported abuses included seeking tools to track the movements of ethnic minorities and identifying government critics. The incident highlights the challenge of preventing powerful general-purpose AI from being misused for digital espionage and state control, a risk that OpenAI is actively combatting by enforcing its policy against misuse.