OpenAI said it has seen its AI models being used to generate fake election content, such as social media comments, and even long-form articles aimed at influencing the upcoming US presidential election, according to a new report released Wednesday.
Cybercriminals are increasingly using AI tools, including ChatGPT, to aid in their malicious activities such as creating and debugging malware, and generating fake content for websites and social media platforms, the AI startup said.
Since the beginning of 2024, the ChatGPT-maker said it has neutralized more than 20 such attempts, including a set of ChatGPT accounts in August that were used to produce articles on topics that included the US elections.
There is increasing worry about the use of AI tools and social media sites to generate and propagate fake content related to elections, especially as the US gears for presidential polls.
According to the US Department of Homeland Security, the nation sees a growing threat from Russia, Iran, and China in attempts to influence the November 5th elections, often using AI tools to disseminate fake or divisive information.
Coinciding with a Microsoft security report in August, the ChatGPT-maker announced it had banned multiple Iranian accounts for using the chatbot to generate false content about US elections and other world events.
The company also said it had banned several accounts from Rwanda in July that were used to generate comments about the elections in that country for posting on social media site X.
None of the activities listed in the report attempting to influence global elections drew viral engagement or sustainable audiences, OpenAI added.
In January, Open AI launched several tools to fight ChatGPT generated disinformation in an effort to combat the abuse of its tech ahead of multiple world elections. At the time, it had also announced a ban on the use of ChatGPT for political campaigns.
OpenAI cemented its position as one of the world's most valuable private companies last week after a $6.6 billion funding round.
ChatGPT has 250 million weekly active users since its launch in November 2022.
Your email address will not be published. Required fields are markedmarked