A man in China has been arrested for allegedly generating fake news of a train crash and disseminating it online using artificial intelligence technology to “concoct information” and post it on multiple accounts. The case has been reported to be China’s first arrest for misuse of ChatGPT, a popular AI language model.
In this article, we will take a closer look at the incident and its implications. We will discuss the details of the case and how the suspect was caught, as well as the charges he is facing. We will also examine the impact of the incident on the development and use of AI technology in China.
Details of the Case
The suspect surnamed Hong, was detained by police in northwestern Gansu province for “using artificial intelligence technology to concoct false and untrue information”. Hong was accused of using ChatGPT to generate fake news of a train accident that claimed the lives of nine people. The fake news was posted on multiple accounts on Baijiahao, a blog-style platform run by Chinese search engine giant Baidu.
The fake news article had received more than 15,000 clicks by the time it came to authorities’ attention. The cyber division of a county police bureau in Kongtong County spotted the article and alerted the authorities.
The police said they traced the origins of the article to a company owned by the suspect Hong, which operated personal media platforms registered in Shenzhen in Guangdong province in southern China. They then searched Hong’s home and computer and detained him.
How the Suspect Generated Fake News
According to the police statement, Hong confessed to bypassing Baijiahao’s duplication check function to publish on multiple accounts he had acquired. He input the elements of trending social stories in China from past years into ChatGPT to quickly produce different versions of the same fake story and uploaded them to his Baijiahao accounts.
Implications of the Incident
The incident has raised concerns about the misuse of AI technology and the need for regulation. China has been experimenting with its versions of ChatGPT after Microsoft and Google announced their innovations. However, the Chinese government closely monitors its social media through firewalls, especially Sina Weibo, which has over 592 million users to ensure no critical content against the ruling Communist Party of China (CPC).
China’s top internet regulator has long voiced concern that unchecked development and use of deep synthesis technology could lead to its use in criminal activities such as online scams or defamation. As ChatGPT has gone viral in recent months, China’s law enforcement agencies have repeatedly voiced suspicion, and even warnings, about the technology.
The suspect Hong was charged with the crime of “picking quarrels and provoking trouble”, which carries a maximum sentence of five years. Offenders can be jailed for 10 years and given additional penalties in cases that are deemed especially severe. This is the first time the public has been made aware of an arrest by Chinese authorities after Beijing’s first provisions to regulate the use of “deep fake” technology officially took effect in January.
Conclusion
The arrest of the suspect in China for misusing ChatGPT to generate fake news of a train crash highlights the need for regulation of AI technology. The incident has raised concerns about the misuse of AI and its potential to be used for criminal activities such as online scams or defamation. As AI technology continues to develop, it is essential to establish clear regulations to prevent its misuse and ensure its responsible use.
