Gettyimagebank

Researchers at University College London, four years ago, evaluated deepfake technology as "the most dangerous AI-based crime that could occur over the next 15 years."

This assessment was the result of a discussion among 31 experts from academia and law enforcement, who evaluated 18 types of crimes based on factors like potential harm and feasibility. Deepfake technology emerged amidst concerns about its potential misuse in serious crimes.

Deepfake crimes, which can create "realistic fakes" in just a few minutes using artificial intelligence, are also on the rise domestically. Deepfakes are not only used in highly controversial sex crimes but also in spreading fake information or impersonating celebrities to commit fraud.

Experts argue that while regulating the technology itself is impossible, the time has come to adopt alternatives such as strengthening international cooperation.

A video featuring President Yoon Suk Yeol created with deepfake technology / Captured from TikTok

Misuse of faces of celebrities and ordinary people

In February, a 46-second video appeared showing President Yoon Suk Yeol saying, "I am the person who has enforced laws that harass the people."

This is one of the most notable examples of deepfake videos targeting politicians in South Korea. Two months later, a man in his 50s who created and distributed the video on social media was arrested for defamation under the Information and Communications Network Act.

The use of deepfakes to influence elections is also increasing. According to data obtained by Democratic Party of Korea Rep. Han Byung-do from the National Election Commission (NEC), there were 388 illegal election campaign posts using deepfakes reported during the campaign period for the general elections on April 10.

Of these, 97 (25 percent) were not removed despite the NEC's requests. The total number of online violations of the Public Official Election Act also increased significantly, reaching 74,172 cases compared to 1,793 in the 2012 general elections.

Celebrities, who are frequently in front of cameras, are also often targeted for such crimes. Last year, a fraud group created deepfake videos of actors Jo In-sung and Song Hye-kyo encouraging investments, luring victims into scams.

In February this year, a case in Hong Kong involved the use of a deepfake of an ordinary person's face. According to CNN, an employee of a multinational corporation transferred approximately $25 million after receiving a request from someone they believed to be the chief financial officer.

The employee initially suspected the email but relaxed their suspicions upon seeing familiar faces during a video conference with other colleagues. However, the entire video was a deepfake.

A poster warns that Illegal deepfake videos are subject to severe punishment. Korea Times file

Difficult to curb technological advancements

It is challenging to halt the rapid advancement of deepfake technology itself, as an environment where anyone can easily create and distribute such content is already in place.

Kim Min-ho, a professor at Sungkyunkwan University Law School, said, "Deepfakes have existed for several years, but they became a social issue once non-experts could create them easily without cost. Illegal activities should be monitored and cracked down on through distribution networks like Telegram."

There is also a growing opinion that people need to be educated on the fact that deepfakes are not merely for fun but can be a serious crime.

Crimes involving deepfakes that have already occurred must be strictly monitored through international cooperation.

"Deepfakes can spread a climate of distrust in our society, potentially even leading to a crisis of democracy," said Lim Jong-in, a professor emeritus at Korea University's Graduate School of Information Security. "International cooperation is essential, much like how the global community addresses drug crimes."

This article from the Hankook Ilbo, a sister publication of The Korea Times, is translated by a generative AI and edited by The Korea Times.