doption of the new artificial intelligence, generative AI and machine learning based technologies is not only making human lives easier, it is also posing some serious threats.

The threat actors have already started adopting these new technologies to cheat the people at large. In February 2024, fraud amounting to $25 million was reported by Hong Kong police. The fraudsters using the new AI, Gen AI and ML based sophisticated developed deep-fakes of the CFO of a company. This is so far the largest amount reported to have been stolen using a deep-fake.

Deep-fake tools and services are available on the dark-net marketplace. Some creators of the Gen AI are willing to sell a one-minute deep-fake video to a client for as little as $300. These services offer generative AI video creation for a variety of purposes, including fraud, blackmail and theft of confidential data.

In its Global Risk Report of January 2024, the World Economic Forum has warned that the Gen AI based misinformation and disinformation will be a great challenge for the world over the next two years, especially in elections in India, Pakistan, US and UK.

Pakistanis have recently experienced the Gen AI based video messages of former primer Imran Khan who is in jail. In some cases, such Gen AI based videos are identified by the public. However, most of the time people are unable to differentiate a deep-fake video from a genuine one.

A recent Kaspersky Business Digitisation Survey disclosed that only 25 percent of the corporate employees in the META region can distinguish a real image from an AI-generated one. The report mentioned that deep-fakes are a threat not only to businesses, but also to individual users. Both individual and corporate security concerns are increasing with the widespread growth of deep-fakes and their availability at dark-net.

The report says that the cybercriminals can create a fake video of a CEO requesting a wire transfer or authorising a payment, which can be used to steal corporate funds. Compromising videos or images of individuals can be created, which can be used to extort money or information from them.

Only 25 percent of the corporate employees can distinguish a real image from an AI-generated one. Deep-fakes are a threat not only to businesses, but also to individual users.

Technical group manager at Kaspersky Hafeez Rehman says that deep-fakes are not widely available so far. “One of its most likely use will be to generate voices in real-time to impersonate someone. However, it’s important to remember that deep-fakes are a threat not only to businesses, but also to individual users. They spread misinformation which is used for scams, or to impersonate someone without consent. These are a growing cyber threat in the modern world and everyone needs to be protected from them.”

Arslan Bokhari, a cyber security expert, says that most of the time data-thieves, malware and deep-fakes creators work together. “These malwares steal data from individuals or company officials; Gen AI based deep-fakes are created by using the stolen data. They work in close liaisons and perform the assigned tasks. Since, everyone is expert in their respective areas in the dark-net groups they develop deep-fake products that cannot be identified by commoners.”

Bokhari suggests that people and businesses should be aware of the key characteristics of deep-fake videos. “The companies should also strengthen the human firewall by ensuring their employees understand what they see.”

He adds that the situation is so alarming that Google in its recent Term of Services updates has mentioned that it will not claim ownership over original content generated by Google AI-powered services. “So, the threat is serious. We should be cautious in the digital world,” he says.

Zohaib Khan, the Pakistan Software Houses Association chairman, has pointed out that some Pakistanis are doing excellent work in AI and Gen AI. “However, the opportunities in the local markets are limited. Pakistanis are mainly exporting the Gen AI products.”

He says that the UAE has a designated minister of AI while Saudi Arabia has recently announced $40 billion investment plans in the AI. “This is a huge market. Pakistani developers should plan to get maximum advantage from it.”

Khan says globally Gen AI is developing fast and many people are getting training in this field. “The government of Pakistan should also focus on AI and Gen AI training. It is not simple programming and traditional IT languages certificates. Strong physics, math and data analytics aptitude is required for AI. Once Pakistani developers are trained, they will be able to get advantage in the global forums. Availability of the data is the basic requirements for AI and Gen AI. Fortunately, in Pakistan such data is available at almost all levels. AI and Gen AI based decisions to increase the efficiency and efficacy of the working process.” He says that policies and regulations should be introduced to regulate this emerging technology.

The writer is a staff reporter at The News. He tweets @Jawwadrizvi