With the rapid development of neural network AI technology, the accuracy of many computer vision applications has greatly improved. Since Google introduced Transformer architecture in 2017, generative AI (GenAI) applications have surged, enabling AI to create content from text prompts and inspire new creative possibilities.
However, along with its benefits, generative AI has introduced controversial applications - most notably, deepfakes. The term "deepfake" combines "deep learning" and "fake," referring to AI generated images, videos, or audio that simulate someone’s appearance or voice, creating content they never actually produced.
Deepfakes can be used responsibly in media, entertainment, and marketing. For example:
NVIDIA used deepfake technology in 2021 to generate a video segment of NVIDIA CEO Jensen Huang's speech.
Source： CNET
As Deepfakes can mislead audiences when used maliciously. In 2023, a series of AI-generated videos falsely depicted major global influencers endorsing cryptocurrency scams, misleading thousands of viewers and impacting markets.
Ukrainian YouTuber Olga Loiek exposes how she was subjected to AI face-swapping for pro-China propaganda.
Source： Olga Loiek YouTube
During the 2024 U.S. elections, deepfake videos circulated online showing candidates making statements they never actually said, including doctored footage of public figures appearing to endorse or criticize policies, creating confusion and influencing voter perception.
Former President Trump shared this image created using deepfake technology that shows mega-popstar Taylor Swift expressing support for him.
Source： TMZ
Deepfakes have been used to replace the faces of celebrities or public figures (usually women) into explicit, pornographic videos. This not only can create severe damage to the victim’s reputation but can also lead to significant psychological trauma. The UK combats this issue with a law that makes the creation of nonconsensual sexually explicit deepfake images a criminal offense punishable with fines and possible jail time.
Additionally, deepfake technology has been used in commercial fraud. In one significant fraud case in early 2024, deepfake technology was used to generate fake video conferences, simulating the voices and appearance of company executives. A duped employee thought they were participating in a video conference with the company's CFO, when in reality, the video and audio were deepfakes generated in real-time. Believing the meeting to be real, the employee was tricked into transferring $25 million USD.
Although face-swapping, video editing, and post-production techniques have existed for a long time, deepfake technology has taken these operations to a new level, making it difficult for the human eye to discern between what is real and what is fake, and even allowing for real-time generation of false content. Because deepfake tools can be easily downloaded and used from the internet, their potential harm is nearly impossible to measure.
The European Union's Artificial Intelligence Act EU AI Act: Requires AI-generated content to carry digital watermarks and clear AI-generated labeling.
United States: Laws like California AB 602/730 and Texas statutes restrict election-related and pornographic deepfakes.
Social media platforms: TikTok, Instagram, and YouTube now enforce stricter detection and labeling of AI-generated content. Taiwan Financial Supervisory Commission (FSC): With the "Core Principles and Policies for the Use of AI in the Financial Industry", banks must verify live identities in video interactions to prevent deepfake-based fraud.
eKYC (Electronic Know Your Customer) is a process of remotely verifying customer identity through online or digital technologies, helping service-providing companies to quickly and reliably verify and authenticate customer identity. eKYC technology is widely used in industries such as finance and banking, contributing to increased business efficiency and reduced operational costs.
However, during the process of remotely collecting customer facial images, deepfake technology poses potential security risks. Hackers may exploit the following methods to attack eKYC systems:
If the eKYC digital identity verification process allows customers to upload their own photos, hackers may tamper with identity documents and photos, or even use deepfake technology to create fake photos for identity impersonation. In this case, service providers find it difficult to effectively detect these forged images, not only requiring significant manpower to verify the authenticity of the data but also facing a higher risk of financial crime.
To enhance security, some eKYC processes now require users to take real-time selfies using their cameras to reduce the risk of hackers impersonation using stolen documents. However, hackers can still utilize computers or tablets to display fake facial photos or videos, or even generate corresponding dynamic videos using deepfake technology to deceive through a mobile phone camera. This type of impersonation attack is referred to as a "Presentation Attack" (PA). Although service providers can rely on real-time manual reviews to block such attacks, this undoubtedly significantly increases the workload for reviewers and poses challenges in terms of efficiency.
Finally, hackers may also infiltrate the devices running the eKYC application or website and inject streams of fake images generated by deepfake technology. This means that applications or websites executing eKYC digital identity verification may mistakenly identify these images as real individuals in a live setting, while in reality, all these images are fabricated. This type of attack has a higher technical threshold, significantly increasing the difficulty of identity impersonation, but it also makes prevention more complex. Although this attack method has not yet emerged on a large scale, financial institutions and other companies that require eKYC verification should proactively recognize these risks and take appropriate protective measures.
In the FaceMe eKYC digital identity verification process, FaceMe employs multiple strategies to effectively prevent deepfake and other potential attacks, ensuring that the results of digital identity verification are highly credible, reliable, and secure. FaceMe's solution includes:
In summary, during the eKYC authentication process, it is essential to prevent identity impersonation attacks using deepfake technology, as well as to address other forms of attacks, such as presentation attacks (PA), forged identity documents, and counterfeit facial masks. FaceMe provides a comprehensive anti-fraud solution that can withstand various identity impersonation attacks, offering reliable protection for the financial industry and all service providers that require digital identity verification.
FaceMe not only helps these institutions comply with regulatory requirements but also further ensures the high security of accounts and transactions, thereby establishing a safer and more trustworthy digital identity verification system. Choosing FaceMe means choosing reliability and security, ensuring that your business can operate steadily in the face of various identity impersonation risks.
Our comprehensive anti-spoofing solutions will provide secure protection for your digital identity verification.