Deepfake videos and AI-generated voices have become so realistic that cybersecurity experts are changing their advice. Instead of teaching people how to spot fake videos, they are urging them to recognize the warning signs of scams.
The message emerged during a round-table discussion with key opinion leaders across Southeast Asia (SEA) and executives of ManageEngine on the sidelines of the ManageEngine Southeast Asia User Conference held recently in Jakarta. The discussion explored how artificial intelligence (AI) is making online fraud more convincing and what governments, businesses, and consumers can do to stay protected.
Panelists shared examples of criminals using AI to create fake identities, voices, and videos to impersonate real people. In one case discussed, AI-generated content was allegedly used to apply for financial services using another person’s identity. As AI tools become easier to access, experts warned that these scams are becoming more sophisticated and harder to detect.
The panel agreed that while some AI-generated videos still contain obvious flaws, professionally made deepfakes are now difficult to distinguish from real ones. Detection tools are struggling to keep up as the technology improves, making it harder for people to rely on visual clues alone.
Instead, experts said people should focus on how scammers behave rather than whether a video or voice recording looks or sounds real.
Common warning signs include messages that create a sense of panic or urgency, requests for one-time passwords (OTPs), bank account details, or other personal information, and instructions to install unfamiliar apps. These tactics remain consistent even as the technology behind the scams becomes more advanced.
The discussion also highlighted that people, not technology, continue to be the weakest link in cybersecurity. Many organizations already have security systems, backup procedures, and industry standards in place, but attacks still succeed because employees and consumers are caught off guard by increasingly convincing scams.
ManageEngine CEO Rajesh Ganesan said cybersecurity has become a boardroom issue as organizations place greater importance on protecting their digital operations. However, many businesses are still working on the basics, such as understanding what digital assets they have, keeping systems updated, and strengthening security practices before tackling more advanced AI threats.
Participants also called for closer cooperation between governments and the private sector. While some Southeast Asian countries have started introducing AI and cybersecurity regulations, others are still developing policies to address deepfakes and AI-powered fraud. They noted that cybercriminals can easily operate across borders, making regional collaboration increasingly important.
The panel concluded that as AI evolves faster than tools designed to detect it, awareness is becoming the best defense. Instead of trying to determine whether a video is fake, people should pause and question unexpected requests, verify messages through trusted channels, and recognize the common tactics scammers use to pressure victims into making quick decisions.