
随着各行各业加快应用AI技术,网络黑客们也把这项技术当成了作恶的利器。
有行业专家表示,面对自动化的网络袭击和AI诈骗等新型威胁,企业有必要思考如何强化自身安全防线。除了技术反制以外,企业还应该考虑一系列其他手段,比如优化软件补丁的部署模式,以及重新设计人的因素在网络安全上能够发挥的作用。
雪花公司首席安全与信任官马扬克·乌帕德亚伊在接受《财富》采访时表示:“所有人都面临着一场即将到来的战争。”他表示,一家企业有很多地方容易成为网络袭击的突破口,比如企业的网络、办公电脑、云平台和登录系统等等,它们每时每刻都会产生海量数据。仅凭人工团队根本无法完成威胁甄别工作,必须借助AI的力量。
长久以来,绝大多数企业都是按照固定程序管控网络安全风险的。安全团队排查出软件漏洞后,服务商会将修复程序整合进定期更新包,企业再择机安装补丁。这些操作的间隔通常以周、月甚至季度为单位。这种批次处理、滞后处理的模式之所以会存在,有部分原因在于,企业的一些核心系统必须要离线升级,而一些补丁程序本身也有故障隐患。
但是现在,市面上的一些AI系统已经可以做到大面积扫描代码,自动针对漏洞生成攻击程序,甚至能直接利用这些程序侵入企业网络、窃取数据或操控系统。借助AI技术,黑客从发现漏洞到制作出攻击工具,往往只需要几个小时,而不像以往那样需要几天或者几周。这就意味着传统的安全补丁模式已经过时。
因此,行业领袖和专家们认为,唯一的办法就是以AI对抗AI。
“我们除了用AI别无选择,因为数据量太大了。”乌帕德亚伊说:“当黑客用AI进行攻击时,再多的安全人员也难以招架。”
Anthropic公司全新推出的Mythos模型,就是AI时代的一个网络安全利器,它目前仅对部分公司开放。据亚马逊首席安全官史蒂夫?施密特向《财富》介绍,Mythos模型不仅能修复单个程序漏洞,还能从根源上堵住系统中长期潜藏的同类安全隐患。
他表示:“我们看到的情况表明,我们用AI构建的安全防线,要比黑客的AI攻击工具更有效。从Mythos模型的经验看,防御方掌握了明显优势。”
他同时表示,这套模型离不开资深工程师的配合。即便是再先进的智能系统,如果脱离人工管控独立运行,也会产生大量误报预警,久而久之,技术人员便会失去对系统预警的信任。
在企业安全上,我们已进入全新时期
当前,网络攻击背后的经济逻辑也在发生转变。以前,定制化的高级攻击只会瞄准高价值目标,而中小企业由于知名度不高,往往不是攻击的目标。不过RSA大会执行主席休·汤普森指出,AI已经彻底改写了这一逻辑,现在定制攻击的技术门槛和实施成本已经大幅降低,如今几乎任何企业都有可能成为攻击目标。
“黑客借助AI工具可以同时向海量目标发起攻击,而人们的安全认知也必须随之彻底转变。”他说。
目前,人们的关注重点往往放在AI如何利用技术漏洞实施攻击,却甚少提及社交层面的网络攻击带来的风险。这类攻击主要通过心理操控,来让人泄露数据和开放权限。
社交层面攻击的形式多种多样,有仿冒同事行文风格的钓鱼邮件,有伪装成IT运维人员或合作方的语音诈骗,有冒充企业高管骗取转账权限的商务邮件诈骗,现在更是出现了AI换脸换声诈骗,骗子可以精准假冒成别人,对你进行诈骗。比如曾有一起著名案件,不法分子利用AI技术复刻了企业财务负责人的声音和面部,通过视频通话对企业员工实施诈骗,致使该公司有近2500万美元的资金被转入诈骗账户。
想要防范这类新型AI风险,仅靠让员工看提前录制好的安全课程,偶尔开展钓鱼邮件测试,是远远不够的。企业不能对这种风险抱有任何侥幸,必须做好所有员工都有可能成为攻击目标的准备。
AI安全初创企业查理曼实验室的研究显示,当下市面上主流的AI模型已经能够实现多轮连贯的逼真话术欺骗,这不是单一的信息诱导,而是可以像真人一样,以来回对话的方式实现诈骗,这也是现实世界的电诈案件中最难防范的环节。有研究预判,未来12到24个月内,AI就将有能力实施全流程自动化的、高仿真的诈骗。
前Meta公司产品经理、查理曼实验室CEO杰里米?菲利普?盖伦表示:“大多数AI从业者关注的都是如何从技术上实施网络攻击,而在现实生活中,电诈仍是主要犯罪形式,却一直没能得到足够重视。”
为此,盖伦的团队研发了一套名为“查理”的系统。该系统依托AI技术实时监测各类信息,能够及时向用户发出风险预警,如同一个全天候的诈骗过滤器。
他表示:“单纯依靠人员培训是不够的,因为你永远无法教会所有人防范所有威胁。可以说我们在企业安全的问题上,已经进入了一个全新的时期。”
现在,雪花公司的安全团队每天都会开展应急演练,应用安全、云平台、IT和安全运维等部门的人员都会参加,目的就是打破部门壁垒,跟上人工智能时代的网络攻击速度。他们提出了一个“AI速度”的口号,就是跟攻击者使用相同的AI工具,但是要攻击者之前找出隐患、解决问题。
乌帕德亚伊建议,企业应搭建一套由AI驱动的四步安全运维体系:一是部署安全防御措施,二是实时监测入侵行为,三是处置和清除入侵的程序或漏洞,四是增设新的安全管控机制,杜绝同类隐患再次被利用。
“将整套安全运维流程自动化,以AI抗衡AI,这是当下所有企业都急需推进的事。”他说。(财富中文网)
译者:朴成奎
随着各行各业加快应用AI技术,网络黑客们也把这项技术当成了作恶的利器。
有行业专家表示,面对自动化的网络袭击和AI诈骗等新型威胁,企业有必要思考如何强化自身安全防线。除了技术反制以外,企业还应该考虑一系列其他手段,比如优化软件补丁的部署模式,以及重新设计人的因素在网络安全上能够发挥的作用。
雪花公司首席安全与信任官马扬克·乌帕德亚伊在接受《财富》采访时表示:“所有人都面临着一场即将到来的战争。”他表示,一家企业有很多地方容易成为网络袭击的突破口,比如企业的网络、办公电脑、云平台和登录系统等等,它们每时每刻都会产生海量数据。仅凭人工团队根本无法完成威胁甄别工作,必须借助AI的力量。
长久以来,绝大多数企业都是按照固定程序管控网络安全风险的。安全团队排查出软件漏洞后,服务商会将修复程序整合进定期更新包,企业再择机安装补丁。这些操作的间隔通常以周、月甚至季度为单位。这种批次处理、滞后处理的模式之所以会存在,有部分原因在于,企业的一些核心系统必须要离线升级,而一些补丁程序本身也有故障隐患。
但是现在,市面上的一些AI系统已经可以做到大面积扫描代码,自动针对漏洞生成攻击程序,甚至能直接利用这些程序侵入企业网络、窃取数据或操控系统。借助AI技术,黑客从发现漏洞到制作出攻击工具,往往只需要几个小时,而不像以往那样需要几天或者几周。这就意味着传统的安全补丁模式已经过时。
因此,行业领袖和专家们认为,唯一的办法就是以AI对抗AI。
“我们除了用AI别无选择,因为数据量太大了。”乌帕德亚伊说:“当黑客用AI进行攻击时,再多的安全人员也难以招架。”
Anthropic公司全新推出的Mythos模型,就是AI时代的一个网络安全利器,它目前仅对部分公司开放。据亚马逊首席安全官史蒂夫?施密特向《财富》介绍,Mythos模型不仅能修复单个程序漏洞,还能从根源上堵住系统中长期潜藏的同类安全隐患。
他表示:“我们看到的情况表明,我们用AI构建的安全防线,要比黑客的AI攻击工具更有效。从Mythos模型的经验看,防御方掌握了明显优势。”
他同时表示,这套模型离不开资深工程师的配合。即便是再先进的智能系统,如果脱离人工管控独立运行,也会产生大量误报预警,久而久之,技术人员便会失去对系统预警的信任。
在企业安全上,我们已进入全新时期
当前,网络攻击背后的经济逻辑也在发生转变。以前,定制化的高级攻击只会瞄准高价值目标,而中小企业由于知名度不高,往往不是攻击的目标。不过RSA大会执行主席休·汤普森指出,AI已经彻底改写了这一逻辑,现在定制攻击的技术门槛和实施成本已经大幅降低,如今几乎任何企业都有可能成为攻击目标。
“黑客借助AI工具可以同时向海量目标发起攻击,而人们的安全认知也必须随之彻底转变。”他说。
目前,人们的关注重点往往放在AI如何利用技术漏洞实施攻击,却甚少提及社交层面的网络攻击带来的风险。这类攻击主要通过心理操控,来让人泄露数据和开放权限。
社交层面攻击的形式多种多样,有仿冒同事行文风格的钓鱼邮件,有伪装成IT运维人员或合作方的语音诈骗,有冒充企业高管骗取转账权限的商务邮件诈骗,现在更是出现了AI换脸换声诈骗,骗子可以精准假冒成别人,对你进行诈骗。比如曾有一起著名案件,不法分子利用AI技术复刻了企业财务负责人的声音和面部,通过视频通话对企业员工实施诈骗,致使该公司有近2500万美元的资金被转入诈骗账户。
想要防范这类新型AI风险,仅靠让员工看提前录制好的安全课程,偶尔开展钓鱼邮件测试,是远远不够的。企业不能对这种风险抱有任何侥幸,必须做好所有员工都有可能成为攻击目标的准备。
AI安全初创企业查理曼实验室的研究显示,当下市面上主流的AI模型已经能够实现多轮连贯的逼真话术欺骗,这不是单一的信息诱导,而是可以像真人一样,以来回对话的方式实现诈骗,这也是现实世界的电诈案件中最难防范的环节。有研究预判,未来12到24个月内,AI就将有能力实施全流程自动化的、高仿真的诈骗。
前Meta公司产品经理、查理曼实验室CEO杰里米?菲利普?盖伦表示:“大多数AI从业者关注的都是如何从技术上实施网络攻击,而在现实生活中,电诈仍是主要犯罪形式,却一直没能得到足够重视。”
为此,盖伦的团队研发了一套名为“查理”的系统。该系统依托AI技术实时监测各类信息,能够及时向用户发出风险预警,如同一个全天候的诈骗过滤器。
他表示:“单纯依靠人员培训是不够的,因为你永远无法教会所有人防范所有威胁。可以说我们在企业安全的问题上,已经进入了一个全新的时期。”
现在,雪花公司的安全团队每天都会开展应急演练,应用安全、云平台、IT和安全运维等部门的人员都会参加,目的就是打破部门壁垒,跟上人工智能时代的网络攻击速度。他们提出了一个“AI速度”的口号,就是跟攻击者使用相同的AI工具,但是要攻击者之前找出隐患、解决问题。
乌帕德亚伊建议,企业应搭建一套由AI驱动的四步安全运维体系:一是部署安全防御措施,二是实时监测入侵行为,三是处置和清除入侵的程序或漏洞,四是增设新的安全管控机制,杜绝同类隐患再次被利用。
“将整套安全运维流程自动化,以AI抗衡AI,这是当下所有企业都急需推进的事。”他说。(财富中文网)
译者:朴成奎
As companies rush to adopt AI across their operations, attackers are exploiting the same technology against them.
From automated hacking to AI powered scams, the new threats are forcing companies to rethink their broader approach to security. Beyond hardening technical defenses, companies operating in the AI age need to examine a wide range of practices, say industry experts, updating the way software patches are deployed and rebuilding the human layer of security.
“Everybody needs to be on a war footing right now,” Mayank Upadhyay, chief security and trust officer at Snowflake, told Fortune. The attack surface across a typical enterprise—network, laptops, cloud infrastructure, logins—is now generating so much data that human teams can’t hope to triage without help from AI, he said.
For years, most organizations managed cyber risk on a predictable schedule. Security teams would discover flaws in their software, vendors would bundle fixes into periodic updates, and companies would decide when to install those patches—often weekly, monthly, or even quarterly. That slower, batch style approach existed, in part, because updating critical systems can mean taking them offline, and there is always a risk that a new patch breaks something important.
Now, widely accessible AI systems can scan codebases at scale, automatically generate exploits for the vulnerabilities they find, and in some cases deploy those exploits to infiltrate networks and steal data or take control of systems. This AI accelerated vulnerability discovery allows threats to be identified and weaponized in hours rather than days or weeks, outpacing the traditional patching cycle.
Experts and industry leaders say the answer is to fight AI with AI.
“You have to use AI. It’s not even a choice, because there’s just so much data,” said Upadhyay. “If you’re being attacked by AI, there’s not enough security specialists you can put in place to fight that.”
Anthropic’s new Mythos model, although currently available only to select companies, is a prime example of the critical role AI can play as a defensive tool. Steve Schmidt, Amazon’s chief security officer, told Fortune that Mythos not only helps to patch individual bugs but also helps to permanently close whole classes of weaknesses that have been lurking in their systems.
“Everything we’ve seen has shown that we are far more effective using AI as defenders than adversaries are using it for attacks,” he said. “The experience we have with…the Mythos model is that it is a significant advantage to the defender.”
However, he said, the model only really performs when it’s paired with experienced engineers, adding that left to run on its own, even the most advanced systems throw off so many false alarms that developers eventually stop trusting what they see.
A new era of workforce risk
The economics of attacks are shifting too. Sophisticated, tailored intrusions used to be reserved for high-value targets; small and midsize companies could rely on relative obscurity. AI changes that calculus, lowering the cost and skill required to launch a customized attack against almost any organization, said Hugh Thompson, executive chairman of the RSA Conference.
“The fact that these tools can go after so many potential victims at once is a game changer in mindset,” he said.
And while a lot of attention has been given to AI models’ ability to exploit technical vulnerabilities, there’s been less conversation about the risks around social engineering—using psychology to manipulate people into giving attackers data or access.
Social engineering attacks utilize things like phishing emails crafted to mimic a colleague’s writing style; vishing—voice calls impersonating IT support or a vendor; business email compromise, in which an attacker poses as a senior executive to authorize a fraudulent wire transfer; and increasingly, deepfake audio or video calls designed to convincingly replicate a real person. In one high profile case, criminals used an AI generated video and voice clone of a company’s finance chief on a live video call to trick an employee into wiring roughly $25 million to fraudulent accounts.
Preparing workers for these AI risks requires more than prerecorded training videos or the occasional phishing email test. And instead of thinking about the risk of one or two employees being targeted by a sophisticated phishing attack, companies need to be prepared for all employees to be regularly targeted.
According to research from Charlemagne Labs, an AI-security startup, AI models already widely available can now sustain believable, multi-turn deception—conversations that span many back-and-forth exchanges rather than a single message—which is the hardest part of real-world scams. AI models, the research found, may enable convincing, automated end-to-end scams within 12 to 24 months.
“Because most AI researchers are more familiar with technical hacking and exploits, we believe social engineering—still the attack genesis for the vast majority of attacks—has gotten too little attention,” says Jeremy Philip Galen, a former Meta product manager and CEO of Charlemagne Labs.
One way that Galen’s startup is trying to address this is with a system named Charley that uses AI to monitor incoming messages and warn users about likely scams, acting as a kind of always on scam filter in the background.
“You can’t really train people, and that’s scary. You can’t teach people to identify threats, which means we’re entering a new era of workforce risk,” he said.
Snowflake’s Upadhyay says his team is already running daily “war room” exercises that bring together application security, cloud infrastructure, IT, and security operations teams. The aim is to remove silos so they’re prepared to react at “AI speed,” using the same AI powered tools as they test their defenses and find gaps before attackers do.
Upadhyay says teams should be establishing what is a four-step cycle powered by AI: Set up defenses, monitor them for breaches, contain and clean up any attacks or vulnerabilities that break through, and then build new controls so the same weakness can’t be exploited again.
“Just automating that entire life cycle—it’s using AI to fight AI. This is the thing that everybody should be rushing to do at this moment,” he said.