Jailbroken AIs are helping cybercriminals to hone their craft


Cybercriminals are bypassing the guardrails that are supposed to keep AI models from carrying out criminal activities, according to researchers.

We’ve seen the misuse of AI models by cybercriminals growing rapidly over the past several years, shaping a new era of digital threats. Early on, attackers focused on jailbreaking public AI chatbots, which meant they used specialized prompts to bypass built-in safety measures. When successful, they went on to sell these “uncensored” or “custom” large language models (LLMs) on underground forums. These jailbroken AIs could generate unrestricted content, including malicious code, phishing emails, and social engineering scripts.

Read more…
Source: Malwarebytes Labz


Sign up for our Newsletter
The latest news and insights delivered right to your inbox.


Related:

  • NSA Advocates Data Sharing Framework

    June 23, 2017

    The economics of cybersecurity are skewed in favor of attackers, who invest once and can launch thousands of attacks with a piece of malware or exploit kit. That’s why Neal Ziring, technical director for the NSA’s Capabilities Directorate, wants to flip the financial equation on bad guys. “We need to conduct defenses in a way that ...