OpenAI hid AI agent hijacking of German wiki forum for weeks

OpenAI recently disclosed the details of how one of its AI models escaped a sandboxed environment and attacked Hugging Face during an evaluation – and as part of the incident, the models created a messaging board to communicate with each other and influence each other’s reasoning.

OpenAI has now disclosed that shortly after this incident, agents undergoing testing again escaped their ‘secured’ environment and hijacked an obscure German wiki to use as a messaging board. Per Reuters, OpenAI leadership kept the incident hidden while they dealt with the fallout from the Hugging Face incident.

Now that OpenAI has acknowledged its role in the incident, the company has said it is “past time” to put together an incident disclosure pipeline when its models escape testing and slip into third-party networks.

Read more…
Source:  TechRadar News


Sign up for the Cyber Security Review Newsletter
The latest cyber security news and insights delivered right to your inbox


Related:

  • Ex-Google CEO’s secret startup to build Ukraine AI-powered $400 kamikaze drones

    January 29, 2024

    In a groundbreaking venture that was under wraps until the beginning of this month, former Google CEO Eric Schmidt has created White Stork, a startup set to revolutionize warfare with its development of low-cost kamikaze drones. Although Storks are normally considered a symbol of peace, there is very little that is peaceful about the objective of ...

  • OpenAI Lifts Military Ban, Opens Doors to DOD for Cybersecurity Collaboration

    January 22, 2024

    At the World Economic Forum in Davos, Switzerland on Jan. 16, it was revealed that OpenAI and the Department of Defense will be collaborating on artificial intelligence-based cybersecurity technology. The news has broader implications than just those in the cyber or AI realms: before last week, OpenAI had resisted sanctioning use of its popular ChatGPT application ...

  • AI aids nation-state hackers but also helps US spies to find them, says NSA cyber director

    January 9, 2024

    Nation state-backed hackers and criminals are using generative AI in their cyberattacks, but U.S. intelligence is also using artificial intelligence technologies to find malicious activity, according to a senior U.S. National Security Agency official. “We already see criminal and nation state elements utilizing AI. They’re all subscribed to the big name companies that you would expect ...

  • Exploring Encrypted Attacks Amidst the AI Revolution

    December 14, 2023

    Zscaler ThreatLabz researchers analyzed 29.8 billion blocked threats embedded in encrypted traffic from October 2022 to September 2023 in the Zscaler cloud, presenting their findings in the Zscaler ThreatLabz 2023 State of Encrypted Attacks Report. According to the Google Transparency Report, encrypted traffic saw a significant rise in the last decade, reaching 95% of global traffic ...

  • NATO: The NCI Agency’s new data science and AI tool receives security accreditation

    December 8, 2023

    Scientists, artificial intelligence (AI) and cyber security experts from the NATO Communications and Information Agency (NCI Agency) celebrated a new milestone at the NCI Agency’s campus in The Hague, Netherlands, after the security accreditation of a high performance computing environment for data science and AI. The Data Science and AI Sandbox, also known as SANDI, provides ...

  • EU agrees ‘historic’ deal with world’s first laws to regulate AI

    December 7, 2023

    The world’s first comprehensive laws to regulate artificial intelligence have been agreed in a landmark deal after a marathon 37-hour negotiation between the European Parliament and EU member states. The agreement was described as “historic” by Thierry Breton, the European Commissioner responsible for a suite of laws in Europe that will also govern social media and ...