Can Open-source Models Hack a Neocloud?
Dylan Patel says most neoclouds have terrible security, and open-source models can hack one or reach other customers' data on it. He points to GLM 5.3, a Chinese open-source model, as especially good at that. SemiAnalysis published a report he calls Most Neoclouds Suck at Security. Alex Kantrowitz read an Ilya Sutskever post warning that neoclouds have limited cybersecurity, and Patel says the post echoed that report.
On one cluster, the firm accidentally saw other clients' storage and Slurm jobs, including work for intelligence agencies of a non-American country in the top ten by GDP. They reported it. A malicious customer on that shared cluster could have seen what those clients were training on the GPUs.
Can AI Keep Growing Exponentially? Let’s Ask SemiAnalysis — With Dylan Patel and Jordan Nanos ·
From the transcript
I'd say super intelligence that we might have a problem here. Yeah, so we posted an article titled, Most Neoclouds Suck at Security. Yeah. Documenting. By the way, the art for that is incredible. We'll put it on the screen for those who are watching. It's like this guy getting, yeah, exactly, getting stabbed by everybody. And it's like, it's SOC 2 compliant.
But yeah, so we posted that report and then that, you know, like maybe eight or eight hours later or whatever, Ilya posted his tweet
because they are very much, you know, using various clouds. They're obviously super secretive and care a lot about the secrecy of like what they're working on, but also they are big believers in super intelligence. you know, I guess safe superintelligence SSI, they were the first and Trump actually copied Ilya. Ilya's first with another one, right? First to reasoning, first to LLM scaling, and now first to superintelligence branding.