Inside the Hack: How Vulkan and Unlocked RAM Turned the PS5 Into an AI Server

Introduction: A Gaming Console Turned AI Server

For tech enthusiasts and local AI hobbyists, the boundary between specialized workstations and consumer gaming hardware continues to blur. Recent milestones in the PlayStation 5 homebrew community have stunned observers by demonstrating that a jailbroken console can run local large language models (LLMs) at remarkable speeds. While headlines boasting over 100 tokens per second have captured widespread attention, a closer look at the architecture reveals a fascinating technical evolution—and a few practical catches.

From CPU-Bound Limits to Native GPU Acceleration

The journey of running artificial intelligence models on Sony's hardware began with Mert Cobanov's original PS5LM project. This initial iteration ported llama.cpp to the console as a CPU payload, which unfortunately restricted memory usage to roughly 6 GB. However, a significant breakthrough arrived with the introduction of PS5LM Plus, a fork developed by Abhiram (u/AdIllustrious7246).

PS5LM Plus introduced a native application utilizing PS5_Vulkan—a port of the RADV graphics driver. This crucial development allowed homebrew software to directly access the PS5's custom AMD graphics processor and drastically expand available shared memory to approximately 11.4 GB. It is worth noting that these modifications rely on the Relapse jailbreak, which currently supports PlayStation 5 firmware versions ranging from 7.00 through 13.60.

Performance Metrics: Separating Hype From Reality

Tech analysts have noted that the PS5’s 16GB of shared GDDR6 memory, featuring a massive 448 GB/s bandwidth, offers exceptional memory bandwidth relative to its price point. This makes it theoretically viable for running local LLMs despite strict platform lockdowns. But how does it perform in practice?

Performance varies dramatically depending on the scale of the model:

• Smaller Models: Compact architectures like Gemma 4 E4B and Llama 3.2 3B achieve impressive speeds of 61 and 124 tokens per second, respectively, easily justifying the high-speed claims in optimal conditions.
• Larger Models: Running a heavily quantized Qwen3.8-27B model on the PS5 GPU yields approximately 20 tokens per second.

Hardware commentators view these milestones as a sign that the console is increasingly treated as a general-purpose computing device or development platform. During local AI text generation, the system draws roughly 86W of power while maintaining stable temperatures between 54°C and 55°C.

Operational Challenges and Community Realities

Despite the excitement across Reddit and social media platforms, community discussions highlight several real-world operational bottlenecks. Users running these models face slow prompt prefill times, noticeable quality trade-offs resulting from heavy model quantization, and the procedural hassle of re-applying payloads after every system reboot. Furthermore, while the prospect of executing a 27-billion-parameter model locally without any cloud connection is a major technical feat, the distinction between high-speed lightweight models and resource-heavy architectures remains essential for anyone considering alternative local AI hardware configurations.

Conclusion

The transformation of a jailbroken PlayStation 5 into a functional local AI server underscores the incredible potential of modern console hardware when platform restrictions are bypassed. While practical hurdles like quantization trade-offs and reboot requirements remain, projects like PS5LM Plus open up exciting new avenues for hobbyists exploring cost-effective ways to run large language models.