An updated version of the PS5LM project now enables a jailbroken PlayStation 5 to execute AI models at speeds exceeding 100 tokens per second. This significant boost came to public attention via a Reddit post, where a user shared their fork of PS5LM—a llama.cpp port designed to run AI large language models locally on the console—featuring substantial performance enhancements.
Qwen 27B at ~20 tok/s on a jailbroken PS5’s GPU. I forked PS5LM and turned it into a native app
by u/AdIllustrious7246 in LocalLLM
Operating as a native app, this updated release leverages the graphics chip of the PS5 to accelerate response times. Testing indicates that certain smaller models achieve up to 124 tokens per second, while larger models operate at a reduced pace yet still provide practical performance. Consequently, the console can process artificial intelligence workloads directly on the hardware rather than routing requests through an external online service.
According to reports, the software is compatible with multiple models. These include Llama 3.2 3B at 124 tokens per second, Gemma 4 E4B at approximately 61 tokens per second, and the larger Qwen 3.8 27B model operating at roughly 20 tokens per second.
Furthermore, the application displays operational metrics including generation speed, memory consumption, power draw, and thermal readings. Users are able to access its chat interface via a web browser on a separate device linked to the same local network. At present, functionality is restricted to jailbroken systems and is unavailable on standard consoles.
GPU Access Makes a Big Difference
By incorporating a Vulkan-based GPU framework built on a port of the RADV graphics driver, the new build grants the software direct utilization of the console’s graphics processing unit. This change expands the available memory pool for the model and its context window to roughly 11.4GB, an increase from the approximately 6GB limit in previous iterations. The expanded memory accommodates larger models more effectively, while GPU acceleration drives faster output generation.
While this initiative demonstrates that the hardware is capable of tasks beyond gaming, performance levels fluctuate based on the specific model loaded. Because the software is unofficial and mandates a modified system, the vast majority of console owners cannot access it in its current state.
