A GitHub user named cobanov released an unofficial port of llama.cpp that allows jailbroken PlayStation 5 consoles to execute AI chat models locally. The initial version operated as a CPU payload, which restricted memory access to approximately 6 GiB to prevent system instability.
A subsequent fork by user u/AdIllustrious7246 utilizes PS5_Vulkan, a port of the RADV graphics driver, to enable native GPU access. This development allows the console to allocate up to 11.4 GiB of RAM for AI tasks, significantly improving performance over the previous CPU-bound implementation.
Performance tests show the console running a 27B parameter model at 20 tokens per second. Smaller models, such as Gemma 4 E4B and Llama 3.2 3B, achieved speeds of 61 and 124 tokens per second, respectively. The software also includes a dashboard for monitoring power, temperature, and resource usage.
The updated implementation supports the llama.cpp web UI, enabling users to interact with the models via a browser from other local devices. While this allows the PS5 to function as an AI assistant, the hardware limitations of the console make it unlikely to impact the broader GPU market.
