howto
Running a Local LLM on a Raspberry Pi 5: What Actually Works
Hands-on results running quantized LLMs on a Raspberry Pi 5. Which model sizes are usable, what tokens/sec to expect, and the accessories you actually need.
#edge-ai
1 post.
1 post.
Hands-on results running quantized LLMs on a Raspberry Pi 5. Which model sizes are usable, what tokens/sec to expect, and the accessories you actually need.