Raspberry Pi AI HAT+ 2 Lets You Run LLMs Locally
A new version of the Raspberry Pi AI HAT+ has been released with enough power to run popular generative AI (GenAI) models, including Qwen and DeepSeek. The first generation Raspberry Pi AI HAT+ add-ons were designed for on-device acceleration of vision-based neural network models, but wasn’t powerful enough to run more generalised large-language models (LLMs) – something the new AI HAT+ 2 solves. Described as the company’s “first AI product designed to fill the generative AI gap”, the Raspberry Pi AI HAT+ 2 packs in a Hailo-10H NPU with 40 TOPS (INT4) of inferencing performance and is paired with 8GB […]
You're reading Raspberry Pi AI HAT+ 2 Lets You Run LLMs Locally, a blog post from OMG! Ubuntu. Do not reproduce elsewhere without permission.