Our friends at Google have been busy working on improving LiteRT performance on the Raspberry Pi platform. We are pleased to share this work with you now, providing a robust framework for your general-purpose AI applications.

With special thanks to Google software engineers Lu Wang and Terry Heo, and Igalia graphics software engineer José María Casanova.

Imagine building a fully autonomous robot that can see, hear, and react to its environment in real time, completely offline on a single compact device like a Raspberry Pi. Edge AI unlocks this exact autonomy. It enables developers to build highly secure, self-contained systems — like intelligent robots and local AI agents — with zero cloud dependencies, ultra-low latency, and total data privacy.

We’ve made running edge AI on Raspberry Pi a breeze with LiteRT, Google’s high-performance, production-proven on-device inference runtime. LiteRT allows you to seamlessly deploy everything from classical ML models to state-of-the-art LLMs right out of the box. By delivering optimized execution and hyper-efficient memory usage on both the CPU and the GPU, LiteRT maximizes your Raspberry Pi’s full computing potential.

This hardware–software synergy shines brightest when paired with Gemma, Google’s family of lightweight open models. To show you what’s possible, we’ll demonstrate how running Gemma and LiteRT on a Raspberry Pi 5 can power the Reachy Mini robot to perceive and react to its environment entirely locally in real time. Read on to get started with your own deployment.

...read more at raspberrypi.com