TechCapsules

AI-summarised brief · reviewed before publication

Google DeepMind has introduced a powerful on-device version of its Gemini Robotics AI, allowing robots to complete complex tasks without relying on a cloud connection. This new system, known as Gemini Robotics On-Device, brings Gemini's advanced reasoning and control capabilities directly into physical robots. It is designed for fast, reliable performance in places with poor or no internet connectivity, making it ideal for real-world, latency-sensitive environments. Unlike its cloud-connected predecessor, this version runs entirely on the robot itself. It can understand natural language, perform fine motor tasks and generalize from very little data, all without requiring an internet connection. According to Carolina Parada, head of robotics at Google DeepMind, the system is "small and efficient enough" to operate directly onboard. Developers can use the model in situations where connectivity is limited, without sacrificing intelligence or flexibility. Gemini Robotics On-Device can be customized with just 50 to 100 demonstrations. The model was first trained using Google's ALOHA robot, but it has already been adapted to other platforms like Apptronik's Apollo humanoid and the Franka FR3. For the first time, developers can fine-tune a DeepMind robotics model. Google is offering access through its trusted tester program and has released a full SDK to support development. This new technology has the potential to revolutionize the way robots operate in various environments, including those with limited or no internet connectivity. With its advanced capabilities and flexibility, Gemini Robotics On-Device is poised to make a significant impact in the field of robotics.