Robot dogs now read gauges and thermometers using Google Gemini

Boston Dynamics' Spot, the innovative four-legged robot, has taken a significant leap in its operational abilities, now equipped to accurately read analog thermometers and pressure gauges. This advancement is made possible by Google DeepMind's latest AI model, Gemini Robotics-ER 1.6, which was unveiled on April 14. The Gemini Robotics-ER 1.6 model serves as a high-level reasoning tool for robots, enabling them to plan and execute various tasks with greater efficiency. This sophisticated model enhances Spot's capabilities, allowing it to perform complex visual inspections and read intricate instruments, including sight glasses that provide critical insights into tanks and pipes. This development is the result of an ongoing collaboration between Google DeepMind and Boston Dynamics, aimed at pushing the boundaries of robotic performance in industrial settings. Boston Dynamics, under the ownership of Hyundai Motor Group, is exploring the use of both quadruped and humanoid robots for various roles in industrial environments, including automotive factories. Spot's role as a robotic inspector is crucial, as it must navigate complex visual data, interpreting multiple instruments' needles, liquid levels, and markings. The introduction of agentic vision in the Gemini Robotics-ER 1.6 model significantly boosts the robot's performance in reading instruments, elevating accuracy from 23 percent with the previous model to an impressive 98 percent. This capability builds on the earlier Gemini 3.0 Flash model, which achieved 67 percent accuracy. Even without the agentic vision feature, the baseline Gemini Robotics-ER 1.6 model maintains an impressive 86 percent accuracy in reading instruments. The model utilizes advanced techniques to process visual images, enabling it to count items and identify key features effectively. Additionally, it boasts enhanced multi-view reasoning capabilities, leveraging multiple camera streams to gain a comprehensive understanding of its surroundings.