Andrej Karpathy says he uses an AI agent named Dobby the Elf Claw to control his pool and track his packages

Andrej Karpathy, a prominent figure in the AI community and co-founder of Eureka Labs, has introduced an innovative AI assistant named 'Dobby,' inspired by the beloved character from the Harry Potter series. In a recent discussion on the 'No Priors' podcast, Karpathy shared how this AI agent manages various household tasks, including controlling lights, HVAC systems, shades, and even monitoring his pool and spa. Karpathy describes Dobby as a 'claw' that autonomously handles his home's operations. He elaborated on its capabilities, stating, "It controls all of my lights, my HVAC, my shades, the pool, the spa, and also the security system." This new generation of AI agents, like Dobby, represents a shift from traditional language models, as they can directly interact with applications and devices, executing tasks such as scheduling and home automation. The rise of these AI tools has been notable, with frameworks like OpenClaw gaining popularity. The competition is heating up, as both tech giants and startups race to develop similar technologies. Earlier this year, OpenAI acquired OpenClaw and its creator, Peter Steinberger. Karpathy is already finding practical uses for Dobby. He mentioned that the AI assists him with monitoring deliveries, sending notifications via WhatsApp along with images to keep him updated. "It shows an image from the outside, and it says, 'Hey, a FedEx truck just pulled up, and you might want to check it, you got new mail,'" he explained. This setup has allowed him to streamline his smartphone usage by eliminating six separate apps, as Dobby now oversees all of them. Recently, Karpathy received a significant upgrade for his system—a DGX Station from Nvidia CEO Jensen Huang, equipped with a GB300 superchip designed for advanced AI tasks. He expressed enthusiasm for his new hardware, noting that it would enhance Dobby's capabilities further. Despite entrusting Dobby with critical functions of his home, Karpathy reassured listeners about security concerns. He clarified that Dobby operates within his home's local network, making devices less vulnerable to external threats. This arrangement even contributes to his relaxation, as he can simply say, 'Dobby, it's sleepy time,' to turn off all the lights, helping him unwind at the end of the day.