Uptime Industries wants to boost localized AI usage with an ‘AI-in-a-box’ called Lemony AI

Uptime Industries is venturing into the realm of on-premise artificial intelligence with their innovative device, Lemony AI, a compact 'AI-in-a-box' that fits in the palm of your hand. This device, comparable in size to a sandwich, is engineered to operate a large language model (LLM), AI agents, and various AI workflows all from a single node. Remarkably, Lemony AI consumes only 65 watts of power—similar to charging a laptop—and can be stacked and interconnected to create larger AI clusters. According to Sascha Buehrle, co-founder and CEO of Uptime, each unit is capable of sustaining an LLM with up to 75 billion parameters, and it can accommodate both open-source and modified closed models. When deployed in clusters, each Lemony unit can execute different models simultaneously, enhancing versatility. Uptime is kickstarting this venture with partnerships alongside tech giants IBM and JetBrains, enabling users to effortlessly access a variety of AI models, including proprietary ones from IBM. The inspiration for Lemony AI emerged during a side project where Buehrle and his co-founder, Ivan Kuleshov, explored the feasibility of distributing language models on Raspberry Pi microcomputers. Although initially unrelated to generative AI, this exploration paved the way for their realization that local device deployment could significantly enhance AI adoption among organizations hesitant to rely on cloud solutions. The emphasis on compact design and data privacy aims to facilitate quicker adoption of AI technologies by businesses. As Buehrle explained, their goal was to create a small solution that could integrate smoothly into teams without necessitating extensive organizational decision-making. "We need to build something small that can be easily integrated into teams, essentially bringing on-premise generative AI solutions right into business settings," he stated. Uptime has already reported considerable interest from industries with stringent regulations, such as finance, healthcare, and law. Buehrle emphasized the security aspect, stating, "Everything stays in your box. Your documents, files, and emails remain secure, as the models and agents operate locally within the device." So far, the startup has successfully raised $2 million in seed funding, led by True Ventures, with contributions from Alumni Ventures, JetBrains, and various angel investors. These funds are earmarked for further development of their devices. Uptime's future plans include adapting their Lemony OS software to function on other hardware, such as the Nvidia DGX Spark, and expanding the software's capabilities from single-user access to team usage. The subscription cost for Lemony AI is set at $499 per month, allowing access for up to five users.