Court filings reveal OpenAI and io’s early work on an AI device

Recent legal documents filed by OpenAI and Jony Ive’s startup, io, have shed light on their collaborative efforts to create a groundbreaking AI hardware device aimed at mass-market consumers. This revelation comes amidst a trademark dispute initiated by iyO, a hardware startup backed by Google, which is known for developing custom-molded earpieces designed to connect with various gadgets. In response to the lawsuit, OpenAI has withdrawn promotional content related to its $6.5 billion acquisition of io, complying with a court order. The company is vigorously contesting iyO’s claims of trademark infringement. According to filings from iyO’s lawsuit, both OpenAI and io have spent the past year delving into the market for in-ear hardware. They reportedly acquired over 30 headphone models from various brands to analyze existing offerings. Moreover, there have been interactions between OpenAI and iyO’s leadership, including demonstrations of their in-ear technology. However, it appears that the initial product from OpenAI and io may not be a traditional pair of headphones. Tang Tan, co-founder of io and former Apple executive, clarified in a court statement that the prototype mentioned by OpenAI CEO Sam Altman in io’s promotional video is neither an in-ear device nor a wearable gadget. He emphasized that the prototype's design is still under development and that it won't be ready for public release for at least another year. The specifics of this first device remain largely undisclosed. Altman described the project as the beginning of a 'family' of AI devices with diverse functionalities, while Jony Ive expressed that the prototype had significantly inspired him. Altman previously mentioned in an internal meeting that when completed, the device would be compact enough to fit in a pocket or rest on a desk, and it would possess awareness of its surroundings, functioning as a supplementary device alongside smartphones and laptops. OpenAI’s legal representatives have indicated that the company is exploring a broad spectrum of device types, ranging from desktop and mobile platforms to wireless, wired, wearable, and portable options. Although smart glasses have become a popular focus for AI-enabled technology, with competitors like Meta and Google vying to lead this sector, there is also considerable interest in AI-integrated headphones. For instance, Apple is reportedly developing AirPods equipped with cameras to enhance AI capabilities by capturing environmental data. In the quest for innovation, OpenAI and io executives have been actively researching in-ear products. A notable meeting took place on May 1, where OpenAI’s VP of Product, Peter Welinder, and Tan engaged with iyO’s CEO, Jason Rugolo, to gain insights into iyO’s offerings. During this encounter, they tested iyO’s custom-fit earpiece, which unfortunately did not perform reliably during the demonstrations, as revealed in subsequent emails. Tan noted that he approached the meeting with caution, aiming to limit his exposure to iyO’s intellectual property, suggesting that legal counsel review materials beforehand. Despite this, it seems there was an eagerness among OpenAI and io representatives to gather insights from iyO’s experiences. iyO has a unique approach to customizing its in-ear headsets, sending specialists to capture detailed ear scans. An email from Marwan Rammah, an ex-Apple engineer now at io, hinted at the potential benefits of acquiring a comprehensive database of 3D ear scans for ergonomic development, though it remains uncertain if such an arrangement was finalized. Rugolo attempted to cultivate a stronger partnership with io and OpenAI but faced challenges in his efforts. He proposed launching iyO’s device as an early developer kit for OpenAI’s ultimate AI product and even suggested investment opportunities, including an offer to sell his company for $200 million. However, Tan declined these proposals. Evans Hankey, another former Apple executive and io co-founder, stated in court that io is not focused on developing a custom-molded earpiece. It appears that OpenAI is still over a year away from introducing its first hardware offering, which may encompass a form factor beyond just in-ear devices.