OpenAI wants to make ChatGPT into a universal app frontend

During the recent OpenAI Dev Days keynote, CEO Sam Altman introduced an exciting new SDK preview that empowers developers to create fully functional applications directly within ChatGPT. This innovative tool offers "full stack" control over app data, action triggers, and interactive user interfaces, all integrated within the ChatGPT conversation window. Built on the open-source Model Context Protocol (MCP), the SDK allows developers already utilizing MCP to easily incorporate ChatGPT integration by simply adding an HTML resource. This integration transforms how users interact with applications—imagine asking Figma to convert a sketch into a diagram and receiving the results seamlessly within your ChatGPT chat. The capabilities extend further, with ChatGPT now able to recommend apps based on user queries. For instance, when someone requests song suggestions, ChatGPT can automatically create a Spotify playlist. In a live demonstration, OpenAI software engineer Alexi Christakis illustrated how the API allows ChatGPT to communicate with various apps, enhancing the user experience. He showcased how the language model could provide real-time commentary on content from an embedded Coursera video, eliminating the need for users to describe what they're viewing. Additional demonstrations highlighted ChatGPT's ability to work with Canva for generating poster ideas while users simultaneously accessed an inline Zillow map. Even when the Zillow window was expanded to full screen, users could still engage with ChatGPT for further context through an overlaid chat window, showcasing the potential for a truly integrated app experience.