Pixi’s new iOS app turns text messages into interactive AR experiences

In a bold move to redefine the messaging landscape, Pixi has launched a new iOS app that integrates interactive augmented reality (AR) into text conversations. Released on Wednesday, this innovative app allows users to send AI-driven AR characters via iMessage, creating a more dynamic and engaging messaging experience. Unlike typical stickers or GIFs, Pixi's characters spring to life through the recipient's iPhone camera, responding to their environment and engaging in real-time interactions. While augmented reality has been around for a while, with companies like Snap pioneering AR filters, Pixi's unique approach combines AR with on-device AI. This enables the characters to react contextually; for instance, a virtual cat might respond when a real dog walks by, enhancing the immersive experience. Mark Drummond, the founder of Pixi and a former executive at DreamWorks Animation and Apple, emphasizes that the app is designed to enrich digital conversations by introducing a sense of presence and spontaneity. Instead of merely sending a text to celebrate a birthday, users can send a character that offers a shared experience, transforming a simple message into a memorable digital gift. "We are addressing the challenge of connecting with friends who are not physically present," Drummond told TechCrunch. He likened this to the concept of 'creative gifting,' where users share tokens of affection like e-cards and gifts, but in a way that is more suited to the digital age. During a demonstration of the app, Drummond showcased a cat character that performed stand-up comedy on his desk, notably reacting to his facial expressions. The interaction culminated in a smile, highlighting the character's ability to interpret emotional cues. At its launch, users can choose from various characters, including a robot, a cat, and an animated envelope that can playfully interact with others. The app also features games like tic-tac-toe and whack-a-mole, providing a fun, interactive element. Pixi aims to expand its character offerings by creating a marketplace for studios, brands, and independent creators to share their unique characters. This feature could be utilized for promotional events, generating excitement around new product launches or movie premieres. Drummond mentioned plans to introduce characters from classic literature, like Alice in Wonderland, to further showcase how these figures can engage with users' surroundings. Looking ahead, Pixi envisions allowing users to design their own characters using generative AI capabilities, enabling them to craft personalized experiences. To send a character, users simply need to download the app on iOS and utilize iMessage. The app is currently compatible with iPhone models 11 and newer, with future plans for Android and additional messaging platforms. While the app is free for individual users, brands may choose to monetize their characters. Drummond encourages a collaborative spirit, suggesting that free characters can motivate users to become brand ambassadors, sharing their experiences and stories through these interactive creations.