ElevenLabs’s new music generation model can switch genres mid-track

ElevenLabs, renowned for its advancements in voice AI, has introduced an innovative iteration of its music-generation model, dubbed Music v2. This cutting-edge model can effortlessly transition between genres within a single track, showcasing an impressive capacity for both vocal complexity and intricate composition. This latest release arrives nearly ten months after the debut of the original music generation model. According to ElevenLabs, the new version can swiftly shift from opera to heavy metal and return, maintain clarity during rapid rap segments, and even incorporate non-musical sound effects into its compositions. Artists can now select specific sections of a song to recreate using prompts, allowing them to modify parts without altering the entire track. Additionally, rather than generating brief musical clips, the model enables artists to construct songs by assembling various segments, such as intros, verses, and choruses, before merging them into a complete piece. ElevenLabs also highlighted that the model exhibits enhanced reliability across different languages, lyrics, vocals, and arrangements. The competitive landscape of AI music generation has intensified in recent months, with several labs, including Google, Stability AI, and Suno, unveiling their own models capable of producing longer and more sophisticated musical works. At the recent Google I/O developer conference, Google showcased features allowing users to create covers, edit tracks by sections, and even generate music videos using its Flow Music tool. Importantly, ElevenLabs assures that its new model is built on licensed data and is cleared for commercial use, enabling users to utilize the generated tracks without concern. Establishing partnerships with music labels is crucial, especially as other AI music startups like Suno and Udio have encountered legal challenges regarding copyright issues. The Music v2 model is now accessible through ElevenLabs’ ElevenCreative tool, designed for marketing and branding teams, in addition to the newly launched ElevenMusic platform tailored for creating AI-generated songs, with plans for integration into ElevenAPI on the horizon.