Imogen Heap and Jen Launch AI Voice and Music Models to Capture Artist’s Style

Pioneering producer and singer Imogen Heap has partnered with Jen, an ethical AI music creation platform, to launch two new models inspired by her musical stylings. The partnership was announced Thursday (Nov. 14) at the Web Summit conference in Lisbon, Portugal.

First, Heap is launching her own StyleFilter model, Jen’s patented tool that allows users to create original tracks that infuse the distinct musical styles of of an artist or producer into their new works. Specifically for Heap’s collaboration, the StyleFilter model was trained on her new singles “What Have You Done To Me” and “Last Night of an Empire.” Importantly, StyleFilter is said to do this while still “maintaining transparency, protection and compensation” for Heap. Secondly, Heap and Jen have also announced a new AI voice model trained on Heap’s distinct vocals.

Jen co-founder and CEO, Shara Senderoff, and Heap took the stage at Web Summit’s Centre Stage to demonstrate how StyleFilter works, transforming prompts into compositions that weave Heap’s style into a user’s original works. Watch their explanation below:

Over her decades-long career, Heap has been viewed as an innovator, pushing the boundaries of art and technology. Since the early days of her career, she has popularized the use of vocoders. Later, she developed her own products, like the Mi.Mu gloves, a wearable tool that allows her to record loops and edit vocals with small hand movements, and The Creative Passport, a service that combines all of an artist’s information in one place from a bio, press photos, royalty accounting, set lists and more.

Last month, in an interview with The Guardian, Heap explained her new AI assistant, called Mogen, which is trained on Heap’s interviews, speeches and TK to act as essentially a living autobiography that can answer questions for fans in her persona. Later, she hopes to expand Mogen to be trained on her musical improvisation and to become a live collaborator at gigs.

Jen is an AI music making platform that puts transparency at the forefront. Its Jen-1 model, launched in June, is a text-to-music model trained on 40 different licensed catalogs (and then verified against 150 million songs). It is also backed by APG founder/CEO Mike Caren, who came on as a founding partner in fall 2023. As Senderoff explained in a August 2023 interview with Billboard, “Jen is spelled J-E-N because she’s designed to be your friend who goes into the studio with you. She’s a tool.”

Jen uses blockchain technology to ensure transparency and the ability to track its works after they are generated and put out in the world. Each of the works created with Heap’s StyleFilter will be authorized for use through Auracles — an upcoming non-profit platform, designed by Jen, that uses data provenance to give artists have more access, control and permission for what is made using their StyleFilter model.

While other AI companies have worked on creating personalized AI music models, trained on a specific producer or artists catalog before, like Soundful Collabs, the team at Jen believes StyleFilter is different because “it can learn and apply the style of an artist by training on a single song, establishing a new level of creative precision and efficiency,” says a spokesperson for the company.

“Shara’s integrity shines an outstanding light at this pivotal moment in our human story,” says Heap. “The exponential curve of innovation in and with AI attracts opportunists primarily focused on filling their pockets in the gold rush or those racing at speed to stick their ‘technological flag’ in the sand to corner a marketplace. Alongside the clear innovation in products and new revenue streams for musicians at Jen, Shara’s inspiring strength and determination to get the ethical foundations right from the start are inspiring. An all-too-rare example of a service, contributing to a future where humans are empowered, valued and credited, within and for our collective global tools and knowledge.”

“At Jen, we are determined to create innovative products that invite artists to participate as AI reshapes the music industry, enabling their artistry to take new forms as technology evolves while ensuring they are respected and fairly compensated,” says Senderoff. “Our StyleFilter is a testament to this vision, introducing a groundbreaking way for users to collaborate with the musical essence of artists they might never have the chance to work with directly. Premiering this product with Imogen Heap, a pioneer at the intersection of music and technology, exemplifies our commitment to build with respect and reverence for those who paved the way. She’s also an incomparable human that I’m honored to call my friend.”