After mastering the art of machine learning (ML) based voice cloning and synthesis, ElevenLabs, the two-year-old AI startup founded by former Google and Palantir employees, is moving to expand its portfolio with a new text-to-sound model.
Teased a few hours ago, the AI will allow creators to generate sound effects by simply describing their imagination in words. It is expected to enrich content in a new way in the age of AI-driven digital experiences.
The model is not available publicly, but ElevenLabs has showcased its capabilities by releasing a minute-long teaser featuring videos produced by OpenAI’s new Sora and enhanced with its own AI sounds. The company has also set up a signup page and is calling potential users to join an early access waitlist for the model.
Source: VentureBeat