STABILITY AI RELEASES FREE, OPEN-SOURCE TEXT-TO-AUDIO MODEL THAT ‘RESPECTS CREATOR RIGHTS’

  • SaySay
  • Ai
  • June 16, 2024
  • 0 Comments

Stability AI, renowned for its AI art generator Stable Diffusion, has introduced Stable Audio Open, a free and open-source model designed to create short audio clips.

Stable Audio Open enables users to generate high-quality audio samples for sound design, producing clips up to 47 seconds long based on simple text descriptions. This tool is specifically geared towards creating sound effects, drum beats, instrument riffs, ambience, and other elements commonly used in music and sound design.

The open-source nature of the model allows users to fine-tune it with their custom audio data. For instance, a drummer could train the model on their own recordings to generate new, unique beats in their style.

This release follows the introduction of Stable Audio 1.0 in September 2023, which TIME magazine recognized as one of the Best Inventions of 2023. Stable Audio 1.0 lets users create short audio clips from text descriptions.

In April of this year, Stability AI unveiled Stable Audio 2.0, an updated version providing artists and musicians with more creative tools and the ability to produce full-length music tracks.

“Our commercial Stable Audio product produces high-quality, full tracks with coherent musical structure up to three minutes in length, as well as advanced capabilities like audio-to-audio generation and coherent multi-part musical compositions,” Stability AI stated in a blog post.

While Stable Audio Open is optimized for generating shorter audio clips and production elements, it is not designed for creating full songs, melodies, or vocals. The model weights for Stable Audio Open are available for download on Hugging Face, a platform for machine learning models. Stability AI encourages sound designers, musicians, developers, and anyone interested in audio to explore the model’s capabilities and provide feedback.

The release of Stable Audio Open occurs amid an ongoing debate about the use of artificial intelligence in the music industry, particularly concerning copyright issues. Ed Newton-Rex, Stability AI’s former Vice President of Audio, resigned towards the end of 2023, citing disagreements over the use of copyrighted materials in training datasets.

“Companies worth billions of dollars are, without permission, training generative AI models on creators’ works, which are then used to create new content that can compete with the original works,” said Newton-Rex. “I don’t see how this can be acceptable in a society that relies on copyright to support the economics of the creative arts,” Newton-Rex added in his public resignation letter.

Stability AI stated that its new model was trained on a dataset of audio clips from Freesound and the Free Music Archive. “This allowed us to create an open audio model while respecting creator rights,” the company said.

Say

Related Posts

Elon Musk Reveals When the Optimus Robot Will Start Working in Factories
  • SaySay
  • July 23, 2024

Elon Musk has shared updates on the progress of humanoid robots and their upcoming integration into practical applications. Initially, Tesla plans to deploy these robots within its own operations, with…

Continue reading
OpenAI Introduces GPT-4o Mini to Replace GPT-3.5 Turbo
  • SaySay
  • July 19, 2024

OpenAI has expanded its family of language models with the new GPT-4o Mini. According to the developers, this new model operates faster and more efficiently than the current GPT-3.5 Turbo…

Continue reading

Leave a Reply

Your email address will not be published. Required fields are marked *

You Missed

Elon Musk Reveals When the Optimus Robot Will Start Working in Factories

  • By Say
  • July 23, 2024
  • 1 views
Elon Musk Reveals When the Optimus Robot Will Start Working in Factories

NTT Sorority has unveiled the nwm ONE—open-back headphones with sound leakage protection.

  • By Say
  • July 23, 2024
  • 1 views
NTT Sorority has unveiled the nwm ONE—open-back headphones with sound leakage protection.

MAXSUN has released an affordable motherboard for AMD Ryzen 9000 processors.

  • By Say
  • July 23, 2024
  • 1 views
MAXSUN has released an affordable motherboard for AMD Ryzen 9000 processors.

YouTube Relic: Video of Herobrine’s First Appearance in Minecraft Found

  • By Say
  • July 22, 2024
  • 5 views
YouTube Relic: Video of Herobrine’s First Appearance in Minecraft Found

Samsung Patents Accordion-Style Tablet with Expandable Screen

  • By Say
  • July 22, 2024
  • 4 views
Samsung Patents Accordion-Style Tablet with Expandable Screen

The End: Showrunners of The Witcher Series Conclude Plot for Fifth Season

  • By Say
  • July 22, 2024
  • 4 views
The End: Showrunners of The Witcher Series Conclude Plot for Fifth Season