Stability AI, the startup behind the popular image generation tool Stable Diffusion, has launched Stable Audio Open Small, a new AI model to generate stereo audio. The company claims that this model is the fastest on the market, capable of running efficiently on mobile devices like smartphones. Developed in collaboration with Arm Holdings, chipmaker behind processors used in many mobile devices, Stable Audio Open Small eliminates the need for cloud processing, making it a more accessible and efficient solution for AI-powered audio generation.
Optimized for Arm CPUs, Stable Audio Open Small is trained on a dataset consisting of royalty-free audio from libraries such as Free Music Archive and Freesound. This distinguishes it from other audio generation models that rely on copyrighted content, potentially posing intellectual property risks. The model is designed to generate short audio clips and sound effects, such as drum and instrument riffs. It can produce up to 11 seconds of audio in less than 8 seconds on a smartphone, making it fast and efficient for mobile use.
Read Also: Trump Fires Copyright Office Head Amid AI Training Controversy
However, there are some limitations with the model. For example, Stable Audio Open Small can only support prompts written in English and cannot generate realistic vocals or high-quality songs. Additionally, its performance varies across musical styles, with a bias toward Western music due to the training data. Despite these restrictions, the model offers a significant leap forward in terms of mobile AI-driven audio generation.
In terms of accessibility, Stable Audio Open Small is free for researchers, hobbyists, and small businesses with annual revenue under $1 million. For larger companies with higher revenue, an enterprise license is required. This move is part of Stability AI’s strategy to make advanced AI tools more accessible to a broader audience, while also securing revenue from commercial enterprises.This release is particularly significant for Stability AI, which has faced financial difficulties and leadership changes in recent months. The company has recently appointed a new CEO and secured additional investment to help revitalize its operations. With the launch of Stable Audio Open Small and other new AI models, Stability AI is positioning itself to continue innovating in the AI space and overcoming the challenges that have affected its growth in recent times.
