Next-Gen Sound by AI-Powered Music Tool

Tue May 27 2025

Summary

The Mark Cuban Podcast: Episode Summary

Title: Next-Gen Sound by AI-Powered Music Tool
Host: The Mark Cuban Podcast
Release Date: May 27, 2025

In this insightful episode of The Mark Cuban Podcast, hosted by Mark Cuban himself, the discussion centers around the latest advancements in AI-powered music tools, specifically focusing on Stability AI's new audio feature. Cuban delves deep into the implications of this technology, comparing it to existing competitors, and explores the broader landscape of AI in music creation. Additionally, he introduces his own venture, AI Box AI, highlighting its relevance in the current AI ecosystem.

1. Introduction to Stability AI’s New Audio Feature

Mark Cuban kicks off the episode by introducing Stability AI, a company renowned for pioneering the AI revolution with its development of Stable Diffusion, a model that has significantly impacted AI-generated imagery.

"Stability is kind of an interesting company. You'll probably remember it just for the fact that it was one of, like, the leaders in the AI revolution. They literally invented a stable diffusion and the way that we use AI to generate images..." [00:00]

He highlights the recent rollout of Stability AI's new audio feature, signaling a potential turnaround for the company, which had been beleaguered by financial challenges.

2. Stability AI’s Audio Model vs. Competitors

Cuban provides a comparative analysis between Stability AI's new audio model and existing players in the market, such as Suno and Yu Dio.

"Most of these ones that are kind of doing this generated music. People criticize them for the copyright..." [04:30]

Stability AI differentiates itself by avoiding copyright issues, having trained its model exclusively on royalty-free audio libraries and sounds. This ethical approach contrasts with competitors who have faced backlash over using copyrighted data without permission.

3. Technical Specifications and Capabilities

Delving into the technical aspects, Cuban explains that Stability AI's audio model is lightweight, boasting 341 million parameters, and is optimized for ARM CPUs, making it feasible to run directly on smartphones without relying on cloud servers.

"It's really small. It's 341 million parameters in size and it was specifically optimized to run on ARM CPUs so ARM makes chips... it's able to run on an ARM CPU, right. On a phone." [08:45]

This optimization allows users to generate audio samples swiftly—up to 11 seconds—in approximately eight seconds on a smartphone. While this speed surpasses that of competitors like Suno and Yu Dio, the trade-off is in the quality and complexity of the generated music.

4. Quality and Limitations of the Audio Model

Cuban is candid about the model's current limitations. Despite its efficiency, the audio quality does not match that of Suno or Yu Dio.

"It's just not as good as Suno or Udio. It's just, that's just the nature of the beast." [12:20]

Key limitations include:

Audio Length: Capable of producing only up to 11-second clips.
Quality: Lacks the ability to generate realistic vocals or high-quality, fully fleshed-out songs.
Style Diversity: Primarily trained on Western music, leading to limited genre diversity.
Language Constraints: Supports only English prompts, necessitating translations for non-English users.

5. Licensing, Copyright, and Ethical Considerations

A significant advantage of Stability AI's approach is its avoidance of copyright infringement by utilizing only royalty-free and freely available audio sources for training.

"They trained this only on content that they had copyright for, which is fantastic, right? They don't want any sort of IP risk involved with this when they're releasing it." [05:50]

However, this ethical stance comes with its own set of challenges, such as limited training data leading to constrained musical creativity and diversity.

Additionally, Stability AI has implemented a licensing model:

Free Access: For researchers, hobbyists, and businesses with annual revenues below one million dollars.
Enterprise Licensing: Required for businesses exceeding the revenue threshold.

This structure aims to balance accessibility with the company's financial sustainability.

6. Stability AI’s Corporate Turnaround and Future Directions

Cuban provides a background on Stability AI's tumultuous journey, marked by financial mismanagement under former CEO Imod Mostaq, which led to significant staff resignations and fractured partnerships, including a notable fallout with Canva.

"Imod Mostaq was their co-founder and he was kind of the former CEO. He apparently really mismanaged all of their finances, almost completely destroyed the company..." [19:00]

In recent developments, Stability AI has secured new investment from prominent figures such as Eric Schmidt, Sean Parker, and now includes filmmaker James Cameron on its board of directors. This strategic infusion of leadership and capital suggests a pivot towards integrating AI-generated visuals and possibly videos, aligning with Cameron's expertise.

"They appointed James Cameron to their board of directors. Which is interesting because typically this has kind of been famous as an image company and with James Cameron you can kind of imagine where they're going..." [22:35]

7. Implications for the AI Music and Video Industry

Cuban speculates on the potential synergy between AI-generated audio and video, positing that Stability AI's advancements could revolutionize content creation. The ability to generate sound effects and music directly on smartphones opens new avenues for creators to produce multimedia content seamlessly.

"They want this in the background of if, you know, they're making music tracks to be able to or sorry, videos. It'd be really cool to have also AI generated music in the background." [24:10]

This integration promises to enhance the efficiency and creativity of content creators, offering tools that are both accessible and ethically sound.

8. Promotion of AI Box AI

Transitioning to his entrepreneurial endeavors, Cuban introduces AI Box AI, his startup offering the AI Box Playground. This platform consolidates access to the top 20 AI models across audio, image, and text on a single subscription basis for $20 a month.

"If you haven't tried AI Box already, there's a link in the description. I would love to have you try it. You can dump a ton of your subscriptions for $20 a month." [28:50]

Key features include:

Unified Access: Eliminates the need for multiple subscriptions.
Multi-Modal Interaction: Enables users to chat with various AI models within the same interface.
Cost-Effective: Provides comprehensive AI tool access at a fraction of the cost of individual subscriptions.

Cuban emphasizes the platform's utility for both hobbyists and professionals, positioning it as a valuable resource in the rapidly evolving AI landscape.

9. Conclusion and Future Outlook

Mark Cuban wraps up the episode by reiterating Stability AI's potential for growth and innovation, encouraging listeners to stay tuned for further developments.

"Stability is on track to do some cool things. I think specifically if we're looking at videos, doing these sound effects and kind of these like smaller music bits makes a lot of sense." [26:40]

He also invites listeners to support the podcast by leaving ratings and reviews and to explore AI Box AI as a means to harness the power of multiple AI models efficiently.

Key Takeaways:

Stability AI is expanding its AI capabilities into the audio domain with a new model optimized for mobile devices, prioritizing ethical data use by avoiding copyrighted material.
While Stability AI’s audio model offers speed and accessibility, it currently falls short in music quality and diversity compared to competitors like Suno and Yu Dio.
The company is undergoing a significant corporate turnaround, bringing in new leadership and investors to pave the way for future innovations, potentially merging AI-generated audio with video content.
AI Box AI, Mark Cuban’s startup, presents a unified platform for accessing multiple AI models, offering a cost-effective solution for users seeking diverse AI functionalities without juggling multiple subscriptions.

This episode offers a comprehensive look into the current state and future potential of AI in music and multimedia creation, highlighting both the technological advancements and the ethical considerations that accompany them. Mark Cuban effectively balances technical insights with entrepreneurial advice, providing valuable perspectives for listeners interested in the intersection of AI, business, and creative industries.

Loading summary...

Transcript

A (0:00)

Today on the podcast, we're going to be talking about Stability AI and a brand new feature that has just rolled out, and that is the ability for them to do audio. So this is a new update that they've rolled out recently. And Stability is kind of an interesting company. You'll probably remember it just for the fact that it was one of, like the leaders in the AI revolution. They literally invented a stable diffusion and the way that we use AI to generate images, and yet they really got left behind as a company that's had a lot of financial issues. But I think that they're about to make a big turnaround. And so because of this, I don't think it's a company that you should count out just quite yet. The one thing I did want to mention before we get into this, if you haven't tried it already, my startup, AI Box AI is officially out of. It is officially launched, and our first product is the AI Box Playground. We have a beta out right now that essentially allows you to Access the top 20 AI models all on one platform. You can chat with them all in the same chat. We have audio, image and text all in the same chat for $20 a month. So you don't have to have subscriptions to 20 different platforms. You pay one time for that and then you get access to all the different platforms. So you can check it out, the links in the description AI Box AI. All right, let's get into what's happening with Stability AI. So the new update, they have the thing that's really interesting about it, beyond the fact that, you know, they came up with kind of like an audio model, and I should preface this by saying they have a big announcement about an audio model, but this isn't like a vocal model. This is a music model. So specifically, it does music. There's a bunch of different competitors. There's Suno and Yu Dio that are doing this, but most of these ones that are kind of doing this generated music. People criticize them for the copyright. So they're like, look, these guys, they grabbed all of this data from the Internet. They grabbed everyone's music, they trained a model, and now it creates music. So people are upset about kind of the copyright in the data set for this stability tried to avoid this, essentially. And they did a couple cool things. Number one, it's a really lightweight, small model that actually can run on your phone. Meaning, like Suno and Udio have apps that can run on your phone, but obviously that's going up to the server, to the cloud. And running off of, you know, their own, their own websites and servers and stuff. You have to have access to the Internet. With this application you technically could just do everything on your phone. Your phone is powerful enough to run this model and it can generate you stuff. Now I will put a caveat on this by saying this is not as good as Sooner or Udio. It's just, that's just the nature of the beast. So Stability trained this only on content that they had copyright for, which is fantastic, right? They don't want any sort of IP risk involved with this when they're releasing it. So they said that it's entirely made out of royalty free audio libraries and free. The free music archive and free sounds, those are kind of their sources and they're allowed to do this, which is technically great except that it's not as good. So that's, I think the big thing, it is really small. It's 341 million parameters in size and it was specifically optimized to run on ARM CPUs so ARM makes chips. These are built on, you know, this model was essentially built so that it's able to run on an ARM CPU, right. On a phone. These ARM CPUs are often put into phones. So the thing that it's specifically made for doing though is for quick kind of shorter audio samples and sound effects. So you can do drums, you can do instruments, you can do riffs and it can make up to 11 seconds of audio. You can do it on a smartphone and it takes about eight seconds to do this. So this is, you know, definitely faster than your average Udo or Suno AI piece. But and I'm not saying it's bad, I actually think it's fairly decent for what it can do but like it doesn't do vocals and so if you're trying to make a fully fledged song or honestly a really great song like Suno and Yuio are going to do a much better job in my opinion of making music. I've tried both of the. I've extensively tried Suno and it does incredible work, makes amazing music. People criticize that it was trained off of the copyrighted data. I'm not too concerned about that. That's not really my problem, you know, and I'm sure people get mad at me or criticize me for that, but that's just my opinion is just like that's, you know, their copyright issue. To deal with the model so much better. As a user and a consumer and someone that would like to create things, I'm Going to use the best model. So that's kind of what I'm getting out of Suno or Yudio. All right. I wanted to give you a sample though because I'm actually quite impressed by what they have been able to produce completely copyright free. There's no issues there. So they have a couple samples of what it's able to actually. So you can actually go online, check out SoundCloud. They got a bunch of different samples and all of their samples are like much shorter but they are, you know, showing you exactly what it's capable of doing. They could do some drums, some music. They have a bunch of limitations in addition to the all the ones I've mentioned already. One, it can only do English prompts written in English. So if you speak another language, you'd have to translate your prompts into English and Google Translate or something like that. It can't generate realistic vocals or high quality songs. It's kind of low quality and it doesn't do a lot of different musical styles. It was really just built on a bunch of kind of Western, they call them Western biased training data. So these free music libraries are not very extensive. It's just mostly kind of like Western music. So it also has a little bit of restrictive usage. It's not the end of the world. You got to make money somewhere. So it's free for researchers and hobbyists and businesses that make less than a million dollars annual revenue. But if you're making over a million dollars, you have to pay Stability's enterprise license. This isn't the end of the world. And I think this is a pretty standard licensing kind of deal. Although yeah, it feels like they'd be making something open source. So I guess some people are upset about that. Now Stable Diffusion is a company that has had a ton of issues in the past. They raised some new money last year. A bunch of their investors, including Eric Schmidt from Google, the Napster founder, Sean Parker, famously who, you know, invested in Meta. We're really trying to turn the business around. So Imod Mostaq was their co founder and he was kind of the former CEO. He apparently really mismanaged all of their finances, almost completely destroyed the company. Tons of staff resigned. There was a partnership they had with Canva that fell through. Investors were super concerned about this. So in the last few months they actually got a new CEO and they appointed James Cameron to their board of directors. Which is interesting because typically this has kind of been famous as a image company and with James Cameron you can kind of imagine where they're going with this is going to become a video company. All these AI generated images are perfectly poised to create AI generated videos. And they've also released a bunch of new image generation models. So it seems like Stability is on track to do some cool things. I think specifically if we're looking at videos, doing these sound effects and kind of these like smaller music bits makes a lot of sense. They want this in the background of if, you know, they're making music tracks to be able to or sorry, videos. It'd be really cool to have also AI generated music in the background. So this makes a lot of sense with kind of their strategic direction. I'll be super curious to see where they go. This is a very, you know, prolific company. It's raised a lot of money, it's done a lot of interesting things, but again, it has faced a lot of challenges. So I'll keep you up to date on everything happening with Stability. Make sure to leave a rating and review wherever you listen to your podcast. And again, if you haven't tried AI Box already, there's a link in the description. I would love to have you try it. You can dump a ton of your subscriptions for $20 a month. You get access to all the top AI models. You can compare results side by side of different models. You can chat with all of the models in the same chat. You don't have to switch or, you know, not have the ability to keep talking to different models. And it's a lot of fun. So check it out, AI Box AI and I will catch you next time.