Loading summary
A
Runway, the creator of AI Video Generator, has just come out with an amazing new feature they've just launched called Act One. So there's a ton of people talking about this. I want to break down a couple of the use cases, a couple of the demos that people are showing off, and what exactly this tool can do. Now, before I get into it, I wanted to mention that if you are looking for a good way to make money with AI tools or grow your current business and scale it with AI tools, I would love for you to be a member of. Of the AI Hustle School community. This is something where I put exclusive content every single week of all the tools, workflows, and products I'm selling, the ways that I'm making money with AI tools, and how I'm growing my businesses. So if you're interested in joining the community, I would love for you to be a member. It's currently $19 a month. I'll probably increase the price to $100 a month in the future, but for now, if you lock in that price, it will never be raised on you. Okay, let's talk about what Runway is currently working on. So act one is absolutely fascinating. They, uh, they put out a blog post. They announced it over on LinkedIn and on X recently, and they've showed off some incredible demos. Essentially, what this does is it allows you to have one actor sitting in front of. You could say a green screen, but really like a white screen, and they're talking, and it converts it into some sort of character. Realistic or cartoon. Um, it's using the same words, it's using the same expressions. The head is moving the same way, but it's a completely different character. And you can do a completely different voice that syncs to the lips. So, all in all, this is absolutely incredible. They have a ton of cool demos. I want to show you a couple interesting things that people have made with this, how this works. But I wanted to say show you a little bit of the responses. First, in the comments section on X, what people are saying. People are saying the motion capture industry is cooked. This is true. This is a massive industry. People are saying, how long before Chinese overlords copy this with less censorship and better ui? Give it three weeks on a side. Now this is pretty great. I have to subscribe again. Okay, so, you know, some people are saying, Chinese overlords, blah, blah, blah, whatever. I think, like, the real thing people are concerned about is deep fakes are now theoretically, incredibly easy. Right. You could say anything, and now I can turn it into Me being Trump or Joe Biden or, you know, anyone else, Xi Jinping, any, you know, any leader or whatever, celebrity. And obviously this could be very problematic. Now Runway has specifically addressed this concern as they kind of talked about the rollout of Act 1 and what they're doing for safety. They said with, as with all our releases, we're committed to responsible development and deployment. We're releasing this new tool with a comprehensive suite of content moderation and safety precautions, including apparently they have even more robust abilities to detect and block attempts to generate content containing public figures. Right. So, and it's kind of interesting, like what constitutes a public figure? Obviously actors, obviously government officials. It's interesting to see if it goes much further than that. Is it YouTubers, is it, you know, whatever? So they say technical measures to verify that an end user has the right to use the voice they've created. This is also interesting, right, because, you know, technically people could be trying to use it for deep fake audio and then just cut out the video. So make it sound like Joe Biden or Trump or anyone else and then cut out the video and then you've got that. Now there's tons of other tools that actually technically allow you to do that. I'm pretty sure there's lots of open source tools where you can clone voices and you could do a lot of that. So I'm not saying that this is completely impossible. The video aspect though, is quite a big step forward and it's different. So they're really trying to counter that. They also said continuous monitoring to detect and mitigate other potential misuses of our tool and platform. Okay, this doesn't mean anything, continuous monitoring. I mean, it's just saying if something goes viral on Twitter, they're going to quickly try to fix the bug of whatever bad things someone used it to generate. So, I mean, that's. Every company is probably doing that it or should be doing that. So I wouldn't give them a ton of credit for that. That being said, like, I do appreciate they have this whole safety blurb on here and this is something that they're actually looking forward to. They said, looking ahead, we're excited to see what forms of creative storytelling Act One brings to animation and character performance. Act One is another step forward in our global and our goal to bring previously sophisticated techniques to a broad range of creators and artists. We look forward to seeing how artists and storytellers will use Act 1 to bring their visions into life in new, exciting ways. Access to Act 1 will, you know, roll out to everyone soon. Okay. So what's interesting to me is they're like, we're trying to see what people are going to use this for. They have an example of one guy. They have this, like, kind of cool skit or shot or whatever where it's one guy playing both roles of two people in a diner sitting across from each other, talking. And he's just in front of a green screen reciting both lines. Like, he looks one way, recites a line, changes his head, looks the other way, recites the line, and they use that to do both characters. Completely different voices, completely different sets, completely different characters. This is amazing. This is, you know, stuff that Hollywood has been doing for a long time and kind of had the capabilities of doing this to some degree. This is completely a whole new level. And this puts it into the hands of literally everyone. So really, really interesting. And, I mean, even to the point where people are like, oh, no, what about, like, deep fakes? Like, obviously, the capability has been there. Hollywood's been doing deep fakes. You can do makeup you could do. There's all sorts of things you could try to, you know, clone someone or whatever. This is now just in the hands of everyone, everyday people. So very, very fascinating. Something else that I thought was really interesting is they. You essentially put in, like, the driving performance. So the. The original person, it's not even a green screen. They put it on a white screen, so just a plain background. And they've shown a couple demos where they have the main driving performance. They're doing a ton of different shots. There's, like, one guy, and then he's, you know, very clean, sort of animated, looking in front of a bookshop. There's another one where it's, like, the same dude, but he's, like, very kind of overexposed background. He's in a car. And another one where he's got, like, a ton of hair and he's, you know, in a white room. So it's the same guy in three different settings. What was interesting to me is that his face is actually looking in a slightly different direction in the three settings. Overall, everything Runway has produced here is absolutely incredible. I'll definitely keep you up to date on anything else they pull out. And also what people are making with this, I think we're about to start seeing on Twitter and X a ton of different content people sharing where they've actually used these tools, you know, recording themselves and making multiple people to make some incredible films. This is next year. 2025 is the year of AI video. I believe everyone's going to become or have the tools to become a producer and create their own films. I'll be covering all of that and keeping you up to date. If you enjoyed the podcast today, if you could leave it a review, I'd be super grateful. And if you're interested in making money with AI tools, make sure to go and check out the AI Hustle School community link in the description. Thanks so much and I will see you next time.
Podcast Summary: Joe Rogan Experience for AI
Episode: Runway Has AI Video Breakthrough "Act One" for Face Rigging
Release Date: November 13, 2024
In the latest episode of the "Joe Rogan Experience for AI," the host delves into Runway's groundbreaking AI video generation tool, Act One. Launched recently, Act One represents a significant advancement in AI-driven video production, particularly in the realm of face rigging and character animation.
Act One enables users to transform a single actor's performance into multiple distinct characters seamlessly. By positioning an actor against a white screen, the tool captures their expressions and lip movements, converting them into different realistic or cartoonish characters with synchronized voice changes.
“[Act One] allows you to have one actor sitting in front of... a white screen, and they're talking, and it converts it into some sort of character. Realistic or cartoon... it’s using the same words, it's using the same expressions.”
— Host [02:15]
Runway showcased several impressive demos highlighting Act One's versatility:
Dual Character Performance: One actor performs two roles in a diner scene, switching perspectives and voices to portray both characters convincingly.
“He looks one way, recites a line, changes his head, looks the other way, recites the line...”
— Host [05:30]
Dynamic Settings: The same actor is depicted in various environments—standing in front of a bookstore, sitting in a car, and appearing in a minimalist white room—all while maintaining consistent performance nuances.
These demonstrations illustrate how Act One democratizes high-quality video production, previously dominated by Hollywood's sophisticated technology, by making it accessible to everyday creators.
The response to Act One has been a mix of excitement and concern within the tech and creative communities:
Enhanced Motion Capture Perception: Some commentators believe that Act One could render the traditional motion capture industry obsolete due to its efficiency and accessibility.
“People are saying the motion capture industry is cooked... This is a massive industry.”
— Host [07:50]
Global Competition Fears: There are apprehensions about rapid replication by international entities, particularly speculating that "Chinese overlords" might emulate the tool with fewer restrictions and superior user interfaces.
“How long before Chinese overlords copy this with less censorship and better UI? Give it three weeks on a side.”
— Host [04:10]
Acknowledging potential misuse, especially concerning deep fakes, Runway has implemented several safety protocols:
Content Moderation: Act One includes robust measures to detect and block the generation of content involving public figures, ensuring unauthorized use of likenesses is prevented.
“Technical measures to verify that an end user has the right to use the voice they've created.”
— Host [08:45]
Continuous Monitoring: Runway commits to ongoing surveillance to identify and mitigate misuse swiftly, although the host notes that such measures are standard across the industry.
“Continuous monitoring to detect and mitigate other potential misuses of our tool and platform.”
— Host [09:15]
The host expresses optimism about Act One's potential to revolutionize storytelling and content creation:
Empowering Creators: By lowering the barriers to high-quality video production, Act One empowers a broader range of creators and artists to realize their visions without the need for extensive technical expertise.
“We're excited to see what forms of creative storytelling Act One brings to animation and character performance.”
— Host [10:05]
Anticipated Growth in AI-Driven Media: Predicting significant growth in AI-generated content, the host believes that 2025 will be a pivotal year for AI video tools, enabling more individuals to produce their own films and media content.
“2025 is the year of AI video. I believe everyone's going to become or have the tools to become a producer and create their own films.”
— Host [12:20]
Runway's Act One marks a transformative step in AI-powered video production, offering unprecedented accessibility and creative flexibility. While it opens exciting possibilities for creators worldwide, it also underscores the importance of ethical considerations in AI development. The host anticipates a surge in innovative uses of Act One and commits to keeping the audience informed about future advancements and community creations.
Notable Quotes:
“They have a ton of cool demos. I want to show you a couple interesting things that people have made with this, how this works.”
— Host [03:30]
“This is a completely whole new level. And this puts it into the hands of literally everyone.”
— Host [06:45]
“If you could leave it a review, I'd be super grateful.”
— Host [14:00] (Though this pertains to podcast feedback, it's included here for comprehensiveness.)
This episode provides an in-depth exploration of Runway's Act One, highlighting its innovative features, potential applications, and the broader implications for the AI and creative industries. Whether you're an AI enthusiast, a content creator, or simply curious about the future of technology, this discussion sheds light on how AI is reshaping the landscape of video production.