Freebeat just launched and it's the first AI music video agent I've seen that can actually generate a full music video up to 6 minutes long from any song you give it. In this video I walk through exactly how it works, including how it breaks down the BPM, rhythm, and structure of your track to plan out visuals, then I run three full demos to show what you can actually create with it. First, I generate a music video for a Lady Gaga song to test the photorealistic gothic realism look. Then I pull an AI-generated track from Suno and upload my own character to test the storytelling mode and lip sync accuracy. And finally I drop a lo-fi instrumental from SoundCloud into the abstract mode, which honestly ended up being my favorite of the three. I also cover the platform's other tools, the different style and aspect ratio options (vertical and horizontal), and how to try Freebeat for free at the link below.
CHAPTERS: 0:00 What Just Launched - Freebeat AI Music Video Agent 0:19 In This Video 0:34 What is Freebeat & How AI Music Video Generation Works 1:14 Key Features: Lip Sync, Character Consistency, Vertical & Horizontal Export 1:44 How to Try Freebeat AI for Free + 10% Off Code 2:05 Freebeat Platform Homepage Walkthrough 2:23 Demo 1: Generating a Music Video From a Lady Gaga Song 2:55 Talking to the AI to Customize Your Music Video Visuals 3:21 Character, Aspect Ratio, and Resolution Settings in Freebeat 3:43 Photorealistic Style and Caption Options 3:57 Expert Mode vs Auto Mode in Freebeat 4:30 Reviewing Freebeat's Song Analysis and Music Identity Output 4:50 AI-Selected Style: Gothic Realism 5:07 Creative Concept & Storyline Generation 5:51 Scene Breakdown: 10 Scenes With Lighting, Atmosphere & Transitions 6:09 Storyboard Frame Generation (79 AI Images) 6:43 Final Music Video Output: 60+ AI-Generated Clips 6:55 Demo 1 Result: Lady Gaga AI Music Video Preview 7:37 Demo 2: Storytelling Mode With a Suno AI-Generated Song 8:23 Uploading a Custom Character to Freebeat 8:49 Cyberpunk Style & Vertical 9:16 Format Setup 9:03 Turning on Auto Mode for End-to-End AI Generation 9:41 Demo 2 Result & Lip Sync Accuracy Test 10:30 Demo 3: Abstract Music Video Mode for Instrumentals 10:54 Pulling Instrumentals From SoundCloud Into Freebeat 11:16 Demo 3 Result: Abstract Lo-Fi AI Music Video 11:41 The Freebeat Toolbox: 30+ AI Tools and Agents 11:55 Why Freebeat is Unique: 6 Minutes of Cohesive AI Video 12:34 Try Freebeat AI for Free + 10% Off Code
------------------- Clips channel @jonlawclips
I do NOT sell any products of my own. Watch out for scams.
Guys, the world's first ever AI music video agent just launched. It's called FreeBeat. You paste a
song link, hit generate, and you get a full music video back. It is up to six minutes of video long
which is insane. Visuals are beat synced to your track, characters stay consistent, and there is
lip sync if your song has vocals. Now in this video, I want to show you everything you need
to know, so exactly how it works, some step-by-step demos, and finally just show you what this stuff
actually looks like. It's going to be a really fun one. This is a super unique product and launch,
so I'm looking forward and let's go. So again, what this is is an AI music video agent that
takes a song and automatically outputs a complete music video, and I'm just a nerd with this stuff.
So just a little bit about how it works, right? It'll analyze or break down the BPM, the rhythm,
and then the structure of the song, and once it understands that structure, then it can generate
the individual video or visual generations that it needs. And then once it understands the
structure or the beat, then it can break it down into individual video or visual generations that's
required, and then it stacks those together into your full six minutes of video, which like there
are not tools out there that generate six minutes of cohesive AI video. So a really cool application
here. What's also cool is that you can upload links just directly from YouTube or SoundCloud
or just your own mp3 audio, and it'll pull that audio in for the generation. And the lip sync,
in my estimation, is about 90% accurate. That's across multiple languages. It is really good with
character consistency, and then critically, it exports in vertical format as well as horizontal.
So if you want to make shorter reels or shorts, then you can do that in one generation as well
for your 9 by 16. So I want to jump into my computer for the demos. Now first, if you want
to follow along and make your own music videos while you're watching this and learning about
the platform, it is completely free to start. You can go to this link on the screen or in the
description and you support the channel when you do that. If you want more usage and you want to
upgrade to a paid plan, you can get 10% off with the code in the description. Either way, that is
freebie.ai. And now let's get into my computer. And this is overall what the platform looks like.
There is a lot in here we're going to get into. There's also a lot we won't, which you can get
into on your own time. Well, let's just jump straight into it. What I want to do, I want to
go to creative agents right here and then click on music to MV or music to music video. Let's
just jump into it. What I want to start with is the core feature, right? Singing to music video,
e.g. taking a song and turning it into a music video. Now, again, you can upload your own MP3
track. You can also pull from YouTube, from SoundCloud or from a whole range of popular
songs that we can see right here. So let's go with abracadabra from Lady Gaga. And then I'm
going to go ahead and expand this to the first two and a half minutes of the song. Let's go ahead and
click confirm. So we've chosen our song. Now we can talk to the AI, you can describe the exact
visuals that you want. If you have a vision in mind, if it's your own MP3 track, and you want
to bring your own song and music to life, this is how you do it. Just write an extremely descriptive
prompt, the more the better. We're not going to do that. We're just going to let the AI come up with
whatever it wants. And there is a borderline infinite range of styles the AI or you can go
with. If we click under character, we can see some of the preset consistent characters it can use.
You can also upload your own if you want to. For aspect ratio, we're going to stick with 16 by 9.
We're going to go to 1080 full resolution. Now for style, again, this is all just how much do
you want to customize it or what's your own vision. For this, let's go photorealistic. Let's
see how good the AI can do. Now for captions, if you've used a tool like Opus, you'll recognize a
lot of these. These are all the very popular subtitles that you see on social media. I don't
want that in this case. So I'll leave it off. We're also going to switch from fast to expert mode.
And then let's go ahead and click create. We'll click continue. Now we can see all the steps here
that it's going to go with. If you turn on auto mode, then the agent or the AI will do all of it
for you. In this case, just to show you what the process is here, we are not going to do that. But
again, you can skip all of that if you want to. I also want to point out the three tabs here. We
can see the canvas, which is a more visual way of seeing all the steps that the agent will go
through. Then we have the editor, which ones of your visuals will make more sense. And then
results. Now if we also click under thought here, we can see exactly what's being worked on. So it
analyzed the song, it mapped out the music, and then this is the analysis. It did a whole, you
know, segment analysis, music identity. There is a lot here, which especially if it's your own music,
I think will be really interesting to you. In our case, let's go ahead and say continue,
and that this looks good to me. Now we're on to style. Okay, it selected a gothic realism as the
primary style, which will be fun to watch. Let's go ahead and say continue. Then ironically,
I think that is a good fit. And now that I think about it, that is a pretty good fit for that song
specifically. Okay, now we can see the creative concept that's generated here. So this is where
we start to see the visual direction for the music video. In this case, we have a brutalist forge with
a lone practitioner transmuting the raw elemental grief, which he or she feels into a pulsating
liquid chrome relic as a dark moon rises. So pretty creative storyline there. And again,
you can start to see basically the same steps here a human would go through. You have a rough concept,
you get through a storyline. Then after this, we start to actually create the visuals. But this is
just the story with all the different shots planned out, which then gets turned into those
individual clips to form this multi-minute video. That looks good to me. Let's click continue. Now
here we can see that that overall storyline was translated into specifically 10 scenes,
each with a description of style, lighting, atmosphere, narrative, function, transition,
etc. So this is the literal plan that now we're going to translate into visuals. Let's say
continue. And now here we can see that 79 images or shots are being generated for this and we are
55 through. Okay, our 79 storyboard frames are done. And what a beauty this is. I mean,
just look at the scale of the visuals here. Really just fun to see. And again, this is the default
mode. So it's much more performance oriented versus the more abstract or the more cohesive
story arc that we'll get into and some of the other features and demos. So this looks awesome
to me. I'm excited to see the video. Let's click continue. Okay, the final video is done. We had
about 60 videos generated from the images or the shots. Now we are going to have to replace this
with no copyright music. This is a Lady Gaga track. So I'll play that over it. This is the
actual Abracadabra song. And let's watch the first 30 seconds together. So very cool abstract theme
there with some pretty epic visuals. It is synced pretty well to the music as well. You would have
to actually be able to hear it. You could try that out yourself to hear that. So that is the
whole flow and doing it manually. But next, what if you want an actual story that is pulled
cohesively through your music video? You can do that too. And you can do it without having to
manually prompt every shot. So let's jump into demo number two. And for this, I want to customize
it more. So what we're going to do, I found this copyright free YouTube video song with lyrics.
Let's listen to this for a second. Now what I did here, I went to Suno.com. This is an AI
music maker. Let's listen to one of these for a few seconds. So that's the song we're going to
use. I'm going to go ahead and copy the link. Let's jump back into here. I will paste that
Suno link. So this is going to be full AI end-to-end song and music video for this demo.
So it is pulling the rhythm and the lyrics from here. And then let's go find a character. So let's
search this dude. Let's take that image. You can upload a video of yourself if it's your own music.
And then once this is done, we'll go ahead and upload that character. Okay, for this, we'll
select 30 seconds. And let's move to a portion with more lyrics. Let's click confirm. Now under
character right here, I'm going to click upload. So now we have our guy. Let's click continue. Now
under style, what I'm going to do is select Cyberpunk. We'll keep this to 1080. Let's go
vertical. So 9 by 16. And we'll keep this on fast. And then we're going to turn on auto. So all steps
are automatically going to be accepted and gone through by the AI itself. Now we'll click continue.
And with storytelling mode, again, there will be more of a actual cohesive story told throughout
this video. Let's select the first 30 seconds. Once more, I'll click confirm. We'll leave it blank.
Let's go back to 16 by 9. For style, let's go for sketch. We'll go a lot more abstract for this.
Also, I saw Lego in there. That's a fun one right there. I'll have to play around with that. And we
will leave this one on 720p so it's a bit faster. We have auto on. We're on expert mode. I'll click
create. Okay, so we can see in the editor track, this is done as well. I didn't show you this last
time, but you can play around with all of the actual clips here. Let's go ahead to results and
give this a watch for a few seconds. Now what I also want you to pay attention to right here is
the lip sync. If we jump back, just listen to this few seconds and look at the lips.
So that's the kind of accurate lip sync you can get. If you want it, you just prompt it and you
will get that. Let's watch it one more time. And so we can see much more of a story is told there.
And we can go check the creative brief if we don't want to understand what the storyline is or
what's being told. Now for demo number three here, what I want to do is the abstract music video mode.
The default mode is focused around your performances or your individual very visual
videos. Storytelling has a cohesive narrative or story arc. And abstract is exactly like it sounds.
This will be best for music videos which have no vocals in the song, rather just instrumentals.
Let's go ahead and click add music. So we're here on SoundCloud with some no copyright lo-fi. Let's
go ahead and click share on this track. I'll copy the URL. We'll jump back. I'll paste that link,
click enter. And so now it's going to directly pull the instrumentals from that SoundCloud link.
Okay, it is working through all these steps fully on its own. Okay, let's give this a watch. It's
transitions that we get, especially in that shot right there. So those are the three core
demos for music videos. So singing, storytelling, and abstract. There's a lot more that we're not
covering here. If we click on the toolbox, we can see all these, you know, 30 different tools
and agents and apps. And that's what I really want to emphasize here to wrap it up. You can
have as much control as you want and use this to reflect what you want to create. If you want
hands-off, abstract, just let the agent do everything, you can do that. If you want to
plan every single shot for your own music, you can do it as well. This is supposed to give you
the tools and the ability to bring your visions to life, whether you're storyboarding out the
music video you create in real life or this being the deployed end-to-end product. And this is one
of the only platforms, period, where you can generate something like six minutes of cohesive,
intelligent, consistent video. And there you go, that is Freebeat.ai. Okay, so there you go,
that's everything I wanted to show you. Again, a really cool and unique platform. And I hope,
honestly, they generalize it to just not only music videos, but just anything that you want
six minutes of cohesive video for. But anyway, if you want to try them out for free, that is
Freebeat.ai. It is in the name, you can start for free, or you can use that code in the description
for 10% off. Either way, go make something cool. I appreciate your time and being here,
and I will see you in the next one.