Sound Design for Filmmakers (Master THESE Fundamentals)

Movie sound effects
101 followers
How can you use sound to enhance your films?
Well, to answer that question, today we're going to one of the top
post-production sound studios in all of documentary filmmaking.
The music should convey the feelings that you don't see on camera.
Jacob Bloomfield Misroch is an award-winning composer and sound designer who oversees
projects for clients such as A24, Marvel, Apple, and many independent filmmakers.
He was the sound designer and mixer for the A24 and Apple documentary,
The Money Game on Amazon, and also the sound supervisor for the Sundance award-winning film
Crip Camp, which was released by Netflix and nominated for an Academy Award.
Today, he's going to walk us through how to manage sound in post-production.
I think a lot of the future of artistic filmmaking is merging the world of sound design and score.
How to organize media, build soundscapes, use music, and we'll even walk through a case study
scene so that you can see exactly how focusing on sound will take your films to the next level.
We're about to unpack the process of post-production sound.
And our forte really is documentary features, so we work in a lot of docs.
So anything that we do here today is applicable to working on documentary.
So before we jump into the case study, maybe we can cover,
what does post-production sound mean?
Post-production is anything that happens after you've captured your production sound.
Post-production includes management and organization of your media,
which is super important from start to finish because these projects get really big.
So organization is very helpful.
Then that gets turned into a dialogue edit and production sound editing.
So just taking what you've gotten and cleaning it up and getting some of the clicks and pops
out and the noise and the barking dog, all that stuff happens in a dialogue edit.
And then sound design, which can be literal or diegetic sound design of if a car goes by and you
want to hear that better, you cut in the sound of a car or non-diegetic sound design.
If there's an ominous moment, you can put in some low rumbly stuff that's
not really tied to a literal moment in the film, but it creates a feeling.
And then bringing in the score and music and how to make good music choices,
where to pull good music sources.
And then all of that gets put together for a final mix and how to make those things fit together
so that you have a nice thing to send off for festivals or distribution.
This is a sound design studio.
So this is the specialty of the studio.
But these are all things that everyone out there watching right now can do with their own projects.
They can do it in whether they're shooting and editing in Final Cut or Premiere,
or it looks like we're going to be looking at Pro Tools today.
These are all things that they can do as well.
That's correct.
Okay, we're in the field, we've captured, we're bringing things back to our editing software.
Are there any first step principles when it comes to organizing sound?
Yeah, have clear groups of tracks.
So all your voiceover should be on one group of tracks,
never to be intercut or mingled with, say, music or sound effects.
Your sit-down formal dialogue interviews, like we're doing right now,
should be on its own group of tracks,
not to be intercut with, let's say, run and gun,
or let's say you just happen to catch this one great moment
of you're driving with the character in your film
and you just capture some stuff of the two of you talking in the car.
Don't put that on your voiceover tracks.
Don't put that on your formal sit-down tracks
because from an audio standpoint, those are going to be processed and mixed very differently.
For sound effects, if you are planning to do your own sound design on your own,
you can organize your sound effects into groups like ambiences
so that you can always find your trees and your birds or your distant traffic
in one set of tracks.
You can find your spot effects of, you know,
let's say you need to put keys jingling as you open the front door
or someone slams a car door.
Things like that could all be on one specific set of group tracks.
That's good for me to hear because I so often like to have,
you know, the tightest timeline in the edit
where it's like, it looks like everything is just like,
in just a couple layers.
Yeah, very compact.
The Tetris game.
Exactly, exactly.
Don't do that.
But don't do that because it's gonna be harder to find things later in the process of like,
where is that?
Where is that sound that I need to adjust a certain amount of decibels or things like that?
Yeah.
And if you ever decide to hand off your project
to a sound house or a sound mixer or a sound designer,
it's a nightmare if all of those tracks are intermingled
because the first thing that you'll get in our spec sheet to turn over to us
is to organize all your tracks out separately.
Okay.
And I'm happy to share that it's free information on our website,
immersivesound.com, which is I-M-R-S-V, sound.com.
There's a delivery spec page where all of this is written out.
Okay.
So go to the website and all of this is very clearly labeled on voiceover, dialogue, sound design.
We call them PIX tracks if it's picture department sound effects
so that we know how to keep your sound effects you've already worked hard on intact
before we start adding our own layer of sound effects.
And just for a little bit of perspective,
when you're doing sound design on a feature-length documentary,
how many tracks are we talking here?
Hundreds.
Hundreds it goes down.
Just of sound design, yeah.
Wow.
All right, so that's first tip on organization.
Don't play the Tetris game.
We're going to look at a case study here.
Yeah.
Well, before we even get into the sort of fun sound design and music and mixing pieces of it,
let's just take a look at the media management
just to get a sense of how you can organize your own sessions.
So over here in Pro Tools, we've got a bunch of track options.
I'm going to pull in the AAF and let's just collapse everything.
And for all those watching, I do not use Pro Tools.
I use Premiere.
So I'll try my best to kind of ask the questions that
for those who are also editing on Premiere will make it
so we can kind of translate the timelines we're looking at onto our editing software.
So everything that we're doing in Pro Tools,
you can essentially do in Premiere just in terms of organization and workflow.
Okay.
So I love folders.
I love not looking at everything all at once.
So we've got our video track up at the top here.
This AAF is very important.
This is what the filmmaker will deliver to the sound team.
If you're doing it yourself, then that's not going to apply.
But if you ever turn over your work to a sound team or sound designer mixer,
I always keep the original raw delivery intact so that I can go find something.
Let's say you're in the final mix.
Everything's sounding great.
They're saying, oh, you know what?
There's one piece of dialogue I'm not hearing.
We can always go back.
So I keep copies of everything.
I keep copies of source material.
So in here is an AAF folder with all the raw files.
So this filmmaker delivered something that had, you know, 24 audio tracks to you.
And then you just put it into this AAF folder and you just slide it in there.
Yep.
And you kind of build, you built this edit that we're going to watch kind of from that.
Right.
I'll copy their media down.
So these tracks up here are going to be dialogue tracks.
So I'll copy their media down into our dialogue tracks.
And you'll see we have two groups of dialogue, A and B.
A is going to be the sit down formal interviews.
Let's see if we've got some over here.
Yep.
Got a formal interview there.
And then our dialogue B tracks will be informal dialogue of just
walking around, talking in the street, doing different sources.
So I copied them down so I can always find the originals.
And then we have something called X tracks, which is really great as well.
These are generally dead tracks where we put the originals before we process them.
So let's say the filmmaker gives us four audio tracks.
Because if you're recording in the field, you'll generally have a boom, a love,
and maybe a stereo mix that your sound devices or whatever unit you're using
just creates a stereo mix.
We're not going to use all that mix.
So first we take, let me zoom in here, we take just what's going to be usable.
So if you scroll down to our active dialogue tracks, we'll probably find two tracks.
So that's going to be a boom and a love.
OK.
Before we start doing the noise reduction and the mouth declicking and all the process
that we're going to do, we say, OK, these are the mics that we like.
Now we're going to put these up on X tracks, which you're not going to hear them.
But I can retrace the steps of what mics I'm going to use.
And then let's say I do a little bit of, if we zoom in on this one,
you can see that the name of the file is the original.
Right below that, OK, that's the boom and the love.
Right below that, we've got RX Connect, which is a program we use to take clicks and pops out.
It looks like we did a second round here and then even a third round.
So this is...
So the X tracks is a way to kind of know where you came from in your edit.
If you need to revert back to the source of any particular one mic or clip.
So there's probably going to be three or four processes done to each piece of audio.
It could be maybe something got distorted when you're out in the field.
So it might be a round of de-clipping it, which means taking the distortion out.
And then maybe the person talking was kind of clicky and mouthy with their words.
So there's going to be a round of that.
Then there's going to be a round of just taking out background hum.
Right there are three different things.
I might like two or three of them.
But the client might come in for the final mix and say,
there's too much noise reduction on here.
Or I sound unnatural with how many mouth clicks you took out.
Can you put some back?
The X tracks are a way to find all of those processes quickly.
So that we're not redoing work.
That's a little bit technical and surgical, but it's a part of the process.
Did we cover pop already at the top?
We've got a pop track here.
So this is going to be probably at the beginning of the session.
Your 2-pop, which is very important.
You want your 2-pop to be at 59, 58.
And then the first frame of picture is going to be at 1.
So the hour mark is really where your film starts.
And you get 10 seconds of pre-roll.
And then two seconds you get the pop, which is called the 2-pop.
So that's some sort of technical thing.
It is and it isn't.
It's really important to have a 2-pop for sync purposes.
Because when you deliver this to Netflix or HBO
or anywhere that's going to be streaming it,
they're going to sync your picture and your audio with a 2-pop.
It's a pretty typical sound.
It sounds like that.
And then a couple seconds later, exactly two seconds later, your film starts.
So 2-pop is handy to have in there.
Okay, cool.
So we've covered what the filmmaker sent to you,
the pop, the X tracks, the dialogue A and B.
Let's keep moving down the...
PFX are fun.
PFX are all of your production sound that doesn't have dialogue in it.
So PFX...
What does that stand for?
Production effects.
So PFX and PixTracks are a little bit different.
PFX are production sound effects.
They're not really sound effects, but they're sounds that were captured.
Maybe you got good B-roll and it's just distant car bys
or maybe there's some kids playing at a park or something.
That would go on production sound effects
because it was captured during production.
It's synced to picture, but there's no dialogue.
Okay.
Let's see if we can even hear...
Yeah, there you go.
That's a good example of production sound effects.
And so those were all recorded when they were shooting those clips of the water.
Exactly.
That is synced to picture.
It was recorded on set.
Okay.
Okay, that makes sense.
Cool.
And then you've got music tracks,
which is a combination of score or any other type of music.
Not all music in a film is score.
Sometimes it's a needle drop.
Have some music that you like of a friend or famous piece of music that you can license.
And then all your music tracks go in here.
And then sound effects tracks.
These are some of the different categories that I was talking about.
PixTracks are picture department sound effects.
So let's say...
Let's see what we got in here as an example.
We have an ambulance.
That ambulance was not recorded on set,
but the filmmaker knew that they wanted to have an ambulance sound there.
Okay.
So they cut it in.
We left it in.
We liked it.
We probably added a few more layers to it.
And that could have been a sound that they got from like a licensing library
or it could have been something that they recorded, you know, out in the field.
Okay.
Yep.
Spot effects is kind of what I was talking about of specific sounds that...
See what we got in these.
So just some specific sounds that are momentary.
Okay.
Externals for external ambiences.
We have one group of ambiences that are all going to play as outside.
Some crickets in there.
Distant traffic.
So these are things, yeah, you're all putting in after they weren't necessarily recorded
when this person is actually getting into the hot tub.
Yep.
Okay.
Yeah.
All of this is fake, so to speak.
One trick as a sound designer, I would say that one layer is almost never enough
for ambiences and background sounds.
And here you're going to have four layers, each one doing a slightly different thing.
You could look at some of these layers.
One of them is electric hum with dogs barking.
So that captures some of the...
You see the lights from this sort of ADU that's going there.
Another one is night ambiences that is probably...
Those are more crickets.
Okay.
That's more of an exterior room tone.
It's sort of darker and just a warmer sound.
And then we've got a second one of those, which maybe got panned differently
because this was a surround sound mix.
You can spread some of these out and make it a really immersive experience.
Wow.
And those are all very, like, very subtle.
Very subtle.
Yeah.
Yeah, very subtle.
And then interior is going to be interior room tones and ambiences.
Here's an interior tone just for an airport.
Okay.
So that's that.
And then those all feed the main mix down here.
And organizationally, that's sort of the bulk of it.
Okay.
So it seems like a lot.
And I know that's why we wanted to choose this particular project and speak with you.
Because it showcases, like, the depth that you can go into sound design.
For those watching who want maybe, like, a simplified kind of, like,
a few things to think about based on what we just went over,
I'm hearing, like, organization on your tracks.
Super important.
And then making sure that probably when we're out on production,
to be thinking about your sound design in post.
When are you going to need certain sounds?
And then also having access to a library where you can get sound effects.
Those can be really important.
Anything else you would kind of say?
Top line summary there?
I mean, getting back to the production sound piece,
I think these filmmakers were very smart to capture some sirens when they were on set.
And they knew there were sirens around, even if it wasn't while they were filming.
So that could be a different conversation about how to get really good production sound.
But I think your point is well taken.
That if you're out in the world and you want to capture that world,
take a few minutes to look around and see if you can capture any wild sounds
that might be helpful in the edit and the mix.
Okay, perfect.
Shall we get into a scene case study to look at how all these layers come together?
Yeah, let's do it.
I also just want to be very thankful of these particular filmmakers.
It's two filmmakers.
We can put their information in the credits.
And they're very generous to share this film.
It's a great film.
It's an important film.
It's a delicate film about PTSD and healing it through alternative medicines.
So to set up the scene a little bit,
there's two people who were trying to use psychedelics
to heal some of their emotional wounds.
And Western medicine just was not cutting it.
So they had to leave the country because there weren't
trials or resources available to do it in the United States.
So they went to a different country.
And this scene shows some of what they went through in that experience.
I like the scene because it starts out in a literal sort of very diegetic sense of
we had to do a big cleanup on the dialogue because the subjects were very far away.
It's an intimate moment.
These people are very vulnerable.
So you couldn't have a camera right in their face
while they were going through this healing process.
So normally I'd say have a lav or a boom at least a couple of feet away.
The mics were probably 10 feet or more away.
So the noise reduction was very severe.
And we had to be very surgical about it.
So I can show some of what we did there.
And then the sound design starts out literal and then tries to go
to an internal headspace of these subjects going through a psychedelic experience.
So we used both sound design and music.
We were lucky enough to do both the score and the music for this film.
And I think a lot of the future of sort of artistic filmmaking
is merging the world of sound design and score
because both of them have a similar function.
It's to support the emotional experience of the film.
You know, good sound design elevates the emotional impact
and score and music very much elevates the emotional impact.
And those two can blend and the line between them is blurring more and more
which I think is very exciting.
So let me break down sort of how we approach the scenes.
I'll start off by muting all of the sound effects and all the music.
So to take a look, let's open up our dialogue tracks
and see what we're working with here.
Okay, so that audio has already been cleaned up.
Let's take a look at our original source material
and see how it sounds in comparison.
So right away I hear a lot more hiss.
Yeah.
I can zoom in on the waveforms.
They look pretty quiet because they were so far away.
Yeah, I mean that's hard.
That's tough.
To like lean on that for a scene.
Yeah, if that's our only audio, that's tricky.
So just curious if I look at our extracts, you can see the different processes.
It looks like we definitely did at least one, two, three, four, five layers of work
to make that usable.
So we were left with...
That's one of the mics.
And that's another one.
So this one, it sounds like we took a lot of the top end hiss out.
Let's see if we've got any.
Yeah, this is a noise reduction plugin.
It's been around a long time, but it still works.
It's bypassed.
And that's engaged.
There's a bunch of low rumble it's taking out, so that was useful.
And that's in addition to five rounds of surgical noise reduction.
So anyway, that's some of the dialogue work that we would do.
And let's just play the scene on its own.
Let's move forward a little bit before we get to some of the sound design and music.
So here they start to take the medicine.
And then their spiritual journey begins.
So one of the first things you'll start to hear is just reverb.
And reverb is a powerful friend.
It's a dangerous friend to overuse.
But it's something that we used a little bit on this one just to take us into a dreamy headspace.
And we have it set up as a send here.
So we could probably even watch as the fader starts to grow.
So is that something with that reverb coming in and taking us to that dream-like place?
Is that something where the filmmaker is asking you to do that?
Or are you coming in and making that creative decision in the edit?
Both.
I think whoever has the idea presents it to the other part of the team.
And we work with all types of filmmakers and clients where some filmmakers just say,
here's my film, go nuts.
Other filmmakers have a very creative and artistic vision on how it should be designed,
not just sort of cleaned up and mixed.
And we love working with everyone because it really is just a team effort to get these
films to be their best.
I will say a big part of the process that's very important is the spotting session.
So if you are working with the sound team, the spotting session is when the filmmaking
team and the sound design team get together, you watch the film,
you really talk about all of the intentions for the different scenes.
OK.
So we use some of the dialogue tracks to begin the sound design experience.
But if we keep playing it, it's still going to sound...
Over many hours, I began this releasing process.
I started yelling a complete primal yell.
But to me, if I see a shot like that with different frames overlaid on top of each other,
and obviously we're getting very emotional now with their experiences,
it's begging for sound design.
So let's go take a look at our sound design tracks.
We got a little weird, but it can happen sometimes.
Just a little bit too much in the edge of horror film for me.
But we tucked it way in under the music just to give you some sense of distress.
That's another good example of non-diegetic sound design,
where we're putting in things to make you feel something, but it's not footsteps.
It's not a door opening.
It's much more interpretive.
Releasing process.
I started yelling a complete primal yell.
That's with production and the sound effects mixed together.
Sirens, yeah.
And so those are our spot effects.
And then a big heavy lifter was the score for this.
So we already have what feels to me like a relatively full sound.
We've got the banging of the drums in the background.
We've got the reverb production dialogue going.
We've got a few spot effects on the sound design to accent certain things.
But then the music really took it to a different place.
So you can play a little bit of that.
Is this all music that you did personally?
Yep.
It's also music that we created for this.
Over many hours, I began this releasing process.
I started yelling a complete primal yell.
I've been screaming and I flipped open my eye shade.
Everything was bright.
There was these two white figures over one of the people that were screaming these things.
Mute the music.
They were both covered in blood and the blood was like going everywhere.
It seemed like a bad car accident to me.
How much of a difference emotionally that makes?
I'm trying to erase trauma like this out of my brain.
And instead, it gave me more.
I was involved in what Santa Cruz County called the worst vehicle accident in the county's history.
So cutting the music in and out, it really...
Huge difference.
...made a difference, yeah.
Huge difference.
It's really about the feeling.
So I think as a composer or even as a director,
your goal is to think of what is the feeling of the scene.
And I like to make those decisions based on the needs of the film and the characters in the film.
So these characters, I mean, they're real people,
but they were going through a very overwhelming experience.
So I wanted to make it sound and feel like a very overwhelming experience.
In this particular piece of music, it's not bombastic.
There's not like an orchestra or a bunch of big drums.
But emotionally, it feels very overwhelming to me.
How do you define what your role is when it comes to creating music for a scene like this?
I agree to some degree on you don't want to tell the audience what to feel or how to feel.
But also, as a filmmaker, you're making a piece of art that's supposed to convey an emotion.
And I think the filmmaker should be in control generally of what the feeling of the film is.
So we don't want any tiny violins.
You know, if there's a scene and a dog dies, you don't need to put in some really sad stuff.
There's a great quote that I heard that says,
the music should convey the feelings that you don't see on camera.
There's a lot of different types of music you could put over the scene.
You could put solo piano because it's an intimate experience they're going through.
You could put strings that are kind of tucked away and maybe a little bit of drama to them.
But to me, what they're going through feels somewhat chaotic.
And I think with deep psychedelics, there's a lot of a loss of control.
I think that's a lot of the point.
You're losing control of your ego in that moment to find something deeper.
And so thinking about your filmmaking in that sense of what are the feelings
that aren't necessarily on camera, but that are really underneath all that.
I feel like this music basically conveys sort of a darker loss of control in a pretty big way.
Yeah. And what was fulfilling about this project for you?
Yeah. I love some of the risks that we were able to take on this film.
I think documentaries are having a great moment right now where
there's a lot more exploration that's happening with them.
And anything that's entering into psychedelic phase sort of lends itself to that.
I don't think that's the only thing about it.
These filmmakers were really open to figuring out how to support
these deeper emotional journeys that these filmmakers are going on.
And I think getting into risk-taking,
whenever you can try to dig a little bit further below
the surface of what the feelings are underneath these characters,
you get to more rewarding stories and more rewarding filmmaking.
The sound is a huge part of how a film feels.
The dialogue is a huge part of how the information is conveyed.
But the feeling, most of the time, is from sound design and music.
Yeah. One of the things that I'm taking away from this session here is
when I'm setting out to do my own documentary project,
I think through the story, I think through the themes, I think through the characters.
And then I choose, as a cinematographer,
my visual language in a way that's going to match that story.
Whether I'm going to be all on a tripod, or if I'm going to be going handheld,
or the proximity to the characters, things like that.
I don't typically do that with sound.
And it's probably because by the time it's ready for sound design, I'm tired.
And I'm ready for it to just be out in the world.
And I don't feel like an expert when it comes to sound.
And so it's just some place where I lose energy, that part of the process.
So I think this is a reminder.
And I'll have to experiment with ways that I can get that extra boost of energy
when it comes to the sound design process,
to then start thinking about, what is the soundscape of this story?
And maybe that's something I should be thinking about from the jump,
not just when I get to the end of picture lock.
Maybe it should be something that I'm thinking about
when I start just the way I do with cinematography.
I think the more intention that you put into the sound of your film
when you're editing it, shooting it, preparing it,
the better it will be when you hand it off to anyone else to finish it.
And that's what those Pix tracks are for, the picture department sound effects,
because this film is a good example.
They cut in sounds to show us the intention
of the type of work and tonality that we needed to create.
And the more, even if it's hard for you,
and I totally get being burnt out by the end of an edit,
documentary filmmakers work for years,
and it's our job to then gently receive this thing
that you've worked on so long and so hard.
If you have the bandwidth to cut in temporary sound effects
that might even stay as final sound effects,
it helps you organize your own feelings
about the type of work that we should be doing for you.
If you're just burnt out, that's fine.
There's plenty of filmmakers that come to us and say,
I'm over it, I've been working on this film for 10 years,
just take it away from me and make it sound good.
And then we'll have a spotting session, we'll sit there all day long,
we'll have a lot of conversation about what we need to do,
and we'll make it great.
So any amount of prep is worthwhile.
For those watching, drop a comment with questions that you have
about sound design, about anything that we just went over,
because we live close to each other,
and so I can try to get some more time on his schedule.
Come ask him the specific questions that you have.
Jacob, thank you so much.
I'm going to put the links and information to Immersive Sound
if you want to check it out in the description.
Thank you for watching.
