Facial Recognition for Filmmakers is Almost Here

Filmmaking Techniques
4 followers
Nov 23, 2024
When you build anything that you're passionate about, you must be able to validate your ideas
every step of the way. In fact, building a business is a lot like building a film.
I would know. I've done both. And if you take nothing from this episode, hear this critical step.
Stress test your own assumptions. See, when you want to make a film, you start with a synopsis.
Then you write a script and maybe you make a short. And if you're lucky, you shoot the feature,
you start editing and outputting rough cuts. But filmmakers and entrepreneurs get really nervous
about the same thing, showing unfinished work. But you must get reactions at every stage of
development. If you try to build anything without stress testing your assumptions,
you end up creating something that will almost certainly require some amount of course correction.
One person said, if you get on the wrong train, make sure to get off at the very next stop,
because the longer you stay on it, the more expensive the return trip will be.
And they weren't talking about trains. That's why even our little team at Strata puts in a thousand
hours of work each week. And we still just decided to spend a ton of time and a ton of money and a
ton of resources to see what we could learn by meeting people face to face at the International
Broadcasters Convention in Amsterdam. We are bringing facial recognition to Strata,
and if the results are what we planned, it's gonna be a game changer.
People who know me know that I love trade shows, but I'm not sure they all know why.
As exhausting and expensive as trade shows are, I find they are the most efficient way to connect
with people one-on-one and capture honest, unbiased, actionable feedback.
We have to decide, largely based on IBC, what are the features that we have to commit to that people
will pay for? If you've been following Strata since our start, you might recall that we actually
attended IBC one year ago. And at the time, all we had was a website and an idea. I mean, literally,
we had not yet started building the actual Strata platform. You can watch episode eight and see us
duct-taping together this website that literally did one thing. Log in. That's all it did. It did
absolutely nothing else. Sign up for waitlist. So is that not because you weren't seen just yet?
No, it's first seen. There we are. So how did we get here? We were in search of a problem and
workflow that no one else was solving. So we took that feedback and started building an
alpha version of Strata, which we showed in January of 2024 to a live audience. And so this
is a representation of where we start with AI analytics inside of media and entertainment
application. From that event, we learned which features were resonating with people. So we took
that feedback and started building a beta version of Strata. We took that to the NAB convention in
April to show even more progress. And then we took that feedback and invested in our own booth at
Cinegear Expo in June and learned that you wanted to use the beta yourself, which inspired us to
activate a beta release program. Do you see the pattern? This is how you build. You obsess about
creating with your team behind closed doors, and then you take your progress as often as you can
and you show it to strangers so you can capture honest feedback from as many corners of the world
as possible. If you're creating anything, do this. It changes you. And while this approach is at times
risky and expensive, it costs far less than having to correct for a major mistake somewhere down the
line. A painful lesson somebody watching here knows. And that's why I'm here talking and sharing
this. Making myself vulnerable is the best way to remove my own biases and blinders and invite
outsiders to help me orient and prioritize. And when this formula begins to work, you start to
gain confidence and you might even learn that you're on the right track. This time last year,
you were walking the halls with a name and not a business. And I came back to find you 12 months
later. Here you are. And you have a product. You've done it several times, Michael. And it's
always interesting to see where you're looking because I don't think you've ever been wrong.
Now, everything I've said thus far is a great reason to attend trade shows. But there's another
reason that I haven't mentioned. You get a chance to show off. And we've been working on a new
feature for a very long time. And we think it might be a game changer for workflow. Automated
facial recognition. I mean, think about the power of being able to automatically search through all
of your media, every asset and find what you're looking for simply by typing a name. Strata can
detect a face. You can name that person one time and forever search them in any amount of footage,
new and old. Austin has been shepherding facial recognition for months, but the IBC show is still
a few days away and it's still not working yet. So like a lot of new tech, this is going to be
close. Here's a design flaw. People will absolutely call people the same name because there's two
Johns. So I'm going to call you, John, and this person, John, and our system is going to combine
those even though they're different Johns. It's almost seven o'clock. We have a few hours tonight
and we'll try to figure this out. Way to cancel our dinner plan. So we're back at the hotel.
We're trying to get facial recognition to work and try to be able to demonstrate that.
We don't think anyone's actually doing what we're doing. There are people that can tag this and that,
but so much tagging is relegated to a final project or a single asset. And we're trying
to make this work off of thousands of source media because that's when it's hard. So after
a long trip, several long days of building the booth, followed by a long night of fine tuning
our facial recognition approach, we find ourselves on the first day of the show,
putting on the finishing touches so we can show it to you. You ready? Yes.
Hola. Hi. It's that day. When you have this idea of being able to tag a face, we can find a face,
but then you realize if it becomes more tedious than just doing it by hand, people won't trust
the automation. And last night we accidentally tagged two people with the same name and the
learned and we taught it something wrong. We need to build whole experiences around tagging
because we became a search company and we didn't set out to be a search company. And I think we
were landing there. So we got version zero done. It's not really ready for users, but we have
something to show at the show and the team is going to wake up today and keep working on it.
So with that, it's time to open up our booth and show our first version of facial recognition to
the community and capture what you think. We think we're the only company that has timecode
syncing in the cloud, multicam plus transcripts all at the same time. So I can search by the
actress's name, Shayna, click on the face and then boom, it will filter. Wow. Let's turn the media
search engine into something that is so fast that our creative people have more time to create and
be creative than they do spending time hunting and pecking for assets. And I can find that in
10 seconds when normally that would take 10 minutes. There's millions of hours of content
laying in cupboards somewhere. It's companies can just reuse. That's right. Okay. I just want you to
see how this alpha version zero of Strata facial recognition works in Strata. When I select my
assets and click analyze, I now have choices to analyze different things, including people. Once
I select it, Strata will automatically detect a person which I can give a proper name and Strata
will automatically find and tag that person every time they appear in any clip. So in this huge
batch of assets, if I needed to find shots of the contestant Richard celebrating, I could search for
Richard and it quickly narrows down the assets. Then I could add a compound search for triumphant
and Strata finds just these results. I mean, why haven't we had this before? I've been editing for
a long time. I've never had a search experience like this. And thankfully the people who visited
our booth started to notice that we were doing something totally different. I don't think I've
seen anything at IBC today that is closely resembling this. I never saw any product like
Strata before. I haven't really seen this kind of speed in terms of creating the metadata that would
be useful to me. And also certainly not in something that is kind of available to a single
independent content creator. We are Influencer, we have a YouTube channel as well and we don't
have like a huge team. For editor, we have three editors and this is amazing for people who need
to have more time not searching and spend all the time searching for all the files. We want a couple,
you know, like craftsmanship to automation so that directors and creative people can spend more time
in creativity. What's really great about how this show has gone is that customers are like,
will it do this? And we're like, oh yeah, that's like coming next week. That's really validating
because you want to be just in sync with your own customers. The value of coming here is really
measured in the density of the discussions and the quality of the conversations. And that's where we
totally nailed it. I met people that stayed in the booth for hours, multiple hours in this little
spot. They're actually wanting to learn every facet of what we built so far. And then they're
asking about how to apply it directly into their existing workflows. And I think that engagement
tells us that we're striking the right chords. I think the biggest thing that we learned is that
no one else is really doing what we're doing. And I think the reason for that is because we are
truly obsessive about workflow. Anyone can build a technology that does a function,
even a cool function. And there are certainly tools that can tag and analyze video. But if
you're like me, you don't use them. And I think it's because they're not doing it right. It's not
enough to just satisfy a function. We think the products of the future must consider the entire
workflow, not just a portion of it. In fact, it's why we call our company Strata. Strata is Italian
for street. And we know that taking a project from concept to completion is a long journey.
And while some tools provide a solution within that workflow, it's a whole lot better if you
can rely on a single platform to drive the whole thing. And with every person that we showed Strata
to, and we've now done this demo like hundreds and hundreds of times, we're making sure that we
understand the workflows of everyone so that we can align your feedback with our roadmap.
This is really interesting. I don't think we came up with any new ideas from this trade show,
which is actually awesome, right? Like when you're showing somebody like a brand new product,
what you don't want is for everybody to be like, oh, can it do this and this and this?
And you're like, oh, I haven't thought of that before.
We've got a long way to go. But as I said earlier, we did a lot in a year. And so much of it is
thanks to your input. To our early adopters, thank you for being willing to explore a new way of
working. To the rest of you, you should join us. Sign up for free at strata.tech.
This season of our YouTube channel is dedicated to the first users,
and we are right in the middle of getting Strata into the hands of the first 1,000 people,
which has us excited as we begin to transition our build strategy to,
I can't believe I'm saying this, Strata version 1.0.
