Day in the life of a data engineer | fintech startup

Balance Beam Board
29 followers
Good morning! This morning was really chaotic. My nose started bleeding, as you saw, and I had to
wash my sheets because they got a little bit bloody. So now it's 7 20 and I booked a Pilates
class for 7 30 but I'm like almost nervous to go because what if my nose starts bleeding again
during Pilates. I keep on discovering new scenes from my nose bleed and having to clean them up
and I'm gonna head to work now. Our dress code is like casual so I'm wearing this sweater
um and jeans and then this winter coat. Good morning! So because it's two of the executives'
first day, we got kaffir for breakfast which is so good and then I settled into my desk and ate
while working. So I'm a data engineer at a fintech startup and that means that I act as a source of
truth for the data. It's really important that the data we get from our customers is accurate
so we build and design systems to collect and process all the data we get. If you've watched
some of my other videos, you know that I used to do data science but I switched to data eng because
I feel like there's more interesting problems in this field that haven't been solved yet
and I love thinking about how to design things that are efficient and robust which is a lot of
the problems that I saw that worked so I've been having a lot of fun so far. Every week, we have a
meeting with our manager where we go over all the projects we've done and where he tells us about
the things that he's doing. I really like this meeting because we're all working on different
things so we get a really holistic overview of kind of like where the company's at, what we're
all doing. I always learn a lot in these meetings and our manager also gives us great advice on like
how to solve our projects and kind of distributes the tasks from external teams to us. Okay so Steve,
how's the food? Really good. Always some A-plus chicken and the hummus and bread. How would you
rate the other parts of the meal? This type of salad is extremely spicy. It was unexpected. The
it's good. I'm really, really blown away by the green sauce. I already ate it. It's very good
and I feel like it complements the pita bread perfectly. See, that's why I don't want to deal
with it. And then the rice is good. Overall, a really solid meal. I think the chicken and the
pita bread and the sauce all paired up perfectly to be the star of the show. Right now, I'm working
on a project to design an easy way for my team to visualize the quality of our data. So this would
make it super easy to see when something goes completely wrong in our pipeline and we need to
address something ASAP or that something we think is wrong isn't actually going wrong and we don't
need to spend our time to address it. Yeah, I'm really enjoying this project because it's
interesting to think of an elegant solution that's really easy for my team to use. Right now, I'm
just drafting up some ideas so that when I have my one-on-one with my manager, I can present it to
him and get feedback on my approach. So I just got some feedback from my manager and now I'm
sitting down and thinking of ways to implement it. As you can see, I really like sitting in
different places in the office. When I'm feeling a little tired, just sitting somewhere else and
putting on some music really gets me some energy to keep on working. I love that my office has
so many different places to sit and it's such a comfortable and beautiful space, especially the
lamps.
There's never a shortage of things to do, especially working at a startup,
and I love the autonomy that we have to find new ways to improve the business and implement them,
and that's what I've been doing on the side. I'm working on a new ETL script. This basically
describes how we move data between systems because a few months ago, we were talking about how our
costs were probably going to go up because these two SaaS companies merged, so I explored using an
open source tool that I've heard about to cut down costs. That ended up not working out, so I just
wrote my own script for one of our old accounting processes and it turned out to be much more
simpler, powerful, and more robust than the current script. So I've been building and testing it out
on the side and it's probably going to get implemented soon. I love how we can all explore
and propose our own ideas and I think it's a lot more fun, and you can do this at any company, but
I think it's more fun to do at a startup because their product is a lot younger and there's more
uncharted territory to really explore and make it impactful. So I've noticed that ever since I
started working, my evenings after work are either very productive and nice or they're very lazy
and unfortunately today, I think it's going to be very lazy. I just feel very tired, especially after
that big nosebleed in the morning. I kind of felt like blood going down my throat and stuff like
that during the day. And then I also found out that my bedsheets aren't dry, so I'm going to
have to find my other bedsheets and put them on my bed. So it just feels like a lot to do
and a lot that I've done today, so I'm not going to do much today.
