Welcome to P2 of this series. As we’ve already established what mindsets you need before embarking on this journey, let’s take a look at what I think are the fundamental skills you need to succeed and become a modern Data Engineer. These are in no particular order although I think…

You would imagine Data Engineering communities would be filled with questions about the intricacies of computer science and how to min-max your existing architecture with ingenious methods, theoretical discussions about what the future is like, and generally being excited about new technology. In fact, there is one question which occurs…

“SQL easy -> SQL medium -> Python easy -> AWS -> sql medium hard -> Python medium -> spark -> more AWS -> more leetcode” — Literal reply to a post asking ‘Where to begin as a data engineer’. No additional context. If you’re trying to break into DE, you’ve probably seen one job ad which listed over 20 frameworks, 4 languages and 10 years of experience and felt a little bit of you die…

What do you actually do? — What do you actually do? What is your remit? — A question to me from a friend in the most businessy way possible My dad has asked me several times, “What do you do now? Aren’t you a Chemist?” to which I reply I haven’t been one for two years. …

You’ve decided that Data Engineering is absolutely the career for you. You’ve started learning a couple of languages, maybe purchased a few courses. Feeling confident, you start applying for jobs. …

“So, whilst I ended up being rejected for some other jobs, I got this amazing one instead! Everything happens for a reason” — Somebody I know. The reason this person got the job because their dad got them this role. Let me start by saying I absolutely hate the phrase ‘everything happens for a reason’. …

“Why do data engineers have so much to learn?” — Redditor A common question posed by aspiring DEs looking to break into the market. This is usually because they’ve begun their journey, decided they wanted to become a DE at some point, then started looking at jobs to ‘decide what to learn’. They look at a few jobs and…

Are you an aspiring Data Engineer (DE)? Are you having trouble getting calls back? Maybe you’re not even there yet and you’re having trouble getting started. If that sounds like you, then you’re right in the right place because, once upon a time, I was you. Who am I? Well…

“Sometimes, it’s better to be lucky than to be good” — A sarcastic comment from a friend of mine. I’d say this has aged rather well We find ourselves in February 2021. Everything was coming to a close now; the bootcamp, the outcome of the job application which had taken six weeks. My nails were getting constantly shorter as the…