Skip to main content

The Blog

Thoughts on data engineering, software, and the occasional rabbit hole.

Featured

ETL vs ELT: Knowing Which One to Reach For

8 min read

ETL and ELT are two of those terms that get used interchangeably in job descriptions and architecture documents, as if the letter order doesn't matter. It does. They represent genuinely different approaches to moving and transforming data, and picking the wrong one for your situation creates problems that compound over time.

Data Engineeringsql
5 min read

Why I Created a GitHub Organisation (And Why You Probably Should Too)

I've had a personal GitHub account for years. It does what it needs to do — it holds my repos, tracks my contributions, and occasionally embarrasses me with commits from 2018 that I'd rather not think about.

miscgithubOpen Source
6 min read

AI Agents: The Good, the Frustrating, and the Genuinely Useful

Full transparency upfront: this post was written by a GitHub Copilot agent on my behalf. I gave it the brief, it wrote the words. My thoughts, its keyboard. Make of that what you will.

miscWeb DevAI
4 min read

How I Used an AI Agent to Modernize My Portfolio

I recently handed the keys of my portfolio site over to a GitHub Copilot coding agent and asked it to modernize the whole thing — version upgrades, UI polish, dependency management, the lot. Here's what that actually looked like in practice.

miscWeb DevAI
6 min read

Dimensional Modeling 101 - Design Better Data Warehouses

If you're building a data warehouse, dimensional modeling is your best friend. It makes data easier to query, understand, and analyze. Let's break down this powerful technique!

Data Modelingsql
6 min read

Data Quality Validation - Ensuring Your Data is Trustworthy

Bad data leads to bad decisions. As data engineers, one of our most important jobs is ensuring data quality. Let's explore how to validate and maintain high-quality data!

Data EngineeringPython
5 min read

Getting Started with Apache Airflow - Orchestrate Your Data Pipelines

Apache Airflow has become the go-to tool for orchestrating data workflows. If you've ever needed to run tasks in a specific order, on a schedule, with dependencies - Airflow is your friend!

Data Engineering
4 min read

How to Choose the Right Database for Your Data Project

Choosing a database feels a bit like choosing a car - there's no single "best" option, only the best option for your specific needs. Let's navigate this together!

Database
3 min read

Introduction to Data Pipelines - Your First Step in Data Engineering

Hey there! If you're stepping into the world of data engineering, you've probably heard the term "data pipeline" thrown around quite a bit. Let's break down what they are and why they're so important.

Data EngineeringPython
1 min read

Welcome

Welcome to my new blog

misc