How to Make Your AI Data Pipeline Self-Healing
Imagine having an AI data pipeline that can automatically detect and fix errors, retry failed tasks, and even regenerate code […]
How to Make Your AI Data Pipeline Self-Healing Read More »
Data Engineering
Learn Data Contracts with Open Source Tools: A Free Hands-on Coding Tutorial
Hey there! Are you interested in learning about data contracts but don’t know where to start? Well, you’re in luck!
Learn Data Contracts with Open Source Tools: A Free Hands-on Coding Tutorial Read More »
What’s Behind Robinhood’s Tech Stack?
As I was scrolling through job listings, I stumbled upon an Analytics Engineer role at Robinhood. What caught my attention
What’s Behind Robinhood’s Tech Stack? Read More »
Unlocking Structured Data: The Power of DocStrange’s Local Web UI and Upgraded 7B Model
As data engineers, we’re always on the lookout for innovative solutions to extract clean structured data from unstructured sources like
Unlocking Structured Data: The Power of DocStrange’s Local Web UI and Upgraded 7B Model Read More »
The Ultimate YAML Config File for Data Engineers: Tips and Tricks
As a solo senior dev working on a data warehouse, I’ve found myself wondering what features to include in my
The Ultimate YAML Config File for Data Engineers: Tips and Tricks Read More »
Unlocking Blazing Fast Data Processing: Polars GPU Execution
If you’re working with large datasets, you know how frustrating it can be to wait for your data to process.
Unlocking Blazing Fast Data Processing: Polars GPU Execution Read More »
The Unseen Heroes of Data Engineering: Bugs
As data engineers, we often focus on the scoreboard – the metrics, the dashboards, the reports. But let’s be real,
The Unseen Heroes of Data Engineering: Bugs Read More »
Building a Database from an API with No Order Tracking Status: A Real-Time Conundrum
As a data engineer, I’ve faced a familiar problem: building a database from an API that lacks order tracking status.
Building a Database from an API with No Order Tracking Status: A Real-Time Conundrum Read More »
Build Your Own Open Data Lakehouse with Presto and Iceberg: A Hands-on Guide
Have you ever wanted to spin up your own open data lakehouse locally using open-source tools? I recently put together
Build Your Own Open Data Lakehouse with Presto and Iceberg: A Hands-on Guide Read More »
The ETL Pipeline Conundrum: How to Tame Schema Evolution
If you’ve worked with ETL pipelines, you know the drill: data sources change, schema evolves, and your pipeline breaks. It’s
The ETL Pipeline Conundrum: How to Tame Schema Evolution Read More »