DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
[Databricks on AWS #0] The Target Architecture: Isolating Prod, Dev, and Sandbox with Unity Catalog

[Databricks on AWS #0] The Target Architecture: Isolating Prod, Dev, and Sandbox with Unity Catalog

5 min read
Apache Data Lakehouse Weekly: June 24 to July 1, 2026

Apache Data Lakehouse Weekly: June 24 to July 1, 2026

25 min read
# How We Built a Real-Time ETS Price Tracker for CBAM Compliance

# How We Built a Real-Time ETS Price Tracker for CBAM Compliance

5 min read
Data Backfilling with Apache Airflow: Architectures and Implementations for Historical Data Processing

Data Backfilling with Apache Airflow: Architectures and Implementations for Historical Data Processing

1
3 min read
One Big Table vs the star schema: I think everyone's arguing about the wrong thing

One Big Table vs the star schema: I think everyone's arguing about the wrong thing

3 min read
Day 51: ClickHouse® Materialized Views: Automating Data Transformations and Aggregations

Day 51: ClickHouse® Materialized Views: Automating Data Transformations and Aggregations

1
6 min read
Understanding Data Modeling, Schemas, Relationships, and Joins: The Foundation of Every Great Database

Understanding Data Modeling, Schemas, Relationships, and Joins: The Foundation of Every Great Database

1
5 min read
philliant on youtube is the companion to the writing

philliant on youtube is the companion to the writing

1
3 min read
DE Interviews Dropped DSA. The Replacement Is a Mess.

DE Interviews Dropped DSA. The Replacement Is a Mess.

7 min read
I Built an Open Healthcare Data Dictionary with 100k+ ISO-11179 Terms — Here's What I Learned

I Built an Open Healthcare Data Dictionary with 100k+ ISO-11179 Terms — Here's What I Learned

1
4 min read
Day 50 - How to Migrate Data from MySQL to ClickHouse®: A Step-by-Step Guide

Day 50 - How to Migrate Data from MySQL to ClickHouse®: A Step-by-Step Guide

1
5 min read
GenAI Won't Replace Data Engineers. Here's What Actually Changes

GenAI Won't Replace Data Engineers. Here's What Actually Changes

2 min read
Day 49: Building Dashboards with ClickHouse® and Apache Superset

Day 49: Building Dashboards with ClickHouse® and Apache Superset

2
4 min read
How Microsoft Excel Quietly Breaks Your JSON Imports (And How to Fix It)

How Microsoft Excel Quietly Breaks Your JSON Imports (And How to Fix It)

1 min read
How to Build a Modern On-Premise Data Lakehouse (Without Vendor Lock-in)

How to Build a Modern On-Premise Data Lakehouse (Without Vendor Lock-in)

4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.