Data Platform Architecture
Data platform architecture is not just about choosing tools. It is about designing the system around them.
This category is about platform layers, data flows, ownership, ingestion patterns, modeling boundaries, environments, orchestration, metadata, governance, observability, and deployment design.
The goal is to build data platforms that are reliable in production and still understandable six months later.
-
How considering an Iceberg migration made me rethink BigQuery costs
An Iceberg migration assessment exposed unexpected trade-offs between storage size, query speed, and slot consumption. Here is how those findings changed my approach to BigQuery costs.
-
How to make Data Engineers actually write documentation
Most data teams don’t have a documentation discipline problem. They have a system that makes documentation expensive to create and easy to ignore. Here’s how to turn it into a natural byproduct of shipping.