Posts
All blog posts and articles.
Recent Posts
-
Getting a handle on the blobs behind Unity Catalog
Often when working with Unity Catalog, especially with managed tables, the underlying blob storage structure can feel a bit opaque. Understanding storage con...
-
Creating Reusable Databricks Asset Bundle (DAB) Templates
As teams adopt Databricks Asset Bundles (DABs) for managing projects, ensuring consistency and accelerating setup becomes crucial. Instead of copying and pas...
-
Using Deterministic Primary Keys Instead of Identities 🔑
Traditional data warehousing often relies on auto-incrementing IDs as primary keys, leading to dependencies that can hinder data freshness, particularly in s...
-
From Batch to Streaming: Supercharging Data Freshness on Azure Databricks
We traded in our clunky, nightly batch processing for a sleek, real-time streaming data machine on Azure Databricks. By cleverly combining a hybrid approach ...