Databricks Workflows is now Lakeflow Jobs, and the old Workflows vs Airflow question has a third contender in Dagster. Here is how the three compare for a lakehouse team, when a hybrid makes sense, and the red flags that say fix the process before you pick a tool.
— Blog · The Discipline Layer for AI
Field notes on doing AI the disciplined way.
Contrarian, data-grounded essays on the three things that decide whether AI pays: a sharper problem, governed data, and demand that survives the answer-engine age.
— Featured
Growth · Featured essay
AI Content Generation: From Caves to Code
The first content strategists painted on cave walls. The newest ones orchestrate agents. This essay traces the whole arc — and shows how a disciplined content engine drove 359% organic traffic growth for a B2B client by treating generation as a system, not a shortcut.
Frank Shines & Umer Qureshi · Read the essay →
— All essays
Read by pillar.
Every post strengthens one of the three foundations — Problem, Data, or Growth.
Consolidating 70 to 120 Security Tools Into One Gold Layer
Security tool sprawl is a data engineering problem. Here is how a Databricks lakehouse gold layer replaces point tools and legacy SIEMs.
OCSF and the Silver Layer: Conforming Security Logs
Map raw security logs to OCSF in the Databricks lakehouse silver layer to end schema drift, cut SIEM ingest cost and speed threat hunting.
Hive Metastore to Unity Catalog Migration: Plan, UCX and What Breaks
New Databricks workspaces lose Hive metastore access from 30 September 2026, while existing ones keep it. Here is how to plan the Unity Catalog migration, pick the right tool per table, and avoid the breaks.
Data Governance as a Measured Program, Not a Policy Binder
Policy binders do not stop bad data. See how governance coded into a Databricks lakehouse keeps AI pipelines and outputs trustworthy.
Databricks Lakewatch: What the Agentic SIEM Changes for Security Data
Databricks Lakewatch is an agentic SIEM that runs on the lakehouse, built on OCSF and Unity Catalog. Here is what it changes for security data, and what it does not.
— The newsletter
One disciplined idea, in your inbox.
New essays plus the occasional contrarian take on where AI is overhyped and where it’s underrated. No spam.
— From essay to engagement
Reading about it is step one.
When you’re ready to put the discipline to work, we ship it in 90 days.






