Home › On your cloud › Databricks
On your cloud · the same headings as the concepts
Databricks
The lakehouse platform on any cloud: Unity Catalog, Lakeflow, SQL warehouses, Genie and Mosaic AI. The headings match the concepts tree: learn the idea in the concepts, then see here which Databricks product does each job. Product names change often; check the current docs before you build.
Databricks
Data systems: in and out
| Job | Product on Databricks |
|---|---|
| Change data capture from databases | Lakeflow Connect |
| Connectors to SaaS apps | Lakeflow Connect |
| Sharing data out | Delta Sharing, Marketplace |
No pages for this on Databricks yet; the concepts apply as they are.
Databricks
Data engineering
| Job | Product on Databricks |
|---|---|
| Storage | Unity Catalog volumes on cloud storage |
| Table format | Delta Lake |
| Into landing | Lakeflow Connect |
| Landing → bronze | Auto Loader / Lakeflow pipelines |
| Bronze → silver → gold | Lakeflow Declarative Pipelines or dbt |
| Quality checks | Pipeline expectations |
| Catalog, access, lineage | Unity Catalog |
| Semantic layer | Metric views |
| Orchestration | Lakeflow Jobs |
Data platform on AWS + Databricks
The whole picture with a product in every box.
DataTwin Studio
One batch through Spark and Delta Lake, recorded from a real run.
Streaming on Databricks without the pain
Blog: when and how to stream.
Databricks
BI and analytics
| Job | Product on Databricks |
|---|---|
| Semantic layer | Metric views |
| Dashboards | AI/BI dashboards |
| Ask in plain words | Genie |
Genie and metric views
Blog: talk to your data the right way.
Databricks
ML
| Job | Product on Databricks |
|---|---|
| Experiments and model registry | MLflow (managed) |
| Features | Feature engineering in Unity Catalog |
| Model serving | Model Serving |
No pages for this on Databricks yet; the concepts apply as they are.
Databricks
AI
| Job | Product on Databricks |
|---|---|
| Models | Foundation Model APIs, AI Gateway |
| Agents | Mosaic AI Agent Framework |
| Retrieval | Vector Search |
| Evaluation and guardrails | Agent Evaluation (MLflow) |
The agent harness on Databricks
The same 22 concerns as on Azure and AWS, each bound to a Databricks service, with a real agent's status.
Build an agent on Databricks
Each Databricks AI service explained: what we use, what we do not, and why.
Databricks
Across all of them
| Job | Product on Databricks |
|---|---|
| Governance and access | Unity Catalog |
| Cost | Billing system tables, budgets |
| Observability | System tables, data quality monitoring |
| Infrastructure as code | Asset Bundles, Terraform |
Databricks cost calculator
Whole-platform and per-hop cost with streaming and hidden costs.
Unity Catalog done right
Blog: one governance model for data and AI.
CI/CD with Asset Bundles
Blog: deploying Databricks like software.
Your Databricks bill has a leak
Blog: ten cost mistakes.
Databricks
Learning paths by role
Crawl, walk and run for each role, on Databricks.
Databricks