Home › On your cloud › Databricks

On your cloud · the same headings as the concepts

Databricks

The lakehouse platform on any cloud: Unity Catalog, Lakeflow, SQL warehouses, Genie and Mosaic AI. The headings match the concepts tree: learn the idea in the concepts, then see here which Databricks product does each job. Product names change often; check the current docs before you build.

Databricks

Data systems: in and out

JobProduct on Databricks
Change data capture from databasesLakeflow Connect
Connectors to SaaS appsLakeflow Connect
Sharing data outDelta Sharing, Marketplace

No pages for this on Databricks yet; the concepts apply as they are.

Databricks

Data engineering

JobProduct on Databricks
StorageUnity Catalog volumes on cloud storage
Table formatDelta Lake
Into landingLakeflow Connect
Landing → bronzeAuto Loader / Lakeflow pipelines
Bronze → silver → goldLakeflow Declarative Pipelines or dbt
Quality checksPipeline expectations
Catalog, access, lineageUnity Catalog
Semantic layerMetric views
OrchestrationLakeflow Jobs

Data platform on AWS + Databricks

The whole picture with a product in every box.

DataTwin Studio

One batch through Spark and Delta Lake, recorded from a real run.

Streaming on Databricks without the pain

Blog: when and how to stream.

Databricks

BI and analytics

JobProduct on Databricks
Semantic layerMetric views
DashboardsAI/BI dashboards
Ask in plain wordsGenie

Genie and metric views

Blog: talk to your data the right way.

Databricks

ML

JobProduct on Databricks
Experiments and model registryMLflow (managed)
FeaturesFeature engineering in Unity Catalog
Model servingModel Serving

No pages for this on Databricks yet; the concepts apply as they are.

Databricks

AI

JobProduct on Databricks
ModelsFoundation Model APIs, AI Gateway
AgentsMosaic AI Agent Framework
RetrievalVector Search
Evaluation and guardrailsAgent Evaluation (MLflow)

The agent harness on Databricks

The same 22 concerns as on Azure and AWS, each bound to a Databricks service, with a real agent's status.

Build an agent on Databricks

Each Databricks AI service explained: what we use, what we do not, and why.

Databricks

Across all of them

JobProduct on Databricks
Governance and accessUnity Catalog
CostBilling system tables, budgets
ObservabilitySystem tables, data quality monitoring
Infrastructure as codeAsset Bundles, Terraform

Databricks cost calculator

Whole-platform and per-hop cost with streaming and hidden costs.

Unity Catalog done right

Blog: one governance model for data and AI.

CI/CD with Asset Bundles

Blog: deploying Databricks like software.

Your Databricks bill has a leak

Blog: ten cost mistakes.

Databricks

Learning paths by role

Crawl, walk and run for each role, on Databricks.

Databricks

Certifications