Home › Paths › ML Engineering › Databricks

Learning path · Databricks

ML Engineering on Databricks

You turn models into reliable products: features, training, serving and monitoring.

Free, like everything here: no sign-up, no paywall. Only the cloud you practise on may charge; the open-source path costs nothing.

Classic machine learning still runs most predictions in business: churn, fraud, demand, pricing. ML engineers make those models repeatable, served, monitored and retrained, which is also the foundation for LLM work.

Every topic below is a concept (the job) with the Databricks product that does it. Learn the concept once; on another platform only the product name changes. Read alongside: The AI Universe · Certification prep on this site.

Beginner · 8 weeks

Crawl: You can build one thing end to end, with help.

Train a model honestly, track it and serve it.

Key ideas at this level, the same on every platform:

Learn

LearnWhat it meansOn Databricks you use
Python for datapandas or Polars, plotting, notebooksDatabricks notebooksnotebook workspace
Core MLtrain, validate, test; leakage; a dumb baseline firstDatabricks ML runtimetraining
Track experimentsevery run, its data and its scoreMLflowexperiment tracking
Serve ita simple prediction endpointModel Servingmodel serving

Build on GitHub

Proposed · needs a lead

Churn model, end to end

A tabular model from raw data to a tracked experiment to a served endpoint, with an honest baseline first.

You are ready to move on when

Intermediate · 3 months

Walk: You can build it so it keeps working, without help.

Make it production-grade: features, registry, pipelines and safe releases.

Key ideas at this level, the same on every platform:

Learn

LearnWhat it meansOn Databricks you use
Feature storethe same features for training and servingFeature engineering in Unity Catalogfeature store
Model registryversions, approvals, rollbackModels in Unity Catalogmodel registry
Pipelinesretrain and test on a scheduleLakeflow Jobs + MLflowml pipelines
Lakeflow Jobsorchestration
Safe releasesshadow, canary, rollbackModel Servingmodel serving
GitHub Actions + bundlesci/cd

Build on GitHub

Proposed · needs a lead

Features and serving

Same features for training and live predictions, a model registry, and a canary release with rollback.

You are ready to move on when

Advanced · 6 months +

Run: You can design it, prove it and lead others through it.

Run models as a platform: monitoring, drift, cost and many teams.

Key ideas at this level, the same on every platform:

Learn

LearnWhat it meansOn Databricks you use
Monitoring and driftnotice quiet decay; alert on itLakehouse Monitoringmodel monitoring
Retraining policyrelease only when it beats the current modelLakeflow Jobs + MLflowml pipelines
Platform for teamstemplates, shared features, cost per modelDeclarative Automation Bundles (Asset Bundles)infrastructure as code
Billing system tablescost
From ML to LLMwhere classic models still win, and how they combineFoundation Model APIsmodel api
MLflow evaluationevaluation

Build on GitHub

Proposed · needs a lead

Drift and retrain loop

Watch a live model, detect drift, retrain on a schedule, and only release when it beats the current one.

Needs a lead

Robotics data benchmark

A benchmark for the data pipelines that feed robot learning: formats, quality and cost.

You are ready to move on when

Optional

Certifications on Databricks

Projects prove more than certificates, but a certificate can open a door. These fit this path. Exam names and codes change, so check the current one before you book.

Free prep we have written: Certifications.

Learn together

Do it with others

Every project above has a page, a list of open work and a "good first issue" label on GitHub. Pick one at your level, say hello by email, and build it in the open. If a project says needs a lead, that can be you.

All projects →   Another path →