Home › Learn › Databricks interview prep
Interview prep · data engineering
Databricks interview prep for data engineers
What a core Databricks interviewer asks when the questions get hard: what each command does, why jobs are slow or dear, how security is enforced, and how to answer. Plain words first, then the detail.
Defaults, limits and preview status change often. Check the current Databricks docs before quoting a number.
OPTIMIZE, VACUUM and compaction: what each does
OPTIMIZE, Z-order, liquid clustering, VACUUM, auto compaction, deletion vectors, REORG, RESTORE and CLONE: what each does, what it does not, and the hard follow-ups.
Row-level security and column masking
How row filters, column masks, dynamic views and tag-driven policies work in Unity Catalog, and the performance and bypass questions interviewers ask.
Which compute for which job
All-purpose, job, serverless, SQL warehouse and pool compute: when to use each, serverless settings, the best setup for streaming, and driver memory problems.
Join types and which to use when
Inner, outer, semi, anti, cross and range joins, then broadcast, shuffle-hash and sort-merge: which to use when, plus the join problems interviewers probe.
Skew, salting and avoiding shuffle
What a shuffle is, how to spot skew, the fixes in order (AQE, hints, key isolation, salting with code), and how to shuffle less today.
AQE, Photon, Predictive Optimization and newer features
What AQE, Photon and Predictive Optimization do, when each helps or does not, how Photon works inside, and a map of newer Databricks features.
The biggest cost and performance levers
Ranked levers for Databricks cost and performance, how to find your own with system tables and the query profile, plus egress and ingress costs.
What declarative means, and a semantic layer example
Declarative versus imperative in plain words, Spark Declarative Pipelines versus Databricks Lakeflow, and a worked Unity Catalog metric view.
Asset Bundles: projects as code
What Databricks Asset Bundles are, a complete databricks.yml and job example, commands, CI/CD, hard problems and the Terraform split.
Lakeflow Connect: managed ingestion
What Lakeflow Connect is, how it works, when to use it versus Auto Loader, federation, sharing and COPY INTO, and the hard points to know.
How UniForm works inside
How Delta UniForm generates Iceberg metadata, why column mapping and field IDs are required, and the consequences and alternatives.
Vector Search: internals, limits, production and maintenance
How Databricks Vector Search works inside, its limits, how to ingest, production and maintenance challenges, and when not to use it.
dbt and the Open Data Contract Standard
What problems dbt solves and where it stops, how it compares with declarative pipelines, and what the Open Data Contract Standard solves.
Cheapest way to move data in and out
The cheapest way to egress and ingress data on Databricks: avoid, shrink, then pick the path, with hidden network costs and a way to find them.
Table maintenance in pictures, with real runs
OPTIMIZE, Z-order, VACUUM, deletion vectors, RESTORE, CLONE, optimized writes and auto compaction, drawn and measured on a real Delta table.
Compaction mechanics, and partitioning vs Z-order vs liquid clustering
Who really compacts (cloud or Databricks), snappy versus compaction, when each mechanism triggers, and how liquid clustering differs inside from Z-order and partitioning.
Maintenance strategy: automatic, scheduled or both
How to choose between automatic and scheduled table maintenance by layer, table type and change rate, fixing tiny streaming files, and external table care.
Why writing lots of data is slow, and how to fix it
A measured example of a slow write (8,000 files against 2) and the causes and fixes: layout, task counts, commits, MERGE, statistics and storage.
Backup and recovery on Azure Databricks
What Azure Databricks gives you for backup and recovery (time travel, RESTORE, UNDROP, clones, storage features) and what you must build, with a practical pattern.
Tagging: best practices and how organizations use tags
The four kinds of tags, how organizations use them for cost, ownership, classification and automation, and the practices that keep them useful.
Hard problems and the question bank
The hardest Databricks data engineering scenarios with strong answers, a question bank by topic, and ten sentences to have ready for an interview.
Already on this site
Go deeper
Declarative pipelines · Metric views · Who maintains your tables · Delta vs Iceberg · SCD2 on Databricks · Real-time mode