Home › AWS › AWS data services
On your cloud · AWS · master catalog
AWS services for data platforms and streaming
Every AWS service our data platform and streaming pages use, on one picture and in one table. Each has its own page, about a 10-minute read: what it is in plain words, where it fits, what goes wrong in production, what to compare it with, cost, and a verdict.
The big picture
Every service, in its place
Names under each lane are the services that do that job. Open any of them in the table below.
| Group | Its job |
|---|---|
| Ingestion and CDC | Bring data in from databases, SaaS apps, files and devices. |
| Streaming and events | Carry events and messages while they happen. |
| Storage and table formats | Keep the data: files, tables, archive and protection. |
| Processing and compute | Run the code that cleans, joins and shapes data. |
| Query, warehouse and APIs | Answer questions and hand data to apps. |
| Operational stores | Fast databases for apps, live screens and metadata. |
| BI and dashboards | Show the numbers to people. |
| ML and AI | Train models and call language models over the data. |
| Catalog and governance | Know what data exists, who may see it and whether it is good. |
| Orchestration | Run steps in the right order at the right time. |
| Security, identity and network | Keys, secrets, roles and private network paths. |
| Observability, audit and cost | See health, who did what, and what it costs. |
| Infrastructure as code and CI/CD | Build and change all of it from code. |
The catalog
All 66 services
| Service | Group | What it does | Verdict | Azure | Google Cloud | Databricks |
|---|---|---|---|---|---|---|
| AWS DMS | Ingestion and CDC | Copies a database once, then keeps copying every insert, update and delete, here as change files into S3 landing. | Pursue | Azure Database Migration Service for moves; Data Factory or Fabric Mirroring for ongoing change capture | Datastream (change capture) and Database Migration Service (moves) | Lakeflow Connect database connectors, which write straight into tables |
| AppFlow | Ingestion and CDC | A managed, no-code copier that pulls records from SaaS apps and SAP OData services into S3 on a schedule or on an event. | Pursue | Data Factory copy activity with SaaS and SAP connectors | Application Integration connectors, or Cloud Data Fusion | Lakeflow Connect (managed SaaS connectors such as Salesforce and ServiceNow) |
| Data Exchange | Ingestion and CDC | A catalog and delivery service for third-party data: subscribe to files, APIs, Redshift shares or S3 access from providers, or send data grants. | Pursue with care | Azure Marketplace data offers and Azure Data Share | BigQuery sharing (formerly Analytics Hub) | Databricks Marketplace and Delta Sharing |
| DataSync | Ingestion and CDC | A managed copy service that moves files and objects between on-premises shares, other clouds and AWS storage, checking every file it copies. | Pursue with care | Azure Storage Mover (and AzCopy) | Storage Transfer Service | none: Databricks reads what DataSync lands in S3 with Auto Loader |
| IoT Core | Ingestion and CDC | A managed MQTT front door that gives every device its own identity, routes its messages with rules, and sends commands back. | Pursue with care | Azure IoT Hub (or Event Grid MQTT broker) | none since Google Cloud IoT Core was retired in 2023; use a partner MQTT broker into Pub/Sub | none: Databricks reads what IoT Core rules land in Kinesis or S3 |
| IoT Events and IoT Analytics | Ingestion and CDC | Two retired AWS IoT services: a device state-machine detector and a device-data analytics store. Both reached end of support; this page shows replacements. | Drop | Events: Stream Analytics or Fabric Real-Time Intelligence Activator; Analytics: Azure Data Explorer or Fabric Eventhouse | Events: Dataflow with Cloud Functions; Analytics: BigQuery (Cloud IoT Core itself was retired in 2023) | Analytics: streaming tables and Delta on the lakehouse; Events: Structured Streaming with state, or the live lane outside Databricks |
| IoT Greengrass | Ingestion and CDC | An edge runtime on a plant gateway that runs collectors, buffers data when offline and exports it to Kinesis, deployed from the cloud. | Pursue | Azure IoT Edge (and Azure IoT Operations) | none native; partner edge platforms or a self-run container host | none: Databricks reads what the gateway sends to Kinesis or S3 |
| IoT SiteWise | Ingestion and CDC | Collects readings from plant machines through an on-site gateway, and optionally models and stores them as industrial assets in the cloud. | Pursue | Azure IoT Operations (OPC UA and MQTT at the plant edge) | No first-party equivalent since Google Cloud IoT Core was retired in 2023; use partner gateways such as Litmus | none: Databricks reads what the gateway lands in Kinesis or S3 |
| Transfer Family | Ingestion and CDC | A managed SFTP, FTPS, FTP and AS2 server, plus outbound connectors and browser web apps, that store files straight into Amazon S3. | Pursue | SFTP support for Azure Blob Storage (or Azure Data Factory SFTP connector) | No managed SFTP server; a partner product from the Marketplace or a self-run server | none: Auto Loader reads the files Transfer Family writes to S3; Lakeflow Connect has an SFTP source for pulling |
| Zero-ETL | Ingestion and CDC | AWS-managed replication from Aurora, RDS, DynamoDB and some SaaS apps into Redshift or the SageMaker lakehouse, with no pipeline to build. | Keep if you have it | Fabric Mirroring (Azure SQL, Cosmos DB and others into OneLake) | Datastream into BigQuery, and Spanner or Bigtable federation | Lakeflow Connect database connectors, and Lakebase synced tables |
| Amazon MSK | Streaming and events | Apache Kafka run by AWS: brokers you size (Standard or Express), a serverless option, managed Kafka Connect and cross-cluster replication. | Pursue with care | Event Hubs (Kafka endpoint) or Confluent Cloud on Azure | Google Cloud Managed Service for Apache Kafka | none: Databricks reads and writes Kafka directly |
| Data Firehose | Streaming and events | A serverless delivery pipe that buffers records for a minute or more and writes them as files or table rows into S3 and other stores. | Pursue | Event Hubs Capture (or Stream Analytics) | Pub/Sub BigQuery and Cloud Storage subscriptions | Auto Loader reads what Firehose writes; Zerobus Ingest for single-reader app streams |
| DynamoDB Streams | Streaming and events | A built-in change feed on a DynamoDB table: every insert, update and delete, in order per item, kept for 24 hours. | Pursue | Cosmos DB change feed | Firestore listeners, or Bigtable and Spanner change streams | Lakebase (Postgres) logical replication, or Delta change data feed for tables |
| EventBridge | Streaming and events | Serverless event router: buses match events to targets, Pipes link one source to one target, Scheduler fires timed calls. | Pursue with care | Event Grid, plus Logic Apps or Functions timers for schedules | Eventarc, plus Cloud Scheduler | Lakeflow Jobs triggers (schedule, file arrival, table update) for work inside Databricks |
| Glue Schema Registry | Streaming and events | A free, serverless store of versioned Avro, JSON Schema and Protobuf schemas that checks every change against a compatibility rule. | Pursue | Azure Schema Registry in Event Hubs | Pub/Sub schemas, or the schema registry in Managed Service for Apache Kafka | none for streams; Unity Catalog governs tables, and from_avro reads Confluent Schema Registry natively |
| Kinesis Data Streams | Streaming and events | A managed, ordered log of events that many readers can replay, kept from one day up to a year, with no cluster to run. | Pursue | Event Hubs | Pub/Sub | none: Databricks reads Kinesis directly (Zerobus Ingest writes to a table, it is not a log) |
| Managed Flink | Streaming and events | Runs Apache Flink jobs for you: event-time windows, state and joins over streams, with checkpoints so a restart loses nothing. | Pursue | Azure Stream Analytics, or Confluent Cloud for Apache Flink on Azure | Dataflow (Apache Beam) | Structured Streaming, and real-time mode for sub-second work |
| SNS | Streaming and events | A managed publish and subscribe service that pushes each message to every subscriber: queues, functions, email, SMS and HTTPS endpoints. | Pursue | Event Grid (and Azure Monitor action groups for alerts) | Pub/Sub push subscriptions (and Cloud Monitoring notification channels) | none: Databricks job and SQL alert notifications cover alerts inside Databricks |
| SQS | Streaming and events | A managed queue that holds work items until one worker takes, finishes and deletes each one; no replay once read. | Pursue with care | Azure Queue Storage or Service Bus queues | Pub/Sub (pull subscriptions) or Cloud Tasks | none: Auto Loader file notification mode creates and reads an SQS queue for you |
| S3 | Storage and table formats | Object storage that holds every file and table of the platform: landing files, Delta tables, checkpoints, logs and archives. | Pursue | Azure Data Lake Storage Gen2 (Blob Storage with a hierarchical namespace) | Cloud Storage | none: Databricks stores managed tables and volumes in your S3 buckets |
| S3 Express One Zone | Storage and table formats | The fastest S3 storage class: single-digit millisecond access from directory buckets kept in one Availability Zone you choose. | Pursue with care | Azure Premium Block Blob storage (locally redundant) | Cloud Storage Rapid (zonal buckets) | none as storage; disk cache on compute does a similar job for repeated reads |
| S3 Tables | Storage and table formats | A special S3 bucket type that stores Apache Iceberg tables, holds their catalog pointer and runs compaction and clean-up for you. | Keep if you have it | No direct twin; Iceberg or Delta on ADLS with Fabric OneLake or Unity Catalog managing it | BigLake Iceberg tables (BigLake metastore) | Unity Catalog managed tables (Delta or managed Iceberg) with Predictive Optimization |
| S3 data protection | Storage and table formats | Keep old versions of objects, copy them to another bucket or region, and lock records so nobody can change them. | Pursue | Blob versioning, soft delete, object replication and immutable storage (WORM) policies | Object Versioning, soft delete, dual-region or turbo replication, Bucket Lock and object retention | Delta time travel, UNDROP for managed tables, deep clone to another region (protects tables, not raw buckets) |
| S3 storage classes | Storage and table formats | Price tiers for the same S3 object, plus lifecycle rules that move or delete objects as they age. | Pursue | Blob Storage access tiers (Hot, Cool, Cold, Archive) and lifecycle management | Cloud Storage classes (Standard, Nearline, Coldline, Archive) and Autoclass | none: Databricks reads whatever class S3 serves; Delta VACUUM and Predictive Optimization manage table history, not storage class |
| Amazon EMR | Processing and compute | AWS's managed big-data service for Spark, Hive, Trino, Flink and HBase, run on your own clusters, serverless, or on Kubernetes. | Keep if you have it | Azure HDInsight, Fabric Spark | Dataproc (clusters and Serverless) | Databricks classic and serverless compute |
| EC2 | Processing and compute | The virtual machines in your own AWS account that Databricks classic clusters run on: you pick the family, size, Spot share and pools. | Pursue with care | Azure Virtual Machines (Azure Databricks classic compute) | Compute Engine (Databricks on Google Cloud classic compute) | Serverless compute for jobs, pipelines, notebooks and SQL |
| ECS and Fargate | Processing and compute | Runs your containers on AWS: ECS decides where and how many, and Fargate supplies the machines so you never manage servers. | Keep if you have it | Azure Container Apps or Azure Container Instances | Cloud Run | none: Databricks jobs and apps run your code on its own compute |
| EKS | Processing and compute | Managed Kubernetes on AWS: AWS runs the control plane, and with Auto Mode the worker machines too, while you run containers on it. | Keep if you have it | Azure Kubernetes Service (AKS) | Google Kubernetes Engine (GKE) | none: Databricks runs its own managed compute |
| Glue ETL jobs | Processing and compute | Serverless Apache Spark and plain Python jobs on AWS, billed per worker-second, for moving and reshaping data between stores. | Keep if you have it | Azure Data Factory data flows, Fabric Spark | Dataproc Serverless, Dataflow | Lakeflow Jobs and Lakeflow Declarative Pipelines on serverless compute |
| Lambda | Processing and compute | Runs a small piece of your code when something happens, for up to 15 minutes, and bills only while it runs. | Pursue with care | Azure Functions | Cloud Run functions | none: use a Lakeflow Jobs file-arrival trigger or a small serverless job |
| API Gateway | Query, warehouse and APIs | A managed front door for APIs: REST and HTTP APIs answer requests, WebSocket APIs keep a live line open to push changes to screens. | Pursue | Azure API Management; Azure Web PubSub or SignalR for push | API Gateway or Apigee; no managed WebSocket gateway (use Cloud Run) | none: Databricks Apps can serve a small API or server-sent events, and SQL Statement Execution API answers queries |
| AppSync | Query, warehouse and APIs | Managed real-time APIs: AppSync Events is serverless publish and subscribe over WebSocket; AppSync GraphQL serves typed queries with live subscriptions. | Pursue with care | Azure Web PubSub (Events); no managed GraphQL service, use API Management GraphQL | none managed for push (Firebase Realtime Database or Cloud Run); Apigee for GraphQL | none: Databricks Apps can push server-sent events from Lakebase |
| Athena | Query, warehouse and APIs | Serverless SQL over files and tables in S3, billed by the data each query scans; good for small one-off questions. | Keep if you have it | Synapse serverless SQL pool, or Fabric SQL analytics endpoint | BigQuery (on-demand) with external or BigLake tables | Databricks SQL serverless warehouse |
| Redshift | Query, warehouse and APIs | AWS's managed SQL data warehouse, as clusters or Serverless; on this platform kept for existing BI while new work moves to Databricks SQL. | Keep if you have it | Fabric Data Warehouse, or Synapse dedicated SQL pool | BigQuery | Databricks SQL warehouse (serverless) on Delta tables in Unity Catalog |
| Aurora PostgreSQL | Operational stores | AWS's PostgreSQL-compatible database on shared, self-healing storage; a common source for DMS, and the metadata store considered but not chosen. | Keep if you have it | Azure Database for PostgreSQL flexible server | AlloyDB for PostgreSQL | Lakebase (Databricks managed PostgreSQL) |
| DynamoDB | Operational stores | A serverless key-value database that answers lookups by key in milliseconds; on this platform the fast lane's live store, not the metadata store. | Pursue | Azure Cosmos DB (NoSQL API) | Firestore or Bigtable | Lakebase (managed PostgreSQL) if every store must be inside Unity Catalog |
| ElastiCache | Operational stores | Managed in-memory cache (Valkey, Redis OSS or Memcached) for sub-millisecond lookups; dropped as the platform's primary live store. | Drop | Azure Cache for Redis, or Azure Managed Redis | Memorystore (Valkey, Redis, Memcached) | None; Lakebase or a Databricks App's own memory for small caches |
| OpenSearch | Operational stores | Managed OpenSearch for full-text search, log analytics and vector search, as domains or Serverless; not on this platform's main path. | Keep if you have it | Azure AI Search, or Elastic on Azure | Vertex AI Search, or Elastic Cloud on Google Cloud | Databricks Vector Search for embeddings; SQL warehouse for analytics |
| RDS PostgreSQL | Operational stores | Community PostgreSQL on a managed server AWS patches and backs up; a common DMS source, dropped as this platform's metadata store. | Keep if you have it | Azure Database for PostgreSQL flexible server | Cloud SQL for PostgreSQL | Lakebase (Databricks managed PostgreSQL) |
| Timestream | Operational stores | AWS's time-series databases: LiveAnalytics, closed to new customers, and managed InfluxDB 2 and 3; dropped as the live store here. | Drop | Azure Data Explorer, or Eventhouse in Microsoft Fabric | Bigtable for time-keyed data, or BigQuery | Delta tables with liquid clustering on time and device; Lakebase for latest values |
| Managed Grafana | BI and dashboards | Open-source Grafana run by AWS: live time-series boards for engineers over CloudWatch, Prometheus and fast stores. | Pursue with care | Azure Managed Grafana | Cloud Monitoring dashboards, or Grafana Cloud | AI/BI dashboards and SQL alerts over system tables (no live time-series board) |
| Quick Sight | BI and dashboards | AWS's managed dashboard and BI tool, now the Quick Sight part of AWS Quick, with an in-memory engine called SPICE. | Keep if you have it | Power BI | Looker and Looker Studio | AI/BI dashboards and Genie |
| Bedrock | ML and AI | One AWS API to call many large language models in your account, with retrieval, guardrails and a platform for running agents. | Pursue with care | Azure AI Foundry models and Foundry Agent Service | Vertex AI (Gemini and Model Garden) and Agent Builder | Foundation Model APIs, AI Gateway, Vector Search and Mosaic AI Agent Framework |
| Comprehend | ML and AI | Ready-made text analysis on AWS: finds personal data, entities, key phrases, language and sentiment in free text, with no model to train. | Pursue with care | Azure AI Language (PII detection, entities, sentiment) | Cloud Natural Language and Sensitive Data Protection | ai_mask, ai_extract and ai_classify SQL functions, and data classification in Unity Catalog |
| SageMaker AI | ML and AI | AWS's machine learning service for training, tracking and serving models, now called SageMaker AI, inside a wider SageMaker with Unified Studio. | Keep if you have it | Azure Machine Learning | Vertex AI | Mosaic AI: MLflow, feature engineering in Unity Catalog, Model Serving |
| DataZone | Catalog and governance | A business data catalog and request-and-approve sharing portal, now the catalog layer inside Amazon SageMaker Unified Studio. | Drop | Microsoft Purview (Unified Catalog) | Dataplex Universal Catalog | Unity Catalog with Catalog Explorer, tags, lineage and access requests |
| Glue Data Catalog | Catalog and governance | The AWS-native list of databases, tables and their file locations that Athena, EMR, Redshift and Glue jobs use to find data in S3. | Keep if you have it | Microsoft Purview Unified Catalog (and the OneLake catalog in Fabric) | BigLake metastore and Dataplex Universal Catalog | Unity Catalog |
| Glue Data Quality | Catalog and governance | Serverless data quality rules, written in DQDL, run against Glue Data Catalog tables or inside Glue ETL jobs, with anomaly detection. | Drop | Microsoft Purview data quality | Dataplex data quality scans | Lakeflow pipeline expectations, DQX, and data profiling (Lakehouse Monitoring) |
| Lake Formation | Catalog and governance | Database-style grants on Glue Data Catalog tables, down to columns, rows and cells, enforced across Athena, EMR, Redshift and Glue. | Keep if you have it | Microsoft Purview data access policies and OneLake security in Fabric | Dataplex and BigLake fine-grained access with IAM | Unity Catalog grants, row filters, column masks and ABAC policies |
| Glue Workflows | Orchestration | Chains Glue jobs and crawlers with triggers on a schedule, on demand or on an event, inside the Glue console. | Drop | Azure Data Factory pipelines and triggers | Cloud Composer or Workflows | Lakeflow Jobs (tasks, triggers, run history) |
| MWAA | Orchestration | Apache Airflow run by AWS: Python workflows that schedule and chain tasks across many systems, as always-on environments or the newer Serverless option. | Keep if you have it | Azure Data Factory workflow orchestration manager (managed Airflow), Fabric Apache Airflow jobs | Cloud Composer | Lakeflow Jobs |
| Step Functions | Orchestration | A serverless state machine that chains AWS service calls with waits, branches, retries and parallel steps, drawn and run as a visual workflow. | Pursue with care | Azure Logic Apps or Durable Functions | Workflows | Lakeflow Jobs (for Databricks tasks) |
| Direct Connect, VPN, Transit Gateway | Security, identity and network | The private roads from plants, offices and SAP into your AWS VPCs: a leased line, encrypted tunnels over the internet, and one hub joining them. | Pursue | ExpressRoute, VPN Gateway and Virtual WAN | Cloud Interconnect, Cloud VPN and Network Connectivity Center | none: Databricks relies on your cloud network; classic compute sits in your VPC behind it |
| IAM and STS | Security, identity and network | Who may do what in AWS: roles, policies and short-lived credentials, including the roles Databricks assumes to reach your buckets. | Pursue | Microsoft Entra ID with managed identities and Azure RBAC; Databricks access connectors | Cloud IAM with service accounts and workload identity federation | Unity Catalog grants for data; storage and service credentials wrap the IAM roles underneath |
| KMS | Security, identity and network | Managed encryption keys that never leave AWS; one key per catalog lets you see, limit and revoke every use of that data. | Pursue | Azure Key Vault (keys) and Managed HSM | Cloud KMS and Cloud HSM | Customer-managed keys for managed services and workspace storage, which point at KMS keys |
| Macie | Security, identity and network | Scans S3 buckets for personal and sensitive data and flags buckets that are public, unencrypted or shared outside your account. | Pursue with care | Microsoft Purview data classification and Defender for Storage sensitive data discovery | Sensitive Data Protection (formerly Cloud DLP) discovery | Unity Catalog data classification on tables (check current status); Macie looks at raw files, Unity Catalog at tables |
| Organizations and Control Tower | Security, identity and network | The landing zone: many AWS accounts under one organization, with guardrail policies no account can override and a central log and security account. | Pursue | Management groups, Azure Policy and Azure Landing Zones | Resource Manager folders, Organization Policy and the Cloud Foundation setup | none: Databricks has one account per company and per-workspace settings; the AWS accounts underneath come from your landing zone |
| PrivateLink | Security, identity and network | Private, one-way connections to a service through an address inside your own network, so traffic never crosses the internet. | Pursue | Azure Private Link (private endpoints) | Private Service Connect | Front-end and back-end PrivateLink, private access settings, and network connectivity configurations for serverless |
| Secrets Manager | Security, identity and network | One encrypted home for passwords, API keys and tokens, with automatic rotation, audit and copies in other regions. | Pursue | Azure Key Vault (secrets) | Secret Manager | Workspace secret scopes, and Unity Catalog secrets, which can be backed by Secrets Manager (Beta in Nov 2026) |
| VPC, endpoints and NAT | Security, identity and network | Your private network in AWS, the private doors from it to AWS services, and the one guarded door out to the internet. | Pursue | Virtual Network with service endpoints, private endpoints and NAT Gateway | VPC with Private Google Access, Private Service Connect and Cloud NAT | Customer-managed VPC for classic compute; serverless compute uses network connectivity configurations instead |
| AWS Backup | Observability, audit and cost | One place to schedule, keep, copy and lock backups of AWS databases, volumes and buckets, with restore tests and audit reports. | Pursue with care | Azure Backup | Backup and DR Service | Delta time travel, deep clone and Unity Catalog undrop (no separate backup service) |
| CloudTrail | Observability, audit and cost | The record of who called which AWS API, when and from where; here it joins the access report as audit evidence. | Pursue | Azure Activity Log and resource diagnostic logs | Cloud Audit Logs | Audit logs in the system.access.audit system table |
| CloudWatch | Observability, audit and cost | AWS's built-in metrics, logs and alarms for every service, plus X-Ray tracing; here it watches the AWS movers. | Pursue | Azure Monitor (metrics, Log Analytics, alerts) and Application Insights | Cloud Monitoring, Cloud Logging and Cloud Trace | System tables, job notifications, SQL alerts and data quality monitoring |
| Cost Explorer, CUR, Budgets | Observability, audit and cost | AWS's cost tools: charts of spend, a line-by-line bill exported to S3, and budgets that warn before spend runs away. | Pursue | Microsoft Cost Management (cost analysis, exports, budgets) | Cloud Billing reports, BigQuery billing export and budgets | Billing system tables (system.billing.usage and list_prices) and budget policies |
| CDK and CloudFormation | Infrastructure as code and CI/CD | AWS's own way to describe infrastructure as code: CloudFormation templates deployed as stacks, and CDK to write them in Python or TypeScript. | Keep if you have it | Azure Resource Manager templates and Bicep | Infrastructure Manager (managed Terraform) | Databricks Terraform provider for infrastructure, Declarative Automation Bundles (formerly Asset Bundles) for jobs and pipelines |
| CodePipeline and CodeBuild | Infrastructure as code and CI/CD | AWS's managed release pipeline (CodePipeline) and build runner (CodeBuild); an alternative to GitHub Actions for testing and deploying platform code. | Keep if you have it | Azure Pipelines (Azure DevOps) | Cloud Build and Cloud Deploy | none: Databricks is deployed to by CI using the CLI and Declarative Automation Bundles |
FAQ
Questions people ask
Which AWS services do I need for a data platform with Databricks?
S3 for storage, IAM, KMS and VPC endpoints for access and privacy, a mover for each source type (DMS for databases, AppFlow for SaaS, Transfer Family for SFTP, Kinesis or MSK for streams) and CloudWatch, CloudTrail and cost reports to run it. Databricks does the processing, catalog and orchestration.
Kinesis or MSK?
Kinesis Data Streams when you want a managed stream with no cluster and AWS-native producers; MSK when you already speak Kafka, need Kafka Connect or Debezium, or want the same tool on every cloud. Each has its own page here.
Is AWS Glue still needed if I use Databricks?
Usually not for ETL; Databricks jobs and pipelines do that. The Glue Data Catalog still matters if Athena, Redshift or EMR must read the same tables, and Glue Schema Registry if streams use Avro.
What is the Azure equivalent of each AWS data service?
Every row in the table above lists the Azure, Google Cloud and Databricks equivalent, and each service page compares them in more depth.
Related
Where it connects
AWS, on one page · Data platform on AWS + Databricks · Streaming on AWS and Databricks · Streaming options at a glance · Who maintains your tables · Databricks cost calculator