AWS DMS

AWS Database Migration Service (DMS) is a service that replicates and migrates data between databases, including ongoing change data capture. DEA-C01 covers DMS as an ingestion path for bringing relational data into data lakes and warehouses.

All DEA-C01 Terms

AWS Glue

AWS Glue is a serverless data-integration service for discovering, cataloging, transforming, and moving data.

Glue Data Catalog

The AWS Glue Data Catalog is a central metadata repository that stores table definitions and schema for data in S3 and other stores.

Amazon Kinesis

Amazon Kinesis is a family of services for real-time streaming data, including Data Streams and Data Firehose.

Amazon MSK

Amazon Managed Streaming for Apache Kafka (MSK) is a managed Kafka service for building streaming data pipelines.

Amazon Redshift

Amazon Redshift is AWS's petabyte-scale cloud data warehouse for analytics using SQL.

Amazon Athena

Amazon Athena is a serverless interactive query service that runs SQL directly against data in S3 using the Glue Data Catalog.

Data Lake

A data lake is a centralized repository, typically on Amazon S3, that stores structured and unstructured data at any scale for analytics.

AWS Lake Formation

AWS Lake Formation is a service that simplifies building and securing data lakes with fine-grained, centrally managed permissions.

Partitioning

Partitioning is organizing data-lake files into folders by key (such as date) so queries scan less data and run faster and cheaper.

Parquet

Apache Parquet is a columnar storage file format that compresses well and speeds up analytic queries by reading only needed columns.

AWS DMS

AWS Database Migration Service (DMS) is a service that replicates and migrates data between databases, including ongoing change data capture.

Step Functions

AWS Step Functions is a serverless orchestration service that coordinates multiple AWS services into workflows using state machines.