Chapter 1 of 4 · AWS DEA-C01
Data Ingestion and Transformation
Streaming and batch ingestion, processing, orchestration and programming skills.
- 8topics
- 40 minfast track
- 5diagrams and exhibits
- 34%of the exam
Topics in this chapter
Take them in order, or jump to the one you need.
- 1Streaming Data IngestionChoose between Kinesis Data Streams, Amazon Data Firehose and Amazon MSK for streaming ingestion, and handle shards, throughput…Diagram5 min
- 2Batch Ingestion and MigrationPick the right AWS service for batch loads and database migration with DMS, AppFlow, DataSync, Transfer Family and Glue, using…Diagram7 min
- 3File Formats and CompressionCompare CSV, JSON, Avro, Parquet and ORC and the main compression codecs, and learn how format, file size and partitioning affect…4 min
- 4Choosing a Processing ServiceDecide between AWS Glue, Amazon EMR, Lambda, Athena and Redshift for data transformation, including EMR deployment options and…Diagram5 min
- 5AWS Glue ETL JobsBuild and tune AWS Glue ETL jobs: job types, DynamicFrames, bookmarks, workers and DPUs, connections, streaming ETL and common…5 min
- 6Step Functions and Glue WorkflowsOrchestrate data pipelines with AWS Step Functions and Glue workflows, using states, retries, error handling, service…Diagram4 min
- 7MWAA and Event Driven PipelinesUse Amazon MWAA, EventBridge, SNS and SQS to orchestrate event driven and scheduled data pipelines, and choose between Airflow…Diagram5 min
- 8Programming Concepts and IaCApply SQL, Lambda, Git, CI/CD and infrastructure as code with CloudFormation, CDK and SAM to build repeatable, tested data…5 min
About this chapter
What this chapter covers
This chapter follows the path data takes from its source to a usable form. It starts with how data enters AWS, then how it is changed, then how the steps are scheduled and automated.
It has four outline topics: ingestion, transformation and processing, orchestration, and programming concepts. The questions are mostly about selecting the right service for a scenario, so each page stresses selection logic and the typical trap.
The chapter follows the first domain of the AWS Certified Data Engineer Associate DEA-C01 exam guide.
How the topics fit together
The pages follow the life of a pipeline from the first record to the deployed code.
- Streaming and batch ingestion cover Kinesis, Firehose, MSK, DMS, AppFlow, DataSync and replayable loads.
- Formats and compression explain why Parquet, partitions and file sizes drive cost and speed.
- Processing services compare Glue, EMR, Lambda, Athena and Redshift, and go deeper on Glue jobs.
- Orchestration covers Step Functions, Glue workflows, MWAA, EventBridge, SNS and SQS.
- Programming concepts cover SQL, Lambda, Git, CI/CD and infrastructure as code.
Most questions in this chapter hinge on one phrase such as "least operational overhead", "near real time" or "existing Kafka". Learn which service each phrase points to.
How to use these pages
Each topic page has the same shape, so you can skim for what you need.
- What it is: the idea in plain words.
- How it works: the mechanism, with diagrams and examples.
- What to remember for the exam: the facts to memorise.
- Common mistakes: the classic traps.
- Check yourself: three questions to test your understanding.
Read the pages in order the first time, because later pages assume the earlier ones. Then return to the comparison tables when you revise.
Ready for more practice?
The full AWS DEA-C01 question bank has 845 questions, with timed practice exams and an explanation for every answer.
This study guide is independent and is not affiliated with, endorsed by, or sponsored by AWS. Vendor names, certification names and exam codes are trademarks of their respective owners and are used for identification only.