Chapter 2 of 3 · Microsoft DP-700
Ingest and Transform Data
Full and incremental loads, dimensional models, shortcuts, mirroring, batch transforms and streaming with Eventstream and KQL.
- 6topics
- 30 minfast track
- 3diagrams and exhibits
- 30–35%of the exam
Topics in this chapter
Take them in order, or jump to the one you need.
- 1Loading Patterns: Full, Incremental, Dimensional and StreamingDP-700 loading patterns: full and incremental loads with watermarks and MERGE, slowly changing dimensions, surrogate keys and a…Diagram5 min
- 2Choosing a Data Store and a Transformation ToolDP-700 choices: lakehouse, warehouse, Eventhouse or SQL database, and Dataflow Gen2, notebooks, KQL or T-SQL for transforming…5 min
- 3Ingesting Batch Data with Shortcuts, Mirroring and PipelinesDP-700 batch ingestion: create and manage OneLake shortcuts, choose mirroring for databases, and copy data with pipeline Copy…Diagram5 min
- 4Transforming Batch Data with PySpark, SQL and KQLDP-700 batch transforms in PySpark, T-SQL and KQL: denormalize with joins, group and aggregate, remove duplicates, fill missing…5 min
- 5Streaming Engines, Shortcuts in Real-Time Intelligence and EventstreamDP-700 streaming: choose Eventstream, Eventhouse or Spark, native tables vs OneLake shortcuts, query acceleration, and…Diagram5 min
- 6Spark Structured Streaming, KQL Processing and Windowing FunctionsDP-700 stream processing: Spark structured streaming with checkpoints and watermarks, KQL update policies and materialized views…5 min
About this chapter
What this chapter covers
Ingest and Transform Data is 30 to 35% of the Microsoft DP-700 exam. It covers loading patterns (full, incremental, dimensional and streaming), batch ingestion with pipelines, OneLake shortcuts and mirroring, transformation with PySpark, SQL and KQL, and streaming with Eventstream, Spark structured streaming and KQL, including windowing functions.
Questions are scenarios and code: you choose the store, engine or tool that fits a requirement, or complete a PySpark, T-SQL or KQL statement. Expect to tell apart dropDuplicates and arg_max, a shortcut and a mirrored database, or a tumbling and a hopping window.
How the topics fit together
Batch data and streaming data take different routes into Fabric, but both end as Delta tables in OneLake that every engine can read.
Ask first whether the data must be copied at all. A shortcut or mirroring often beats building a copy process.
How to use these pages
Each topic page has the same shape, so you can skim for what you need.
- What it is: the idea in plain words.
- How it works: the mechanism, with tables and code examples.
- What to remember for the exam: the facts to memorise and how questions are phrased.
- Common mistakes: the classic traps.
- Check yourself: three questions to test your understanding.
Ready for more practice?
The full Microsoft DP-700 question bank has 645 questions, with timed practice exams and an explanation for every answer.
This study guide is independent and is not affiliated with, endorsed by, or sponsored by Microsoft. Vendor names, certification names and exam codes are trademarks of their respective owners and are used for identification only.