Chapter 3 of 4 · Snowflake ARA-C01
Data Engineering
Loading and unloading design, ingestion paths, schema changes, ecosystem tools and Snowpark.
- 16topics
- 1 h 17 minfast track
- 3diagrams and exhibits
- 25%of the exam
Topics in this chapter
Take them in order, or jump to the one you need.
- 1Choosing Loading and Unloading Solutions and Data SourcesPick the right Snowflake loading or unloading design from the data source: data at rest, data in motion, external sources and…Diagram5 min
- 2Streaming Data, CDC, OLTP and API SourcesDesign Snowflake ingestion for streams of events, change data capture, OLTP databases and APIs, with Snowpipe, Kafka, streams…5 min
- 3Data Ingestion - Bulk COPY, Snowpipe and Snowpipe StreamingCompare bulk file upload with COPY, Snowpipe auto ingest and REST, and Snowpipe Streaming: latency, compute, billing, load…5 min
- 4External Tables, Reload, Incremental Updates and Iceberg TablesQuery data in place with external and Iceberg tables, understand load history and reloads, and choose incremental or full updates…5 min
- 5COPY Parameters, Error Handling and Data UnloadingMaster COPY INTO options for loading and error handling, then unload data with COPY INTO location: file size, single file…4 min
- 6Schema Detection, Schema Evolution and Handling Source ChangesHandle changing sources in Snowflake with INFER_SCHEMA, USING TEMPLATE, ENABLE_SCHEMA_EVOLUTION, MATCH_BY_COLUMN_NAME and…5 min
- 7Snowflake Ecosystem Tools and Connectors for Kafka, Spark and PythonKnow how the Snowflake Connector for Kafka, the Spark connector and the Python connector work, what each is for and how they…Diagram5 min
- 8ServiceNow and Google Analytics Connectors, JDBC and ODBC DriversLearn the Snowflake Connectors for ServiceNow and Google Analytics, and when to use the JDBC and ODBC drivers, with connection…4 min
- 9API Endpoints, SYSTEM$ALLOWLIST, SQL API, SnowSQL and Snowflake CLIUse SYSTEM$ALLOWLIST for firewall rules, call Snowflake through the SQL API, and choose between SnowSQL and the Snowflake CLI for…5 min
- 10Snowpark - Python, Scala and JavaUnderstand Snowpark DataFrames, lazy pushdown execution, UDFs and stored procedures, and how the Python, Scala and Java libraries…4 min
- 11Views and Tables - Choosing a Transformation SolutionChoose between views, secure and materialized views, table types and CTAS: properties, limits, data type effects, and storage and…5 min
- 12Dynamic Tables and Staging LayersDesign declarative pipelines with dynamic tables: target lag, refresh modes, downstream lag and cost, plus raw, staging and…Diagram5 min
- 13Querying Semi-Structured Data and FLATTENQuery JSON in VARIANT columns: path notation, casting, LATERAL FLATTEN arguments and output columns, and the performance…5 min
- 14Stored Procedures and Data Processing OptionsChoose how to process data in Snowflake: procedure languages, owner and caller rights, procedures versus UDFs, and when SQL…5 min
- 15Streams and Tasks - Change Capture and SchedulingBuild change data pipelines with streams and tasks: stream types, offsets and staleness, schedules, task graphs, triggered and…5 min
- 16Functions - UDFs, UDTFs, External Functions and Secure FunctionsChoose between UDFs, UDTFs, external functions and secure functions: languages, calling syntax, remote service limits…5 min
About this chapter
What this chapter covers
Data Engineering is the chapter on how data gets into and out of Snowflake and which tools talk to it. For the SnowPro Advanced: Architect ARA-C01 exam it tests design decisions rather than syntax: which loading path, which connector, which parameter, and why.
Questions are scenarios that start with "An Architect needs to ...". They are single answer, multiple select or interactive, and the right answer usually hinges on one trade-off such as latency, cost, duplicates or where the code runs.
How the topics fit together
Data travels a path, and each step has its own tools and failure modes.
- Choosing a solution starts from the source (at rest or in motion) and the latency the business needs.
- Streaming and CDC cover events, change capture, OLTP sources and APIs.
- Ingestion engines are bulk COPY, Snowpipe and Snowpipe Streaming.
- Tables over files are external and Iceberg tables, with load history and full or incremental updates.
- COPY parameters and unloading decide error handling and the shape of exported files.
- Schema change is handled with schema detection, schema evolution and a stable raw layer.
- Ecosystem tools are connectors, drivers, the SQL API, SnowSQL, Snowflake CLI and Snowpark.
Learn the defaults as a set. ON_ERROR is ABORT_STATEMENT for COPY and SKIP_FILE for Snowpipe, load metadata lasts 64 days for COPY and 14 days for pipes, and unload files default to CSV, split into parallel files of up to 16 MB.
How to use these pages
Each topic page has the same shape, so you can skim for what you need.
- What it is: the idea in plain words.
- How it works: the mechanism, with diagrams, SQL and comparison tables.
- Common mistakes: the classic traps.
- What to remember for the exam: the facts to memorize.
- Check yourself: three questions to test your understanding.
Read the pages in order the first time. Later pages reuse the stages, file formats and COPY options from the earlier ones.
Ready for more practice?
The full Snowflake ARA-C01 question bank has 687 questions, with timed practice exams and an explanation for every answer.
This study guide is independent and is not affiliated with, endorsed by, or sponsored by Snowflake. Vendor names, certification names and exam codes are trademarks of their respective owners and are used for identification only.