Monitor and Optimize an Analytics Solution · Topic 3 of 5

Resolving Eventhouse, Eventstream, T-SQL and OneLake Shortcut Errors

DP-700 troubleshooting: Eventhouse ingestion failures and query limits, Eventstream runtime logs, warehouse T-SQL errors, and broken OneLake shortcuts.

  • 5 min
In a nutshell
  • .show ingestion failures lists failed ingestions with a transient or permanent kind.
  • KQL results are truncated at 500,000 records or 64 MB by default.
  • Eventstream: data insights for counts, runtime logs for errors, and publish after edits.

What it is

Real-time items, SQL engines and shortcuts fail differently from batch jobs. A stream can run while silently dropping events, a T-SQL statement can hit an unsupported feature, and a shortcut breaks when someone renames its target folder.

Find where data stops, read the message, and fix the cause: format, schema, permissions, credentials or unsupported syntax.

SourceEventstreamruntime logs, data insightsEventhouseingestion failuresQueryresult limitsLakehouse tableSQL endpointmetadata syncSQL querypermissions and syntax

How it works

Eventhouse errors

Failed ingestions are listed by a management command:

.show ingestion failures
| where FailedOn > ago(1d)
| project FailedOn, Table, ErrorCode, FailureKind, Details
SymptomLikely causeFix
Ingestion failures, or rows with empty columnsIngestion mapping does not match the incoming JSON or CSV fieldsCorrect the ingestion mapping or the data format
Data appears with a delayIngestion batching waits to collect dataAdjust the batching policy, or use streaming ingestion for low latency
Query result is cut offThe default result limit of 500,000 records or 64 MBFilter or aggregate; avoid set notruncation for large results
Query fails on memory or runs very longQuery scans too much data or joins large tables badlyFilter by time first, project fewer columns, summarize before joining
Old data missingIt aged out under the retention policyExtend retention, or keep history in OneLake

FailureKind shows whether a failure is Transient (a retry may succeed) or Permanent (the data or mapping must change).

Eventstream errors

WhereWhat it shows
Data insightsIncoming and outgoing event counts per node
Runtime logsErrors, warnings and information for sources, operators and destinations
Node statusWhether a source or destination is active or has failed
SymptomLikely causeFix
No incoming eventsWrong connection string or key, or another reader using the same Event Hubs consumer groupFix the connection; give the eventstream its own consumer group
Events come in but none reach the destinationFormat mismatch (JSON, CSV or Avro), or an operator filters everything outSet the correct data format; test operators in the editor
Destination errorsEventhouse table or lakehouse table schema does not match the eventsAlign the schema or mapping
Changes have no effectThe eventstream was edited but not publishedPublish the changes

T-SQL errors

SymptomLikely causeFix
INSERT or UPDATE fails on a lakehouseThe SQL analytics endpoint is read-onlyWrite with Spark, or load into a warehouse
CREATE TABLE fails on a data typeUnsupported type in Fabric Warehouse, such as nvarchar, datetime or moneyUse varchar, datetime2(6) and decimal
A new lakehouse table is not visible in the endpointMetadata sync has not caught up, or the folder is not a valid Delta tableWait or refresh the endpoint's metadata; check the table format
Permission deniedMissing ReadData, or missing GRANTGrant the item permission or object permission
Update conflict errorTwo transactions modified the same table at once under snapshot isolationRetry the losing transaction; avoid concurrent writes to one table
Cross-database query failsThree-part names work only for items in the same workspaceUse a shortcut to bring the other item's table into this workspace
-- Fails in Fabric Warehouse: nvarchar and datetime are not supported
-- CREATE TABLE dbo.Customer (Name NVARCHAR(100), Created DATETIME);

CREATE TABLE dbo.Customer
(
    Name    VARCHAR(100) NOT NULL,
    Created DATETIME2(6) NOT NULL
);

OneLake shortcut errors

SymptomLikely causeFix
Shortcut shows an error or no dataTarget folder deleted, moved or renamedRecreate the shortcut to the new path
Works for some users, fails for othersInternal shortcut: those users lack permission on the targetGrant them access to the target item
Fails for everyone after working beforeExternal shortcut: connection credentials expired or were rotatedUpdate the connection
Access denied from cloud storageThe storage account's role assignments or firewall do not allow the identityGrant the identity a storage data role, or allow access
Shortcut sits under an Unidentified folder in TablesTarget is not a Delta tablePoint it to a Delta folder, or create it under Files

A worked example

Analysts report that a KQL dashboard has shown no new data since the morning, but the IoT devices are sending normally.

In the eventstream, data insights shows incoming events but none outgoing, and the runtime logs show deserialization errors. A firmware update had switched the devices from JSON to Avro, so setting the source's data format to Avro and publishing the eventstream restores the flow.

How the exam asks about this

  • "Find why rows are not being ingested into a KQL table." .show ingestion failures.
  • "An eventstream receives events but the destination gets none." Check runtime logs and data insights for format or schema errors.
  • "A shortcut works for the lakehouse owner but not for a Viewer." The Viewer lacks permission on the shortcut's target.

What to remember for the exam

  • .show ingestion failures lists failed ingestions with a transient or permanent kind.
  • KQL results are truncated at 500,000 records or 64 MB by default.
  • Eventstream: data insights for counts, runtime logs for errors, and publish after edits.
  • Fabric Warehouse does not support nvarchar, datetime or money; the SQL analytics endpoint is read-only.
  • Internal shortcuts fail per user; external shortcuts fail for everyone when the connection breaks.
Watch out

Rotating a storage key or SAS token breaks every external shortcut that uses that connection at the same moment. Update the connection as part of the rotation.

Common mistakes

Assuming no errors means no data loss in a stream. Mapping or format mismatches can drop or empty fields; compare incoming and outgoing counts.

Running set notruncation to "fix" a truncated result. Filter or aggregate instead.

Granting workspace Contributor to fix a shortcut access error. Grant the user read access on the target item instead.

Check yourself

  • Which command lists failed ingestions in an Eventhouse?

    .show ingestion failures, which includes the error code and whether the failure is transient or permanent.

  • Why does an UPDATE against a lakehouse table through the SQL analytics endpoint fail?

    The endpoint is read-only; lakehouse tables are changed with Spark or loaded into a warehouse instead.

  • What does an Unidentified folder in a lakehouse's Tables area indicate for a shortcut?

    The shortcut target is not a Delta table, so it cannot be registered as a table.

Topic 3 of 5 in Monitor and Optimize an Analytics Solution

Test yourself on Monitor and Optimize an Analytics Solution

The full Microsoft DP-700 question bank has 645 questions, with timed practice exams and an explanation for every answer.

This study guide is independent and is not affiliated with, endorsed by, or sponsored by Microsoft. Vendor names, certification names and exam codes are trademarks of their respective owners and are used for identification only.