White Cheese (Burgos) - Developing
White Cheese (Burgos) - Developing
Very new or simple note, likely to evolve and change.
Click the cheese icon to learn more

Deletes in Delta Table Streams

Author: guiferviz Created: Last Modified:

By default, deletes in a Delta Table cause a streaming query to fail, as Spark Streaming expects append-only sources. This ensures data integrity but requires configuration to handle deletes without interrupting the stream:

  • ignoreDeletes or skipChangeCommits, described in the docs.
  • Delta Table Change Data Feed (CDF).