Streaming: Checkpoint Location

Medium
Streaming
Kafka
Checkpoint
Databricks
Snowflake

Streaming: Checkpoint Location

Read orders_topic bounded from earliest to latest. Write to orders_checkpoint_topic using writeStream with a checkpoint location for fault tolerance.

Return the stream DataFrame. The checkpoint intent is recorded - no real checkpointing occurs.

Browser Engine: Evaluates PySpark DataFrame & SQL logic locally in Pyodide WebAssembly.

Input data

0 DataFrames

These DataFrames are passed to solve(spark, dfs). Access one with dfs['name'].

Browser engine
Loading Python editor…
Click Run to try the sample cases, or Submit to check the hidden cases. First run caches the browser Python engine (~8–15s once); all code stays on your device.