Structured Streaming was introduced in Spark 2.0. Note that the utility classes from the basic streaming examples (predating structured streaming) are referenced here as well.
File | What's Illustrated |
---|---|
Basic.scala |
A very simple example of structured streaming from a sequence of CSV files, where the newly received records with each batch are dumped tot he console. |
BasicAggregation.scala |
Introduced the idea of one streaming DataFrame aggregating another. With every batch, this time the entire updated aggregation is dumped to the console. |