Skip to content

Latest commit

 

History

History
 
 

structured

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 

Structured Streaming Examples

Structured Streaming was introduced in Spark 2.0. Note that the utility classes from the basic streaming examples (predating structured streaming) are referenced here as well.

Basic Examples

FileWhat's Illustrated
Basic.scala

A very simple example of structured streaming from a sequence of CSV files, where the newly received records with each batch are dumped tot he console.

BasicAggregation.scala

Introduced the idea of one streaming DataFrame aggregating another. With every batch, this time the entire updated aggregation is dumped to the console.