File | What's Illustrated |
---|---|
FileBased.scala | Streaming from a sequence of files. |
QueueBased.scala | Streaming from a queue. |
Accumulation.scala | Accumulating stream data in a single RDD. |
Windowing.scala | Maintaining a sliding window on the most recent stream data. |
File | What's Illustrated |
---|---|
CustomReceiver.scala | Implement a very simple but well behaved custom Receiver. |
Monitoring.scala | Extend StreamListener to monitor the number of records passing through a stream. |
For examples of structured streaming as introduced in Spark 2.0, see the structured directory.
For a new, separate GitHub project that provides self-contained examples of using Spark Streaming with Kafka, please look here.