It’s best to start with Structured Streaming https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html#tab_python_0
https://spark.apache.org/docs/latest/structured-streaming-kafka-integration.html#tab_python_0 _____________________________ From: Aakash Basu <aakash.spark....@gmail.com> Sent: Wednesday, March 14, 2018 1:09 AM Subject: How to start practicing Python Spark Streaming in Linux? To: user <user@spark.apache.org> Hi all, Any guide on how to kich-start learning PySpark Streaming in ubuntu standalone system? Step wise, practical hands-on, would be great. Also, connecting Kafka with Spark and getting real time data and processing it in micro-batches... Any help? Thanks, Aakash.