eaming + Kafka Integration Guide. Apache Kafka is publish-subscribe
messaging rethought as a distributed, partitioned, replicated commit log
service.
1.6.x https://spark.apache.org/docs/1.6.3/streaming-kafka-integration.html
Regards,
Tushar Adeshara
Technical Specialist - Analytics Practice
Pers
You can also try coalesce as it will avoid full shuffle.
Regards,
Tushar Adeshara
Technical Specialist – Analytics Practice
Cell: +91-81490 04192
Persistent Systems Ltd. | Partners in Innovation |
www.persistentsys.com<http://www.persistentsys.com/>
___
