Hi, I would like to implement a custom partitioning algorithm in a streaming environment, preferably in a generic manner using a single pass. The only sources I could find mention Apache Kafka which adds a complexity I would like to avoid since there seem to be no documentation regarding ways to achieve effective communication between the 2.
Could you give me pointers in regards to implementing a custom partitioner with streaming support or redirect me to related sources? --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
