Re: Spark streaming action running the same work in parallel

2015-04-27 Thread ColinMc
My unit test showed that there was one RDD that had both customers with their events as partitions. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-streaming-action-running-the-same-work-in-parallel-tp22613p22665.html Sent from the Apache Spark User List

Re: Spark streaming action running the same work in parallel

2015-04-22 Thread Tathagata Das
wing off the results when > comparing against the expected results. > > Here is some of the code in the test for troubleshooting > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Spark-streaming-action-run

Spark streaming action running the same work in parallel

2015-04-22 Thread ColinMc
launch worker-x." This is throwing off the results when comparing against the expected results. Here is some of the code in the test for troubleshooting -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-streaming-action-running-the-same-work-in-par