[GitHub] [spark] joanjiao2016 commented on pull request #21038: [SPARK-22968][DStream] Throw an exception on partition revoking issue
joanjiao2016 commented on pull request #21038: URL: https://github.com/apache/spark/pull/21038#issuecomment-658514137 > Why can't you use a different group id? If the two spark streaming applications use different group id, the data will be processed twice and the result (in hbase) will be wrong This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] joanjiao2016 commented on pull request #21038: [SPARK-22968][DStream] Throw an exception on partition revoking issue
joanjiao2016 commented on pull request #21038: URL: https://github.com/apache/spark/pull/21038#issuecomment-658020895 @koeninger Hi， we have prepared two spark streaming applications with the same group id to run respectively on different cluster for disaster recovery，the first application will failed when the second application started a few minutes later, and threw exception as: java.lang.IllegalStateException: No current assignment for partition xxx This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
