[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user tdas commented on the issue: https://github.com/apache/spark/pull/20253 Great. Merging this to master and 2.3. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20253 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20253 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86208/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #86208 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86208/testReport)** for PR 20253 at commit [`408f4ee`](https://github.com/apache/spark/commit/408f4ee7c05f60ac510794a5b1d41420905444c6). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user tdas commented on the issue: https://github.com/apache/spark/pull/20253 LGTM, assuming tests pass. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #86208 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86208/testReport)** for PR 20253 at commit [`408f4ee`](https://github.com/apache/spark/commit/408f4ee7c05f60ac510794a5b1d41420905444c6). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #4051 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4051/testReport)** for PR 20253 at commit [`4bb9c3f`](https://github.com/apache/spark/commit/4bb9c3f06f4da1c14ab24ad6a642bf831c90503f). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #4052 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4052/testReport)** for PR 20253 at commit [`4bb9c3f`](https://github.com/apache/spark/commit/4bb9c3f06f4da1c14ab24ad6a642bf831c90503f). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #4051 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4051/testReport)** for PR 20253 at commit [`4bb9c3f`](https://github.com/apache/spark/commit/4bb9c3f06f4da1c14ab24ad6a642bf831c90503f). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #4052 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4052/testReport)** for PR 20253 at commit [`4bb9c3f`](https://github.com/apache/spark/commit/4bb9c3f06f4da1c14ab24ad6a642bf831c90503f). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #4047 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4047/testReport)** for PR 20253 at commit [`4bb9c3f`](https://github.com/apache/spark/commit/4bb9c3f06f4da1c14ab24ad6a642bf831c90503f). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #4049 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4049/testReport)** for PR 20253 at commit [`4bb9c3f`](https://github.com/apache/spark/commit/4bb9c3f06f4da1c14ab24ad6a642bf831c90503f). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #4048 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4048/testReport)** for PR 20253 at commit [`4bb9c3f`](https://github.com/apache/spark/commit/4bb9c3f06f4da1c14ab24ad6a642bf831c90503f). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #4049 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4049/testReport)** for PR 20253 at commit [`4bb9c3f`](https://github.com/apache/spark/commit/4bb9c3f06f4da1c14ab24ad6a642bf831c90503f). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #4047 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4047/testReport)** for PR 20253 at commit [`4bb9c3f`](https://github.com/apache/spark/commit/4bb9c3f06f4da1c14ab24ad6a642bf831c90503f). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #4048 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4048/testReport)** for PR 20253 at commit [`4bb9c3f`](https://github.com/apache/spark/commit/4bb9c3f06f4da1c14ab24ad6a642bf831c90503f). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user jose-torres commented on the issue: https://github.com/apache/spark/pull/20253 All tests seem to have gotten a kill -9 at the same clock time (1:05), despite being on different machines and at different points in the run. Poking around the build history, this same thing seems to have happened to other runs active at 1:05. I'm calling shenanigans and starting a few more. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20253 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86082/ Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20253 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #4043 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4043/testReport)** for PR 20253 at commit [`4bb9c3f`](https://github.com/apache/spark/commit/4bb9c3f06f4da1c14ab24ad6a642bf831c90503f). * This patch **fails due to an unknown error code, -9**. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #4044 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4044/testReport)** for PR 20253 at commit [`4bb9c3f`](https://github.com/apache/spark/commit/4bb9c3f06f4da1c14ab24ad6a642bf831c90503f). * This patch **fails due to an unknown error code, -9**. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #86082 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86082/testReport)** for PR 20253 at commit [`4bb9c3f`](https://github.com/apache/spark/commit/4bb9c3f06f4da1c14ab24ad6a642bf831c90503f). * This patch **fails due to an unknown error code, -9**. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #4042 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4042/testReport)** for PR 20253 at commit [`4bb9c3f`](https://github.com/apache/spark/commit/4bb9c3f06f4da1c14ab24ad6a642bf831c90503f). * This patch **fails due to an unknown error code, -9**. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #4045 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4045/testReport)** for PR 20253 at commit [`4bb9c3f`](https://github.com/apache/spark/commit/4bb9c3f06f4da1c14ab24ad6a642bf831c90503f). * This patch **fails due to an unknown error code, -9**. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user jose-torres commented on the issue: https://github.com/apache/spark/pull/20253 Kicked off the 5 runs. I noticed one of the earlier runs actually failed in PySpark. I don't know of a plausible mechanism by which this PR could cause that. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #4043 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4043/testReport)** for PR 20253 at commit [`4bb9c3f`](https://github.com/apache/spark/commit/4bb9c3f06f4da1c14ab24ad6a642bf831c90503f). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #4044 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4044/testReport)** for PR 20253 at commit [`4bb9c3f`](https://github.com/apache/spark/commit/4bb9c3f06f4da1c14ab24ad6a642bf831c90503f). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #4045 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4045/testReport)** for PR 20253 at commit [`4bb9c3f`](https://github.com/apache/spark/commit/4bb9c3f06f4da1c14ab24ad6a642bf831c90503f). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #4042 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4042/testReport)** for PR 20253 at commit [`4bb9c3f`](https://github.com/apache/spark/commit/4bb9c3f06f4da1c14ab24ad6a642bf831c90503f). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user jose-torres commented on the issue: https://github.com/apache/spark/pull/20253 In commit 4bb9c3f, there are no occurrences remaining of the string "processAllAvailable" in KafkaContinuousSourceSuite.scala, KafkaContinuousSinkSuite.scala, KafkaContinuousTest.scala, or StreamTest.scala. There are four occurrences in KafkaSourceSuite.scala, two within the MicroBatch suite and two matched to not happen in ContinuousExecution. (One test with a foreach sink was moved to the MicroBatch suite, because it was executing in microbatch mode anyway since we haven't updated foreach for continuous processing.) I believe this is exhaustive. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #86082 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86082/testReport)** for PR 20253 at commit [`4bb9c3f`](https://github.com/apache/spark/commit/4bb9c3f06f4da1c14ab24ad6a642bf831c90503f). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20253 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86071/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20253 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #86071 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86071/testReport)** for PR 20253 at commit [`71bfbcf`](https://github.com/apache/spark/commit/71bfbcfbca3b8bce064c790a92dbab59a9414934). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user jose-torres commented on the issue: https://github.com/apache/spark/pull/20253 The builds at commit 3fe76e3 were on an incomplete version of the PR, so their failures are expected. Of the 6 builds at target commit 0efc8c5, 5 passed and 1 failed. The failure was due to a stream.processAllAvailable() call in the Kafka suite; we already knew this method is inherently flake-prone for continuous processing, and had attempted to remove usages of it. I'm going to do another pass to get the rest, and then kick off 5 more attempts. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20253 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86064/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20253 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #4037 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4037/testReport)** for PR 20253 at commit [`3fe76e3`](https://github.com/apache/spark/commit/3fe76e30a01698ce8732044a0c663baa277605cb). * This patch **fails from timeout after a configured wait of \`250m\`**. * This patch **does not merge cleanly**. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #86064 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86064/testReport)** for PR 20253 at commit [`5f4f7cf`](https://github.com/apache/spark/commit/5f4f7cf6662a389abe42bfcc433d2035c5d1c35e). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #4038 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4038/testReport)** for PR 20253 at commit [`0efc8c5`](https://github.com/apache/spark/commit/0efc8c5b7e98f3e79361f355a08fc8404d2d7d9b). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20253 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86063/ Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20253 Build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #86063 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86063/testReport)** for PR 20253 at commit [`3fe76e3`](https://github.com/apache/spark/commit/3fe76e30a01698ce8732044a0c663baa277605cb). * This patch **fails Spark unit tests**. * This patch **does not merge cleanly**. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #4041 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4041/testReport)** for PR 20253 at commit [`0efc8c5`](https://github.com/apache/spark/commit/0efc8c5b7e98f3e79361f355a08fc8404d2d7d9b). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #4040 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4040/testReport)** for PR 20253 at commit [`0efc8c5`](https://github.com/apache/spark/commit/0efc8c5b7e98f3e79361f355a08fc8404d2d7d9b). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20253 Build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20253 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86060/ Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #86060 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86060/testReport)** for PR 20253 at commit [`f575483`](https://github.com/apache/spark/commit/f5754837efbdca10398b769be07eaf53ae36f0f3). * This patch **fails from timeout after a configured wait of \`250m\`**. * This patch **does not merge cleanly**. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #4039 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4039/testReport)** for PR 20253 at commit [`0efc8c5`](https://github.com/apache/spark/commit/0efc8c5b7e98f3e79361f355a08fc8404d2d7d9b). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20253 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86065/ Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20253 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #86065 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86065/testReport)** for PR 20253 at commit [`0efc8c5`](https://github.com/apache/spark/commit/0efc8c5b7e98f3e79361f355a08fc8404d2d7d9b). * This patch **fails PySpark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20253 **[Test build #86071 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86071/testReport)** for PR 20253 at commit [`71bfbcf`](https://github.com/apache/spark/commit/71bfbcfbca3b8bce064c790a92dbab59a9414934). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user jose-torres commented on the issue: https://github.com/apache/spark/pull/20253 That was an old part of the description, and no longer applies to the current change. We have almost full failOnDataLoss support, with the exception that searching for an offset greater than the available range is not a failure. This is a data loss scenario in the microbatch case, because when it happens it means that an offset within the preconstructed batch range was no longer available. I think that this is not a data loss scenario in the continuous case, since: * we expect to block forever until the next row shows up * we do not have a secondary consumer that will also expect to see this offset --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20253: [SPARK-22908][SS] Roll forward continuous processing Kaf...
Github user tdas commented on the issue: https://github.com/apache/spark/pull/20253 Why dont we have full failOnDataLoss support any more with this change? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
