[GitHub] spark issue #21441: [DO-NOT-MERGE] Run tests against hadoop-3.1 to see the t...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21441 **[Test build #91990 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91990/testReport)** for PR 21441 at commit [`2c4bc85`](https://github.com/apache/spark/commit/2c4bc85cd3ef79318b8433196128adf3a3f752dd). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21441: [DO-NOT-MERGE] Run tests against hadoop-3.1 to see the t...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21441 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21441: [DO-NOT-MERGE] Run tests against hadoop-3.1 to see the t...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21441 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/248/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21441: [DO-NOT-MERGE] Run tests against hadoop-3.1 to see the t...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21441 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/4143/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21441: [DO-NOT-MERGE] Run tests against hadoop-3.1 to see the t...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21441 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21534: [SPARK-24526][build] Spaces in the build dir causes fail...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21534 @trystanleftwich, mind if I ask fix the title to ` [SPARK-24526][build][test-maven] Spaces in the build dir causes failures in the build/mvn script` so that Jenkins triggers a build with Maven and then we can see if the build still passes for sure? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Runs SBT checkstyle after the build...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Runs SBT checkstyle after the build...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21571: [SPARK-24565][SS] Add API for in Structured Streaming fo...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21571 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Runs SBT checkstyle after the build...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21567: [SPARK-24560][CORE][MESOS] Fix some getTimeAsMs as getTi...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21567 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Runs SBT checkstyle after the build...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21221: [SPARK-23429][CORE] Add executor memory metrics to heart...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21221 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21575: [SPARK-24566][CORE] spark.storage.blockManagerSlaveTimeo...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21575 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Runs SBT checkstyle after the build...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21579 ^ I just double checked if it affects Unidoc too which we run after the build. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Runs SBT checkstyle after the build...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Runs SBT checkstyle after the build...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21579 **[Test build #91987 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91987/testReport)** for PR 21579 at commit [`14351d6`](https://github.com/apache/spark/commit/14351d69dff9daf5fc558a8532e0a9ee75c92957). * This patch **fails to generate documentation**. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Runs SBT checkstyle after the build...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91987/ Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Runs SBT checkstyle after the build...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21579 **[Test build #91989 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91989/testReport)** for PR 21579 at commit [`73a494e`](https://github.com/apache/spark/commit/73a494e7f02979c32c01cac575d8a150e1d4fa2f). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Runs SBT checkstyle after the build...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/4142/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Runs SBT checkstyle after the build...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Runs SBT checkstyle after the build...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Runs SBT checkstyle after the build...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/247/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Runs SBT checkstyle after the build...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21579 **[Test build #91988 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91988/testReport)** for PR 21579 at commit [`6529622`](https://github.com/apache/spark/commit/6529622e690e4752401817e95663db03818071fa). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Delays SBT checkstyle after the bui...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/4141/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Delays SBT checkstyle after the bui...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Delays SBT checkstyle after the bui...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/246/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Delays SBT checkstyle after the bui...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Delays SBT checkstyle after the bui...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21579 cc @cloud-fan --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Delays SBT checkstyle after the bui...
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21579 Build / checkstyle passed in https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91981/console --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Delays SBT checkstyle after the bui...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21579 **[Test build #91987 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91987/testReport)** for PR 21579 at commit [`14351d6`](https://github.com/apache/spark/commit/14351d69dff9daf5fc558a8532e0a9ee75c92957). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Delays SBT checkstyle after the bui...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/4140/ Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Delays SBT checkstyle after the bui...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/245/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Delays SBT checkstyle after the bui...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Delays SBT checkstyle after the bui...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request #21579: [SPARK-24573][INFRA] Delays SBT checkstyle after ...
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/21579#discussion_r195918221 --- Diff: dev/run-tests.py --- @@ -366,6 +366,9 @@ def build_spark_assembly_sbt(hadoop_version): " ".join(profiles_and_goals)) exec_sbt(profiles_and_goals) +if checkstyle: +run_java_style_checks() --- End diff -- This takes 2min-ish now given my past tries. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Delays SBT checkstyle after the bui...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21579 **[Test build #91986 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91986/testReport)** for PR 21579 at commit [`7f46304`](https://github.com/apache/spark/commit/7f463046859a3615c096c601fef8b43c7ef4f6ba). * This patch **fails Java style tests**. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Delays SBT checkstyle after the bui...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91986/ Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [SPARK-24573][INFRA] Delays SBT checkstyle after the bui...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [DO-NOT-MERGE] Investigate SBT Java stylecheck affecting...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21579 **[Test build #91986 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91986/testReport)** for PR 21579 at commit [`7f46304`](https://github.com/apache/spark/commit/7f463046859a3615c096c601fef8b43c7ef4f6ba). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [DO-NOT-MERGE] Investigate SBT Java stylecheck affecting...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/4139/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [DO-NOT-MERGE] Investigate SBT Java stylecheck affecting...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [DO-NOT-MERGE] Investigate SBT Java stylecheck affecting...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [DO-NOT-MERGE] Investigate SBT Java stylecheck affecting...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/244/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21575: [SPARK-24566][CORE] spark.storage.blockManagerSlaveTimeo...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21575 **[Test build #91985 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91985/testReport)** for PR 21575 at commit [`9673613`](https://github.com/apache/spark/commit/967361302682ad86437261e704c1b14b933d3a86). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21575: [SPARK-24566][CORE] spark.storage.blockManagerSlaveTimeo...
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/21575 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21567: [SPARK-24560][CORE][MESOS] Fix some getTimeAsMs as getTi...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21567 **[Test build #91984 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91984/testReport)** for PR 21567 at commit [`0dd57ea`](https://github.com/apache/spark/commit/0dd57ea193cc4c3282961cea63ecf36b1d6a7e95). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21221: [SPARK-23429][CORE] Add executor memory metrics to heart...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21221 **[Test build #91983 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91983/testReport)** for PR 21221 at commit [`263c8c8`](https://github.com/apache/spark/commit/263c8c846265b6bdfdce471e44c163ab85b930a3). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21571: [SPARK-24565][SS] Add API for in Structured Streaming fo...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21571 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/4138/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21571: [SPARK-24565][SS] Add API for in Structured Streaming fo...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21571 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21571: [SPARK-24565][SS] Add API for in Structured Streaming fo...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21571 **[Test build #91982 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91982/testReport)** for PR 21571 at commit [`6f9fdf4`](https://github.com/apache/spark/commit/6f9fdf444aa704ea07e3c6ffc89474e1aeb59b6f). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [DO-NOT-MERGE] Investigate SBT Java stylecheck affecting...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [DO-NOT-MERGE] Investigate SBT Java stylecheck affecting...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21579 **[Test build #91981 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91981/testReport)** for PR 21579 at commit [`01a9bc8`](https://github.com/apache/spark/commit/01a9bc8af6cca13ffc5fdc96e3ff92c3d6872010). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [DO-NOT-MERGE] Investigate SBT Java stylecheck affecting...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/242/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [DO-NOT-MERGE] Investigate SBT Java stylecheck affecting...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/4137/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21571: [SPARK-24565][SS] Add API for in Structured Streaming fo...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21571 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/243/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [DO-NOT-MERGE] Investigate SBT Java stylecheck affecting...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21571: [SPARK-24565][SS] Add API for in Structured Streaming fo...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21571 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [DO-NOT-MERGE] Investigate SBT Java stylecheck affecting...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91980/ Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [DO-NOT-MERGE] Investigate SBT Java stylecheck affecting...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21579 **[Test build #91980 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91980/testReport)** for PR 21579 at commit [`96f5458`](https://github.com/apache/spark/commit/96f545849bc6d2cc0cccad81dac00cf857eeb899). * This patch **fails to build**. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [DO-NOT-MERGE] Investigate SBT Java stylecheck affecting...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request #21571: [SPARK-24565][SS] Add API for in Structured Strea...
Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/21571#discussion_r195917161
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/streaming/DataStreamWriter.scala
---
@@ -322,6 +338,45 @@ final class DataStreamWriter[T] private[sql](ds:
Dataset[T]) {
this
}
+ /**
+ * :: Experimental ::
+ *
+ * (Scala-specific) Sets the output of the streaming query to be
processed using the provided
+ * function. This is supported only the in the micro-batch execution
modes (that is, when the
+ * trigger is not continuous). In every micro-batch, the provided
function will be called in
+ * every micro-batch with (i) the output rows as a Dataset and (ii) the
batch identifier.
+ * The batchId can be used deduplicate and transactionally write the
output
+ * (that is, the provided Dataset) to external systems. The output
Dataset is guaranteed
+ * to exactly same for the same batchId (assuming all operations are
deterministic in the query).
+ *
+ * @since 2.4.0
+ */
+ @InterfaceStability.Evolving
+ def foreachBatch(function: (Dataset[T], Long) => Unit):
DataStreamWriter[T] = {
--- End diff --
Well... that is an existing problem because one can write the following
confusion code
```
df.writeStream.format("kafka").foreach(...).start()
```
This will execute the foreach but it looks confusing nonetheless.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [DO-NOT-MERGE] Investigate SBT Java stylecheck affecting...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/241/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [DO-NOT-MERGE] Investigate SBT Java stylecheck affecting...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/4136/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [DO-NOT-MERGE] Investigate SBT Java stylecheck affecting...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [DO-NOT-MERGE] Investigate SBT Java stylecheck affecting...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [DO-NOT-MERGE] Investigate SBT Java stylecheck affecting...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21579 **[Test build #91980 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91980/testReport)** for PR 21579 at commit [`96f5458`](https://github.com/apache/spark/commit/96f545849bc6d2cc0cccad81dac00cf857eeb899). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [DO-NOT-MERGE] Investigate SBT Java stylecheck affecting...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [DO-NOT-MERGE] Investigate SBT Java stylecheck affecting...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21579 **[Test build #91979 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91979/testReport)** for PR 21579 at commit [`8307cbd`](https://github.com/apache/spark/commit/8307cbd470c2cda35d5e7d8634d8bdebd9bafb54). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [DO-NOT-MERGE] Investigate SBT Java stylecheck affecting...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [DO-NOT-MERGE] Investigate SBT Java stylecheck affecting...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/4135/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21579: [DO-NOT-MERGE] Investigate SBT Java stylecheck affecting...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21579 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/240/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request #21579: [DO-NOT-MERGE] Investigate SBT Java stylecheck af...
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/21579 [DO-NOT-MERGE] Investigate SBT Java stylecheck affecting the build ## What changes were proposed in this pull request? TBD ## How was this patch tested? Jenkins tests. You can merge this pull request into a Git repository by running: $ git pull https://github.com/HyukjinKwon/spark investigate-javastyle Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/21579.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #21579 commit 8307cbd470c2cda35d5e7d8634d8bdebd9bafb54 Author: hyukjinkwon Date: 2018-06-17T03:16:03Z Empty commit --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request #21571: [SPARK-24565][SS] Add API for in Structured Strea...
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/21571#discussion_r195917011 --- Diff: python/pyspark/sql/streaming.py --- @@ -1016,6 +1018,35 @@ def func_with_open_process_close(partition_id, iterator): self._jwrite.foreach(jForeachWriter) return self +@since(2.4) +def foreachBatch(self, func): +""" +Sets the output of the streaming query to be processed using the provided +function. This is supported only the in the micro-batch execution modes (that is, when the +trigger is not continuous). In every micro-batch, the provided function will be called in +every micro-batch with (i) the output rows as a DataFrame and (ii) the batch identifier. +The batchId can be used deduplicate and transactionally write the output +(that is, the provided Dataset) to external systems. The output DataFrame is guaranteed +to exactly same for the same batchId (assuming all operations are deterministic in the +query). + +.. note:: Evolving. + +>>> def func(batch_df, batch_id): +... batch_df.collect() +... +>>> writer = sdf.writeStream.foreach(func) +""" + +from pyspark.java_gateway import ensure_callback_server_started +gw = self._spark._sc._gateway +java_import(gw.jvm, "org.apache.spark.sql.execution.streaming.sources.*") + +wrapped_func = ForeachBatchFunction(self._spark, func) +gw.jvm.PythonForeachBatchHelper.callForeachBatch(self._jwrite, wrapped_func) +ensure_callback_server_started(gw) --- End diff -- This is not possible because the callback from JVM ForeachBatch sink to Python is made ONLY after the query is started. And the query cannot be started until this foreach() method finishes and start() is called. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20636: [SPARK-23415][SQL][TEST] Make behavior of BufferHolderSp...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20636 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91978/ Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20636: [SPARK-23415][SQL][TEST] Make behavior of BufferHolderSp...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20636 **[Test build #91978 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91978/testReport)** for PR 20636 at commit [`a134091`](https://github.com/apache/spark/commit/a134091aad0c3f8e3674f6cd751c2b8d5d83e39e). * This patch **fails to build**. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20636: [SPARK-23415][SQL][TEST] Make behavior of BufferHolderSp...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20636 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20636: [SPARK-23415][SQL][TEST] Make behavior of BufferHolderSp...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20636 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/239/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20636: [SPARK-23415][SQL][TEST] Make behavior of BufferHolderSp...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20636 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20636: [SPARK-23415][SQL][TEST] Make behavior of BufferHolderSp...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20636 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20636: [SPARK-23415][SQL][TEST] Make behavior of BufferHolderSp...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20636 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/4134/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20636: [SPARK-23415][SQL][TEST] Make behavior of BufferHolderSp...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20636 **[Test build #91978 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91978/testReport)** for PR 20636 at commit [`a134091`](https://github.com/apache/spark/commit/a134091aad0c3f8e3674f6cd751c2b8d5d83e39e). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20636: [SPARK-23415][SQL][TEST] Make behavior of BufferHolderSp...
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/20636 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21576: [SPARK-24548][SQL] Fix incorrect schema of Dataset with ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21576 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91977/ Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21576: [SPARK-24548][SQL] Fix incorrect schema of Dataset with ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21576 **[Test build #91977 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91977/testReport)** for PR 21576 at commit [`e349448`](https://github.com/apache/spark/commit/e349448c6f667d04074008e27501c6f32cdcd52b). * This patch **fails to build**. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21576: [SPARK-24548][SQL] Fix incorrect schema of Dataset with ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21576 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21576: [SPARK-24548][SQL] Fix incorrect schema of Dataset with ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21576 **[Test build #91977 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91977/testReport)** for PR 21576 at commit [`e349448`](https://github.com/apache/spark/commit/e349448c6f667d04074008e27501c6f32cdcd52b). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21576: [SPARK-24548][SQL] Fix incorrect schema of Dataset with ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21576 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21576: [SPARK-24548][SQL] Fix incorrect schema of Dataset with ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21576 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/238/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21576: [SPARK-24548][SQL] Fix incorrect schema of Dataset with ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21576 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/4133/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21576: [SPARK-24548][SQL] Fix incorrect schema of Dataset with ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21576 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21576: [SPARK-24548][SQL] Fix incorrect schema of Dataset with ...
Github user viirya commented on the issue: https://github.com/apache/spark/pull/21576 retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20146: [SPARK-11215][ML] Add multiple columns support to String...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20146 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91976/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20146: [SPARK-11215][ML] Add multiple columns support to String...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20146 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20146: [SPARK-11215][ML] Add multiple columns support to String...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20146 **[Test build #91976 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91976/testReport)** for PR 20146 at commit [`a6551b0`](https://github.com/apache/spark/commit/a6551b02a10428d66e0dadcfcb5a8da3798ec814). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21534: [SPARK-24526][build] Spaces in the build dir causes fail...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21534 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91975/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21534: [SPARK-24526][build] Spaces in the build dir causes fail...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21534 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21534: [SPARK-24526][build] Spaces in the build dir causes fail...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21534 **[Test build #91975 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91975/testReport)** for PR 21534 at commit [`bb12f3e`](https://github.com/apache/spark/commit/bb12f3e2ad74f9d4c89e1c7adab4d306fa87b101). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19675: [SPARK-14540][BUILD] Support Scala 2.12 closures and Jav...
Github user skonto commented on the issue: https://github.com/apache/spark/pull/19675 Current status: ``` ProactiveClosureSerializationSuite: - throws expected serialization exceptions on actions - mapPartitions transformations throw proactive serialization exceptions *** FAILED *** Expected exception org.apache.spark.SparkException to be thrown, but no exception was thrown (ProactiveClosureSerializationSuite.scala:58) - map transformations throw proactive serialization exceptions *** FAILED *** Expected exception org.apache.spark.SparkException to be thrown, but no exception was thrown (ProactiveClosureSerializationSuite.scala:58) - filter transformations throw proactive serialization exceptions *** FAILED *** Expected exception org.apache.spark.SparkException to be thrown, but no exception was thrown (ProactiveClosureSerializationSuite.scala:58) - flatMap transformations throw proactive serialization exceptions *** FAILED *** Expected exception org.apache.spark.SparkException to be thrown, but no exception was thrown (ProactiveClosureSerializationSuite.scala:58) - mapPartitionsWithIndex transformations throw proactive serialization exceptions *** FAILED *** Expected exception org.apache.spark.SparkException to be thrown, but no exception was thrown (ProactiveClosureSerializationSuite.scala:58) Run completed in 15 minutes, 23 seconds. Total number of tests run: 2096 Suites: completed 212, aborted 0 Tests: succeeded 2079, failed 17, canceled 4, ignored 8, pending 0 *** 17 TESTS FAILED *** [INFO] [INFO] Reactor Summary: [INFO] [INFO] Spark Project Parent POM 2.4.0-SNAPSHOT SUCCESS [ 24.719 s] [INFO] Spark Project Tags . SUCCESS [ 31.125 s] [INFO] Spark Project Sketch ... SUCCESS [ 14.175 s] [INFO] Spark Project Local DB . SUCCESS [ 5.103 s] [INFO] Spark Project Networking ... SUCCESS [ 40.177 s] [INFO] Spark Project Shuffle Streaming Service SUCCESS [ 5.344 s] [INFO] Spark Project Unsafe ... SUCCESS [ 7.984 s] [INFO] Spark Project Launcher . SUCCESS [ 6.129 s] [INFO] Spark Project Core . FAILURE [17:17 min] ``` --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21578: [SPARK-24571][SQL] Support Char literals
Github user MaxGekk commented on the issue: https://github.com/apache/spark/pull/21578 @rxin Please, review the PR. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
