[GitHub] [spark] AmplabJenkins commented on issue #24350: [SPARK-27348][Core] HeartbeatReceiver should remove lost executors from CoarseGrainedSchedulerBackend
AmplabJenkins commented on issue #24350: [SPARK-27348][Core] HeartbeatReceiver should remove lost executors from CoarseGrainedSchedulerBackend URL: https://github.com/apache/spark/pull/24350#issuecomment-482779620 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104564/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24350: [SPARK-27348][Core] HeartbeatReceiver should remove lost executors from CoarseGrainedSchedulerBackend
AmplabJenkins commented on issue #24350: [SPARK-27348][Core] HeartbeatReceiver should remove lost executors from CoarseGrainedSchedulerBackend URL: https://github.com/apache/spark/pull/24350#issuecomment-482779619 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24350: [SPARK-27348][Core] HeartbeatReceiver should remove lost executors from CoarseGrainedSchedulerBackend
SparkQA commented on issue #24350: [SPARK-27348][Core] HeartbeatReceiver should remove lost executors from CoarseGrainedSchedulerBackend URL: https://github.com/apache/spark/pull/24350#issuecomment-482779499 **[Test build #104564 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104564/testReport)** for PR 24350 at commit [`a933d0a`](https://github.com/apache/spark/commit/a933d0a0a15794295be7f0d3a43b12022455678b). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24350: [SPARK-27348][Core] HeartbeatReceiver should remove lost executors from CoarseGrainedSchedulerBackend
SparkQA removed a comment on issue #24350: [SPARK-27348][Core] HeartbeatReceiver should remove lost executors from CoarseGrainedSchedulerBackend URL: https://github.com/apache/spark/pull/24350#issuecomment-482762616 **[Test build #104564 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104564/testReport)** for PR 24350 at commit [`a933d0a`](https://github.com/apache/spark/commit/a933d0a0a15794295be7f0d3a43b12022455678b). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7
SparkQA commented on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7 URL: https://github.com/apache/spark/pull/24364#issuecomment-482771678 **[Test build #104565 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104565/testReport)** for PR 24364 at commit [`c5c9467`](https://github.com/apache/spark/commit/c5c946759f2086bfad1ac18f59f49b2af6044f34). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7
AmplabJenkins removed a comment on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7 URL: https://github.com/apache/spark/pull/24364#issuecomment-482771581 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9889/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7
AmplabJenkins removed a comment on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7 URL: https://github.com/apache/spark/pull/24364#issuecomment-482771577 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7
AmplabJenkins commented on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7 URL: https://github.com/apache/spark/pull/24364#issuecomment-482771577 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7
AmplabJenkins commented on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7 URL: https://github.com/apache/spark/pull/24364#issuecomment-482771581 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9889/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7
dongjoon-hyun commented on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7 URL: https://github.com/apache/spark/pull/24364#issuecomment-482771524 Retest this please. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] dongjoon-hyun edited a comment on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7
dongjoon-hyun edited a comment on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7 URL: https://github.com/apache/spark/pull/24364#issuecomment-482769350 Oh, the first error is `Unsupported OS/arch, cannot find /linux/amd64/libzstd-jni.so`. ``` [info] org.apache.spark.scheduler.ReplayListenerSuite *** ABORTED *** (21 seconds, 316 milliseconds) [info] java.lang.UnsatisfiedLinkError: no zstd-jni in java.library.path [info] Unsupported OS/arch, cannot find /linux/amd64/libzstd-jni.so or load zstd-jni from system libraries. Please try building from source the jar or providing libzstd-jni in you system. [info] at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867) ``` Since the jar file has it, it seems to be absolute and relative path issue. ``` $ jar tvf zstd-jni-1.3.2-2.jar | grep libzstd-jni.so 699478 Mon Oct 16 23:27:32 PDT 2017 aix/ppc64/libzstd-jni.so 533254 Mon Oct 16 23:28:36 PDT 2017 linux/aarch64/libzstd-jni.so 527844 Thu Oct 19 04:17:22 PDT 2017 linux/amd64/libzstd-jni.so 618660 Mon Oct 16 23:26:04 PDT 2017 linux/i386/libzstd-jni.so 654512 Mon Oct 16 23:26:44 PDT 2017 linux/ppc64/libzstd-jni.so ``` ``` $ jar tvf zstd-jni-1.3.8-7.jar | grep libzstd-jni 967535 Fri Apr 12 09:16:56 PDT 2019 aix/ppc64/libzstd-jni.so 875800 Fri Apr 12 08:03:12 PDT 2019 darwin/x86_64/libzstd-jni.dylib 748390 Fri Apr 12 09:15:30 PDT 2019 linux/aarch64/libzstd-jni.so 907120 Fri Apr 12 09:18:04 PDT 2019 linux/amd64/libzstd-jni.so 869968 Fri Apr 12 09:10:22 PDT 2019 linux/i386/libzstd-jni.so 806425 Fri Apr 12 09:18:28 PDT 2019 linux/mips64/libzstd-jni.so 989272 Fri Apr 12 09:11:54 PDT 2019 linux/ppc64/libzstd-jni.so 917904 Fri Apr 12 09:12:48 PDT 2019 linux/ppc64le/libzstd-jni.so 1288361 Fri Apr 12 08:01:42 PDT 2019 win/amd64/libzstd-jni.dll 1233612 Fri Apr 12 08:07:08 PDT 2019 win/x86/libzstd-jni.dll ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] dongjoon-hyun edited a comment on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7
dongjoon-hyun edited a comment on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7 URL: https://github.com/apache/spark/pull/24364#issuecomment-482769350 Oh, the first error is `Unsupported OS/arch, cannot find /linux/amd64/libzstd-jni.so`. ``` [info] org.apache.spark.scheduler.ReplayListenerSuite *** ABORTED *** (21 seconds, 316 milliseconds) [info] java.lang.UnsatisfiedLinkError: no zstd-jni in java.library.path [info] Unsupported OS/arch, cannot find /linux/amd64/libzstd-jni.so or load zstd-jni from system libraries. Please try building from source the jar or providing libzstd-jni in you system. [info] at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867) ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] dongjoon-hyun edited a comment on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7
dongjoon-hyun edited a comment on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7 URL: https://github.com/apache/spark/pull/24364#issuecomment-482769350 Oh, the first error is `Unsupported OS/arch, cannot find /linux/amd64/libzstd-jni.so`. ``` [info] org.apache.spark.scheduler.ReplayListenerSuite *** ABORTED *** (21 seconds, 316 milliseconds) [info] java.lang.UnsatisfiedLinkError: no zstd-jni in java.library.path [info] Unsupported OS/arch, cannot find /linux/amd64/libzstd-jni.so or load zstd-jni from system libraries. Please try building from source the jar or providing libzstd-jni in you system. [info] at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867) ``` Since the jar file has it, it seems to be absolute and relative path issue. ``` $ jar tvf zstd-jni-1.3.2-2.jar | grep libzstd-jni.so 699478 Mon Oct 16 23:27:32 PDT 2017 aix/ppc64/libzstd-jni.so 533254 Mon Oct 16 23:28:36 PDT 2017 linux/aarch64/libzstd-jni.so 527844 Thu Oct 19 04:17:22 PDT 2017 linux/amd64/libzstd-jni.so 618660 Mon Oct 16 23:26:04 PDT 2017 linux/i386/libzstd-jni.so 654512 Mon Oct 16 23:26:44 PDT 2017 linux/ppc64/libzstd-jni.so ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7
dongjoon-hyun commented on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7 URL: https://github.com/apache/spark/pull/24364#issuecomment-482769350 Oh, the first error is `Unsupported OS/arch, cannot find /linux/amd64/libzstd-jni.so`. ``` [info] org.apache.spark.scheduler.ReplayListenerSuite *** ABORTED *** (21 seconds, 316 milliseconds) [info] java.lang.UnsatisfiedLinkError: no zstd-jni in java.library.path [info] Unsupported OS/arch, cannot find /linux/amd64/libzstd-jni.so or load zstd-jni from system libraries. Please try building from source the jar or providing libzstd-jni in you system. [info] at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867) ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #22168: [SPARK-24985][SQL][WIP] Fix OOM in Full Outer Join in case of data skew
AmplabJenkins removed a comment on issue #22168: [SPARK-24985][SQL][WIP] Fix OOM in Full Outer Join in case of data skew URL: https://github.com/apache/spark/pull/22168#issuecomment-414601240 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #22168: [SPARK-24985][SQL][WIP] Fix OOM in Full Outer Join in case of data skew
AmplabJenkins commented on issue #22168: [SPARK-24985][SQL][WIP] Fix OOM in Full Outer Join in case of data skew URL: https://github.com/apache/spark/pull/22168#issuecomment-482769113 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7
dongjoon-hyun commented on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7 URL: https://github.com/apache/spark/pull/24364#issuecomment-482768919 It's weird because this passed locally before. I'll take a look. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] dongjoon-hyun closed pull request #24363: [SPARK-27451][BUILD] Upgrade lz4-java to 1.5.1
dongjoon-hyun closed pull request #24363: [SPARK-27451][BUILD] Upgrade lz4-java to 1.5.1 URL: https://github.com/apache/spark/pull/24363 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on issue #24363: [SPARK-27451][BUILD] Upgrade lz4-java to 1.5.1
dongjoon-hyun commented on issue #24363: [SPARK-27451][BUILD] Upgrade lz4-java to 1.5.1 URL: https://github.com/apache/spark/pull/24363#issuecomment-482768469 Thank you for review, @srowen . Merged to master. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24363: [SPARK-27451][BUILD] Upgrade lz4-java to 1.5.1
AmplabJenkins removed a comment on issue #24363: [SPARK-27451][BUILD] Upgrade lz4-java to 1.5.1 URL: https://github.com/apache/spark/pull/24363#issuecomment-482765268 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104560/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24363: [SPARK-27451][BUILD] Upgrade lz4-java to 1.5.1
AmplabJenkins removed a comment on issue #24363: [SPARK-27451][BUILD] Upgrade lz4-java to 1.5.1 URL: https://github.com/apache/spark/pull/24363#issuecomment-482765266 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24363: [SPARK-27451][BUILD] Upgrade lz4-java to 1.5.1
AmplabJenkins commented on issue #24363: [SPARK-27451][BUILD] Upgrade lz4-java to 1.5.1 URL: https://github.com/apache/spark/pull/24363#issuecomment-482765268 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104560/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24363: [SPARK-27451][BUILD] Upgrade lz4-java to 1.5.1
AmplabJenkins commented on issue #24363: [SPARK-27451][BUILD] Upgrade lz4-java to 1.5.1 URL: https://github.com/apache/spark/pull/24363#issuecomment-482765266 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24266: [SPARK-25079][python] update python3 executable to 3.6.x
AmplabJenkins removed a comment on issue #24266: [SPARK-25079][python] update python3 executable to 3.6.x URL: https://github.com/apache/spark/pull/24266#issuecomment-482764986 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24363: [SPARK-27451][BUILD] Upgrade lz4-java to 1.5.1
SparkQA commented on issue #24363: [SPARK-27451][BUILD] Upgrade lz4-java to 1.5.1 URL: https://github.com/apache/spark/pull/24363#issuecomment-482765101 **[Test build #104560 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104560/testReport)** for PR 24363 at commit [`4092b71`](https://github.com/apache/spark/commit/4092b71ee174fa8d2451f9259b9ebbf5dfb5b01a). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24266: [SPARK-25079][python] update python3 executable to 3.6.x
AmplabJenkins removed a comment on issue #24266: [SPARK-25079][python] update python3 executable to 3.6.x URL: https://github.com/apache/spark/pull/24266#issuecomment-482764990 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104561/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24363: [SPARK-27451][BUILD] Upgrade lz4-java to 1.5.1
SparkQA removed a comment on issue #24363: [SPARK-27451][BUILD] Upgrade lz4-java to 1.5.1 URL: https://github.com/apache/spark/pull/24363#issuecomment-482715624 **[Test build #104560 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104560/testReport)** for PR 24363 at commit [`4092b71`](https://github.com/apache/spark/commit/4092b71ee174fa8d2451f9259b9ebbf5dfb5b01a). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24266: [SPARK-25079][python] update python3 executable to 3.6.x
AmplabJenkins commented on issue #24266: [SPARK-25079][python] update python3 executable to 3.6.x URL: https://github.com/apache/spark/pull/24266#issuecomment-482764990 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104561/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24266: [SPARK-25079][python] update python3 executable to 3.6.x
AmplabJenkins commented on issue #24266: [SPARK-25079][python] update python3 executable to 3.6.x URL: https://github.com/apache/spark/pull/24266#issuecomment-482764986 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24266: [SPARK-25079][python] update python3 executable to 3.6.x
SparkQA removed a comment on issue #24266: [SPARK-25079][python] update python3 executable to 3.6.x URL: https://github.com/apache/spark/pull/24266#issuecomment-482715650 **[Test build #104561 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104561/testReport)** for PR 24266 at commit [`1d14800`](https://github.com/apache/spark/commit/1d1480094fd102819c8f2675f2c583d96286ba96). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24266: [SPARK-25079][python] update python3 executable to 3.6.x
SparkQA commented on issue #24266: [SPARK-25079][python] update python3 executable to 3.6.x URL: https://github.com/apache/spark/pull/24266#issuecomment-482764842 **[Test build #104561 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104561/testReport)** for PR 24266 at commit [`1d14800`](https://github.com/apache/spark/commit/1d1480094fd102819c8f2675f2c583d96286ba96). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7
AmplabJenkins removed a comment on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7 URL: https://github.com/apache/spark/pull/24364#issuecomment-482763431 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104562/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7
AmplabJenkins removed a comment on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7 URL: https://github.com/apache/spark/pull/24364#issuecomment-482763429 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7
AmplabJenkins commented on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7 URL: https://github.com/apache/spark/pull/24364#issuecomment-482763431 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104562/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7
AmplabJenkins commented on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7 URL: https://github.com/apache/spark/pull/24364#issuecomment-482763429 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7
SparkQA removed a comment on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7 URL: https://github.com/apache/spark/pull/24364#issuecomment-482721933 **[Test build #104562 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104562/testReport)** for PR 24364 at commit [`c5c9467`](https://github.com/apache/spark/commit/c5c946759f2086bfad1ac18f59f49b2af6044f34). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7
SparkQA commented on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7 URL: https://github.com/apache/spark/pull/24364#issuecomment-482763330 **[Test build #104562 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104562/testReport)** for PR 24364 at commit [`c5c9467`](https://github.com/apache/spark/commit/c5c946759f2086bfad1ac18f59f49b2af6044f34). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24350: [SPARK-27348][Core] HeartbeatReceiver should remove lost executors from CoarseGrainedSchedulerBackend
SparkQA commented on issue #24350: [SPARK-27348][Core] HeartbeatReceiver should remove lost executors from CoarseGrainedSchedulerBackend URL: https://github.com/apache/spark/pull/24350#issuecomment-482762616 **[Test build #104564 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104564/testReport)** for PR 24350 at commit [`a933d0a`](https://github.com/apache/spark/commit/a933d0a0a15794295be7f0d3a43b12022455678b). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24350: [SPARK-27348][Core] HeartbeatReceiver should remove lost executors from CoarseGrainedSchedulerBackend
AmplabJenkins removed a comment on issue #24350: [SPARK-27348][Core] HeartbeatReceiver should remove lost executors from CoarseGrainedSchedulerBackend URL: https://github.com/apache/spark/pull/24350#issuecomment-482762477 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24350: [SPARK-27348][Core] HeartbeatReceiver should remove lost executors from CoarseGrainedSchedulerBackend
AmplabJenkins removed a comment on issue #24350: [SPARK-27348][Core] HeartbeatReceiver should remove lost executors from CoarseGrainedSchedulerBackend URL: https://github.com/apache/spark/pull/24350#issuecomment-482762479 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9888/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24350: [SPARK-27348][Core] HeartbeatReceiver should remove lost executors from CoarseGrainedSchedulerBackend
AmplabJenkins commented on issue #24350: [SPARK-27348][Core] HeartbeatReceiver should remove lost executors from CoarseGrainedSchedulerBackend URL: https://github.com/apache/spark/pull/24350#issuecomment-482762477 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24350: [SPARK-27348][Core] HeartbeatReceiver should remove lost executors from CoarseGrainedSchedulerBackend
AmplabJenkins commented on issue #24350: [SPARK-27348][Core] HeartbeatReceiver should remove lost executors from CoarseGrainedSchedulerBackend URL: https://github.com/apache/spark/pull/24350#issuecomment-482762479 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9888/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] xuanyuanking commented on issue #24350: [SPARK-27348][Core] HeartbeatReceiver should remove lost executors from CoarseGrainedSchedulerBackend
xuanyuanking commented on issue #24350: [SPARK-27348][Core] HeartbeatReceiver should remove lost executors from CoarseGrainedSchedulerBackend URL: https://github.com/apache/spark/pull/24350#issuecomment-482762295 retest this please. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24342: [SPARK-27438][SQL] Parse strings with timestamps by to_timestamp() in microsecond precision
AmplabJenkins removed a comment on issue #24342: [SPARK-27438][SQL] Parse strings with timestamps by to_timestamp() in microsecond precision URL: https://github.com/apache/spark/pull/24342#issuecomment-482755967 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24342: [SPARK-27438][SQL] Parse strings with timestamps by to_timestamp() in microsecond precision
AmplabJenkins removed a comment on issue #24342: [SPARK-27438][SQL] Parse strings with timestamps by to_timestamp() in microsecond precision URL: https://github.com/apache/spark/pull/24342#issuecomment-482755969 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104558/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24342: [SPARK-27438][SQL] Parse strings with timestamps by to_timestamp() in microsecond precision
AmplabJenkins commented on issue #24342: [SPARK-27438][SQL] Parse strings with timestamps by to_timestamp() in microsecond precision URL: https://github.com/apache/spark/pull/24342#issuecomment-482755969 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104558/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24342: [SPARK-27438][SQL] Parse strings with timestamps by to_timestamp() in microsecond precision
AmplabJenkins commented on issue #24342: [SPARK-27438][SQL] Parse strings with timestamps by to_timestamp() in microsecond precision URL: https://github.com/apache/spark/pull/24342#issuecomment-482755967 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24342: [SPARK-27438][SQL] Parse strings with timestamps by to_timestamp() in microsecond precision
SparkQA removed a comment on issue #24342: [SPARK-27438][SQL] Parse strings with timestamps by to_timestamp() in microsecond precision URL: https://github.com/apache/spark/pull/24342#issuecomment-482690822 **[Test build #104558 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104558/testReport)** for PR 24342 at commit [`6e88e1b`](https://github.com/apache/spark/commit/6e88e1b8583eb58ebe41d517d6f060b29daac290). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24342: [SPARK-27438][SQL] Parse strings with timestamps by to_timestamp() in microsecond precision
SparkQA commented on issue #24342: [SPARK-27438][SQL] Parse strings with timestamps by to_timestamp() in microsecond precision URL: https://github.com/apache/spark/pull/24342#issuecomment-482755705 **[Test build #104558 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104558/testReport)** for PR 24342 at commit [`6e88e1b`](https://github.com/apache/spark/commit/6e88e1b8583eb58ebe41d517d6f060b29daac290). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24362: [SPARK-27454][ML][SQL] Spark image datasource fail when encounter some illegal images
AmplabJenkins removed a comment on issue #24362: [SPARK-27454][ML][SQL] Spark image datasource fail when encounter some illegal images URL: https://github.com/apache/spark/pull/24362#issuecomment-482754191 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24362: [SPARK-27454][ML][SQL] Spark image datasource fail when encounter some illegal images
AmplabJenkins removed a comment on issue #24362: [SPARK-27454][ML][SQL] Spark image datasource fail when encounter some illegal images URL: https://github.com/apache/spark/pull/24362#issuecomment-482754192 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104563/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24362: [SPARK-27454][ML][SQL] Spark image datasource fail when encounter some illegal images
AmplabJenkins commented on issue #24362: [SPARK-27454][ML][SQL] Spark image datasource fail when encounter some illegal images URL: https://github.com/apache/spark/pull/24362#issuecomment-482754191 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24362: [SPARK-27454][ML][SQL] Spark image datasource fail when encounter some illegal images
SparkQA removed a comment on issue #24362: [SPARK-27454][ML][SQL] Spark image datasource fail when encounter some illegal images URL: https://github.com/apache/spark/pull/24362#issuecomment-482742196 **[Test build #104563 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104563/testReport)** for PR 24362 at commit [`f511615`](https://github.com/apache/spark/commit/f51161541f749bc2136e600cdfda24a0062f3d73). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24362: [SPARK-27454][ML][SQL] Spark image datasource fail when encounter some illegal images
AmplabJenkins commented on issue #24362: [SPARK-27454][ML][SQL] Spark image datasource fail when encounter some illegal images URL: https://github.com/apache/spark/pull/24362#issuecomment-482754192 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104563/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24362: [SPARK-27454][ML][SQL] Spark image datasource fail when encounter some illegal images
SparkQA commented on issue #24362: [SPARK-27454][ML][SQL] Spark image datasource fail when encounter some illegal images URL: https://github.com/apache/spark/pull/24362#issuecomment-482754010 **[Test build #104563 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104563/testReport)** for PR 24362 at commit [`f511615`](https://github.com/apache/spark/commit/f51161541f749bc2136e600cdfda24a0062f3d73). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24365: [SPARK-27453] Pass partitionBy as options in DataFrameWriter
AmplabJenkins removed a comment on issue #24365: [SPARK-27453] Pass partitionBy as options in DataFrameWriter URL: https://github.com/apache/spark/pull/24365#issuecomment-482745748 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] marmbrus commented on issue #24365: [SPARK-27453] Pass partitionBy as options in DataFrameWriter
marmbrus commented on issue #24365: [SPARK-27453] Pass partitionBy as options in DataFrameWriter URL: https://github.com/apache/spark/pull/24365#issuecomment-482748417 Add to whitelist This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24354: [SPARK-25348][SQL] Data source for binary files
AmplabJenkins removed a comment on issue #24354: [SPARK-25348][SQL] Data source for binary files URL: https://github.com/apache/spark/pull/24354#issuecomment-482746828 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24354: [SPARK-25348][SQL] Data source for binary files
AmplabJenkins removed a comment on issue #24354: [SPARK-25348][SQL] Data source for binary files URL: https://github.com/apache/spark/pull/24354#issuecomment-482746833 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104557/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24354: [SPARK-25348][SQL] Data source for binary files
AmplabJenkins commented on issue #24354: [SPARK-25348][SQL] Data source for binary files URL: https://github.com/apache/spark/pull/24354#issuecomment-482746833 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104557/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24354: [SPARK-25348][SQL] Data source for binary files
AmplabJenkins commented on issue #24354: [SPARK-25348][SQL] Data source for binary files URL: https://github.com/apache/spark/pull/24354#issuecomment-482746828 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24354: [SPARK-25348][SQL] Data source for binary files
SparkQA removed a comment on issue #24354: [SPARK-25348][SQL] Data source for binary files URL: https://github.com/apache/spark/pull/24354#issuecomment-482684820 **[Test build #104557 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104557/testReport)** for PR 24354 at commit [`c3d4411`](https://github.com/apache/spark/commit/c3d441199b2694f6d1d5f645c6f1987760664d4b). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24354: [SPARK-25348][SQL] Data source for binary files
SparkQA commented on issue #24354: [SPARK-25348][SQL] Data source for binary files URL: https://github.com/apache/spark/pull/24354#issuecomment-482746533 **[Test build #104557 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104557/testReport)** for PR 24354 at commit [`c3d4411`](https://github.com/apache/spark/commit/c3d441199b2694f6d1d5f645c6f1987760664d4b). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24365: [SPARK-27453] Pass partitionBy as options in DataFrameWriter
AmplabJenkins removed a comment on issue #24365: [SPARK-27453] Pass partitionBy as options in DataFrameWriter URL: https://github.com/apache/spark/pull/24365#issuecomment-482745454 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24365: [SPARK-27453] Pass partitionBy as options in DataFrameWriter
AmplabJenkins commented on issue #24365: [SPARK-27453] Pass partitionBy as options in DataFrameWriter URL: https://github.com/apache/spark/pull/24365#issuecomment-482745748 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24365: [SPARK-27453] Pass partitionBy as options in DataFrameWriter
AmplabJenkins removed a comment on issue #24365: [SPARK-27453] Pass partitionBy as options in DataFrameWriter URL: https://github.com/apache/spark/pull/24365#issuecomment-482745373 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24365: [SPARK-27453] Pass partitionBy as options in DataFrameWriter
AmplabJenkins commented on issue #24365: [SPARK-27453] Pass partitionBy as options in DataFrameWriter URL: https://github.com/apache/spark/pull/24365#issuecomment-482745454 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24365: [SPARK-27453] Pass partitionBy as options in DataFrameWriter
AmplabJenkins commented on issue #24365: [SPARK-27453] Pass partitionBy as options in DataFrameWriter URL: https://github.com/apache/spark/pull/24365#issuecomment-482745373 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24354: [SPARK-25348][SQL] Data source for binary files
AmplabJenkins removed a comment on issue #24354: [SPARK-25348][SQL] Data source for binary files URL: https://github.com/apache/spark/pull/24354#issuecomment-482744932 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104556/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24354: [SPARK-25348][SQL] Data source for binary files
AmplabJenkins removed a comment on issue #24354: [SPARK-25348][SQL] Data source for binary files URL: https://github.com/apache/spark/pull/24354#issuecomment-482744930 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24354: [SPARK-25348][SQL] Data source for binary files
AmplabJenkins commented on issue #24354: [SPARK-25348][SQL] Data source for binary files URL: https://github.com/apache/spark/pull/24354#issuecomment-482744932 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/104556/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24354: [SPARK-25348][SQL] Data source for binary files
AmplabJenkins commented on issue #24354: [SPARK-25348][SQL] Data source for binary files URL: https://github.com/apache/spark/pull/24354#issuecomment-482744930 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24354: [SPARK-25348][SQL] Data source for binary files
SparkQA commented on issue #24354: [SPARK-25348][SQL] Data source for binary files URL: https://github.com/apache/spark/pull/24354#issuecomment-482744566 **[Test build #104556 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104556/testReport)** for PR 24354 at commit [`55a6858`](https://github.com/apache/spark/commit/55a6858203df348ead7a250c5ff61b83be7a8947). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24354: [SPARK-25348][SQL] Data source for binary files
SparkQA removed a comment on issue #24354: [SPARK-25348][SQL] Data source for binary files URL: https://github.com/apache/spark/pull/24354#issuecomment-482680427 **[Test build #104556 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104556/testReport)** for PR 24354 at commit [`55a6858`](https://github.com/apache/spark/commit/55a6858203df348ead7a250c5ff61b83be7a8947). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] liwensun opened a new pull request #24365: [SPARK-27453] Pass partitionBy as options in DataFrameWriter
liwensun opened a new pull request #24365: [SPARK-27453] Pass partitionBy as options in DataFrameWriter URL: https://github.com/apache/spark/pull/24365 ## What changes were proposed in this pull request? Pass partitionBy columns as options and feature-flag this behavior. ## How was this patch tested? A new unit test. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] mengxr commented on issue #24362: [SPARK-27454][ML][SQL] Spark image datasource fail when encounter some illegal images
mengxr commented on issue #24362: [SPARK-27454][ML][SQL] Spark image datasource fail when encounter some illegal images URL: https://github.com/apache/spark/pull/24362#issuecomment-482743172 LGTM This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24362: [SPARK-27454][ML][SQL] Spark image datasource fail when encounter some illegal images
SparkQA commented on issue #24362: [SPARK-27454][ML][SQL] Spark image datasource fail when encounter some illegal images URL: https://github.com/apache/spark/pull/24362#issuecomment-482742196 **[Test build #104563 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104563/testReport)** for PR 24362 at commit [`f511615`](https://github.com/apache/spark/commit/f51161541f749bc2136e600cdfda24a0062f3d73). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24362: [SPARK-22666][ML][FOLLOW-UP] Fix in Spark image datasource fail when encounter some illegal images.
AmplabJenkins removed a comment on issue #24362: [SPARK-22666][ML][FOLLOW-UP] Fix in Spark image datasource fail when encounter some illegal images. URL: https://github.com/apache/spark/pull/24362#issuecomment-482741881 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9887/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24362: [SPARK-22666][ML][FOLLOW-UP] Fix in Spark image datasource fail when encounter some illegal images.
AmplabJenkins removed a comment on issue #24362: [SPARK-22666][ML][FOLLOW-UP] Fix in Spark image datasource fail when encounter some illegal images. URL: https://github.com/apache/spark/pull/24362#issuecomment-482741877 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24080: [SPARK-27147][TEST]Create new unit test cases for SortShuffleWriter
SparkQA commented on issue #24080: [SPARK-27147][TEST]Create new unit test cases for SortShuffleWriter URL: https://github.com/apache/spark/pull/24080#issuecomment-482741806 **[Test build #4705 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4705/testReport)** for PR 24080 at commit [`05febb0`](https://github.com/apache/spark/commit/05febb0d99c17dc8226dfd3d7013b17b696b2f6f). * This patch **fails PySpark unit tests**. * This patch **does not merge cleanly**. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24362: [SPARK-22666][ML][FOLLOW-UP] Fix in Spark image datasource fail when encounter some illegal images.
AmplabJenkins commented on issue #24362: [SPARK-22666][ML][FOLLOW-UP] Fix in Spark image datasource fail when encounter some illegal images. URL: https://github.com/apache/spark/pull/24362#issuecomment-482741877 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on issue #24080: [SPARK-27147][TEST]Create new unit test cases for SortShuffleWriter
SparkQA removed a comment on issue #24080: [SPARK-27147][TEST]Create new unit test cases for SortShuffleWriter URL: https://github.com/apache/spark/pull/24080#issuecomment-482658568 **[Test build #4705 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4705/testReport)** for PR 24080 at commit [`05febb0`](https://github.com/apache/spark/commit/05febb0d99c17dc8226dfd3d7013b17b696b2f6f). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24362: [SPARK-22666][ML][FOLLOW-UP] Fix in Spark image datasource fail when encounter some illegal images.
AmplabJenkins commented on issue #24362: [SPARK-22666][ML][FOLLOW-UP] Fix in Spark image datasource fail when encounter some illegal images. URL: https://github.com/apache/spark/pull/24362#issuecomment-482741881 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9887/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] WeichenXu123 commented on a change in pull request #24362: [SPARK-22666][ML][FOLLOW-UP] Fix in Spark image datasource fail when encounter some illegal images.
WeichenXu123 commented on a change in pull request #24362:
[SPARK-22666][ML][FOLLOW-UP] Fix in Spark image datasource fail when encounter
some illegal images.
URL: https://github.com/apache/spark/pull/24362#discussion_r275080584
##
File path: mllib/src/main/scala/org/apache/spark/ml/image/ImageSchema.scala
##
@@ -133,7 +133,13 @@ object ImageSchema {
*/
private[spark] def decode(origin: String, bytes: Array[Byte]): Option[Row] =
{
-val img = ImageIO.read(new ByteArrayInputStream(bytes))
+val img = try {
+ ImageIO.read(new ByteArrayInputStream(bytes))
+} catch {
+ // Catch runtime exception because `ImageIO` may throw unexcepted
`RuntimeException`.
+ // But do not catch the declared `IOException` (regareded as FileSystem
failure)
Review comment:
Good catch! :)
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] dilipbiswal commented on a change in pull request #24362: [SPARK-22666][ML][FOLLOW-UP] Fix in Spark image datasource fail when encounter some illegal images.
dilipbiswal commented on a change in pull request #24362:
[SPARK-22666][ML][FOLLOW-UP] Fix in Spark image datasource fail when encounter
some illegal images.
URL: https://github.com/apache/spark/pull/24362#discussion_r275072440
##
File path: mllib/src/main/scala/org/apache/spark/ml/image/ImageSchema.scala
##
@@ -133,7 +133,13 @@ object ImageSchema {
*/
private[spark] def decode(origin: String, bytes: Array[Byte]): Option[Row] =
{
-val img = ImageIO.read(new ByteArrayInputStream(bytes))
+val img = try {
+ ImageIO.read(new ByteArrayInputStream(bytes))
+} catch {
+ // Catch runtime exception because `ImageIO` may throw unexcepted
`RuntimeException`.
+ // But do not catch the declared `IOException` (regareded as FileSystem
failure)
Review comment:
Nit: regareded -> regarded
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7
AmplabJenkins removed a comment on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7 URL: https://github.com/apache/spark/pull/24364#issuecomment-482723288 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9886/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7
AmplabJenkins removed a comment on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7 URL: https://github.com/apache/spark/pull/24364#issuecomment-482723283 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7
AmplabJenkins commented on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7 URL: https://github.com/apache/spark/pull/24364#issuecomment-482723288 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9886/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7
AmplabJenkins commented on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7 URL: https://github.com/apache/spark/pull/24364#issuecomment-482723283 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7
SparkQA commented on issue #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7 URL: https://github.com/apache/spark/pull/24364#issuecomment-482721933 **[Test build #104562 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104562/testReport)** for PR 24364 at commit [`c5c9467`](https://github.com/apache/spark/commit/c5c946759f2086bfad1ac18f59f49b2af6044f34). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] dongjoon-hyun opened a new pull request #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7
dongjoon-hyun opened a new pull request #24364: [SPARK-27452][BUILD] Update zstd-jni to 1.3.8-7 URL: https://github.com/apache/spark/pull/24364 ## What changes were proposed in this pull request? This PR aims to update `zstd-jni` from 1.3.2-2 to 1.3.8-7 to be aligned with the latest Zstd 1.3.8 in Apache Spark 3.0.0. ## How was this patch tested? Pass the Jenkins with the existing tests. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] shaneknapp edited a comment on issue #24266: [SPARK-25079][python] update python3 executable to 3.6.x
shaneknapp edited a comment on issue #24266: [SPARK-25079][python] update python3 executable to 3.6.x URL: https://github.com/apache/spark/pull/24266#issuecomment-482712134 > well, i got the tests to pass on worker-05: > > ``` > sknapp@amp-jenkins-worker-05 US]$ sudo mv /usr/share/zoneinfo/US/Pacific-New /tmp > ``` > however, that tzdata file is present and in the same location on the other workers that AREN'T failing tests. > > ¯\\\_(ツ)\_/¯ so, to test whether or not (re)moving the Pacific-New timezone data file to /tmp actually works on all machines, i did the same thing on -03: `sknapp@amp-jenkins-worker-03 US]$ sudo mv /usr/share/zoneinfo/US/Pacific-New /tmp` i then ran the python tests, and they *failed*. seriously, i think my brain is about to (im|ex)plode. edit: to get this to run successfully on -03, i had to: 1) manually edit `anaconda/envs/py36/lib/python3.6/site-packages/pytz/__init__.py` and add US/Pacific-New to both all_timezones and common_timezones 2) recompile the package (`python3.6 -m compileall .`) 3) created a symlink for Pacific-New to point at Pacific in `anaconda/envs/py36/lib/python3.6/site-packages/pytz/zoneinfo/US`. for now i remain, and most likely for a very long time, completely confused. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24266: [SPARK-25079][python] update python3 executable to 3.6.x
AmplabJenkins removed a comment on issue #24266: [SPARK-25079][python] update python3 executable to 3.6.x URL: https://github.com/apache/spark/pull/24266#issuecomment-482717198 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24266: [SPARK-25079][python] update python3 executable to 3.6.x
AmplabJenkins removed a comment on issue #24266: [SPARK-25079][python] update python3 executable to 3.6.x URL: https://github.com/apache/spark/pull/24266#issuecomment-482717205 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9885/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24266: [SPARK-25079][python] update python3 executable to 3.6.x
AmplabJenkins commented on issue #24266: [SPARK-25079][python] update python3 executable to 3.6.x URL: https://github.com/apache/spark/pull/24266#issuecomment-482717205 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9885/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on issue #24266: [SPARK-25079][python] update python3 executable to 3.6.x
AmplabJenkins commented on issue #24266: [SPARK-25079][python] update python3 executable to 3.6.x URL: https://github.com/apache/spark/pull/24266#issuecomment-482717198 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24363: [SPARK-27451][BUILD] Upgrade lz4-java to 1.5.1
AmplabJenkins removed a comment on issue #24363: [SPARK-27451][BUILD] Upgrade lz4-java to 1.5.1 URL: https://github.com/apache/spark/pull/24363#issuecomment-482715113 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24266: [SPARK-25079][python] update python3 executable to 3.6.x
SparkQA commented on issue #24266: [SPARK-25079][python] update python3 executable to 3.6.x URL: https://github.com/apache/spark/pull/24266#issuecomment-482715650 **[Test build #104561 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104561/testReport)** for PR 24266 at commit [`1d14800`](https://github.com/apache/spark/commit/1d1480094fd102819c8f2675f2c583d96286ba96). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on issue #24363: [SPARK-27451][BUILD] Upgrade lz4-java to 1.5.1
AmplabJenkins removed a comment on issue #24363: [SPARK-27451][BUILD] Upgrade lz4-java to 1.5.1 URL: https://github.com/apache/spark/pull/24363#issuecomment-482715120 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/9884/ Test PASSed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on issue #24363: [SPARK-27451][BUILD] Upgrade lz4-java to 1.5.1
SparkQA commented on issue #24363: [SPARK-27451][BUILD] Upgrade lz4-java to 1.5.1 URL: https://github.com/apache/spark/pull/24363#issuecomment-482715624 **[Test build #104560 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104560/testReport)** for PR 24363 at commit [`4092b71`](https://github.com/apache/spark/commit/4092b71ee174fa8d2451f9259b9ebbf5dfb5b01a). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
