[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20511 Sure. No problem. BTW, is it applicable for Apache Spark 2.3? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/20511 +1 for 1.4.3 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20511 @omalley Thanks for your quick reply! @dongjoon-hyun Maybe we should directly bump to 1.4.3? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20511 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20511 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87293/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20511 **[Test build #87293 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87293/testReport)** for PR 20511 at commit [`eeef040`](https://github.com/apache/spark/commit/eeef04073dcf6092e319547be8960651f6fcd9cb). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user omalley commented on the issue: https://github.com/apache/spark/pull/20511 Sorry, I forgot to transition the jira issues for the ORC 1.4.3, so they didn't show up in the search from the notes. The list of jiras closed by the 1.4.3 release is: https://s.apache.org/Fll8 There was an issue with the reader if you had an empty column of floats/doubles (ORC-285) and a compression issue that only seemed to hit LLAP (ORC-296). We are about to start the ORC 1.5 release, but the ORC 1.4 release has been very stable. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20511 I am wondering what is the difference between ORC 1.4.3 and ORC 1.4.2? Their release notes are the SAME. https://orc.apache.org/news/2018/02/09/ORC-1.4.3/ and https://orc.apache.org/news/2018/02/09/ORC-1.4.2/ Could you help us figure out the exact change JIRA lists excluded in these two releases? Should we directly upgrade it to 1.4.3? What is the release schedule for Apache ORC? Our Spark 2.4 will not be released until the second half of 2018. Which version of ORC is stable for production? I am wondering if we should always upgrade to the latest version of ORC? Or wait for more user feedbacks from the ORC community to know whether the version is stable or not? cc @dongjoon-hyun @omalley --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20511 Thank you, @kiszk . --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20511 **[Test build #87293 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87293/testReport)** for PR 20511 at commit [`eeef040`](https://github.com/apache/spark/commit/eeef04073dcf6092e319547be8960651f6fcd9cb). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20511 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20511 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/779/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/20511 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20511 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20511 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87291/ Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20511 **[Test build #87291 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87291/testReport)** for PR 20511 at commit [`eeef040`](https://github.com/apache/spark/commit/eeef04073dcf6092e319547be8960651f6fcd9cb). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20511 **[Test build #87291 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87291/testReport)** for PR 20511 at commit [`eeef040`](https://github.com/apache/spark/commit/eeef04073dcf6092e319547be8960651f6fcd9cb). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20511 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20511 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/777/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20511 Retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20511 cc @srowen --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20511 Thank you for review, @gatorsmile and @HyukjinKwon . Sure, this is for Apache Spark 2.4. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20511 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87079/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20511 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20511 **[Test build #87079 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87079/testReport)** for PR 20511 at commit [`eeef040`](https://github.com/apache/spark/commit/eeef04073dcf6092e319547be8960651f6fcd9cb). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20511 Just FYI, this will not be merged to 2.3 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20511 **[Test build #87079 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87079/testReport)** for PR 20511 at commit [`eeef040`](https://github.com/apache/spark/commit/eeef04073dcf6092e319547be8960651f6fcd9cb). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20511 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20511 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/601/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20511 Retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20511 The failure is due to flaky test suite. ``` org.apache.spark.sql.hive.client.HiveClientSuites.(It is not a test it is a sbt.testing.NestedSuiteSelector) ``` --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20511 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20511 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87073/ Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20511 **[Test build #87073 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87073/testReport)** for PR 20511 at commit [`eeef040`](https://github.com/apache/spark/commit/eeef04073dcf6092e319547be8960651f6fcd9cb). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20511 Right, @kiszk ! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/20511 LGTM since 1.4.2 does not seem to include major changes based on [the release summary](https://orc.apache.org/news/2018/01/23/ORC-1.4.2/). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20511 **[Test build #87073 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87073/testReport)** for PR 20511 at commit [`eeef040`](https://github.com/apache/spark/commit/eeef04073dcf6092e319547be8960651f6fcd9cb). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20511 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/596/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #20511: [SPARK-23340][BUILD] Update ORC to 1.4.2
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20511 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org