[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/20590 thanks, merging to master/2.3! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-ma

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20590 Hi, @cloud-fan and @gatorsmile . It's ready for review again. I think this definitely will reduce the flakiness for that suite. But, I'm still looking at some other places, too. ---

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87425/ Test PASSed. ---

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20590 **[Test build #87425 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87425/testReport)** for PR 20590 at commit [`18c2485`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/874/ Test

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20590 **[Test build #87425 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87425/testReport)** for PR 20590 at commit [`18c2485`](https://github.com/apache/spark/commit/18

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20590 The previous failures are flaky ones and irrelevant to this PR. - org.apache.spark.sql.FileBasedDataSourceSuite.(It is not a test it is a sbt.testing.SuiteSelector) - org.apache.spark.s

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20590 Retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: rev

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87402/ Test FAILed. ---

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20590 **[Test build #87402 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87402/testReport)** for PR 20590 at commit [`18c2485`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87397/ Test PASSed. ---

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20590 **[Test build #87397 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87397/testReport)** for PR 20590 at commit [`5a9fa0b`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20590 **[Test build #87402 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87402/testReport)** for PR 20590 at commit [`18c2485`](https://github.com/apache/spark/commit/18

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/862/ Test

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87393/ Test PASSed. ---

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20590 **[Test build #87393 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87393/testReport)** for PR 20590 at commit [`d4cc32e`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/859/ Test

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20590 **[Test build #87397 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87397/testReport)** for PR 20590 at commit [`5a9fa0b`](https://github.com/apache/spark/commit/5a

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/855/ Test

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20590 **[Test build #87393 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87393/testReport)** for PR 20590 at commit [`d4cc32e`](https://github.com/apache/spark/commit/d4

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/20590 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87385/ Test FAILed. ---

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20590 **[Test build #87385 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87385/testReport)** for PR 20590 at commit [`d4cc32e`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87384/ Test FAILed. ---

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20590 **[Test build #87384 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87384/testReport)** for PR 20590 at commit [`3b8cb0a`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20590 **[Test build #87385 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87385/testReport)** for PR 20590 at commit [`d4cc32e`](https://github.com/apache/spark/commit/d4

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/849/ Test

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/848/ Test

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20590 **[Test build #87384 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87384/testReport)** for PR 20590 at commit [`3b8cb0a`](https://github.com/apache/spark/commit/3b

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-12 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20590 Thank you for review, @viirya , @kiszk , @cloud-fan . Yep. I'm still trying to reproduce it by a test case. I'll inform you later. ---

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-12 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/20590 I know it's hard to add a test, we need a malformed ORC file to make the reader fail midway. @dongjoon-hyun do you think it's possible to generate such a ORC file? --- -

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-12 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/20590 looks reasonable. `batchReader.initBatch` throw `FileNotException`, and we enter `afterEach`, detect the file stream leak and fail. ---

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-12 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/20590 @dongjoon-hyun One question. Do you know which test case in `FileBasedDataSourceSuite` may cause this failure? Now, we are seeing a stack trace at `afterEach`. --- -

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-12 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/20590 Umm... --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apach

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87349/ Test FAILed. ---

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20590 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20590: [SPARK-23399][SQL] Register a task completion listener f...

2018-02-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20590 **[Test build #87349 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87349/testReport)** for PR 20590 at commit [`198f186`](https://github.com/apache/spark/commit/1