[GitHub] [spark] AmplabJenkins removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-530241440 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://a

[GitHub] [spark] AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530241200 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.ber

[GitHub] [spark] AmplabJenkins removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-530241431 Merged build finished. Test FAILed. T

[GitHub] [spark] AmplabJenkins commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-530241440 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs

[GitHub] [spark] AmplabJenkins commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-530241431 Merged build finished. Test FAILed. This is a

[GitHub] [spark] SparkQA removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530206549 **[Test build #110457 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110457/testReport)

[GitHub] [spark] AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530241200 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.ed

[GitHub] [spark] SparkQA commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-10 Thread GitBox
SparkQA commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-530241173 **[Test build #110446 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110446/testRe

[GitHub] [spark] AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530241192 Merged build finished. Test FAILed. This is an au

[GitHub] [spark] SparkQA removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-530162729 **[Test build #110446 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110446

[GitHub] [spark] AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530241192 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] SparkQA commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
SparkQA commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530241007 **[Test build #110457 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110457/testReport)** for

[GitHub] [spark] AmplabJenkins removed a comment on issue #25752: [SPARK-29045][SQL][TESTS] Drop table to avoid test failure in SQLMetricsSuite

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25752: [SPARK-29045][SQL][TESTS] Drop table to avoid test failure in SQLMetricsSuite URL: https://github.com/apache/spark/pull/25752#issuecomment-530240633 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25752: [SPARK-29045][SQL][TESTS] Drop table to avoid test failure in SQLMetricsSuite

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25752: [SPARK-29045][SQL][TESTS] Drop table to avoid test failure in SQLMetricsSuite URL: https://github.com/apache/spark/pull/25752#issuecomment-530240642 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25752: [SPARK-29045][SQL][TESTS] Drop table to avoid test failure in SQLMetricsSuite

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25752: [SPARK-29045][SQL][TESTS] Drop table to avoid test failure in SQLMetricsSuite URL: https://github.com/apache/spark/pull/25752#issuecomment-530240642 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] [spark] AmplabJenkins commented on issue #25752: [SPARK-29045][SQL][TESTS] Drop table to avoid test failure in SQLMetricsSuite

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25752: [SPARK-29045][SQL][TESTS] Drop table to avoid test failure in SQLMetricsSuite URL: https://github.com/apache/spark/pull/25752#issuecomment-530240633 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #25752: [SPARK-29045][SQL][TESTS] Drop table to avoid test failure in SQLMetricsSuite

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #25752: [SPARK-29045][SQL][TESTS] Drop table to avoid test failure in SQLMetricsSuite URL: https://github.com/apache/spark/pull/25752#issuecomment-530198211 **[Test build #110453 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuil

[GitHub] [spark] SparkQA commented on issue #25752: [SPARK-29045][SQL][TESTS] Drop table to avoid test failure in SQLMetricsSuite

2019-09-10 Thread GitBox
SparkQA commented on issue #25752: [SPARK-29045][SQL][TESTS] Drop table to avoid test failure in SQLMetricsSuite URL: https://github.com/apache/spark/pull/25752#issuecomment-530240049 **[Test build #110453 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110

[GitHub] [spark] AmplabJenkins removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-530239115 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://a

[GitHub] [spark] AmplabJenkins removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-530239108 Merged build finished. Test FAILed. T

[GitHub] [spark] AmplabJenkins commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-530239108 Merged build finished. Test FAILed. This is a

[GitHub] [spark] AmplabJenkins commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-530239115 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs

[GitHub] [spark] SparkQA removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-530161220 **[Test build #110445 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110445

[GitHub] [spark] SparkQA commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-10 Thread GitBox
SparkQA commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-530238810 **[Test build #110445 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110445/testRe

[GitHub] [spark] deshanxiao closed pull request #25692: [SPARK-28987][CORE] DiskBlockManager#createTempShuffleBlock should skip read-only directory

2019-09-10 Thread GitBox
deshanxiao closed pull request #25692: [SPARK-28987][CORE] DiskBlockManager#createTempShuffleBlock should skip read-only directory URL: https://github.com/apache/spark/pull/25692 This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
SparkQA commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530234819 **[Test build #110461 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilde

[GitHub] [spark] AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530234337 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530234342 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530234342 Test PASSed. Refer to this link for build results (access rights to CI server needed

[GitHub] [spark] AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530234337 Merged build finished. Test PASSed. --

[GitHub] [spark] AngersZhuuuu edited a comment on issue #25746: [WIP][SPARK-28292][SQL] Enable Injection of User-defined Hint

2019-09-10 Thread GitBox
AngersZh edited a comment on issue #25746: [WIP][SPARK-28292][SQL] Enable Injection of User-defined Hint URL: https://github.com/apache/spark/pull/25746#issuecomment-530221208 This way will be more flexible. Thanks .

[GitHub] [spark] HeartSaVioR edited a comment on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext

2019-09-10 Thread GitBox
HeartSaVioR edited a comment on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext URL: https://github.com/apache/spark/pull/25709#issuecomment-530224431 Failed tests: https://ampla

[GitHub] [spark] SparkQA commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext

2019-09-10 Thread GitBox
SparkQA commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext URL: https://github.com/apache/spark/pull/25709#issuecomment-530225717 **[Test build #110460 has started](https://am

[GitHub] [spark] AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530224562 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530224565 Test PASSed. Refer to this link for build results (access rights to CI server needed

[GitHub] [spark] AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530224562 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530224565 Test PASSed. Refer to this link for build results (access rights to CI server needed): h

[GitHub] [spark] SparkQA removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530199730 **[Test build #110454 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReque

[GitHub] [spark] HeartSaVioR commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext

2019-09-10 Thread GitBox
HeartSaVioR commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext URL: https://github.com/apache/spark/pull/25709#issuecomment-530224431 Failed tests: https://amplab.cs.be

[GitHub] [spark] HeartSaVioR commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext

2019-09-10 Thread GitBox
HeartSaVioR commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext URL: https://github.com/apache/spark/pull/25709#issuecomment-530224460 retest this, please -

[GitHub] [spark] SparkQA commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
SparkQA commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530224099 **[Test build #110454 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuild

[GitHub] [spark] HeartSaVioR edited a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
HeartSaVioR edited a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530223614 > start() just waits for safe mode exit and for this suite of tests it is irrelevant. No. There're

[GitHub] [spark] HeartSaVioR commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
HeartSaVioR commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530223614 > start() just waits for safe mode exit and for this suite of tests it is irrelevant. No. There're some i

[GitHub] [spark] AngersZhuuuu edited a comment on issue #25746: [WIP][SPARK-28292][SQL] Enable Injection of User-defined Hint

2019-09-10 Thread GitBox
AngersZh edited a comment on issue #25746: [WIP][SPARK-28292][SQL] Enable Injection of User-defined Hint URL: https://github.com/apache/spark/pull/25746#issuecomment-530221208 This way will be more flexible. Thanks . may be we still need to RemoveAllHint before Optimizer. Sin

[GitHub] [spark] wangyum commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
wangyum commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530223479 ``` sbt.ResolveException: unresolved dependency: com.typesafe.genjavadoc#genjavadoc-plugin_2.12.10;0.13: not found at sbt.IvyAct

[GitHub] [spark] holdenk commented on a change in pull request #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire

2019-09-10 Thread GitBox
holdenk commented on a change in pull request #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire URL: https://github.com/apache/spark/pull/25748#discussion_r323062064 ## File path: resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s

[GitHub] [spark] cloud-fan commented on issue #25295: [SPARK-28560][SQL] Optimize shuffle reader to local shuffle reader when smj converted to bhj in adaptive execution

2019-09-10 Thread GitBox
cloud-fan commented on issue #25295: [SPARK-28560][SQL] Optimize shuffle reader to local shuffle reader when smj converted to bhj in adaptive execution URL: https://github.com/apache/spark/pull/25295#issuecomment-530222762 Should this be a general optimization? When a reduce task needs to r

[GitHub] [spark] AmplabJenkins removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530221733 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/

[GitHub] [spark] AmplabJenkins commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530221730 Merged build finished. Test FAILed. This is an automated message fr

[GitHub] [spark] AmplabJenkins commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530221733 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/

[GitHub] [spark] SparkQA commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
SparkQA commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530221725 **[Test build #110459 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110459/testReport)** for PR 25404 a

[GitHub] [spark] AmplabJenkins removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530221730 Merged build finished. Test FAILed. This is an automated me

[GitHub] [spark] SparkQA removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530221036 **[Test build #110459 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110459/testReport)** for PR

[GitHub] [spark] AngersZhuuuu commented on issue #25746: [WIP][SPARK-28292][SQL] Enable Injection of User-defined Hint

2019-09-10 Thread GitBox
AngersZh commented on issue #25746: [WIP][SPARK-28292][SQL] Enable Injection of User-defined Hint URL: https://github.com/apache/spark/pull/25746#issuecomment-530221208 This way will be more flexible. Thanks . This is an

[GitHub] [spark] SparkQA commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
SparkQA commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530221036 **[Test build #110459 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110459/testReport)** for PR 25404 at

[GitHub] [spark] AmplabJenkins removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530220676 Merged build finished. Test PASSed. This is an automated me

[GitHub] [spark] AmplabJenkins removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530220681 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu

[GitHub] [spark] AmplabJenkins removed a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530220526 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://a

[GitHub] [spark] AmplabJenkins commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530220681 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins

[GitHub] [spark] AmplabJenkins commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530220676 Merged build finished. Test PASSed. This is an automated message fr

[GitHub] [spark] AmplabJenkins removed a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530220521 Merged build finished. Test PASSed. T

[GitHub] [spark] AmplabJenkins commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530220526 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs

[GitHub] [spark] AmplabJenkins commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530220521 Merged build finished. Test PASSed. This is a

[GitHub] [spark] SparkQA removed a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530195322 **[Test build #110452 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110452

[GitHub] [spark] SparkQA commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
SparkQA commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530220194 **[Test build #110452 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110452/testRe

[GitHub] [spark] wangyum opened a new pull request #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
wangyum opened a new pull request #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404 ## What changes were proposed in this pull request? This PR upgrade Scala to **2.12.9**. Release notes: - Faster compiler: 5–10% faste

[GitHub] [spark] HyukjinKwon commented on issue #25728: [SPARK-29020][SQL] Improving array_sort behaviour

2019-09-10 Thread GitBox
HyukjinKwon commented on issue #25728: [SPARK-29020][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#issuecomment-530219674 Add a Lambda expression for comparator instead of another column `asc` in array_sort. See `array_sort(array(T), function(T, T, int

[GitHub] [spark] shanyu commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
shanyu commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530219153 > What I'm concerned about is the change would also make tests skip initializing. If the test calls `updateAndCheck()

[GitHub] [spark] shanyu edited a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
shanyu edited a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530219153 > What I'm concerned about is the change would also make tests skip initializing. If the test calls `updateAnd

[GitHub] [spark] gengliangwang commented on a change in pull request #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-10 Thread GitBox
gengliangwang commented on a change in pull request #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#discussion_r323057115 ## File path: core/src/main/scala/org/apache/spark/ui/UIUtils.scala ## @@ -311,7 +311

[GitHub] [spark] imback82 commented on a change in pull request #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic

2019-09-10 Thread GitBox
imback82 commented on a change in pull request #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic URL: https://github.com/apache/spark/pull/25747#discussion_r323056338 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalog/v2/LookupCatalog.scal

[GitHub] [spark] SparkQA commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
SparkQA commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530213098 **[Test build #110458 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110458/testReport)** for

[GitHub] [spark] AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530212779 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530212773 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530212779 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.e

[GitHub] [spark] AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530212773 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-530209376 Test PASSed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] [spark] AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-530209376 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-530209375 Merged build finished. Test PASSed. --

[GitHub] [spark] SparkQA removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-530203905 **[Test build #110456 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/11

[GitHub] [spark] AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-530209375 Merged build finished. Test PASSed. This

[GitHub] [spark] SparkQA commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
SparkQA commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-530209301 **[Test build #110456 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110456/te

[GitHub] [spark] AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530207511 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530207509 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530207509 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530207511 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.e

[GitHub] [spark] Gschiavon commented on issue #25728: [SPARK-29020][SQL] Improving array_sort behaviour

2019-09-10 Thread GitBox
Gschiavon commented on issue #25728: [SPARK-29020][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#issuecomment-530207202 How does it translate for this PR @ueshin ? This is an automated me

[GitHub] [spark] SparkQA commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
SparkQA commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530206549 **[Test build #110457 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110457/testReport)** for

[GitHub] [spark] AmplabJenkins removed a comment on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which i

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive URL: https://github.com/apache/spark/pull/25542#issuecomment-530205987 Test PASSed. Re

[GitHub] [spark] SparkQA removed a comment on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is crea

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive URL: https://github.com/apache/spark/pull/25542#issuecomment-530201229 **[Test build #110455 ha

[GitHub] [spark] AmplabJenkins removed a comment on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which i

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive URL: https://github.com/apache/spark/pull/25542#issuecomment-530205984 Merged build finis

[GitHub] [spark] AmplabJenkins commented on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is create

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive URL: https://github.com/apache/spark/pull/25542#issuecomment-530205984 Merged build finished. Tes

[GitHub] [spark] AmplabJenkins commented on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is create

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive URL: https://github.com/apache/spark/pull/25542#issuecomment-530205987 Test PASSed. Refer to t

[GitHub] [spark] SparkQA commented on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by H

2019-09-10 Thread GitBox
SparkQA commented on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive URL: https://github.com/apache/spark/pull/25542#issuecomment-530205919 **[Test build #110455 has finis

[GitHub] [spark] cloud-fan commented on a change in pull request #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic

2019-09-10 Thread GitBox
cloud-fan commented on a change in pull request #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic URL: https://github.com/apache/spark/pull/25747#discussion_r323046755 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalog/v2/LookupCatalog.sca

[GitHub] [spark] SparkQA commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
SparkQA commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-530203905 **[Test build #110456 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110456/tes

[GitHub] [spark] dongjinleekr commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
dongjinleekr commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-530203918 @srowen Fixed, with removing redundant `new` in `KafkaDataConsumerSuite`. -

[GitHub] [spark] dongjinleekr commented on a change in pull request #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
dongjinleekr commented on a change in pull request #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#discussion_r323045234 ## File path: external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka01

[GitHub] [spark] dongjinleekr commented on a change in pull request #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
dongjinleekr commented on a change in pull request #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#discussion_r323045178 ## File path: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka01

[GitHub] [spark] AmplabJenkins removed a comment on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkCont

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext URL: https://github.com/apache/spark/pull/25709#issuecomment-530202414 Test FAILed. Refer to this li

  1   2   3   4   5   6   7   8   9   10   >