[GitHub] [spark] AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469192836 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] AmplabJenkins commented on issue #23957: [SPARK-15095][FOLLOW-UP][SQL] Remove HiveSessionHook related code from ThriftServer

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23957: [SPARK-15095][FOLLOW-UP][SQL] Remove HiveSessionHook related code from ThriftServer URL: https://github.com/apache/spark/pull/23957#issuecomment-469192769 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #23956: [SPARK-27042][SS] Close cached Kafka consumer in case of task retry

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23956: [SPARK-27042][SS] Close cached Kafka consumer in case of task retry URL: https://github.com/apache/spark/pull/23956#issuecomment-469192568 Merged build finished. Test PASSed. This is a

[GitHub] [spark] SparkQA removed a comment on issue #23956: [SPARK-27042][SS] Close cached Kafka consumer in case of task retry

2019-03-04 Thread GitBox
SparkQA removed a comment on issue #23956: [SPARK-27042][SS] Close cached Kafka consumer in case of task retry URL: https://github.com/apache/spark/pull/23956#issuecomment-469183685 **[Test build #102982 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102982

[GitHub] [spark] SparkQA commented on issue #23956: [SPARK-27042][SS] Close cached Kafka consumer in case of task retry

2019-03-04 Thread GitBox
SparkQA commented on issue #23956: [SPARK-27042][SS] Close cached Kafka consumer in case of task retry URL: https://github.com/apache/spark/pull/23956#issuecomment-469192459 **[Test build #102982 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102982/testRe

[GitHub] [spark] AmplabJenkins commented on issue #23956: [SPARK-27042][SS] Close cached Kafka consumer in case of task retry

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23956: [SPARK-27042][SS] Close cached Kafka consumer in case of task retry URL: https://github.com/apache/spark/pull/23956#issuecomment-469192572 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs

[GitHub] [spark] NamanMahor commented on issue #23840: [WIP][DISCUSSION_NEEDED][SPARK-24295][SS] Add option to retain only last batch in file stream sink metadata

2019-03-04 Thread GitBox
NamanMahor commented on issue #23840: [WIP][DISCUSSION_NEEDED][SPARK-24295][SS] Add option to retain only last batch in file stream sink metadata URL: https://github.com/apache/spark/pull/23840#issuecomment-469192269 I was facing this issue SPARK-24295 so I was looking into commit. I have t

[GitHub] [spark] jagadesh-kiran commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
jagadesh-kiran commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469191754 Indentation issues are fixed This is an aut

[GitHub] [spark] AmplabJenkins removed a comment on issue #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue URL: https://github.com/apache/spark/pull/23954#issuecomment-469190646 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

2019-03-04 Thread GitBox
SparkQA commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-469190924 **[Test build #102985 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102985/testReport)** for PR 23783 at

[GitHub] [spark] wangyum opened a new pull request #23957: [SPARK-15095][FOLLOW-UP][SQL] Remove HiveSessionHook related code from ThriftServer

2019-03-04 Thread GitBox
wangyum opened a new pull request #23957: [SPARK-15095][FOLLOW-UP][SQL] Remove HiveSessionHook related code from ThriftServer URL: https://github.com/apache/spark/pull/23957 ## What changes were proposed in this pull request? https://github.com/apache/spark/pull/12881 removed `HiveSe

[GitHub] [spark] AmplabJenkins removed a comment on issue #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue URL: https://github.com/apache/spark/pull/23954#issuecomment-469190669 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] [spark] AmplabJenkins commented on issue #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue URL: https://github.com/apache/spark/pull/23954#issuecomment-469190646 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue URL: https://github.com/apache/spark/pull/23954#issuecomment-469190669 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] onursatici commented on a change in pull request #23928: [SPARK-27023][K8S]configurable k8s client timeouts

2019-03-04 Thread GitBox
onursatici commented on a change in pull request #23928: [SPARK-27023][K8S]configurable k8s client timeouts URL: https://github.com/apache/spark/pull/23928#discussion_r261988535 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-469190243 Merged build finished. Test PASSed. This is an automated mes

[GitHub] [spark] onursatici commented on a change in pull request #23928: [SPARK-27023][K8S]configurable k8s client timeouts

2019-03-04 Thread GitBox
onursatici commented on a change in pull request #23928: [SPARK-27023][K8S]configurable k8s client timeouts URL: https://github.com/apache/spark/pull/23928#discussion_r261988499 ## File path: docs/running-on-kubernetes.md ## @@ -990,6 +990,52 @@ See the [configuration page

[GitHub] [spark] AmplabJenkins removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-469190248 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/

[GitHub] [spark] SparkQA removed a comment on issue #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue

2019-03-04 Thread GitBox
SparkQA removed a comment on issue #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue URL: https://github.com/apache/spark/pull/23954#issuecomment-469178620 **[Test build #102977 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1029

[GitHub] [spark] AmplabJenkins commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-469190248 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/

[GitHub] [spark] AmplabJenkins commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#issuecomment-469190243 Merged build finished. Test PASSed. This is an automated message fro

[GitHub] [spark] SparkQA commented on issue #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue

2019-03-04 Thread GitBox
SparkQA commented on issue #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue URL: https://github.com/apache/spark/pull/23954#issuecomment-469190251 **[Test build #102977 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102977/test

[GitHub] [spark] AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469188901 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://a

[GitHub] [spark] SparkQA removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
SparkQA removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469188525 **[Test build #102984 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102984

[GitHub] [spark] AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-46917 Merged build finished. Test FAILed. T

[GitHub] [spark] AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-46917 Merged build finished. Test FAILed. This is a

[GitHub] [spark] AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469188901 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs

[GitHub] [spark] SparkQA commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
SparkQA commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469188875 **[Test build #102984 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102984/testRe

[GitHub] [spark] SparkQA commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
SparkQA commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469188525 **[Test build #102984 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102984/testRep

[GitHub] [spark] AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469187804 Merged build finished. Test PASSed. T

[GitHub] [spark] AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469187807 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469187807 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469187804 Merged build finished. Test PASSed. This is a

[GitHub] [spark] jagadesh-kiran commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
jagadesh-kiran commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-46918 Updated the Python compilation issue This is

[GitHub] [spark] dongjoon-hyun commented on issue #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC

2019-03-04 Thread GitBox
dongjoon-hyun commented on issue #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC URL: https://github.com/apache/spark/pull/23955#issuecomment-469184966 Yep. It would be great to add the result of a AS-IS baseline in this PR. Also, please update Parquet benchmark too. --

[GitHub] [spark] viirya commented on a change in pull request #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC

2019-03-04 Thread GitBox
viirya commented on a change in pull request #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC URL: https://github.com/apache/spark/pull/23955#discussion_r261982316 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/OrcNestedSchemaPrunin

[GitHub] [spark] viirya commented on a change in pull request #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC

2019-03-04 Thread GitBox
viirya commented on a change in pull request #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC URL: https://github.com/apache/spark/pull/23955#discussion_r261982341 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/OrcNestedSchemaPrunin

[GitHub] [spark] viirya commented on a change in pull request #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC

2019-03-04 Thread GitBox
viirya commented on a change in pull request #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC URL: https://github.com/apache/spark/pull/23955#discussion_r261982142 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/OrcNestedSchemaPrunin

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC

2019-03-04 Thread GitBox
dongjoon-hyun commented on a change in pull request #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC URL: https://github.com/apache/spark/pull/23955#discussion_r261981668 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/OrcNestedSchem

[GitHub] [spark] AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469183041 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] AmplabJenkins removed a comment on issue #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC URL: https://github.com/apache/spark/pull/23955#issuecomment-469182963 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469183029 Merged build finished. Test PASSed. T

[GitHub] [spark] AmplabJenkins removed a comment on issue #23956: [SPARK-27042][SS] Close cached Kafka consumer in case of task retry

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23956: [SPARK-27042][SS] Close cached Kafka consumer in case of task retry URL: https://github.com/apache/spark/pull/23956#issuecomment-469182876 Can one of the admins verify this patch? -

[GitHub] [spark] AmplabJenkins removed a comment on issue #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC URL: https://github.com/apache/spark/pull/23955#issuecomment-469182970 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs

[GitHub] [spark] AmplabJenkins removed a comment on issue #23956: [SPARK-27042][SS] Close cached Kafka consumer in case of task retry

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23956: [SPARK-27042][SS] Close cached Kafka consumer in case of task retry URL: https://github.com/apache/spark/pull/23956#issuecomment-469182688 Can one of the admins verify this patch? -

[GitHub] [spark] SparkQA commented on issue #23956: [SPARK-27042][SS] Close cached Kafka consumer in case of task retry

2019-03-04 Thread GitBox
SparkQA commented on issue #23956: [SPARK-27042][SS] Close cached Kafka consumer in case of task retry URL: https://github.com/apache/spark/pull/23956#issuecomment-469183685 **[Test build #102982 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102982/testRep

[GitHub] [spark] SparkQA commented on issue #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC

2019-03-04 Thread GitBox
SparkQA commented on issue #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC URL: https://github.com/apache/spark/pull/23955#issuecomment-469183704 **[Test build #102983 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102983/testReport)** f

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC

2019-03-04 Thread GitBox
dongjoon-hyun commented on a change in pull request #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC URL: https://github.com/apache/spark/pull/23955#discussion_r261980586 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/OrcNestedSchem

[GitHub] [spark] viirya commented on issue #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC

2019-03-04 Thread GitBox
viirya commented on issue #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC URL: https://github.com/apache/spark/pull/23955#issuecomment-469183129 Yep, for ORC, should I post current benchmark and update it after we have nested schema of ORC?

[GitHub] [spark] AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469183029 Merged build finished. Test PASSed. This is a

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC

2019-03-04 Thread GitBox
dongjoon-hyun commented on a change in pull request #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC URL: https://github.com/apache/spark/pull/23955#discussion_r261980438 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/OrcNestedSchem

[GitHub] [spark] AmplabJenkins commented on issue #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC URL: https://github.com/apache/spark/pull/23955#issuecomment-469182963 Merged build finished. Test PASSed. This is an automat

[GitHub] [spark] AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469183041 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] AmplabJenkins commented on issue #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC URL: https://github.com/apache/spark/pull/23955#issuecomment-469182970 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkele

[GitHub] [spark] AmplabJenkins commented on issue #23956: [SPARK-27042][SS] Close cached Kafka consumer in case of task retry

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23956: [SPARK-27042][SS] Close cached Kafka consumer in case of task retry URL: https://github.com/apache/spark/pull/23956#issuecomment-469182876 Can one of the admins verify this patch? This

[GitHub] [spark] HyukjinKwon commented on issue #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue

2019-03-04 Thread GitBox
HyukjinKwon commented on issue #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue URL: https://github.com/apache/spark/pull/23954#issuecomment-469182903 Looks reasonable. Let me take a closer look soon to be doubly sure. It's quite a core path. -

[GitHub] [spark] AmplabJenkins commented on issue #23956: [SPARK-27042][SS] Close cached Kafka consumer in case of task retry

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23956: [SPARK-27042][SS] Close cached Kafka consumer in case of task retry URL: https://github.com/apache/spark/pull/23956#issuecomment-469182688 Can one of the admins verify this patch? This

[GitHub] [spark] AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469181425 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://a

[GitHub] [spark] dongjoon-hyun commented on issue #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC

2019-03-04 Thread GitBox
dongjoon-hyun commented on issue #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC URL: https://github.com/apache/spark/pull/23955#issuecomment-469182241 Nice! Could you add the BM results? This is an automat

[GitHub] [spark] gaborgsomogyi opened a new pull request #23956: [SPARK-27042][SS] Close cached Kafka consumer in case of task retry

2019-03-04 Thread GitBox
gaborgsomogyi opened a new pull request #23956: [SPARK-27042][SS] Close cached Kafka consumer in case of task retry URL: https://github.com/apache/spark/pull/23956 ## What changes were proposed in this pull request? If a task is failing due to a cached corrupted `KafkaProducer` and t

[GitHub] [spark] AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469181417 Merged build finished. Test FAILed. T

[GitHub] [spark] AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469181417 Merged build finished. Test FAILed. This is a

[GitHub] [spark] SparkQA removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
SparkQA removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469181083 **[Test build #102981 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102981

[GitHub] [spark] SparkQA commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
SparkQA commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469181407 **[Test build #102981 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102981/testRe

[GitHub] [spark] AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469181425 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs

[GitHub] [spark] viirya opened a new pull request #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC

2019-03-04 Thread GitBox
viirya opened a new pull request #23955: [SPARK-27043][SQL] Nested schema pruning benchmark for ORC URL: https://github.com/apache/spark/pull/23955 ## What changes were proposed in this pull request? We have benchmark of nested schema pruning, but only for Parquet. This adds similar

[GitHub] [spark] jagadesh-kiran commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
jagadesh-kiran commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469180967 Updated the Python Style Indentation test case --

[GitHub] [spark] SparkQA commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
SparkQA commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469181083 **[Test build #102981 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102981/testRep

[GitHub] [spark] AmplabJenkins removed a comment on issue #23943: [SPARK-27034][SQL] Nested schema pruning for ORC

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23943: [SPARK-27034][SQL] Nested schema pruning for ORC URL: https://github.com/apache/spark/pull/23943#issuecomment-469180415 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #23943: [SPARK-27034][SQL] Nested schema pruning for ORC

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23943: [SPARK-27034][SQL] Nested schema pruning for ORC URL: https://github.com/apache/spark/pull/23943#issuecomment-469180418 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.

[GitHub] [spark] AmplabJenkins removed a comment on issue #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue URL: https://github.com/apache/spark/pull/23954#issuecomment-469180333 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:

[GitHub] [spark] asmello commented on issue #23882: [SPARK-26979][PYTHON] Add missing string column name support for some SQL functions

2019-03-04 Thread GitBox
asmello commented on issue #23882: [SPARK-26979][PYTHON] Add missing string column name support for some SQL functions URL: https://github.com/apache/spark/pull/23882#issuecomment-469180366 @HyukjinKwon hopefully this last commit will make things more clear. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue URL: https://github.com/apache/spark/pull/23954#issuecomment-469180322 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #23943: [SPARK-27034][SQL] Nested schema pruning for ORC

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23943: [SPARK-27034][SQL] Nested schema pruning for ORC URL: https://github.com/apache/spark/pull/23943#issuecomment-469180418 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenk

[GitHub] [spark] AmplabJenkins commented on issue #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue URL: https://github.com/apache/spark/pull/23954#issuecomment-469180322 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #23943: [SPARK-27034][SQL] Nested schema pruning for ORC

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23943: [SPARK-27034][SQL] Nested schema pruning for ORC URL: https://github.com/apache/spark/pull/23943#issuecomment-469180415 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue URL: https://github.com/apache/spark/pull/23954#issuecomment-469180333 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469179000 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://a

[GitHub] [spark] SparkQA removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
SparkQA removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469178655 **[Test build #102978 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102978

[GitHub] [spark] AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469178996 Merged build finished. Test FAILed. T

[GitHub] [spark] SparkQA commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
SparkQA commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469178982 **[Test build #102978 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102978/testRe

[GitHub] [spark] AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469178996 Merged build finished. Test FAILed. This is a

[GitHub] [spark] AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469179000 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs

[GitHub] [spark] SparkQA commented on issue #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue

2019-03-04 Thread GitBox
SparkQA commented on issue #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue URL: https://github.com/apache/spark/pull/23954#issuecomment-469178620 **[Test build #102977 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102977/testR

[GitHub] [spark] SparkQA commented on issue #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntOrLongColumn

2019-03-04 Thread GitBox
SparkQA commented on issue #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntOrLongColumn URL: https://github.com/apache/spark/pull/23942#issuecomment-469178661 **[Test build #102980 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1029

[GitHub] [spark] jagadesh-kiran commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
jagadesh-kiran commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469178727 @HyukjinKwon thanks for your review, updated the pull request as per your comments ,please review the same

[GitHub] [spark] SparkQA commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
SparkQA commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469178655 **[Test build #102978 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102978/testRep

[GitHub] [spark] SparkQA commented on issue #23943: [SPARK-27034][SQL] Nested schema pruning for ORC

2019-03-04 Thread GitBox
SparkQA commented on issue #23943: [SPARK-27034][SQL] Nested schema pruning for ORC URL: https://github.com/apache/spark/pull/23943#issuecomment-469178675 **[Test build #102979 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102979/testReport)** for PR 2394

[GitHub] [spark] viirya commented on a change in pull request #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue

2019-03-04 Thread GitBox
viirya commented on a change in pull request #23954: [SPARK-27041][PySpark] Use imap() for python 2.x to resolve oom issue URL: https://github.com/apache/spark/pull/23954#discussion_r261975513 ## File path: python/pyspark/worker.py ## @@ -45,6 +45,8 @@ if sys.version >=

[GitHub] [spark] AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469177807 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] AmplabJenkins removed a comment on issue #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntOrLongColumn

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntOrLongColumn URL: https://github.com/apache/spark/pull/23942#issuecomment-469177893 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469177799 Merged build finished. Test PASSed. T

[GitHub] [spark] AmplabJenkins removed a comment on issue #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntOrLongColumn

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntOrLongColumn URL: https://github.com/apache/spark/pull/23942#issuecomment-469177901 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469177799 Merged build finished. Test PASSed. This is a

[GitHub] [spark] AmplabJenkins commented on issue #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntOrLongColumn

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntOrLongColumn URL: https://github.com/apache/spark/pull/23942#issuecomment-469177893 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntOrLongColumn

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntOrLongColumn URL: https://github.com/apache/spark/pull/23942#issuecomment-469177901 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:

[GitHub] [spark] AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong

2019-03-04 Thread GitBox
AmplabJenkins commented on issue #23946: [SPARK-26860][PySpark] Fix for RangeBetween docs appear to be wrong URL: https://github.com/apache/spark/pull/23946#issuecomment-469177807 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] AmplabJenkins removed a comment on issue #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntOrLongColumn

2019-03-04 Thread GitBox
AmplabJenkins removed a comment on issue #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntOrLongColumn URL: https://github.com/apache/spark/pull/23942#issuecomment-468995073 Can one of the admins verify this patch? ---

[GitHub] [spark] maropu commented on a change in pull request #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntOrLongColumn

2019-03-04 Thread GitBox
maropu commented on a change in pull request #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntOrLongColumn URL: https://github.com/apache/spark/pull/23942#discussion_r261974665 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer

[GitHub] [spark] maropu commented on issue #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntOrLongColumn

2019-03-04 Thread GitBox
maropu commented on issue #23942: [SPARK-27033][SQL]Add Optimize rule RewriteArithmeticFiltersOnIntOrLongColumn URL: https://github.com/apache/spark/pull/23942#issuecomment-469177565 ok to test This is an automated message fr

<    5   6   7   8   9   10   11   12   >