[GitHub] [spark] shahidki31 commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-18 Thread GitBox
shahidki31 commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r315060361 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/dat

[GitHub] [spark] AmplabJenkins removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-522438784 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-522438784 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-522438787 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] [spark] AmplabJenkins commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-522438787 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522438165 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jen

[GitHub] [spark] AmplabJenkins removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522438155 Merged build finished. Test PASSed. This is an automated messa

[GitHub] [spark] SparkQA commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page

2019-08-18 Thread GitBox
SparkQA commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522438074 **[Test build #109318 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109318/testReport)** for PR 25445 at c

[GitHub] [spark] SparkQA removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page

2019-08-18 Thread GitBox
SparkQA removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522435095 **[Test build #109318 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109318/testReport)** for PR 25

[GitHub] [spark] AmplabJenkins commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522438155 Merged build finished. Test PASSed. This is an automated message from

[GitHub] [spark] AmplabJenkins commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522438165 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//jo

[GitHub] [spark] shahidki31 commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-18 Thread GitBox
shahidki31 commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r315060361 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/dat

[GitHub] [spark] AmplabJenkins removed a comment on issue #25372: [SPARK-28640][SQL] Only give warning when session catalog is not defined

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #25372: [SPARK-28640][SQL] Only give warning when session catalog is not defined URL: https://github.com/apache/spark/pull/25372#issuecomment-522436930 Test FAILed. Refer to this link for build results (access rights to CI server needed): http

[GitHub] [spark] SparkQA commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-18 Thread GitBox
SparkQA commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-522437126 **[Test build #109320 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder

[GitHub] [spark] SparkQA commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-18 Thread GitBox
SparkQA commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-522437152 **[Test build #109319 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109319/testRe

[GitHub] [spark] SparkQA removed a comment on issue #25372: [SPARK-28640][SQL] Only give warning when session catalog is not defined

2019-08-18 Thread GitBox
SparkQA removed a comment on issue #25372: [SPARK-28640][SQL] Only give warning when session catalog is not defined URL: https://github.com/apache/spark/pull/25372#issuecomment-522432957 **[Test build #109317 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1

[GitHub] [spark] AmplabJenkins removed a comment on issue #25372: [SPARK-28640][SQL] Only give warning when session catalog is not defined

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #25372: [SPARK-28640][SQL] Only give warning when session catalog is not defined URL: https://github.com/apache/spark/pull/25372#issuecomment-522436925 Merged build finished. Test FAILed. -

[GitHub] [spark] SparkQA commented on issue #25372: [SPARK-28640][SQL] Only give warning when session catalog is not defined

2019-08-18 Thread GitBox
SparkQA commented on issue #25372: [SPARK-28640][SQL] Only give warning when session catalog is not defined URL: https://github.com/apache/spark/pull/25372#issuecomment-522436902 **[Test build #109317 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109317/t

[GitHub] [spark] AmplabJenkins commented on issue #25372: [SPARK-28640][SQL] Only give warning when session catalog is not defined

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #25372: [SPARK-28640][SQL] Only give warning when session catalog is not defined URL: https://github.com/apache/spark/pull/25372#issuecomment-522436925 Merged build finished. Test FAILed. This

[GitHub] [spark] AmplabJenkins commented on issue #25372: [SPARK-28640][SQL] Only give warning when session catalog is not defined

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #25372: [SPARK-28640][SQL] Only give warning when session catalog is not defined URL: https://github.com/apache/spark/pull/25372#issuecomment-522436930 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522436615 Merged build finished. Test PASSed. This is an automated messa

[GitHub] [spark] AmplabJenkins commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-522436630 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522436618 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/je

[GitHub] [spark] AmplabJenkins removed a comment on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-522436630 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522436618 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//j

[GitHub] [spark] AmplabJenkins commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-522436637 Test PASSed. Refer to this link for build results (access rights to CI server needed): h

[GitHub] [spark] AmplabJenkins removed a comment on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-522436637 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] AmplabJenkins commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522436615 Merged build finished. Test PASSed. This is an automated message from

[GitHub] [spark] wangyum commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-18 Thread GitBox
wangyum commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r315058705 ## File path: sql/core/src/test/scala/org/apache/spark/sql/StatisticsCollec

[GitHub] [spark] SparkQA commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page

2019-08-18 Thread GitBox
SparkQA commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522435095 **[Test build #109318 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109318/testReport)** for PR 25445 at co

[GitHub] [spark] AmplabJenkins removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-522433948 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] AmplabJenkins removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-522433946 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-18 Thread GitBox
SparkQA removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-522431090 **[Test build #109316 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10931

[GitHub] [spark] SparkQA commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-18 Thread GitBox
SparkQA commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-522433930 **[Test build #109316 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109316/testR

[GitHub] [spark] AmplabJenkins commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-522433946 Merged build finished. Test FAILed. This is

[GitHub] [spark] AmplabJenkins commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-522433948 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] ConeyLiu commented on a change in pull request #25470: [SPARK-28751][Core] Improve java serializer deserialization performance

2019-08-18 Thread GitBox
ConeyLiu commented on a change in pull request #25470: [SPARK-28751][Core] Improve java serializer deserialization performance URL: https://github.com/apache/spark/pull/25470#discussion_r315054629 ## File path: core/src/main/scala/org/apache/spark/serializer/JavaSerializer.scala ##

[GitHub] [spark] wangyum commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-18 Thread GitBox
wangyum commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r315055204 ## File path: sql/core/src/test/scala/org/apache/spark/sql/StatisticsCollec

[GitHub] [spark] SparkQA commented on issue #25372: [SPARK-28640][SQL] Only give warning when session catalog is not defined

2019-08-18 Thread GitBox
SparkQA commented on issue #25372: [SPARK-28640][SQL] Only give warning when session catalog is not defined URL: https://github.com/apache/spark/pull/25372#issuecomment-522432957 **[Test build #109317 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109317/te

[GitHub] [spark] hddong commented on a change in pull request #25412: [SPARK-28691][EXAMPLES] Add Java/Scala DirectKerberizedKafkaWordCount examples

2019-08-18 Thread GitBox
hddong commented on a change in pull request #25412: [SPARK-28691][EXAMPLES] Add Java/Scala DirectKerberizedKafkaWordCount examples URL: https://github.com/apache/spark/pull/25412#discussion_r315055331 ## File path: examples/src/main/java/org/apache/spark/examples/streaming/JavaDir

[GitHub] [spark] ConeyLiu commented on a change in pull request #25470: [SPARK-28751][Core] Improve java serializer deserialization performance

2019-08-18 Thread GitBox
ConeyLiu commented on a change in pull request #25470: [SPARK-28751][Core] Improve java serializer deserialization performance URL: https://github.com/apache/spark/pull/25470#discussion_r315055338 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala

[GitHub] [spark] ConeyLiu commented on a change in pull request #25470: [SPARK-28751][Core] Improve java serializer deserialization performance

2019-08-18 Thread GitBox
ConeyLiu commented on a change in pull request #25470: [SPARK-28751][Core] Improve java serializer deserialization performance URL: https://github.com/apache/spark/pull/25470#discussion_r315055307 ## File path: core/src/main/scala/org/apache/spark/serializer/JavaSerializer.scala ##

[GitHub] [spark] AmplabJenkins removed a comment on issue #25372: [SPARK-28640][SQL] Only give warning when session catalog is not defined

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #25372: [SPARK-28640][SQL] Only give warning when session catalog is not defined URL: https://github.com/apache/spark/pull/25372#issuecomment-522432449 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #25372: [SPARK-28640][SQL] Only give warning when session catalog is not defined

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #25372: [SPARK-28640][SQL] Only give warning when session catalog is not defined URL: https://github.com/apache/spark/pull/25372#issuecomment-522432455 Test PASSed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] [spark] ConeyLiu commented on a change in pull request #25470: [SPARK-28751][Core] Improve java serializer deserialization performance

2019-08-18 Thread GitBox
ConeyLiu commented on a change in pull request #25470: [SPARK-28751][Core] Improve java serializer deserialization performance URL: https://github.com/apache/spark/pull/25470#discussion_r315054629 ## File path: core/src/main/scala/org/apache/spark/serializer/JavaSerializer.scala ##

[GitHub] [spark] AmplabJenkins commented on issue #25372: [SPARK-28640][SQL] Only give warning when session catalog is not defined

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #25372: [SPARK-28640][SQL] Only give warning when session catalog is not defined URL: https://github.com/apache/spark/pull/25372#issuecomment-522432455 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] felixcheung commented on issue #25490: [SPARK-28756][R][FOLLOW-UP] Specify minimum and maximum Java versions

2019-08-18 Thread GitBox
felixcheung commented on issue #25490: [SPARK-28756][R][FOLLOW-UP] Specify minimum and maximum Java versions URL: https://github.com/apache/spark/pull/25490#issuecomment-522432409 Looks fine. Like you said, not sure how SystemRequirements works. Very little documentation.

[GitHub] [spark] AmplabJenkins commented on issue #25372: [SPARK-28640][SQL] Only give warning when session catalog is not defined

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #25372: [SPARK-28640][SQL] Only give warning when session catalog is not defined URL: https://github.com/apache/spark/pull/25372#issuecomment-522432449 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522431788 Merged build finished. Test PASSed. This is an automated messa

[GitHub] [spark] AmplabJenkins removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522431791 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jen

[GitHub] [spark] SparkQA removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page

2019-08-18 Thread GitBox
SparkQA removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522429275 **[Test build #109314 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109314/testReport)** for PR 25

[GitHub] [spark] jzhuge commented on issue #25372: [SPARK-28640][SQL] Only give warning when session catalog is not defined

2019-08-18 Thread GitBox
jzhuge commented on issue #25372: [SPARK-28640][SQL] Only give warning when session catalog is not defined URL: https://github.com/apache/spark/pull/25372#issuecomment-522431929 Handle typo in plugin class name for both v2 session catalog and default catalog. Manual test cases -

[GitHub] [spark] AmplabJenkins commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522431788 Merged build finished. Test PASSed. This is an automated message from

[GitHub] [spark] AmplabJenkins commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522431791 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//jo

[GitHub] [spark] HyukjinKwon closed pull request #25490: [SPARK-28756][R][FOLLOW-UP] Specify minimum and maximum Java versions

2019-08-18 Thread GitBox
HyukjinKwon closed pull request #25490: [SPARK-28756][R][FOLLOW-UP] Specify minimum and maximum Java versions URL: https://github.com/apache/spark/pull/25490 This is an automated message from the Apache Git Service. To respo

[GitHub] [spark] SparkQA commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page

2019-08-18 Thread GitBox
SparkQA commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522431697 **[Test build #109314 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109314/testReport)** for PR 25445 at c

[GitHub] [spark] ConeyLiu commented on a change in pull request #25470: [SPARK-28751][Core] Improve java serializer deserialization performance

2019-08-18 Thread GitBox
ConeyLiu commented on a change in pull request #25470: [SPARK-28751][Core] Improve java serializer deserialization performance URL: https://github.com/apache/spark/pull/25470#discussion_r315054076 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala

[GitHub] [spark] HyukjinKwon opened a new pull request #25490: [SPARK-28756][R][FOLLOW-UP] Specify minimum and maximum Java versions

2019-08-18 Thread GitBox
HyukjinKwon opened a new pull request #25490: [SPARK-28756][R][FOLLOW-UP] Specify minimum and maximum Java versions URL: https://github.com/apache/spark/pull/25490 ### What changes were proposed in this pull request? This PR proposes to set minimum and maximum Java versio

[GitHub] [spark] ConeyLiu commented on a change in pull request #25470: [SPARK-28751][Core] Improve java serializer deserialization performance

2019-08-18 Thread GitBox
ConeyLiu commented on a change in pull request #25470: [SPARK-28751][Core] Improve java serializer deserialization performance URL: https://github.com/apache/spark/pull/25470#discussion_r315053961 ## File path: core/src/test/scala/org/apache/spark/serializer/JavaSerializerBenchmark

[GitHub] [spark] felixcheung commented on issue #25472: [SPARK-28756][R] Fix checkJavaVersion to accept JDK8+

2019-08-18 Thread GitBox
felixcheung commented on issue #25472: [SPARK-28756][R] Fix checkJavaVersion to accept JDK8+ URL: https://github.com/apache/spark/pull/25472#issuecomment-522431488 We also found SystemRequirements didn’t work - it didn’t prevent CRAN from running tests on JDK > 8 -

[GitHub] [spark] sekikn commented on issue #24651: [SPARK-27420][DSTREAMS][Kinesis] KinesisInputDStream should expose a way to configure CloudWatch metrics

2019-08-18 Thread GitBox
sekikn commented on issue #24651: [SPARK-27420][DSTREAMS][Kinesis] KinesisInputDStream should expose a way to configure CloudWatch metrics URL: https://github.com/apache/spark/pull/24651#issuecomment-522431292 @brkyvz Would you take a look into this PR? I think you're an expert on Kinesis-

[GitHub] [spark] SparkQA commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-18 Thread GitBox
SparkQA commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-522431090 **[Test build #109316 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109316/testRe

[GitHub] [spark] AmplabJenkins removed a comment on issue #25490: [SPARK-28756][R][FOLLOW-UP] Specify minimum and maximum Java versions

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #25490: [SPARK-28756][R][FOLLOW-UP] Specify minimum and maximum Java versions URL: https://github.com/apache/spark/pull/25490#issuecomment-522430606 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25490: [SPARK-28756][R][FOLLOW-UP] Specify minimum and maximum Java versions

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #25490: [SPARK-28756][R][FOLLOW-UP] Specify minimum and maximum Java versions URL: https://github.com/apache/spark/pull/25490#issuecomment-522430600 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25490: [SPARK-28756][R][FOLLOW-UP] Specify minimum and maximum Java versions

2019-08-18 Thread GitBox
SparkQA commented on issue #25490: [SPARK-28756][R][FOLLOW-UP] Specify minimum and maximum Java versions URL: https://github.com/apache/spark/pull/25490#issuecomment-522431068 **[Test build #109315 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109315/testR

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25489: [WIP] pyspark.sql.functions.col as C

2019-08-18 Thread GitBox
HyukjinKwon commented on a change in pull request #25489: [WIP] pyspark.sql.functions.col as C URL: https://github.com/apache/spark/pull/25489#discussion_r315053426 ## File path: python/pyspark/sql/functions.py ## @@ -315,6 +312,46 @@ def _options_to_str(options): del _na

[GitHub] [spark] AmplabJenkins removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522430590 Merged build finished. Test PASSed. This is an automated messa

[GitHub] [spark] AmplabJenkins removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-522430594 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-522430604 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] [spark] AmplabJenkins removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522430592 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/je

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #25477: [SPARK-28760][SS][TESTS] Add Kafka delegation token end-to-end test with mini KDC

2019-08-18 Thread GitBox
AngersZh commented on a change in pull request #25477: [SPARK-28760][SS][TESTS] Add Kafka delegation token end-to-end test with mini KDC URL: https://github.com/apache/spark/pull/25477#discussion_r315053199 ## File path: external/kafka-0-10-sql/pom.xml ## @@ -92,6 +92

[GitHub] [spark] AmplabJenkins commented on issue #25490: [SPARK-28756][R][FOLLOW-UP] Specify minimum and maximum Java versions

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #25490: [SPARK-28756][R][FOLLOW-UP] Specify minimum and maximum Java versions URL: https://github.com/apache/spark/pull/25490#issuecomment-522430606 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] AmplabJenkins commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522430590 Merged build finished. Test PASSed. This is an automated message from

[GitHub] [spark] AmplabJenkins commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-522430594 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522430592 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//j

[GitHub] [spark] AmplabJenkins commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-522430604 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] AmplabJenkins commented on issue #25490: [SPARK-28756][R][FOLLOW-UP] Specify minimum and maximum Java versions

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #25490: [SPARK-28756][R][FOLLOW-UP] Specify minimum and maximum Java versions URL: https://github.com/apache/spark/pull/25490#issuecomment-522430600 Merged build finished. Test PASSed. This is

[GitHub] [spark] gatorsmile commented on a change in pull request #25445: [SPARK-28541][WEBUI] Document Storage page

2019-08-18 Thread GitBox
gatorsmile commented on a change in pull request #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#discussion_r315052945 ## File path: docs/web-ui.md ## @@ -45,6 +45,54 @@ The Storage tab displays the persisted RDDs and Data

[GitHub] [spark] zhengruifeng commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-18 Thread GitBox
zhengruifeng commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-522430185 retest this please This is an automated messa

[GitHub] [spark] AmplabJenkins removed a comment on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-522429603 Merged build finished. Test PASSed. Th

[GitHub] [spark] AmplabJenkins removed a comment on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-522429609 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://am

[GitHub] [spark] dongjoon-hyun edited a comment on issue #25490: [SPARK-28756][R][FOLLOW-UP] Specify minimum and maximum Java versions

2019-08-18 Thread GitBox
dongjoon-hyun edited a comment on issue #25490: [SPARK-28756][R][FOLLOW-UP] Specify minimum and maximum Java versions URL: https://github.com/apache/spark/pull/25490#issuecomment-522429435 Oh, thank you for the quick follow-up, @HyukjinKwon ! Could you review this, @felixcheung ? --

[GitHub] [spark] AmplabJenkins commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-522429609 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.

[GitHub] [spark] dongjoon-hyun commented on issue #25490: [SPARK-28756][R][FOLLOW-UP] Specify minimum and maximum Java versions

2019-08-18 Thread GitBox
dongjoon-hyun commented on issue #25490: [SPARK-28756][R][FOLLOW-UP] Specify minimum and maximum Java versions URL: https://github.com/apache/spark/pull/25490#issuecomment-522429435 Oh, thank you for the quick follow-up, @HyukjinKwon ! --

[GitHub] [spark] AmplabJenkins commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-522429603 Merged build finished. Test PASSed. This is an

[GitHub] [spark] HyukjinKwon commented on issue #25472: [SPARK-28756][R] Fix checkJavaVersion to accept JDK8+

2019-08-18 Thread GitBox
HyukjinKwon commented on issue #25472: [SPARK-28756][R] Fix checkJavaVersion to accept JDK8+ URL: https://github.com/apache/spark/pull/25472#issuecomment-522429332 Actually, I was checking `SystemRequirements` out of curiosity and made a followup while I am here. -

[GitHub] [spark] SparkQA commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page

2019-08-18 Thread GitBox
SparkQA commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522429275 **[Test build #109314 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109314/testReport)** for PR 25445 at co

[GitHub] [spark] SparkQA removed a comment on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-08-18 Thread GitBox
SparkQA removed a comment on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-522392908 **[Test build #109308 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109308/

[GitHub] [spark] viirya commented on a change in pull request #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing

2019-08-18 Thread GitBox
viirya commented on a change in pull request #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing URL: https://github.com/apache/spark/pull/24525#discussion_r315051701 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/NestedCol

[GitHub] [spark] HyukjinKwon opened a new pull request #25490: [SPARK-28756][R][FOLLOW-UP] Specify minimum and maximum Java versions

2019-08-18 Thread GitBox
HyukjinKwon opened a new pull request #25490: [SPARK-28756][R][FOLLOW-UP] Specify minimum and maximum Java versions URL: https://github.com/apache/spark/pull/25490 ### What changes were proposed in this pull request? This PR proposes to set minimum and maximum Java versio

[GitHub] [spark] SparkQA commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-08-18 Thread GitBox
SparkQA commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-522429168 **[Test build #109308 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109308/testRep

[GitHub] [spark] AmplabJenkins removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-522428596 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] gatorsmile closed pull request #25459: [SPARK-28734][DOC] Initial table of content in the left hand side bar for SQL doc

2019-08-18 Thread GitBox
gatorsmile closed pull request #25459: [SPARK-28734][DOC] Initial table of content in the left hand side bar for SQL doc URL: https://github.com/apache/spark/pull/25459 This is an automated message from the Apache Git Servic

[GitHub] [spark] SparkQA commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-18 Thread GitBox
SparkQA commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-522428573 **[Test build #109313 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109313/testR

[GitHub] [spark] AmplabJenkins commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-522428596 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] gatorsmile commented on issue #25459: [SPARK-28734][DOC] Initial table of content in the left hand side bar for SQL doc

2019-08-18 Thread GitBox
gatorsmile commented on issue #25459: [SPARK-28734][DOC] Initial table of content in the left hand side bar for SQL doc URL: https://github.com/apache/spark/pull/25459#issuecomment-522428560 LGTM. We will remove the incomplete pages if we are unable to finish them before the release.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-18 Thread GitBox
AmplabJenkins removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-522428592 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-18 Thread GitBox
SparkQA removed a comment on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-522425970 **[Test build #109313 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10931

[GitHub] [spark] dongjoon-hyun commented on issue #25472: [SPARK-28756][R] Fix checkJavaVersion to accept JDK8+

2019-08-18 Thread GitBox
dongjoon-hyun commented on issue #25472: [SPARK-28756][R] Fix checkJavaVersion to accept JDK8+ URL: https://github.com/apache/spark/pull/25472#issuecomment-522428677 Thank you, @felixcheung ! Got it. - For `paste`, I'll do follow up . - For `SystemRequirements: Java (>= 8)`, I'll rev

[GitHub] [spark] AmplabJenkins commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

2019-08-18 Thread GitBox
AmplabJenkins commented on issue #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#issuecomment-522428592 Merged build finished. Test FAILed. This is

  1   2   3   4   5   >