[GitHub] [spark] AmplabJenkins commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query

2019-08-16 Thread GitBox
AmplabJenkins commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#issuecomment-522057087 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkin

[GitHub] [spark] AmplabJenkins commented on issue #25458: [SPARK-27931][SQL] Accept 'on' and 'off' as input and trim input for the boolean data type.

2019-08-16 Thread GitBox
AmplabJenkins commented on issue #25458: [SPARK-27931][SQL] Accept 'on' and 'off' as input and trim input for the boolean data type. URL: https://github.com/apache/spark/pull/25458#issuecomment-522056963 Test PASSed. Refer to this link for build results (access rights to CI server needed

[GitHub] [spark] srowen closed pull request #25449: [PYSPARK] Simpler countByValue using collections' Counter

2019-08-16 Thread GitBox
srowen closed pull request #25449: [PYSPARK] Simpler countByValue using collections' Counter URL: https://github.com/apache/spark/pull/25449 This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [spark] AmplabJenkins commented on issue #25479: [SPARK-28356][FOLLOWUP] fix case with different pre-shuffle partition numbers

2019-08-16 Thread GitBox
AmplabJenkins commented on issue #25479: [SPARK-28356][FOLLOWUP] fix case with different pre-shuffle partition numbers URL: https://github.com/apache/spark/pull/25479#issuecomment-522056788 Merged build finished. Test PASSed.

[GitHub] [spark] dongjoon-hyun commented on issue #25472: [SPARK-28756][R] Fix checkJavaVersion to accept JDK8+

2019-08-16 Thread GitBox
dongjoon-hyun commented on issue #25472: [SPARK-28756][R] Fix checkJavaVersion to accept JDK8+ URL: https://github.com/apache/spark/pull/25472#issuecomment-522056548 Retest this please. This is an automated message from the A

[GitHub] [spark] dongjoon-hyun commented on issue #25474: [SPARK-28758][BUILD][SQL] Upgrade Janino to 3.0.15

2019-08-16 Thread GitBox
dongjoon-hyun commented on issue #25474: [SPARK-28758][BUILD][SQL] Upgrade Janino to 3.0.15 URL: https://github.com/apache/spark/pull/25474#issuecomment-522056255 Retest this please. This is an automated message from the Apac

[GitHub] [spark] dongjoon-hyun commented on issue #25476: [SPARK-28759][BUILD] Upgrade scala-maven-plugin to 4.1.1

2019-08-16 Thread GitBox
dongjoon-hyun commented on issue #25476: [SPARK-28759][BUILD] Upgrade scala-maven-plugin to 4.1.1 URL: https://github.com/apache/spark/pull/25476#issuecomment-522056096 Retest this please This is an automated message from the

[GitHub] [spark] shaneknapp commented on issue #25423: [SPARK-28701][test-java11][k8s] adding java11 support for pull request builds

2019-08-16 Thread GitBox
shaneknapp commented on issue #25423: [SPARK-28701][test-java11][k8s] adding java11 support for pull request builds URL: https://github.com/apache/spark/pull/25423#issuecomment-522055428 test this please This is an automated

[GitHub] [spark] shaneknapp removed a comment on issue #25423: [SPARK-28701][test-java11][k8s] adding java11 support for pull request builds

2019-08-16 Thread GitBox
shaneknapp removed a comment on issue #25423: [SPARK-28701][test-java11][k8s] adding java11 support for pull request builds URL: https://github.com/apache/spark/pull/25423#issuecomment-522050361 test this please This is an au

[GitHub] [spark] AmplabJenkins commented on issue #25479: [SPARK-28356][FOLLOWUP] fix case with different pre-shuffle partition numbers

2019-08-16 Thread GitBox
AmplabJenkins commented on issue #25479: [SPARK-28356][FOLLOWUP] fix case with different pre-shuffle partition numbers URL: https://github.com/apache/spark/pull/25479#issuecomment-522055305 Can one of the admins verify this patch? ---

[GitHub] [spark] cloud-fan commented on issue #25368: [SPARK-28635][SQL] create CatalogManager to track registered v2 catalogs

2019-08-16 Thread GitBox
cloud-fan commented on issue #25368: [SPARK-28635][SQL] create CatalogManager to track registered v2 catalogs URL: https://github.com/apache/spark/pull/25368#issuecomment-522054813 retest this please This is an automated mess

[GitHub] [spark] cloud-fan commented on a change in pull request #25479: [SPARK-28356][FOLLOWUP] fix case with different pre-shuffle partition numbers

2019-08-16 Thread GitBox
cloud-fan commented on a change in pull request #25479: [SPARK-28356][FOLLOWUP] fix case with different pre-shuffle partition numbers URL: https://github.com/apache/spark/pull/25479#discussion_r314777873 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/ReduceNum

[GitHub] [spark] cloud-fan commented on a change in pull request #25479: [SPARK-28356][FOLLOWUP] fix case with different pre-shuffle partition numbers

2019-08-16 Thread GitBox
cloud-fan commented on a change in pull request #25479: [SPARK-28356][FOLLOWUP] fix case with different pre-shuffle partition numbers URL: https://github.com/apache/spark/pull/25479#discussion_r314777426 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/

[GitHub] [spark] cloud-fan commented on issue #25479: [SPARK-28356][FOLLOWUP] fix case with different pre-shuffle partition numbers

2019-08-16 Thread GitBox
cloud-fan commented on issue #25479: [SPARK-28356][FOLLOWUP] fix case with different pre-shuffle partition numbers URL: https://github.com/apache/spark/pull/25479#issuecomment-522053909 ok to test This is an automated message

[GitHub] [spark] cloud-fan closed pull request #25469: [SPARK-27637][Shuffle][FOLLOW-UP]For nettyBlockTransferService, if IOException occurred while create client, check whether relative executor is a

2019-08-16 Thread GitBox
cloud-fan closed pull request #25469: [SPARK-27637][Shuffle][FOLLOW-UP]For nettyBlockTransferService, if IOException occurred while create client, check whether relative executor is alive before retry #24533 URL: https://github.com/apache/spark/pull/25469

[GitHub] [spark] shaneknapp commented on issue #25423: [SPARK-28701][test-java11][k8s] adding java11 support for pull request builds

2019-08-16 Thread GitBox
shaneknapp commented on issue #25423: [SPARK-28701][test-java11][k8s] adding java11 support for pull request builds URL: https://github.com/apache/spark/pull/25423#issuecomment-522050361 test this please This is an automated

[GitHub] [spark] wangyum commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-16 Thread GitBox
wangyum commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r314771686 ## File path: sql/core/src/test/scala/org/apache/spark/sql/StatisticsCollec

[GitHub] [spark] shivaram commented on issue #25478: [SPARK-28755][R][TESTS] Increase tolerance in 'spark.mlp' SparkR test for JDK 11

2019-08-16 Thread GitBox
shivaram commented on issue #25478: [SPARK-28755][R][TESTS] Increase tolerance in 'spark.mlp' SparkR test for JDK 11 URL: https://github.com/apache/spark/pull/25478#issuecomment-522049559 @HyukjinKwon Sure it sounds fine to me. Lets file another JIRA to track where this error is coming fro

[GitHub] [spark] cloud-fan commented on issue #25463: [SPARK-28744][SQL][TEST] rename SharedSQLContext to SharedSparkSession

2019-08-16 Thread GitBox
cloud-fan commented on issue #25463: [SPARK-28744][SQL][TEST] rename SharedSQLContext to SharedSparkSession URL: https://github.com/apache/spark/pull/25463#issuecomment-522048721 retest this please This is an automated messag

[GitHub] [spark] cloud-fan commented on issue #25469: [SPARK-27637][Shuffle][FOLLOW-UP]For nettyBlockTransferService, if IOException occurred while create client, check whether relative executor is al

2019-08-16 Thread GitBox
cloud-fan commented on issue #25469: [SPARK-27637][Shuffle][FOLLOW-UP]For nettyBlockTransferService, if IOException occurred while create client, check whether relative executor is alive before retry #24533 URL: https://github.com/apache/spark/pull/25469#issuecomment-522048859 thanks, merg

[GitHub] [spark] cloud-fan commented on a change in pull request #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution

2019-08-16 Thread GitBox
cloud-fan commented on a change in pull request #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution URL: https://github.com/apache/spark/pull/25456#discussion_r314765055 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/Adapti

[GitHub] [spark] cloud-fan commented on a change in pull request #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution

2019-08-16 Thread GitBox
cloud-fan commented on a change in pull request #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution URL: https://github.com/apache/spark/pull/25456#discussion_r314763473 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/Adapti

[GitHub] [spark] cloud-fan commented on a change in pull request #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution

2019-08-16 Thread GitBox
cloud-fan commented on a change in pull request #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution URL: https://github.com/apache/spark/pull/25456#discussion_r314763473 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/Adapti

[GitHub] [spark] cloud-fan commented on a change in pull request #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution

2019-08-16 Thread GitBox
cloud-fan commented on a change in pull request #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution URL: https://github.com/apache/spark/pull/25456#discussion_r314762909 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/Adapti

[GitHub] [spark] cloud-fan commented on a change in pull request #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution

2019-08-16 Thread GitBox
cloud-fan commented on a change in pull request #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution URL: https://github.com/apache/spark/pull/25456#discussion_r314761861 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/Adapti

[GitHub] [spark] dongjinleekr commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-08-16 Thread GitBox
dongjinleekr commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-522042226 @zsxwing @srowen Rebased onto the latest master. Could you have a look? It seems like almost done. --

[GitHub] [spark] peter-toth commented on issue #25479: [SPARK-28356][FOLLOWUP] fix case with different pre-shuffle partition numbers

2019-08-16 Thread GitBox
peter-toth commented on issue #25479: [SPARK-28356][FOLLOWUP] fix case with different pre-shuffle partition numbers URL: https://github.com/apache/spark/pull/25479#issuecomment-522040585 I opened this PR to fix https://github.com/apache/spark/pull/25121#discussion_r313447177 cc @clo

[GitHub] [spark] wangyum commented on a change in pull request #25458: [SPARK-27931][SQL] Accept 'on' and 'off' as input and trim input for the boolean data type.

2019-08-16 Thread GitBox
wangyum commented on a change in pull request #25458: [SPARK-27931][SQL] Accept 'on' and 'off' as input and trim input for the boolean data type. URL: https://github.com/apache/spark/pull/25458#discussion_r314759147 ## File path: sql/core/src/test/resources/sql-tests/inputs/pgSQL/bo

[GitHub] [spark] peter-toth commented on a change in pull request #25121: [SPARK-28356][SQL] Do not reduce the number of partitions for repartition in adaptive execution

2019-08-16 Thread GitBox
peter-toth commented on a change in pull request #25121: [SPARK-28356][SQL] Do not reduce the number of partitions for repartition in adaptive execution URL: https://github.com/apache/spark/pull/25121#discussion_r314757666 ## File path: sql/core/src/main/scala/org/apache/spark/sql/

[GitHub] [spark] peter-toth opened a new pull request #25479: [SPARK-28356][FOLLOWUP] fix case with different pre-shuffle partition numbers

2019-08-16 Thread GitBox
peter-toth opened a new pull request #25479: [SPARK-28356][FOLLOWUP] fix case with different pre-shuffle partition numbers URL: https://github.com/apache/spark/pull/25479 ### What changes were proposed in this pull request? Small fix to `ReduceNumShufflePartitions` when there

[GitHub] [spark] gaborgsomogyi removed a comment on issue #25477: [WIP][SPARK-28760][SS][TESTS][test-maven] Add Kafka delegation token end-to-end test with mini KDC

2019-08-16 Thread GitBox
gaborgsomogyi removed a comment on issue #25477: [WIP][SPARK-28760][SS][TESTS][test-maven] Add Kafka delegation token end-to-end test with mini KDC URL: https://github.com/apache/spark/pull/25477#issuecomment-522005515 Let's see if the problem appears with maven as well. -

[GitHub] [spark] cloud-fan closed pull request #25473: [SPARK-28757][SQL] File table location should include both values of option `path` and `paths`

2019-08-16 Thread GitBox
cloud-fan closed pull request #25473: [SPARK-28757][SQL] File table location should include both values of option `path` and `paths` URL: https://github.com/apache/spark/pull/25473 This is an automated message from the A

[GitHub] [spark] cloud-fan commented on issue #25473: [SPARK-28757][SQL] File table location should include both values of option `path` and `paths`

2019-08-16 Thread GitBox
cloud-fan commented on issue #25473: [SPARK-28757][SQL] File table location should include both values of option `path` and `paths` URL: https://github.com/apache/spark/pull/25473#issuecomment-522028666 thanks, merging to master! ---

[GitHub] [spark] cloud-fan commented on a change in pull request #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-16 Thread GitBox
cloud-fan commented on a change in pull request #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#discussion_r314743668 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressi

[GitHub] [spark] cloud-fan commented on a change in pull request #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-16 Thread GitBox
cloud-fan commented on a change in pull request #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#discussion_r314743016 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/types/numerics.sc

[GitHub] [spark] cloud-fan commented on a change in pull request #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-16 Thread GitBox
cloud-fan commented on a change in pull request #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#discussion_r314741545 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressi

[GitHub] [spark] cloud-fan commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-16 Thread GitBox
cloud-fan commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r314730854 ## File path: sql/core/src/test/scala/org/apache/spark/sql/StatisticsColl

[GitHub] [spark] maropu commented on issue #25394: [SPARK-28671][SQL] Throw NoSuchPermanentFunctionException for a non-exsistent permanent function in dropFunction/alterFunction

2019-08-16 Thread GitBox
maropu commented on issue #25394: [SPARK-28671][SQL] Throw NoSuchPermanentFunctionException for a non-exsistent permanent function in dropFunction/alterFunction URL: https://github.com/apache/spark/pull/25394#issuecomment-522017433 @PavithraRamachandran Thanks for your contribution! I adde

[GitHub] [spark] maropu commented on issue #25394: [SPARK-28671][SQL] Throw NoSuchPermanentFunctionException for a non-exsistent permanent function in dropFunction/alterFunction

2019-08-16 Thread GitBox
maropu commented on issue #25394: [SPARK-28671][SQL] Throw NoSuchPermanentFunctionException for a non-exsistent permanent function in dropFunction/alterFunction URL: https://github.com/apache/spark/pull/25394#issuecomment-522014509 Thanks! Merged to master

[GitHub] [spark] maropu closed pull request #25394: [SPARK-28671][SQL] Throw NoSuchPermanentFunctionException for a non-exsistent permanent function in dropFunction/alterFunction

2019-08-16 Thread GitBox
maropu closed pull request #25394: [SPARK-28671][SQL] Throw NoSuchPermanentFunctionException for a non-exsistent permanent function in dropFunction/alterFunction URL: https://github.com/apache/spark/pull/25394 This is an au

[GitHub] [spark] peter-toth commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query

2019-08-16 Thread GitBox
peter-toth commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#issuecomment-522013725 retest this please This is an automated message from the Apache Git S

[GitHub] [spark] maropu commented on a change in pull request #25427: [SPARK-28705][SQL][TEST] Drop tables after being used in AnalysisExternalCatalogSuite

2019-08-16 Thread GitBox
maropu commented on a change in pull request #25427: [SPARK-28705][SQL][TEST] Drop tables after being used in AnalysisExternalCatalogSuite URL: https://github.com/apache/spark/pull/25427#discussion_r314725578 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/a

[GitHub] [spark] gaborgsomogyi commented on issue #25477: [WIP][SPARK-28760][SS][TESTS][test-maven] Add Kafka delegation token end-to-end test with mini KDC

2019-08-16 Thread GitBox
gaborgsomogyi commented on issue #25477: [WIP][SPARK-28760][SS][TESTS][test-maven] Add Kafka delegation token end-to-end test with mini KDC URL: https://github.com/apache/spark/pull/25477#issuecomment-522012374 retest this please ---

[GitHub] [spark] gaborgsomogyi removed a comment on issue #25477: [WIP][SPARK-28760][SS][TESTS][test-maven] Add Kafka delegation token end-to-end test with mini KDC

2019-08-16 Thread GitBox
gaborgsomogyi removed a comment on issue #25477: [WIP][SPARK-28760][SS][TESTS][test-maven] Add Kafka delegation token end-to-end test with mini KDC URL: https://github.com/apache/spark/pull/25477#issuecomment-522005385 retest this please ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-16 Thread GitBox
AmplabJenkins removed a comment on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-522008165 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] AmplabJenkins removed a comment on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-16 Thread GitBox
AmplabJenkins removed a comment on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-522008163 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-16 Thread GitBox
AmplabJenkins commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-522008165 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] AmplabJenkins commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-16 Thread GitBox
AmplabJenkins commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-522008163 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-16 Thread GitBox
SparkQA commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-522007625 **[Test build #109208 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilde

[GitHub] [spark] SparkQA removed a comment on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-16 Thread GitBox
SparkQA removed a comment on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-521944351 **[Test build #109208 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReques

[GitHub] [spark] younggyuchun commented on issue #25458: [SPARK-27931][SQL] Accept 'on' and 'off' as input and trim input for the boolean data type.

2019-08-16 Thread GitBox
younggyuchun commented on issue #25458: [SPARK-27931][SQL] Accept 'on' and 'off' as input and trim input for the boolean data type. URL: https://github.com/apache/spark/pull/25458#issuecomment-522006950 retest this please Thi

[GitHub] [spark] younggyuchun commented on a change in pull request #25458: [SPARK-27931][SQL] Accept 'on' and 'off' as input and trim input for the boolean data type.

2019-08-16 Thread GitBox
younggyuchun commented on a change in pull request #25458: [SPARK-27931][SQL] Accept 'on' and 'off' as input and trim input for the boolean data type. URL: https://github.com/apache/spark/pull/25458#discussion_r314716565 ## File path: sql/core/src/test/resources/sql-tests/inputs/pgS

[GitHub] [spark] srowen commented on issue #22570: [SPARK-25553][BUILD] Add EmptyInterpolatedStringChecker to scalastyle config

2019-08-16 Thread GitBox
srowen commented on issue #22570: [SPARK-25553][BUILD] Add EmptyInterpolatedStringChecker to scalastyle config URL: https://github.com/apache/spark/pull/22570#issuecomment-522006541 Whew, that's a lot of files! I'm hesitant to do this. I checked if the standard interpolator special-cases a

[GitHub] [spark] gaborgsomogyi commented on issue #25477: [WIP][SPARK-28760][SS][TESTS][test-maven] Add Kafka delegation token end-to-end test with mini KDC

2019-08-16 Thread GitBox
gaborgsomogyi commented on issue #25477: [WIP][SPARK-28760][SS][TESTS][test-maven] Add Kafka delegation token end-to-end test with mini KDC URL: https://github.com/apache/spark/pull/25477#issuecomment-522005515 Let's see if the problem appears with maven as well. -

[GitHub] [spark] gaborgsomogyi commented on issue #25477: [WIP][SPARK-28760][SS][TESTS][test-maven] Add Kafka delegation token end-to-end test with mini KDC

2019-08-16 Thread GitBox
gaborgsomogyi commented on issue #25477: [WIP][SPARK-28760][SS][TESTS][test-maven] Add Kafka delegation token end-to-end test with mini KDC URL: https://github.com/apache/spark/pull/25477#issuecomment-522005385 retest this please ---

[GitHub] [spark] gaborgsomogyi commented on issue #25477: [WIP][SPARK-28760][SS][TESTS] Add Kafka delegation token end-to-end test with mini KDC

2019-08-16 Thread GitBox
gaborgsomogyi commented on issue #25477: [WIP][SPARK-28760][SS][TESTS] Add Kafka delegation token end-to-end test with mini KDC URL: https://github.com/apache/spark/pull/25477#issuecomment-522001170 Other than that some unexpected dependency problem popped up: ``` org.apache.directory

[GitHub] [spark] attilapiros commented on issue #25299: [SPARK-27651][Core] Avoid the network when shuffle blocks are fetched from the same host

2019-08-16 Thread GitBox
attilapiros commented on issue #25299: [SPARK-27651][Core] Avoid the network when shuffle blocks are fetched from the same host URL: https://github.com/apache/spark/pull/25299#issuecomment-521998645 retest this please. ---

[GitHub] [spark] peter-toth commented on a change in pull request #23531: [SPARK-24497][SQL] Support recursive SQL query

2019-08-16 Thread GitBox
peter-toth commented on a change in pull request #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#discussion_r314704922 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ##

[GitHub] [spark] HyukjinKwon commented on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins

2019-08-16 Thread GitBox
HyukjinKwon commented on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins URL: https://github.com/apache/spark/pull/25443#issuecomment-521996846 After https://github.com/apache/spark/pull/25472, https://github.com/apache/spark/

[GitHub] [spark] peter-toth commented on a change in pull request #23531: [SPARK-24497][SQL] Support recursive SQL query

2019-08-16 Thread GitBox
peter-toth commented on a change in pull request #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#discussion_r314704495 ## File path: sql/core/src/test/resources/sql-tests/results/cte.sql.out ## @@ -328,16 +328,891 @@ s

[GitHub] [spark] peter-toth commented on a change in pull request #23531: [SPARK-24497][SQL] Support recursive SQL query

2019-08-16 Thread GitBox
peter-toth commented on a change in pull request #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#discussion_r314704761 ## File path: sql/core/src/test/resources/sql-tests/results/cte.sql.out ## @@ -328,16 +328,891 @@ s

[GitHub] [spark] peter-toth commented on a change in pull request #23531: [SPARK-24497][SQL] Support recursive SQL query

2019-08-16 Thread GitBox
peter-toth commented on a change in pull request #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#discussion_r314704140 ## File path: sql/core/src/test/resources/sql-tests/results/cte.sql.out ## @@ -328,16 +328,891 @@ s

[GitHub] [spark] peter-toth commented on a change in pull request #23531: [SPARK-24497][SQL] Support recursive SQL query

2019-08-16 Thread GitBox
peter-toth commented on a change in pull request #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#discussion_r314704294 ## File path: sql/core/src/test/resources/sql-tests/results/cte.sql.out ## @@ -328,16 +328,891 @@ s

[GitHub] [spark] HyukjinKwon commented on issue #25478: [SPARK-28755][R][TESTS] Increase tolerance in 'spark.mlp' SparkR test for JDK 11

2019-08-16 Thread GitBox
HyukjinKwon commented on issue #25478: [SPARK-28755][R][TESTS] Increase tolerance in 'spark.mlp' SparkR test for JDK 11 URL: https://github.com/apache/spark/pull/25478#issuecomment-521996496 @felixcheung and @shivaram, we're actually a bit rushing to let Hive 2.3.6 (with JDK 11 fix) releas

[GitHub] [spark] peter-toth commented on a change in pull request #23531: [SPARK-24497][SQL] Support recursive SQL query

2019-08-16 Thread GitBox
peter-toth commented on a change in pull request #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#discussion_r314704239 ## File path: sql/core/src/test/resources/sql-tests/results/cte.sql.out ## @@ -328,16 +328,891 @@ s

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer

2019-08-16 Thread GitBox
gaborgsomogyi commented on a change in pull request #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer URL: https://github.com/apache/spark/pull/22138#discussion_r314703946 ## File path: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/Kafk

[GitHub] [spark] peter-toth commented on a change in pull request #23531: [SPARK-24497][SQL] Support recursive SQL query

2019-08-16 Thread GitBox
peter-toth commented on a change in pull request #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#discussion_r314703486 ## File path: sql/core/src/test/resources/sql-tests/inputs/cte.sql ## @@ -155,6 +155,419 @@ SELECT

[GitHub] [spark] peter-toth commented on a change in pull request #23531: [SPARK-24497][SQL] Support recursive SQL query

2019-08-16 Thread GitBox
peter-toth commented on a change in pull request #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#discussion_r314703339 ## File path: sql/core/src/test/resources/sql-tests/results/cte.sql.out ## @@ -1,5 +1,5 @@ -- Auto

[GitHub] [spark] HyukjinKwon opened a new pull request #25478: [SPARK-28755][R][TESTS] Increase tolerance in 'spark.mlp' SparkR test for JDK 11

2019-08-16 Thread GitBox
HyukjinKwon opened a new pull request #25478: [SPARK-28755][R][TESTS] Increase tolerance in 'spark.mlp' SparkR test for JDK 11 URL: https://github.com/apache/spark/pull/25478 ### What changes were proposed in this pull request? This PR proposes to increase the tolerance f

[GitHub] [spark] gengliangwang commented on a change in pull request #25473: [SPARK-28757][SQL] File table location should include both values of option `path` and `paths`

2019-08-16 Thread GitBox
gengliangwang commented on a change in pull request #25473: [SPARK-28757][SQL] File table location should include both values of option `path` and `paths` URL: https://github.com/apache/spark/pull/25473#discussion_r314702943 ## File path: sql/core/src/main/scala/org/apache/s

[GitHub] [spark] gengliangwang commented on a change in pull request #25473: [SPARK-28757][SQL] File table location should include both values of option `path` and `paths`

2019-08-16 Thread GitBox
gengliangwang commented on a change in pull request #25473: [SPARK-28757][SQL] File table location should include both values of option `path` and `paths` URL: https://github.com/apache/spark/pull/25473#discussion_r314702943 ## File path: sql/core/src/main/scala/org/apache/s

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer

2019-08-16 Thread GitBox
gaborgsomogyi commented on a change in pull request #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer URL: https://github.com/apache/spark/pull/22138#discussion_r314701313 ## File path: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/Kafk

[GitHub] [spark] hvanhovell commented on a change in pull request #25473: [SPARK-28757][SQL] File table location should include both values of option `path` and `paths`

2019-08-16 Thread GitBox
hvanhovell commented on a change in pull request #25473: [SPARK-28757][SQL] File table location should include both values of option `path` and `paths` URL: https://github.com/apache/spark/pull/25473#discussion_r314700747 ## File path: sql/core/src/main/scala/org/apache/spark/sql/

[GitHub] [spark] AmplabJenkins removed a comment on issue #25394: [SPARK-28671][SQL] Throw NoSuchPermanentFunctionException for a non-exsistent permanent function in dropFunction

2019-08-16 Thread GitBox
AmplabJenkins removed a comment on issue #25394: [SPARK-28671][SQL] Throw NoSuchPermanentFunctionException for a non-exsistent permanent function in dropFunction URL: https://github.com/apache/spark/pull/25394#issuecomment-521993198 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25394: [SPARK-28671][SQL] Throw NoSuchPermanentFunctionException for a non-exsistent permanent function in dropFunction

2019-08-16 Thread GitBox
AmplabJenkins removed a comment on issue #25394: [SPARK-28671][SQL] Throw NoSuchPermanentFunctionException for a non-exsistent permanent function in dropFunction URL: https://github.com/apache/spark/pull/25394#issuecomment-521993204 Test PASSed. Refer to this link for build results (acc

[GitHub] [spark] AmplabJenkins commented on issue #25394: [SPARK-28671][SQL] Throw NoSuchPermanentFunctionException for a non-exsistent permanent function in dropFunction

2019-08-16 Thread GitBox
AmplabJenkins commented on issue #25394: [SPARK-28671][SQL] Throw NoSuchPermanentFunctionException for a non-exsistent permanent function in dropFunction URL: https://github.com/apache/spark/pull/25394#issuecomment-521993198 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25477: [SPARK-28760][SS][TESTS] Add Kafka delegation token end-to-end test with mini KDC

2019-08-16 Thread GitBox
AmplabJenkins removed a comment on issue #25477: [SPARK-28760][SS][TESTS] Add Kafka delegation token end-to-end test with mini KDC URL: https://github.com/apache/spark/pull/25477#issuecomment-521992509 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25394: [SPARK-28671][SQL] Throw NoSuchPermanentFunctionException for a non-exsistent permanent function in dropFunction

2019-08-16 Thread GitBox
AmplabJenkins commented on issue #25394: [SPARK-28671][SQL] Throw NoSuchPermanentFunctionException for a non-exsistent permanent function in dropFunction URL: https://github.com/apache/spark/pull/25394#issuecomment-521993204 Test PASSed. Refer to this link for build results (access righ

[GitHub] [spark] SparkQA removed a comment on issue #25394: [SPARK-28671][SQL] Throw NoSuchPermanentFunctionException for a non-exsistent permanent function in dropFunction

2019-08-16 Thread GitBox
SparkQA removed a comment on issue #25394: [SPARK-28671][SQL] Throw NoSuchPermanentFunctionException for a non-exsistent permanent function in dropFunction URL: https://github.com/apache/spark/pull/25394#issuecomment-521926632 **[Test build #109204 has started](https://amplab.cs.berkeley.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25477: [SPARK-28760][SS][TESTS] Add Kafka delegation token end-to-end test with mini KDC

2019-08-16 Thread GitBox
AmplabJenkins removed a comment on issue #25477: [SPARK-28760][SS][TESTS] Add Kafka delegation token end-to-end test with mini KDC URL: https://github.com/apache/spark/pull/25477#issuecomment-521992503 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #25394: [SPARK-28671][SQL] Throw NoSuchPermanentFunctionException for a non-exsistent permanent function in dropFunction

2019-08-16 Thread GitBox
SparkQA commented on issue #25394: [SPARK-28671][SQL] Throw NoSuchPermanentFunctionException for a non-exsistent permanent function in dropFunction URL: https://github.com/apache/spark/pull/25394#issuecomment-521992734 **[Test build #109204 has finished](https://amplab.cs.berkeley.edu/jen

[GitHub] [spark] maropu commented on issue #22570: [SPARK-25553][BUILD] Add EmptyInterpolatedStringChecker to scalastyle config

2019-08-16 Thread GitBox
maropu commented on issue #22570: [SPARK-25553][BUILD] Add EmptyInterpolatedStringChecker to scalastyle config URL: https://github.com/apache/spark/pull/22570#issuecomment-521992646 retest this please This is an automated mes

[GitHub] [spark] wangyum commented on a change in pull request #24829: [SPARK-27988][SQL][TEST] Port AGGREGATES.sql [Part 3]

2019-08-16 Thread GitBox
wangyum commented on a change in pull request #24829: [SPARK-27988][SQL][TEST] Port AGGREGATES.sql [Part 3] URL: https://github.com/apache/spark/pull/24829#discussion_r314699552 ## File path: sql/core/src/test/resources/sql-tests/inputs/pgSQL/aggregates_part3.sql ## @@ -0

[GitHub] [spark] AmplabJenkins commented on issue #25477: [SPARK-28760][SS][TESTS] Add Kafka delegation token end-to-end test with mini KDC

2019-08-16 Thread GitBox
AmplabJenkins commented on issue #25477: [SPARK-28760][SS][TESTS] Add Kafka delegation token end-to-end test with mini KDC URL: https://github.com/apache/spark/pull/25477#issuecomment-521992509 Test FAILed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] [spark] AmplabJenkins commented on issue #25477: [SPARK-28760][SS][TESTS] Add Kafka delegation token end-to-end test with mini KDC

2019-08-16 Thread GitBox
AmplabJenkins commented on issue #25477: [SPARK-28760][SS][TESTS] Add Kafka delegation token end-to-end test with mini KDC URL: https://github.com/apache/spark/pull/25477#issuecomment-521992503 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #25477: [SPARK-28760][SS][TESTS] Add Kafka delegation token end-to-end test with mini KDC

2019-08-16 Thread GitBox
SparkQA removed a comment on issue #25477: [SPARK-28760][SS][TESTS] Add Kafka delegation token end-to-end test with mini KDC URL: https://github.com/apache/spark/pull/25477#issuecomment-521966524 **[Test build #109213 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequest

[GitHub] [spark] AmplabJenkins removed a comment on issue #25477: [SPARK-28760][SS][TESTS] Add Kafka delegation token end-to-end test with mini KDC

2019-08-16 Thread GitBox
AmplabJenkins removed a comment on issue #25477: [SPARK-28760][SS][TESTS] Add Kafka delegation token end-to-end test with mini KDC URL: https://github.com/apache/spark/pull/25477#issuecomment-521967717 Can one of the admins verify this patch? ---

[GitHub] [spark] SparkQA commented on issue #25477: [SPARK-28760][SS][TESTS] Add Kafka delegation token end-to-end test with mini KDC

2019-08-16 Thread GitBox
SparkQA commented on issue #25477: [SPARK-28760][SS][TESTS] Add Kafka delegation token end-to-end test with mini KDC URL: https://github.com/apache/spark/pull/25477#issuecomment-521992302 **[Test build #109213 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder

[GitHub] [spark] wangyum commented on a change in pull request #24829: [SPARK-27988][SQL][TEST] Port AGGREGATES.sql [Part 3]

2019-08-16 Thread GitBox
wangyum commented on a change in pull request #24829: [SPARK-27988][SQL][TEST] Port AGGREGATES.sql [Part 3] URL: https://github.com/apache/spark/pull/24829#discussion_r314699317 ## File path: sql/core/src/test/resources/sql-tests/inputs/pgSQL/aggregates_part3.sql ## @@ -0

[GitHub] [spark] wangyum commented on a change in pull request #24829: [SPARK-27988][SQL][TEST] Port AGGREGATES.sql [Part 3]

2019-08-16 Thread GitBox
wangyum commented on a change in pull request #24829: [SPARK-27988][SQL][TEST] Port AGGREGATES.sql [Part 3] URL: https://github.com/apache/spark/pull/24829#discussion_r314699268 ## File path: sql/core/src/test/resources/sql-tests/inputs/pgSQL/aggregates_part3.sql ## @@ -0

[GitHub] [spark] AmplabJenkins removed a comment on issue #25473: [SPARK-28757][SQL] File table location should include both values of option `path` and `paths`

2019-08-16 Thread GitBox
AmplabJenkins removed a comment on issue #25473: [SPARK-28757][SQL] File table location should include both values of option `path` and `paths` URL: https://github.com/apache/spark/pull/25473#issuecomment-521991871 Test PASSed. Refer to this link for build results (access rights to CI s

[GitHub] [spark] SparkQA removed a comment on issue #25473: [SPARK-28757][SQL] File table location should include both values of option `path` and `paths`

2019-08-16 Thread GitBox
SparkQA removed a comment on issue #25473: [SPARK-28757][SQL] File table location should include both values of option `path` and `paths` URL: https://github.com/apache/spark/pull/25473#issuecomment-521933062 **[Test build #109206 has started](https://amplab.cs.berkeley.edu/jenkins/

[GitHub] [spark] AmplabJenkins removed a comment on issue #25473: [SPARK-28757][SQL] File table location should include both values of option `path` and `paths`

2019-08-16 Thread GitBox
AmplabJenkins removed a comment on issue #25473: [SPARK-28757][SQL] File table location should include both values of option `path` and `paths` URL: https://github.com/apache/spark/pull/25473#issuecomment-521991865 Merged build finished. Test PASSed. --

[GitHub] [spark] wangyum commented on a change in pull request #24829: [SPARK-27988][SQL][TEST] Port AGGREGATES.sql [Part 3]

2019-08-16 Thread GitBox
wangyum commented on a change in pull request #24829: [SPARK-27988][SQL][TEST] Port AGGREGATES.sql [Part 3] URL: https://github.com/apache/spark/pull/24829#discussion_r314698704 ## File path: sql/core/src/test/resources/sql-tests/inputs/pgSQL/aggregates_part3.sql ## @@ -0

[GitHub] [spark] AmplabJenkins commented on issue #25473: [SPARK-28757][SQL] File table location should include both values of option `path` and `paths`

2019-08-16 Thread GitBox
AmplabJenkins commented on issue #25473: [SPARK-28757][SQL] File table location should include both values of option `path` and `paths` URL: https://github.com/apache/spark/pull/25473#issuecomment-521991865 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #25473: [SPARK-28757][SQL] File table location should include both values of option `path` and `paths`

2019-08-16 Thread GitBox
AmplabJenkins commented on issue #25473: [SPARK-28757][SQL] File table location should include both values of option `path` and `paths` URL: https://github.com/apache/spark/pull/25473#issuecomment-521991871 Test PASSed. Refer to this link for build results (access rights to CI server ne

[GitHub] [spark] SparkQA commented on issue #25473: [SPARK-28757][SQL] File table location should include both values of option `path` and `paths`

2019-08-16 Thread GitBox
SparkQA commented on issue #25473: [SPARK-28757][SQL] File table location should include both values of option `path` and `paths` URL: https://github.com/apache/spark/pull/25473#issuecomment-521991464 **[Test build #109206 has finished](https://amplab.cs.berkeley.edu/jenkins/job/Spa

[GitHub] [spark] wangyum commented on a change in pull request #24829: [SPARK-27988][SQL][TEST] Port AGGREGATES.sql [Part 3]

2019-08-16 Thread GitBox
wangyum commented on a change in pull request #24829: [SPARK-27988][SQL][TEST] Port AGGREGATES.sql [Part 3] URL: https://github.com/apache/spark/pull/24829#discussion_r314698141 ## File path: sql/core/src/test/resources/sql-tests/inputs/pgSQL/aggregates_part3.sql ## @@ -0

[GitHub] [spark] gaborgsomogyi commented on issue #25477: [SPARK-28760][SS][TESTS] Add Kafka delegation token end-to-end test with mini KDC

2019-08-16 Thread GitBox
gaborgsomogyi commented on issue #25477: [SPARK-28760][SS][TESTS] Add Kafka delegation token end-to-end test with mini KDC URL: https://github.com/apache/spark/pull/25477#issuecomment-521991336 The issue seems unrelated: ``` [info] *** 1 SUITE ABORTED *** [error] Error: Total 2545,

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #25412: [SPARK-28691][EXAMPLES] Add Java/Scala DirectKerberizedKafkaWordCount examples

2019-08-16 Thread GitBox
gaborgsomogyi commented on a change in pull request #25412: [SPARK-28691][EXAMPLES] Add Java/Scala DirectKerberizedKafkaWordCount examples URL: https://github.com/apache/spark/pull/25412#discussion_r314693286 ## File path: examples/src/main/java/org/apache/spark/examples/streaming/

<    3   4   5   6   7   8   9   10   11   12   >