[GitHub] [spark] HeartSaVioR edited a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-08-22 Thread GitBox
HeartSaVioR edited a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-523827720 The fix wouldn't work since KafkaOffsetReader will be shared across tasks in same JVM (since it's a

[GitHub] [spark] AmplabJenkins commented on issue #25552: [SPARK-28849][CORE] Add a number to control transferTo calls to avoid infinite loop in some occasional cases

2019-08-22 Thread GitBox
AmplabJenkins commented on issue #25552: [SPARK-28849][CORE] Add a number to control transferTo calls to avoid infinite loop in some occasional cases URL: https://github.com/apache/spark/pull/25552#issuecomment-523829565 Merged build finished. Test PASSed.

[GitHub] [spark] HeartSaVioR edited a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-08-22 Thread GitBox
HeartSaVioR edited a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-523827720 The fix wouldn't work since KafkaOffsetReader will be shared across tasks (since it's a singleton

[GitHub] [spark] jerryshao opened a new pull request #25552: [SPARK-28849][CORE] Add number of transferTo calls to avoid infinite loop in some occasional cases

2019-08-22 Thread GitBox
jerryshao opened a new pull request #25552: [SPARK-28849][CORE] Add number of transferTo calls to avoid infinite loop in some occasional cases URL: https://github.com/apache/spark/pull/25552 This patch propose a way to detect the infinite loop issue in `transferTo` and make it fail fast.

[GitHub] [spark] cloud-fan commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-08-22 Thread GitBox
cloud-fan commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-523828834 LGTM except for several minor comments, thanks for working on it!

[GitHub] [spark] HeartSaVioR edited a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-08-22 Thread GitBox
HeartSaVioR edited a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-523827720 The fix wouldn't work since KafkaOffsetReader will be shared across tasks (since it's a singleton

[GitHub] [spark] HeartSaVioR commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-08-22 Thread GitBox
HeartSaVioR commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-523827720 The fix wouldn't work since KafkaOffsetReader will be shared across tasks (since it's a singleton `object`)

[GitHub] [spark] cloud-fan commented on a change in pull request #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-08-22 Thread GitBox
cloud-fan commented on a change in pull request #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#discussion_r316580880 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-08-22 Thread GitBox
cloud-fan commented on a change in pull request #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#discussion_r316580937 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-08-22 Thread GitBox
cloud-fan commented on a change in pull request #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#discussion_r316579615 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-08-22 Thread GitBox
cloud-fan commented on a change in pull request #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#discussion_r316578880 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #25550: [SPARK-28847][TEST] Annotate HiveExternalCatalogVersionsSuite with ExtendedHiveTest

2019-08-22 Thread GitBox
AmplabJenkins commented on issue #25550: [SPARK-28847][TEST] Annotate HiveExternalCatalogVersionsSuite with ExtendedHiveTest URL: https://github.com/apache/spark/pull/25550#issuecomment-523821914 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25550: [SPARK-28847][TEST] Annotate HiveExternalCatalogVersionsSuite with ExtendedHiveTest

2019-08-22 Thread GitBox
AmplabJenkins commented on issue #25550: [SPARK-28847][TEST] Annotate HiveExternalCatalogVersionsSuite with ExtendedHiveTest URL: https://github.com/apache/spark/pull/25550#issuecomment-523821900 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25550: [SPARK-28847][TEST] Annotate HiveExternalCatalogVersionsSuite with ExtendedHiveTest

2019-08-22 Thread GitBox
SparkQA commented on issue #25550: [SPARK-28847][TEST] Annotate HiveExternalCatalogVersionsSuite with ExtendedHiveTest URL: https://github.com/apache/spark/pull/25550#issuecomment-523821356 **[Test build #109561 has

[GitHub] [spark] wangyum commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-22 Thread GitBox
wangyum commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r316570564 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

2019-08-22 Thread GitBox
AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-523815620 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

2019-08-22 Thread GitBox
AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-523815633 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25551: [SPARK-28839][CORE] Avoids NPE in context cleaner when shuffle service is on

2019-08-22 Thread GitBox
HyukjinKwon commented on a change in pull request #25551: [SPARK-28839][CORE] Avoids NPE in context cleaner when shuffle service is on URL: https://github.com/apache/spark/pull/25551#discussion_r316568998 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

2019-08-22 Thread GitBox
cloud-fan commented on a change in pull request #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#discussion_r316568505 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala

[GitHub] [spark] sekikn commented on issue #24651: [SPARK-27420][DSTREAMS][Kinesis] KinesisInputDStream should expose a way to configure CloudWatch metrics

2019-08-22 Thread GitBox
sekikn commented on issue #24651: [SPARK-27420][DSTREAMS][Kinesis] KinesisInputDStream should expose a way to configure CloudWatch metrics URL: https://github.com/apache/spark/pull/24651#issuecomment-523816081 Hmm, I'm not sure why the CI failed on PySpark, because it succeeds with the

[GitHub] [spark] SparkQA commented on issue #25551: [SPARK-28839][CORE] Avoids NPE in context cleaner when shuffle service is on

2019-08-22 Thread GitBox
SparkQA commented on issue #25551: [SPARK-28839][CORE] Avoids NPE in context cleaner when shuffle service is on URL: https://github.com/apache/spark/pull/25551#issuecomment-523816385 **[Test build #109568 has

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25551: [SPARK-28839][CORE] Avoids NPE in context cleaner when shuffle service is on

2019-08-22 Thread GitBox
dongjoon-hyun commented on a change in pull request #25551: [SPARK-28839][CORE] Avoids NPE in context cleaner when shuffle service is on URL: https://github.com/apache/spark/pull/25551#discussion_r316568410 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #25551: [SPARK-28839][CORE] Avoids NPE in context cleaner when shuffle service is on

2019-08-22 Thread GitBox
AmplabJenkins commented on issue #25551: [SPARK-28839][CORE] Avoids NPE in context cleaner when shuffle service is on URL: https://github.com/apache/spark/pull/25551#issuecomment-523815578 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25551: [SPARK-28839][CORE] Avoids NPE in context cleaner when shuffle service is on

2019-08-22 Thread GitBox
AmplabJenkins commented on issue #25551: [SPARK-28839][CORE] Avoids NPE in context cleaner when shuffle service is on URL: https://github.com/apache/spark/pull/25551#issuecomment-523815569 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

2019-08-22 Thread GitBox
SparkQA commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-523813378 **[Test build #109567 has

[GitHub] [spark] HyukjinKwon opened a new pull request #25551: [SPARK-28839][CORE] Avoids NPE in context cleaner when shuffle service is on

2019-08-22 Thread GitBox
HyukjinKwon opened a new pull request #25551: [SPARK-28839][CORE] Avoids NPE in context cleaner when shuffle service is on URL: https://github.com/apache/spark/pull/25551 ### What changes were proposed in this pull request? This PR proposes to avoid to thrown NPE at context cleaner

[GitHub] [spark] HyukjinKwon commented on issue #25551: [SPARK-28839][CORE] Avoids NPE in context cleaner when shuffle service is on

2019-08-22 Thread GitBox
HyukjinKwon commented on issue #25551: [SPARK-28839][CORE] Avoids NPE in context cleaner when shuffle service is on URL: https://github.com/apache/spark/pull/25551#issuecomment-523813395 @vanzin do you mind if I ask to take a look and see if it makes sense?

[GitHub] [spark] SparkQA commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

2019-08-22 Thread GitBox
SparkQA commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#issuecomment-523807621 **[Test build #109566 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

2019-08-22 Thread GitBox
AmplabJenkins removed a comment on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#issuecomment-523806996 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25347: [SPARK-28610][SQL] Allow having a decimal buffer for long sum

2019-08-22 Thread GitBox
AmplabJenkins removed a comment on issue #25347: [SPARK-28610][SQL] Allow having a decimal buffer for long sum URL: https://github.com/apache/spark/pull/25347#issuecomment-523806968 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25347: [SPARK-28610][SQL] Allow having a decimal buffer for long sum

2019-08-22 Thread GitBox
AmplabJenkins removed a comment on issue #25347: [SPARK-28610][SQL] Allow having a decimal buffer for long sum URL: https://github.com/apache/spark/pull/25347#issuecomment-523806959 Build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

2019-08-22 Thread GitBox
AmplabJenkins removed a comment on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#issuecomment-523806985 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25347: [SPARK-28610][SQL] Allow having a decimal buffer for long sum

2019-08-22 Thread GitBox
AmplabJenkins commented on issue #25347: [SPARK-28610][SQL] Allow having a decimal buffer for long sum URL: https://github.com/apache/spark/pull/25347#issuecomment-523806959 Build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

2019-08-22 Thread GitBox
AmplabJenkins commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#issuecomment-523806996 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25347: [SPARK-28610][SQL] Allow having a decimal buffer for long sum

2019-08-22 Thread GitBox
AmplabJenkins commented on issue #25347: [SPARK-28610][SQL] Allow having a decimal buffer for long sum URL: https://github.com/apache/spark/pull/25347#issuecomment-523806968 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

2019-08-22 Thread GitBox
AmplabJenkins commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#issuecomment-523806985 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25347: [SPARK-28610][SQL] Allow having a decimal buffer for long sum

2019-08-22 Thread GitBox
SparkQA commented on issue #25347: [SPARK-28610][SQL] Allow having a decimal buffer for long sum URL: https://github.com/apache/spark/pull/25347#issuecomment-523804876 **[Test build #109565 has

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-22 Thread GitBox
dongjoon-hyun commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r316554164 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-22 Thread GitBox
dongjoon-hyun commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r316553636 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-22 Thread GitBox
dongjoon-hyun commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r316552743 ## File path:

[GitHub] [spark] mgaido91 commented on issue #25347: [SPARK-28610][SQL] Allow having a decimal buffer for long sum

2019-08-22 Thread GitBox
mgaido91 commented on issue #25347: [SPARK-28610][SQL] Allow having a decimal buffer for long sum URL: https://github.com/apache/spark/pull/25347#issuecomment-523800999 > The change to support decimal sum buffer itself looks nice to me, but I think we'd like a coarser flag for that.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

2019-08-22 Thread GitBox
AmplabJenkins removed a comment on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#issuecomment-523798554 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

2019-08-22 Thread GitBox
AmplabJenkins removed a comment on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#issuecomment-523798546 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

2019-08-22 Thread GitBox
AmplabJenkins commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#issuecomment-523798554 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

2019-08-22 Thread GitBox
AmplabJenkins commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#issuecomment-523798546 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

2019-08-22 Thread GitBox
SparkQA commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#issuecomment-523796599 **[Test build #109564 has

[GitHub] [spark] wangyum commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-22 Thread GitBox
wangyum commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r316544252 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-08-22 Thread GitBox
AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-523794803 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-08-22 Thread GitBox
SparkQA removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-523783475 **[Test build #109563 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-08-22 Thread GitBox
AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-523794795 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-08-22 Thread GitBox
AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-523794803 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-08-22 Thread GitBox
AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-523794795 Merged build finished. Test FAILed. This

[GitHub] [spark] SparkQA commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-08-22 Thread GitBox
SparkQA commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-523794740 **[Test build #109563 has

[GitHub] [spark] shahidki31 commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-22 Thread GitBox
shahidki31 commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r316541037 ## File path:

[GitHub] [spark] shahidki31 commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-22 Thread GitBox
shahidki31 commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r316541037 ## File path:

[GitHub] [spark] shahidki31 commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-22 Thread GitBox
shahidki31 commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r316541037 ## File path:

[GitHub] [spark] echauchot commented on issue #23576: [SPARK-26655] [SS] Support multiple aggregates in append mode

2019-08-22 Thread GitBox
echauchot commented on issue #23576: [SPARK-26655] [SS] Support multiple aggregates in append mode URL: https://github.com/apache/spark/pull/23576#issuecomment-523793027 @arunmahadevan any updates on this feature or on the watermark design document ?

[GitHub] [spark] dongjoon-hyun closed pull request #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage

2019-08-22 Thread GitBox
dongjoon-hyun closed pull request #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage URL: https://github.com/apache/spark/pull/25509 This is an automated message from the Apache Git Service.

[GitHub] [spark] dongjoon-hyun closed pull request #25517: [SPARK-26895][CORE][2.3] prepareSubmitEnvironment should be called within doAs for proxy users

2019-08-22 Thread GitBox
dongjoon-hyun closed pull request #25517: [SPARK-26895][CORE][2.3] prepareSubmitEnvironment should be called within doAs for proxy users URL: https://github.com/apache/spark/pull/25517 This is an automated message from the

[GitHub] [spark] wangyum commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-22 Thread GitBox
wangyum commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r316534257 ## File path:

[GitHub] [spark] wangyum commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-22 Thread GitBox
wangyum commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r316534207 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25410: [SPARK-28690][SQL] Add `date_part` function for timestamps/dates

2019-08-22 Thread GitBox
AmplabJenkins removed a comment on issue #25410: [SPARK-28690][SQL] Add `date_part` function for timestamps/dates URL: https://github.com/apache/spark/pull/25410#issuecomment-523785332 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25410: [SPARK-28690][SQL] Add `date_part` function for timestamps/dates

2019-08-22 Thread GitBox
AmplabJenkins removed a comment on issue #25410: [SPARK-28690][SQL] Add `date_part` function for timestamps/dates URL: https://github.com/apache/spark/pull/25410#issuecomment-523785322 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25410: [SPARK-28690][SQL] Add `date_part` function for timestamps/dates

2019-08-22 Thread GitBox
AmplabJenkins commented on issue #25410: [SPARK-28690][SQL] Add `date_part` function for timestamps/dates URL: https://github.com/apache/spark/pull/25410#issuecomment-523785322 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25410: [SPARK-28690][SQL] Add `date_part` function for timestamps/dates

2019-08-22 Thread GitBox
AmplabJenkins commented on issue #25410: [SPARK-28690][SQL] Add `date_part` function for timestamps/dates URL: https://github.com/apache/spark/pull/25410#issuecomment-523785332 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjinleekr commented on a change in pull request #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-08-22 Thread GitBox
dongjinleekr commented on a change in pull request #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#discussion_r316531866 ## File path:

[GitHub] [spark] dongjoon-hyun closed pull request #25550: [SPARK-28847][TEST] Annotate HiveExternalCatalogVersionsSuite with ExtendedHiveTest

2019-08-22 Thread GitBox
dongjoon-hyun closed pull request #25550: [SPARK-28847][TEST] Annotate HiveExternalCatalogVersionsSuite with ExtendedHiveTest URL: https://github.com/apache/spark/pull/25550 This is an automated message from the Apache Git

[GitHub] [spark] dongjoon-hyun commented on issue #25550: [SPARK-28847][TEST] Annotate HiveExternalCatalogVersionsSuite with ExtendedHiveTest

2019-08-22 Thread GitBox
dongjoon-hyun commented on issue #25550: [SPARK-28847][TEST] Annotate HiveExternalCatalogVersionsSuite with ExtendedHiveTest URL: https://github.com/apache/spark/pull/25550#issuecomment-523784010 Thank you, @HyukjinKwon and @wangyum . This only affects

[GitHub] [spark] shahidki31 removed a comment on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-22 Thread GitBox
shahidki31 removed a comment on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-523773058 ``` scala> // enable fallBackToHdfs scala> spark.sql("set

[GitHub] [spark] wangyum commented on issue #25550: [SPARK-28847][TEST] Annotate HiveExternalCatalogVersionsSuite with ExtendedHiveTest

2019-08-22 Thread GitBox
wangyum commented on issue #25550: [SPARK-28847][TEST] Annotate HiveExternalCatalogVersionsSuite with ExtendedHiveTest URL: https://github.com/apache/spark/pull/25550#issuecomment-523779056 retest this please This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage

2019-08-22 Thread GitBox
AmplabJenkins removed a comment on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage URL: https://github.com/apache/spark/pull/25509#issuecomment-523778276 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun closed pull request #25538: [SPARK-28844][SQL] Fix typo in SQLConf FILE_COMRESSION_FACTOR

2019-08-22 Thread GitBox
dongjoon-hyun closed pull request #25538: [SPARK-28844][SQL] Fix typo in SQLConf FILE_COMRESSION_FACTOR URL: https://github.com/apache/spark/pull/25538 This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] AmplabJenkins removed a comment on issue #25538: [SPARK-28844][SQL] Fix typo in SQLConf FILE_COMRESSION_FACTOR

2019-08-22 Thread GitBox
AmplabJenkins removed a comment on issue #25538: [SPARK-28844][SQL] Fix typo in SQLConf FILE_COMRESSION_FACTOR URL: https://github.com/apache/spark/pull/25538#issuecomment-523778125 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

2019-08-22 Thread GitBox
SparkQA commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#issuecomment-523778594 **[Test build #109560 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25546: [SPARK-28780][ML][2.3] deprecate LinearSVCModel.setWeightCol

2019-08-22 Thread GitBox
AmplabJenkins removed a comment on issue #25546: [SPARK-28780][ML][2.3] deprecate LinearSVCModel.setWeightCol URL: https://github.com/apache/spark/pull/25546#issuecomment-523777987 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24759: [SPARK-27395][SQL] Improve EXPLAIN command

2019-08-22 Thread GitBox
AmplabJenkins removed a comment on issue #24759: [SPARK-27395][SQL] Improve EXPLAIN command URL: https://github.com/apache/spark/pull/24759#issuecomment-523778070 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25550: [SPARK-28847][TEST] Annotate HiveExternalCatalogVersionsSuite with ExtendedHiveTest

2019-08-22 Thread GitBox
AmplabJenkins removed a comment on issue #25550: [SPARK-28847][TEST] Annotate HiveExternalCatalogVersionsSuite with ExtendedHiveTest URL: https://github.com/apache/spark/pull/25550#issuecomment-523778054 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage

2019-08-22 Thread GitBox
AmplabJenkins removed a comment on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage URL: https://github.com/apache/spark/pull/25509#issuecomment-523778266 Merged build finished. Test FAILed.

[GitHub] [spark] dongjoon-hyun commented on issue #25538: [SPARK-28844][SQL] Fix typo in SQLConf FILE_COMRESSION_FACTOR

2019-08-22 Thread GitBox
dongjoon-hyun commented on issue #25538: [SPARK-28844][SQL] Fix typo in SQLConf FILE_COMRESSION_FACTOR URL: https://github.com/apache/spark/pull/25538#issuecomment-523778664 I tested this manually. Merged to `master/2.4/2.3`.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25547: [SPARK-28780][ML][2.4] deprecate LinearSVCModel.setWeightCol

2019-08-22 Thread GitBox
AmplabJenkins removed a comment on issue #25547: [SPARK-28780][ML][2.4] deprecate LinearSVCModel.setWeightCol URL: https://github.com/apache/spark/pull/25547#issuecomment-523777967 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage

2019-08-22 Thread GitBox
AmplabJenkins commented on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage URL: https://github.com/apache/spark/pull/25509#issuecomment-523778276 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage

2019-08-22 Thread GitBox
AmplabJenkins commented on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage URL: https://github.com/apache/spark/pull/25509#issuecomment-523778266 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #25538: [SPARK-28844][SQL] Fix typo in SQLConf FILE_COMRESSION_FACTOR

2019-08-22 Thread GitBox
SparkQA removed a comment on issue #25538: [SPARK-28844][SQL] Fix typo in SQLConf FILE_COMRESSION_FACTOR URL: https://github.com/apache/spark/pull/25538#issuecomment-523751544 **[Test build #109552 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25546: [SPARK-28780][ML][2.3] deprecate LinearSVCModel.setWeightCol

2019-08-22 Thread GitBox
AmplabJenkins removed a comment on issue #25546: [SPARK-28780][ML][2.3] deprecate LinearSVCModel.setWeightCol URL: https://github.com/apache/spark/pull/25546#issuecomment-523777975 Merged build finished. Test FAILed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #25538: [SPARK-28844][SQL] Fix typo in SQLConf FILE_COMRESSION_FACTOR

2019-08-22 Thread GitBox
AmplabJenkins removed a comment on issue #25538: [SPARK-28844][SQL] Fix typo in SQLConf FILE_COMRESSION_FACTOR URL: https://github.com/apache/spark/pull/25538#issuecomment-523778114 Merged build finished. Test FAILed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #25550: [SPARK-28847][TEST] Annotate HiveExternalCatalogVersionsSuite with ExtendedHiveTest

2019-08-22 Thread GitBox
AmplabJenkins removed a comment on issue #25550: [SPARK-28847][TEST] Annotate HiveExternalCatalogVersionsSuite with ExtendedHiveTest URL: https://github.com/apache/spark/pull/25550#issuecomment-523778048 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #25546: [SPARK-28780][ML][2.3] deprecate LinearSVCModel.setWeightCol

2019-08-22 Thread GitBox
SparkQA removed a comment on issue #25546: [SPARK-28780][ML][2.3] deprecate LinearSVCModel.setWeightCol URL: https://github.com/apache/spark/pull/25546#issuecomment-523776193 **[Test build #109559 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24759: [SPARK-27395][SQL] Improve EXPLAIN command

2019-08-22 Thread GitBox
AmplabJenkins removed a comment on issue #24759: [SPARK-27395][SQL] Improve EXPLAIN command URL: https://github.com/apache/spark/pull/24759#issuecomment-523778058 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] SparkQA removed a comment on issue #24759: [SPARK-27395][SQL] Improve EXPLAIN command

2019-08-22 Thread GitBox
SparkQA removed a comment on issue #24759: [SPARK-27395][SQL] Improve EXPLAIN command URL: https://github.com/apache/spark/pull/24759#issuecomment-523758116 **[Test build #109554 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109554/testReport)** for PR

[GitHub] [spark] AmplabJenkins removed a comment on issue #25547: [SPARK-28780][ML][2.4] deprecate LinearSVCModel.setWeightCol

2019-08-22 Thread GitBox
AmplabJenkins removed a comment on issue #25547: [SPARK-28780][ML][2.4] deprecate LinearSVCModel.setWeightCol URL: https://github.com/apache/spark/pull/25547#issuecomment-523777959 Merged build finished. Test FAILed. This is

[GitHub] [spark] SparkQA removed a comment on issue #25550: [SPARK-28847][TEST] Annotate HiveExternalCatalogVersionsSuite with ExtendedHiveTest

2019-08-22 Thread GitBox
SparkQA removed a comment on issue #25550: [SPARK-28847][TEST] Annotate HiveExternalCatalogVersionsSuite with ExtendedHiveTest URL: https://github.com/apache/spark/pull/25550#issuecomment-523759771 **[Test build #109555 has

[GitHub] [spark] SparkQA removed a comment on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage

2019-08-22 Thread GitBox
SparkQA removed a comment on issue #25509: [SPARK-28699][CORE][2.4] Fix a corner case for aborting indeterminate stage URL: https://github.com/apache/spark/pull/25509#issuecomment-523721871 **[Test build #109544 has

[GitHub] [spark] AmplabJenkins commented on issue #25538: [SPARK-28844][SQL] Fix typo in SQLConf FILE_COMRESSION_FACTOR

2019-08-22 Thread GitBox
AmplabJenkins commented on issue #25538: [SPARK-28844][SQL] Fix typo in SQLConf FILE_COMRESSION_FACTOR URL: https://github.com/apache/spark/pull/25538#issuecomment-523778125 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25538: [SPARK-28844][SQL] Fix typo in SQLConf FILE_COMRESSION_FACTOR

2019-08-22 Thread GitBox
AmplabJenkins commented on issue #25538: [SPARK-28844][SQL] Fix typo in SQLConf FILE_COMRESSION_FACTOR URL: https://github.com/apache/spark/pull/25538#issuecomment-523778114 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24759: [SPARK-27395][SQL] Improve EXPLAIN command

2019-08-22 Thread GitBox
AmplabJenkins commented on issue #24759: [SPARK-27395][SQL] Improve EXPLAIN command URL: https://github.com/apache/spark/pull/24759#issuecomment-523778070 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25550: [SPARK-28847][TEST] Annotate HiveExternalCatalogVersionsSuite with ExtendedHiveTest

2019-08-22 Thread GitBox
AmplabJenkins commented on issue #25550: [SPARK-28847][TEST] Annotate HiveExternalCatalogVersionsSuite with ExtendedHiveTest URL: https://github.com/apache/spark/pull/25550#issuecomment-523778048 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #25550: [SPARK-28847][TEST] Annotate HiveExternalCatalogVersionsSuite with ExtendedHiveTest

2019-08-22 Thread GitBox
AmplabJenkins commented on issue #25550: [SPARK-28847][TEST] Annotate HiveExternalCatalogVersionsSuite with ExtendedHiveTest URL: https://github.com/apache/spark/pull/25550#issuecomment-523778054 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25546: [SPARK-28780][ML][2.3] deprecate LinearSVCModel.setWeightCol

2019-08-22 Thread GitBox
AmplabJenkins commented on issue #25546: [SPARK-28780][ML][2.3] deprecate LinearSVCModel.setWeightCol URL: https://github.com/apache/spark/pull/25546#issuecomment-523777987 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24759: [SPARK-27395][SQL] Improve EXPLAIN command

2019-08-22 Thread GitBox
AmplabJenkins commented on issue #24759: [SPARK-27395][SQL] Improve EXPLAIN command URL: https://github.com/apache/spark/pull/24759#issuecomment-523778058 Merged build finished. Test FAILed. This is an automated message from

[GitHub] [spark] AmplabJenkins commented on issue #25546: [SPARK-28780][ML][2.3] deprecate LinearSVCModel.setWeightCol

2019-08-22 Thread GitBox
AmplabJenkins commented on issue #25546: [SPARK-28780][ML][2.3] deprecate LinearSVCModel.setWeightCol URL: https://github.com/apache/spark/pull/25546#issuecomment-523777975 Merged build finished. Test FAILed. This is an

<    4   5   6   7   8   9   10   >