[GitHub] [spark] AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573296476 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573297246 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573297244 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573297246 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
SparkQA commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573297151 **[Test build #116527 has

[GitHub] [spark] AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573297244 Merged build finished. Test PASSed. This

[GitHub] [spark] SparkQA commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
SparkQA commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573296470 **[Test build #116526 has

[GitHub] [spark] AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573296474 Merged build finished. Test FAILed. This

[GitHub] [spark] AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573296476 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573296474 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
SparkQA removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573296134 **[Test build #116526 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573296229 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573296233 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573296233 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573296229 Merged build finished. Test PASSed. This

[GitHub] [spark] SparkQA commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
SparkQA commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573296134 **[Test build #116526 has

[GitHub] [spark] wackxu edited a comment on issue #27029: [SPARK-30371][K8S]make KUBERNETES_MASTER_INTERNAL_URL configurable

2020-01-11 Thread GitBox
wackxu edited a comment on issue #27029: [SPARK-30371][K8S]make KUBERNETES_MASTER_INTERNAL_URL configurable URL: https://github.com/apache/spark/pull/27029#issuecomment-573306173 @dongjoon-hyun Could you take a look at this?

[GitHub] [spark] wackxu commented on issue #27029: [SPARK-30371][K8S]make KUBERNETES_MASTER_INTERNAL_URL configurable

2020-01-11 Thread GitBox
wackxu commented on issue #27029: [SPARK-30371][K8S]make KUBERNETES_MASTER_INTERNAL_URL configurable URL: https://github.com/apache/spark/pull/27029#issuecomment-573306173 @dongjoon-hyun This is an automated message from

[GitHub] [spark] AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573311960 Merged build finished. Test FAILed. This

[GitHub] [spark] MaxGekk opened a new pull request #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource

2020-01-11 Thread GitBox
MaxGekk opened a new pull request #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource URL: https://github.com/apache/spark/pull/27174 ### What changes were proposed in this pull request? - Remove the `@deprecated` annotation for `AvroOptions. ignoreExtension` -

[GitHub] [spark] tgravescs commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-11 Thread GitBox
tgravescs commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-573323120 test failures on unrelated and we keep seeing timeout errors in the checks:

[GitHub] [spark] tgravescs commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-11 Thread GitBox
tgravescs commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-573323127 test this please

[GitHub] [spark] srowen commented on issue #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource

2020-01-11 Thread GitBox
srowen commented on issue #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource URL: https://github.com/apache/spark/pull/27174#issuecomment-573330180 OK, the class appears public though, it's definitely not meant to be accessed for other reasons? On Sat, Jan

[GitHub] [spark] MaxGekk commented on issue #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource

2020-01-11 Thread GitBox
MaxGekk commented on issue #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource URL: https://github.com/apache/spark/pull/27174#issuecomment-573331430 AvroOptions (and other options like CSVOptions) shouldn’t be accessible to users. Deprecating any values inside of

[GitHub] [spark] AmplabJenkins commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-573336898 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-573336894 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-573336898 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins removed a comment on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-573336894 Merged build finished. Test PASSed.

[GitHub] [spark] dongjoon-hyun commented on issue #27173: [SPARK-30312][SQL][2.4] Preserve path permission and acl when truncate table

2020-01-11 Thread GitBox
dongjoon-hyun commented on issue #27173: [SPARK-30312][SQL][2.4] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/27173#issuecomment-573340759 Merged to branch-2.4. Thank you, @viirya .

[GitHub] [spark] dongjoon-hyun closed pull request #27173: [SPARK-30312][SQL][2.4] Preserve path permission and acl when truncate table

2020-01-11 Thread GitBox
dongjoon-hyun closed pull request #27173: [SPARK-30312][SQL][2.4] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/27173 This is an automated message from the Apache Git

[GitHub] [spark] dongjoon-hyun commented on issue #27106: [SPARK-30435][DOC] Update doc of Supported Hive Features

2020-01-11 Thread GitBox
dongjoon-hyun commented on issue #27106: [SPARK-30435][DOC] Update doc of Supported Hive Features URL: https://github.com/apache/spark/pull/27106#issuecomment-573342514 Hi, @AngersZh . Since you are one of the active contributors, I want to remind the community policy a little bit.

[GitHub] [spark] viirya opened a new pull request #27175: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table

2020-01-11 Thread GitBox
viirya opened a new pull request #27175: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/27175 ### What changes were proposed in this pull request? This is a followup to fix a brittle assert in a

[GitHub] [spark] SparkQA commented on issue #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource

2020-01-11 Thread GitBox
SparkQA commented on issue #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource URL: https://github.com/apache/spark/pull/27174#issuecomment-573312213 **[Test build #116528 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573311960 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573311961 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource URL: https://github.com/apache/spark/pull/27174#issuecomment-573312312 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource URL: https://github.com/apache/spark/pull/27174#issuecomment-573312311 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource URL: https://github.com/apache/spark/pull/27174#issuecomment-573312312 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] tgravescs commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-11 Thread GitBox
tgravescs commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-573336112 python test not related and timeout error again on the linters

[GitHub] [spark] tgravescs commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-11 Thread GitBox
tgravescs commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-573336124 test this please

[GitHub] [spark] tgravescs commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference

2020-01-11 Thread GitBox
tgravescs commented on issue #27053: [WIP][SPARK-27495][Core][YARN][k8s] Stage Level Scheduling code for reference URL: https://github.com/apache/spark/pull/27053#issuecomment-573336209 Note, I'm working on pulling in the changes made in the PR https://github.com/apache/spark/pull/26682,

[GitHub] [spark] SparkQA commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-11 Thread GitBox
SparkQA commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-573332560 **[Test build #116529 has

[GitHub] [spark] AmplabJenkins commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-573332667 Test FAILed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-573332663 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-573332663 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-11 Thread GitBox
SparkQA removed a comment on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-573323405 **[Test build #116529 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-573332667 Test FAILed. Refer to this link for build results (access

[GitHub] [spark] SparkQA commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-11 Thread GitBox
SparkQA commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-573336734 **[Test build #116530 has

[GitHub] [spark] dongjoon-hyun commented on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table

2020-01-11 Thread GitBox
dongjoon-hyun commented on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/26956#issuecomment-573341193 Ur, @viirya . Our Jenkins with Hadoop-2.7/Hive 1.2 job seems to fail. Could you take a look? -

[GitHub] [spark] dongjoon-hyun edited a comment on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table

2020-01-11 Thread GitBox
dongjoon-hyun edited a comment on issue #26956: [SPARK-30312][SQL] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/26956#issuecomment-573341193 Ur, @viirya . Our Jenkins with Hadoop-2.7/Hive 1.2 job seems to fail. Could you take a look? -

[GitHub] [spark] AmplabJenkins removed a comment on issue #27175: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27175: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/27175#issuecomment-573343432 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27175: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27175: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/27175#issuecomment-573343434 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27175: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27175: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/27175#issuecomment-573343434 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27175: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27175: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/27175#issuecomment-573343432 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27175: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table

2020-01-11 Thread GitBox
SparkQA commented on issue #27175: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/27175#issuecomment-573343340 **[Test build #116531 has

[GitHub] [spark] viirya commented on issue #27175: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table

2020-01-11 Thread GitBox
viirya commented on issue #27175: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/27175#issuecomment-573343304 cc @dongjoon-hyun This is an

[GitHub] [spark] SparkQA removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
SparkQA removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573297151 **[Test build #116527 has

[GitHub] [spark] SparkQA commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
SparkQA commented on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573311877 **[Test build #116527 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27169: [SPARK-30485][SQL] Remove SQL configs deprecated in Spark 2.1 and 2.3 URL: https://github.com/apache/spark/pull/27169#issuecomment-573311961 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource URL: https://github.com/apache/spark/pull/27174#issuecomment-573314192 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource URL: https://github.com/apache/spark/pull/27174#issuecomment-573314191 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-573323522 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins removed a comment on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-573323520 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-11 Thread GitBox
SparkQA commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-573323405 **[Test build #116529 has

[GitHub] [spark] AmplabJenkins commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-573323520 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #26682: [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with URL: https://github.com/apache/spark/pull/26682#issuecomment-573323522 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] viirya commented on a change in pull request #27175: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table

2020-01-11 Thread GitBox
viirya commented on a change in pull request #27175: [SPARK-30312][SQL][FOLLOWUP] Preserve path permission and acl when truncate table URL: https://github.com/apache/spark/pull/27175#discussion_r365535920 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource URL: https://github.com/apache/spark/pull/27174#issuecomment-573312311 Merged build finished. Test PASSed.

[GitHub] [spark] srowen commented on issue #27160: [SPARK-30478][Core]Update the Doc of Memory Package

2020-01-11 Thread GitBox
srowen commented on issue #27160: [SPARK-30478][Core]Update the Doc of Memory Package URL: https://github.com/apache/spark/pull/27160#issuecomment-573325285 I think that's a known issue with Python tests, not related. Let me wait a bit.

[GitHub] [spark] srowen commented on a change in pull request #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource

2020-01-11 Thread GitBox
srowen commented on a change in pull request #27174: [SPARK-30490][SQL] Eliminate compiler warnings in Avro datasource URL: https://github.com/apache/spark/pull/27174#discussion_r365527305 ## File path: external/avro/src/main/scala/org/apache/spark/sql/avro/AvroOptions.scala

[GitHub] [spark] yaooqinn opened a new pull request #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-11 Thread GitBox
yaooqinn opened a new pull request #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176 ### What changes were proposed in this pull request? propose to add two new interval types which are year-month and day-time

[GitHub] [spark] AmplabJenkins removed a comment on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter URL: https://github.com/apache/spark/pull/27041#issuecomment-573377898 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter URL: https://github.com/apache/spark/pull/27041#issuecomment-573377900 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter URL: https://github.com/apache/spark/pull/27041#issuecomment-573377900 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter URL: https://github.com/apache/spark/pull/27041#issuecomment-573377898 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter

2020-01-11 Thread GitBox
SparkQA commented on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter URL: https://github.com/apache/spark/pull/27041#issuecomment-573377825 **[Test build #116541 has

[GitHub] [spark] SparkQA commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests

2020-01-11 Thread GitBox
SparkQA commented on issue #27166: [SPARK-30482][SQL][CORE][TESTS] Add sub-class of `AppenderSkeleton` reusable in tests URL: https://github.com/apache/spark/pull/27166#issuecomment-573379393 **[Test build #116542 has

[GitHub] [spark] SparkQA commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

2020-01-11 Thread GitBox
SparkQA commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573379391 **[Test build #116543 has

[GitHub] [spark] SparkQA commented on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation

2020-01-11 Thread GitBox
SparkQA commented on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation URL: https://github.com/apache/spark/pull/27160#issuecomment-573379392 **[Test build #116544 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116544/testReport)**

[GitHub] [spark] AmplabJenkins commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573379469 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation URL: https://github.com/apache/spark/pull/27160#issuecomment-573379464 Merged build finished. Test PASSed. This is

[GitHub] [spark] dongjoon-hyun closed pull request #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation

2020-01-11 Thread GitBox
dongjoon-hyun closed pull request #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation URL: https://github.com/apache/spark/pull/27160 This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] AmplabJenkins commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573379467 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation URL: https://github.com/apache/spark/pull/27160#issuecomment-573379464 Merged build finished. Test PASSed. This is an

[GitHub] [spark] dongjoon-hyun commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-11 Thread GitBox
dongjoon-hyun commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573381092 cc @gatorsmile and @cloud-fan This

[GitHub] [spark] SparkQA commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-11 Thread GitBox
SparkQA commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573381164 **[Test build #116545 has

[GitHub] [spark] AmplabJenkins commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-11 Thread GitBox
AmplabJenkins commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573381207 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573381208 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573381207 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter

2020-01-11 Thread GitBox
AmplabJenkins removed a comment on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter URL: https://github.com/apache/spark/pull/27041#issuecomment-573385211 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] MaxGekk commented on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource

2020-01-11 Thread GitBox
MaxGekk commented on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource URL: https://github.com/apache/spark/pull/26973#issuecomment-573387323 @HyukjinKwon @dongjoon-hyun @cloud-fan Could you review this PR, please.

[GitHub] [spark] cloud-fan commented on a change in pull request #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2

2020-01-11 Thread GitBox
cloud-fan commented on a change in pull request #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2 URL: https://github.com/apache/spark/pull/26231#discussion_r365563206 ## File path: sql/core/src/main/java/org/apache/spark/sql/connector/read/V1Scan.java ## @@

[GitHub] [spark] cloud-fan commented on a change in pull request #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2

2020-01-11 Thread GitBox
cloud-fan commented on a change in pull request #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2 URL: https://github.com/apache/spark/pull/26231#discussion_r365563231 ## File path: sql/core/src/main/java/org/apache/spark/sql/connector/read/V1Scan.java ## @@

[GitHub] [spark] MaxGekk commented on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource

2020-01-11 Thread GitBox
MaxGekk commented on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource URL: https://github.com/apache/spark/pull/26973#issuecomment-573390974 @cloud-fan The problem was in the line

[GitHub] [spark] MaxGekk edited a comment on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource

2020-01-11 Thread GitBox
MaxGekk edited a comment on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource URL: https://github.com/apache/spark/pull/26973#issuecomment-573391098 And in `pushedFilters`, I store only filters that refer to the schema, and the filters that I can handle.

[GitHub] [spark] MaxGekk edited a comment on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource

2020-01-11 Thread GitBox
MaxGekk edited a comment on issue #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource URL: https://github.com/apache/spark/pull/26973#issuecomment-573390974 @cloud-fan The problem was in the line

[GitHub] [spark] dongjoon-hyun commented on issue #27155: [SPARK-17636][SPARK-25557][SQL] Parquet and ORC predicate pushdown in nested fields

2020-01-11 Thread GitBox
dongjoon-hyun commented on issue #27155: [SPARK-17636][SPARK-25557][SQL] Parquet and ORC predicate pushdown in nested fields URL: https://github.com/apache/spark/pull/27155#issuecomment-573378599 I'll leave this PR to @dbtsai .

[GitHub] [spark] dongjoon-hyun commented on issue #27155: [SPARK-17636][SPARK-25557][SQL] Parquet and ORC predicate pushdown in nested fields

2020-01-11 Thread GitBox
dongjoon-hyun commented on issue #27155: [SPARK-17636][SPARK-25557][SQL] Parquet and ORC predicate pushdown in nested fields URL: https://github.com/apache/spark/pull/27155#issuecomment-573378544 @emaynardigs . In this case, usually, we close the second PR (yours) because the original is

[GitHub] [spark] dongjoon-hyun commented on issue #27160: [SPARK-30478][Core]Update the Doc of Memory Package

2020-01-11 Thread GitBox
dongjoon-hyun commented on issue #27160: [SPARK-30478][Core]Update the Doc of Memory Package URL: https://github.com/apache/spark/pull/27160#issuecomment-573379133 Retest this please. This is an automated message from the

[GitHub] [spark] sddyljsx commented on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation

2020-01-11 Thread GitBox
sddyljsx commented on issue #27160: [SPARK-30478][CORE][DOCS] Fix Memory Package documentation URL: https://github.com/apache/spark/pull/27160#issuecomment-573380206 Thanks! @srowen @dongjoon-hyun This is an automated

  1   2   3   4   >