[GitHub] [spark] AmplabJenkins removed a comment on issue #26666: [SPARK-29081][CORE][FOLLOWUP] Use commons-lang3 instead of commons-lang2

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #2: [SPARK-29081][CORE][FOLLOWUP] Use commons-lang3 instead of commons-lang2 URL: https://github.com/apache/spark/pull/2#issuecomment-558286298 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26666: [SPARK-29081][CORE][FOLLOWUP] Use commons-lang3 instead of commons-lang2

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #2: [SPARK-29081][CORE][FOLLOWUP] Use commons-lang3 instead of commons-lang2 URL: https://github.com/apache/spark/pull/2#issuecomment-558286308 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26666: [SPARK-29081][CORE][FOLLOWUP] Use commons-lang3 instead of commons-lang2

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #2: [SPARK-29081][CORE][FOLLOWUP] Use commons-lang3 instead of commons-lang2 URL: https://github.com/apache/spark/pull/2#issuecomment-558286298 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26666: [SPARK-29081][CORE][FOLLOWUP] Use commons-lang3 instead of commons-lang2

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #2: [SPARK-29081][CORE][FOLLOWUP] Use commons-lang3 instead of commons-lang2 URL: https://github.com/apache/spark/pull/2#issuecomment-558286308 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] vanzin commented on issue #25299: [SPARK-27651][Core] Avoid the network when shuffle blocks are fetched from the same host

2019-11-25 Thread GitBox
vanzin commented on issue #25299: [SPARK-27651][Core] Avoid the network when shuffle blocks are fetched from the same host URL: https://github.com/apache/spark/pull/25299#issuecomment-558285542 > Now we are having to wait to fetch the local blocks first before the host local blocks where

[GitHub] [spark] SparkQA commented on issue #26666: [SPARK-29081][CORE][FOLLOWUP] Use commons-lang3 instead of commons-lang2

2019-11-25 Thread GitBox
SparkQA commented on issue #2: [SPARK-29081][CORE][FOLLOWUP] Use commons-lang3 instead of commons-lang2 URL: https://github.com/apache/spark/pull/2#issuecomment-558285685 **[Test build #114419 has

[GitHub] [spark] tgravescs commented on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core`

2019-11-25 Thread GitBox
tgravescs commented on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core` URL: https://github.com/apache/spark/pull/26658#issuecomment-558285176 so what are the rest of the jiras to fix the build? Its not very user friendly for us to

[GitHub] [spark] dongjoon-hyun opened a new pull request #26666: [SPARK-29081][CORE][FOLLOWUP] Use commons-lang3 instead of commons-lang2

2019-11-25 Thread GitBox
dongjoon-hyun opened a new pull request #2: [SPARK-29081][CORE][FOLLOWUP] Use commons-lang3 instead of commons-lang2 URL: https://github.com/apache/spark/pull/2 ### What changes were proposed in this pull request? ### Why are the changes needed?

[GitHub] [spark] AmplabJenkins removed a comment on issue #26664: [SPARK-9853][Doc][Follow-up] Update the description for all the SQLConf affected by spark.sql.adaptive.enabled

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26664: [SPARK-9853][Doc][Follow-up] Update the description for all the SQLConf affected by spark.sql.adaptive.enabled URL: https://github.com/apache/spark/pull/26664#issuecomment-558282264 Test PASSed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins removed a comment on issue #26664: [SPARK-9853][Doc][Follow-up] Update the description for all the SQLConf affected by spark.sql.adaptive.enabled

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26664: [SPARK-9853][Doc][Follow-up] Update the description for all the SQLConf affected by spark.sql.adaptive.enabled URL: https://github.com/apache/spark/pull/26664#issuecomment-558282253 Merged build finished. Test PASSed.

[GitHub] [spark] srowen commented on a change in pull request #26655: [SPARK-29293][BUILD] Update scalafmt plugin to 1.0.2 for compatibility with Scala 2.13

2019-11-25 Thread GitBox
srowen commented on a change in pull request #26655: [SPARK-29293][BUILD] Update scalafmt plugin to 1.0.2 for compatibility with Scala 2.13 URL: https://github.com/apache/spark/pull/26655#discussion_r350350633 ## File path: dev/scalafmt ## @@ -17,7 +17,4 @@ # limitations

[GitHub] [spark] AmplabJenkins commented on issue #26664: [SPARK-9853][Doc][Follow-up] Update the description for all the SQLConf affected by spark.sql.adaptive.enabled

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26664: [SPARK-9853][Doc][Follow-up] Update the description for all the SQLConf affected by spark.sql.adaptive.enabled URL: https://github.com/apache/spark/pull/26664#issuecomment-558282264 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins commented on issue #26664: [SPARK-9853][Doc][Follow-up] Update the description for all the SQLConf affected by spark.sql.adaptive.enabled

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26664: [SPARK-9853][Doc][Follow-up] Update the description for all the SQLConf affected by spark.sql.adaptive.enabled URL: https://github.com/apache/spark/pull/26664#issuecomment-558282253 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #26664: [SPARK-9853][Doc][Follow-up] Update the description for all the SQLConf affected by spark.sql.adaptive.enabled

2019-11-25 Thread GitBox
SparkQA commented on issue #26664: [SPARK-9853][Doc][Follow-up] Update the description for all the SQLConf affected by spark.sql.adaptive.enabled URL: https://github.com/apache/spark/pull/26664#issuecomment-558281487 **[Test build #114407 has

[GitHub] [spark] SparkQA removed a comment on issue #26664: [SPARK-9853][Doc][Follow-up] Update the description for all the SQLConf affected by spark.sql.adaptive.enabled

2019-11-25 Thread GitBox
SparkQA removed a comment on issue #26664: [SPARK-9853][Doc][Follow-up] Update the description for all the SQLConf affected by spark.sql.adaptive.enabled URL: https://github.com/apache/spark/pull/26664#issuecomment-558180625 **[Test build #114407 has

[GitHub] [spark] AmplabJenkins commented on issue #26649: [SPARK-29862][SQL] CREATE (OR REPLACE) ... VIEW should look up catalog/table like v2 commands

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26649: [SPARK-29862][SQL] CREATE (OR REPLACE) ... VIEW should look up catalog/table like v2 commands URL: https://github.com/apache/spark/pull/26649#issuecomment-558279930 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #26649: [SPARK-29862][SQL] CREATE (OR REPLACE) ... VIEW should look up catalog/table like v2 commands

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26649: [SPARK-29862][SQL] CREATE (OR REPLACE) ... VIEW should look up catalog/table like v2 commands URL: https://github.com/apache/spark/pull/26649#issuecomment-558279918 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType URL: https://github.com/apache/spark/pull/26644#issuecomment-558280042 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] shahidki31 commented on issue #26508: [SPARK-26260][Core]For disk store tasks summary table should show only successful tasks summary

2019-11-25 Thread GitBox
shahidki31 commented on issue #26508: [SPARK-26260][Core]For disk store tasks summary table should show only successful tasks summary URL: https://github.com/apache/spark/pull/26508#issuecomment-558280220 Thanks a lot @vanzin , @srowen

[GitHub] [spark] AmplabJenkins removed a comment on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType URL: https://github.com/apache/spark/pull/26644#issuecomment-558280035 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26649: [SPARK-29862][SQL] CREATE (OR REPLACE) ... VIEW should look up catalog/table like v2 commands

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26649: [SPARK-29862][SQL] CREATE (OR REPLACE) ... VIEW should look up catalog/table like v2 commands URL: https://github.com/apache/spark/pull/26649#issuecomment-558279930 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType URL: https://github.com/apache/spark/pull/26644#issuecomment-558280035 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType URL: https://github.com/apache/spark/pull/26644#issuecomment-558280042 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26649: [SPARK-29862][SQL] CREATE (OR REPLACE) ... VIEW should look up catalog/table like v2 commands

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26649: [SPARK-29862][SQL] CREATE (OR REPLACE) ... VIEW should look up catalog/table like v2 commands URL: https://github.com/apache/spark/pull/26649#issuecomment-558279918 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType

2019-11-25 Thread GitBox
SparkQA removed a comment on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType URL: https://github.com/apache/spark/pull/26644#issuecomment-558180552 **[Test build #114408 has

[GitHub] [spark] SparkQA commented on issue #26649: [SPARK-29862][SQL] CREATE (OR REPLACE) ... VIEW should look up catalog/table like v2 commands

2019-11-25 Thread GitBox
SparkQA commented on issue #26649: [SPARK-29862][SQL] CREATE (OR REPLACE) ... VIEW should look up catalog/table like v2 commands URL: https://github.com/apache/spark/pull/26649#issuecomment-558279355 **[Test build #114418 has

[GitHub] [spark] SparkQA commented on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType

2019-11-25 Thread GitBox
SparkQA commented on issue #26644: [SPARK-30004][SQL] Allow merge UserDefinedType into a native DataType URL: https://github.com/apache/spark/pull/26644#issuecomment-558279389 **[Test build #114408 has

[GitHub] [spark] dongjoon-hyun edited a comment on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core`

2019-11-25 Thread GitBox
dongjoon-hyun edited a comment on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core` URL: https://github.com/apache/spark/pull/26658#issuecomment-558272876 Hi, @srowen and @tgravescs . Thank you for review. - The `commons-lang` of

[GitHub] [spark] dongjoon-hyun commented on issue #26660: [SPARK-29971][CORE][2.4] Fix buffer leaks in `TransportFrameDecoder/TransportCipher`

2019-11-25 Thread GitBox
dongjoon-hyun commented on issue #26660: [SPARK-29971][CORE][2.4] Fix buffer leaks in `TransportFrameDecoder/TransportCipher` URL: https://github.com/apache/spark/pull/26660#issuecomment-558276378 Thank you so much, @vanzin and @normanmaurer !

[GitHub] [spark] dongjoon-hyun closed pull request #26660: [SPARK-29971][CORE][2.4] Fix buffer leaks in `TransportFrameDecoder/TransportCipher`

2019-11-25 Thread GitBox
dongjoon-hyun closed pull request #26660: [SPARK-29971][CORE][2.4] Fix buffer leaks in `TransportFrameDecoder/TransportCipher` URL: https://github.com/apache/spark/pull/26660 This is an automated message from the Apache Git

[GitHub] [spark] xuanyuanking commented on issue #26663: [SPARK-30015][Core] Continuous shuffle block fetching should be disabled by default when the old fetch protocol is used

2019-11-25 Thread GitBox
xuanyuanking commented on issue #26663: [SPARK-30015][Core] Continuous shuffle block fetching should be disabled by default when the old fetch protocol is used URL: https://github.com/apache/spark/pull/26663#issuecomment-558275507 > how things can go wrong if we do batch fetch with old

[GitHub] [spark] xuanyuanking edited a comment on issue #26663: [SPARK-30015][Core] Continuous shuffle block fetching should be disabled by default when the old fetch protocol is used

2019-11-25 Thread GitBox
xuanyuanking edited a comment on issue #26663: [SPARK-30015][Core] Continuous shuffle block fetching should be disabled by default when the old fetch protocol is used URL: https://github.com/apache/spark/pull/26663#issuecomment-558275507 > how things can go wrong if we do batch fetch with

[GitHub] [spark] vanzin commented on issue #26660: [SPARK-29971][CORE][2.4] Fix buffer leaks in `TransportFrameDecoder/TransportCipher`

2019-11-25 Thread GitBox
vanzin commented on issue #26660: [SPARK-29971][CORE][2.4] Fix buffer leaks in `TransportFrameDecoder/TransportCipher` URL: https://github.com/apache/spark/pull/26660#issuecomment-558274903 Merging to 2.4. This is an

[GitHub] [spark] zero323 commented on issue #26118: [SPARK-24915][Python] Fix Row handling with Schema.

2019-11-25 Thread GitBox
zero323 commented on issue #26118: [SPARK-24915][Python] Fix Row handling with Schema. URL: https://github.com/apache/spark/pull/26118#issuecomment-558274617 > I did some performance tests (Details in [this gist](https://gist.github.com/qudade/dc9d01f55d27d65ab66d68e3b8d1588d)). >

[GitHub] [spark] AmplabJenkins removed a comment on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core`

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core` URL: https://github.com/apache/spark/pull/26658#issuecomment-558273809 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core`

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core` URL: https://github.com/apache/spark/pull/26658#issuecomment-558273821 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core`

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core` URL: https://github.com/apache/spark/pull/26658#issuecomment-558273809 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core`

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core` URL: https://github.com/apache/spark/pull/26658#issuecomment-558273821 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA commented on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core`

2019-11-25 Thread GitBox
SparkQA commented on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core` URL: https://github.com/apache/spark/pull/26658#issuecomment-558273248 **[Test build #114417 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink URL: https://github.com/apache/spark/pull/26590#issuecomment-558272970 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink URL: https://github.com/apache/spark/pull/26590#issuecomment-558272976 Test PASSed. Refer to this link for build

[GitHub] [spark] AmplabJenkins commented on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink URL: https://github.com/apache/spark/pull/26590#issuecomment-558272976 Test PASSed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins commented on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink URL: https://github.com/apache/spark/pull/26590#issuecomment-558272970 Merged build finished. Test PASSed.

[GitHub] [spark] dongjoon-hyun edited a comment on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core`

2019-11-25 Thread GitBox
dongjoon-hyun edited a comment on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core` URL: https://github.com/apache/spark/pull/26658#issuecomment-558272876 Hi, @srowen and @tgravescs . Thank you for review. - The `commons-lang` of

[GitHub] [spark] dongjoon-hyun commented on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core`

2019-11-25 Thread GitBox
dongjoon-hyun commented on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core` URL: https://github.com/apache/spark/pull/26658#issuecomment-558272876 Hi, @srowen and @tgravescs . - The `commons-lang` of `core/pom.xml` is changed to `test`

[GitHub] [spark] vanzin closed pull request #26508: [SPARK-26260][Core]For disk store tasks summary table should show only successful tasks summary

2019-11-25 Thread GitBox
vanzin closed pull request #26508: [SPARK-26260][Core]For disk store tasks summary table should show only successful tasks summary URL: https://github.com/apache/spark/pull/26508 This is an automated message from the Apache

[GitHub] [spark] squito commented on issue #24132: [SPARK-27189][CORE] Add Executor metrics and memory usage instrumentation to the metrics system

2019-11-25 Thread GitBox
squito commented on issue #24132: [SPARK-27189][CORE] Add Executor metrics and memory usage instrumentation to the metrics system URL: https://github.com/apache/spark/pull/24132#issuecomment-558272217 > do you have any opinioins on the default value for

[GitHub] [spark] vanzin commented on issue #26508: [SPARK-26260][Core]For disk store tasks summary table should show only successful tasks summary

2019-11-25 Thread GitBox
vanzin commented on issue #26508: [SPARK-26260][Core]For disk store tasks summary table should show only successful tasks summary URL: https://github.com/apache/spark/pull/26508#issuecomment-558272072 Merging to master. This

[GitHub] [spark] SparkQA commented on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink

2019-11-25 Thread GitBox
SparkQA commented on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink URL: https://github.com/apache/spark/pull/26590#issuecomment-558271984 **[Test build #114406 has

[GitHub] [spark] SparkQA removed a comment on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink

2019-11-25 Thread GitBox
SparkQA removed a comment on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink URL: https://github.com/apache/spark/pull/26590#issuecomment-558173641 **[Test build #114406 has

[GitHub] [spark] squito commented on issue #26614: [SPARK-29976] New conf for single task stage speculation

2019-11-25 Thread GitBox
squito commented on issue #26614: [SPARK-29976] New conf for single task stage speculation URL: https://github.com/apache/spark/pull/26614#issuecomment-558271210 yeah I am also torn like @tgravescs . There are a ton of corner cases. I really don't like special casing one task, but I'm

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core`

2019-11-25 Thread GitBox
dongjoon-hyun commented on a change in pull request #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core` URL: https://github.com/apache/spark/pull/26658#discussion_r350336012 ## File path: pom.xml ## @@ -2184,6 +2185,18 @@

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core`

2019-11-25 Thread GitBox
dongjoon-hyun commented on a change in pull request #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core` URL: https://github.com/apache/spark/pull/26658#discussion_r350334157 ## File path: pom.xml ## @@ -2184,6 +2185,18 @@

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core`

2019-11-25 Thread GitBox
dongjoon-hyun commented on a change in pull request #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core` URL: https://github.com/apache/spark/pull/26658#discussion_r350334157 ## File path: pom.xml ## @@ -2184,6 +2185,18 @@

[GitHub] [spark] AmplabJenkins removed a comment on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#issuecomment-558267558 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#issuecomment-558267552 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#issuecomment-558267552 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#issuecomment-558267558 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
SparkQA removed a comment on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#issuecomment-558170353 **[Test build #114405 has

[GitHub] [spark] SparkQA commented on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
SparkQA commented on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#issuecomment-558266861 **[Test build #114405 has

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core`

2019-11-25 Thread GitBox
dongjoon-hyun commented on a change in pull request #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core` URL: https://github.com/apache/spark/pull/26658#discussion_r350330343 ## File path: pom.xml ## @@ -2184,6 +2185,18 @@

[GitHub] [spark] dongjoon-hyun commented on issue #26660: [SPARK-29971][CORE][2.4] Fix buffer leaks in `TransportFrameDecoder/TransportCipher`

2019-11-25 Thread GitBox
dongjoon-hyun commented on issue #26660: [SPARK-29971][CORE][2.4] Fix buffer leaks in `TransportFrameDecoder/TransportCipher` URL: https://github.com/apache/spark/pull/26660#issuecomment-558264490 cc @vanzin This is an

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26665: [MINOR][CORE] Make EventLogger codec be consistent between EventLogFileWriter and SparkContext

2019-11-25 Thread GitBox
dongjoon-hyun commented on a change in pull request #26665: [MINOR][CORE] Make EventLogger codec be consistent between EventLogFileWriter and SparkContext URL: https://github.com/apache/spark/pull/26665#discussion_r350329220 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core`

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core` URL: https://github.com/apache/spark/pull/26658#issuecomment-558261515 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] rdblue commented on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in TableCatalog and SupportsNamespaces

2019-11-25 Thread GitBox
rdblue commented on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in TableCatalog and SupportsNamespaces URL: https://github.com/apache/spark/pull/26617#issuecomment-558261970 @cloud-fan, @fuwhu, @imback82, why would we rename `SupportsNamespace`? That seems

[GitHub] [spark] AmplabJenkins removed a comment on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core`

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core` URL: https://github.com/apache/spark/pull/26658#issuecomment-558261502 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core`

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core` URL: https://github.com/apache/spark/pull/26658#issuecomment-558261502 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core`

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core` URL: https://github.com/apache/spark/pull/26658#issuecomment-558261515 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core`

2019-11-25 Thread GitBox
SparkQA commented on issue #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core` URL: https://github.com/apache/spark/pull/26658#issuecomment-558260901 **[Test build #114416 has

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core`

2019-11-25 Thread GitBox
dongjoon-hyun commented on a change in pull request #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core` URL: https://github.com/apache/spark/pull/26658#discussion_r350324170 ## File path: core/pom.xml ## @@ -164,6 +164,10 @@

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core`

2019-11-25 Thread GitBox
dongjoon-hyun commented on a change in pull request #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core` URL: https://github.com/apache/spark/pull/26658#discussion_r350323511 ## File path: core/pom.xml ## @@ -164,6 +164,10 @@

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core`

2019-11-25 Thread GitBox
dongjoon-hyun commented on a change in pull request #26658: [SPARK-30015][BUILD] Move hive-storage-api dependency from `hive-2.3` to `sql/core` URL: https://github.com/apache/spark/pull/26658#discussion_r350323100 ## File path: pom.xml ## @@ -2184,6 +2185,18 @@

[GitHub] [spark] cloud-fan closed pull request #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in TableCatalog and SupportsNamespaces

2019-11-25 Thread GitBox
cloud-fan closed pull request #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in TableCatalog and SupportsNamespaces URL: https://github.com/apache/spark/pull/26617 This is an automated message from the

[GitHub] [spark] cloud-fan commented on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in TableCatalog and SupportsNamespaces

2019-11-25 Thread GitBox
cloud-fan commented on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in TableCatalog and SupportsNamespaces URL: https://github.com/apache/spark/pull/26617#issuecomment-558257301 looking forward to your 2 followups: 1. renaming `SupportsNamespace` to

[GitHub] [spark] cloud-fan commented on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in TableCatalog and SupportsNamespaces

2019-11-25 Thread GitBox
cloud-fan commented on issue #26617: [SPARK-29979][SQL]Add basic/reserved property key constants in TableCatalog and SupportsNamespaces URL: https://github.com/apache/spark/pull/26617#issuecomment-558256940 thanks, merging to master!

[GitHub] [spark] cloud-fan commented on a change in pull request #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
cloud-fan commented on a change in pull request #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#discussion_r350320040 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26665: [MINOR][CORE] Make EventLogger codec be consistent between EventLogFileWriter and SparkContext

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26665: [MINOR][CORE] Make EventLogger codec be consistent between EventLogFileWriter and SparkContext URL: https://github.com/apache/spark/pull/26665#issuecomment-558253138 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26665: [MINOR][CORE] Make EventLogger codec be consistent between EventLogFileWriter and SparkContext

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26665: [MINOR][CORE] Make EventLogger codec be consistent between EventLogFileWriter and SparkContext URL: https://github.com/apache/spark/pull/26665#issuecomment-558253147 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #26665: [MINOR][CORE] Make EventLogger codec be consistent between EventLogFileWriter and SparkContext

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26665: [MINOR][CORE] Make EventLogger codec be consistent between EventLogFileWriter and SparkContext URL: https://github.com/apache/spark/pull/26665#issuecomment-558253147 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #26665: [MINOR][CORE] Make EventLogger codec be consistent between EventLogFileWriter and SparkContext

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26665: [MINOR][CORE] Make EventLogger codec be consistent between EventLogFileWriter and SparkContext URL: https://github.com/apache/spark/pull/26665#issuecomment-558253138 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #26665: [MINOR][CORE] Make EventLogger codec be consistent between EventLogFileWriter and SparkContext

2019-11-25 Thread GitBox
SparkQA removed a comment on issue #26665: [MINOR][CORE] Make EventLogger codec be consistent between EventLogFileWriter and SparkContext URL: https://github.com/apache/spark/pull/26665#issuecomment-558187301 **[Test build #114409 has

[GitHub] [spark] SparkQA commented on issue #26665: [MINOR][CORE] Make EventLogger codec be consistent between EventLogFileWriter and SparkContext

2019-11-25 Thread GitBox
SparkQA commented on issue #26665: [MINOR][CORE] Make EventLogger codec be consistent between EventLogFileWriter and SparkContext URL: https://github.com/apache/spark/pull/26665#issuecomment-558252386 **[Test build #114409 has

[GitHub] [spark] cloud-fan commented on a change in pull request #26664: [SPARK-9853][Doc][Follow-up] Update the description for all the SQLConf affected by spark.sql.adaptive.enabled

2019-11-25 Thread GitBox
cloud-fan commented on a change in pull request #26664: [SPARK-9853][Doc][Follow-up] Update the description for all the SQLConf affected by spark.sql.adaptive.enabled URL: https://github.com/apache/spark/pull/26664#discussion_r350308309 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26633: [SPARK-29994][CORE] Add WILDCARD task location

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26633: [SPARK-29994][CORE] Add WILDCARD task location URL: https://github.com/apache/spark/pull/26633#issuecomment-558244891 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #26633: [SPARK-29994][CORE] Add WILDCARD task location

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26633: [SPARK-29994][CORE] Add WILDCARD task location URL: https://github.com/apache/spark/pull/26633#issuecomment-558244903 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26633: [SPARK-29994][CORE] Add WILDCARD task location

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26633: [SPARK-29994][CORE] Add WILDCARD task location URL: https://github.com/apache/spark/pull/26633#issuecomment-558244903 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26633: [SPARK-29994][CORE] Add WILDCARD task location

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26633: [SPARK-29994][CORE] Add WILDCARD task location URL: https://github.com/apache/spark/pull/26633#issuecomment-558244891 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] SparkQA commented on issue #26633: [SPARK-29994][CORE] Add WILDCARD task location

2019-11-25 Thread GitBox
SparkQA commented on issue #26633: [SPARK-29994][CORE] Add WILDCARD task location URL: https://github.com/apache/spark/pull/26633#issuecomment-558244366 **[Test build #114415 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/114415/testReport)** for PR 26633

[GitHub] [spark] cloud-fan commented on a change in pull request #26665: [MINOR][CORE] Make EventLogger codec be consistent between EventLogFileWriter and SparkContext

2019-11-25 Thread GitBox
cloud-fan commented on a change in pull request #26665: [MINOR][CORE] Make EventLogger codec be consistent between EventLogFileWriter and SparkContext URL: https://github.com/apache/spark/pull/26665#discussion_r350298293 ## File path:

[GitHub] [spark] tgravescs commented on issue #26580: [SPARK-29741][WEBUI] Spark Application UI- In Environment tab add "Search" option

2019-11-25 Thread GitBox
tgravescs commented on issue #26580: [SPARK-29741][WEBUI] Spark Application UI- In Environment tab add "Search" option URL: https://github.com/apache/spark/pull/26580#issuecomment-558237123 In some ways if we are going to enhance it, I would rather see it in datatables like the executors

[GitHub] [spark] tgravescs edited a comment on issue #26580: [SPARK-29741][WEBUI] Spark Application UI- In Environment tab add "Search" option

2019-11-25 Thread GitBox
tgravescs edited a comment on issue #26580: [SPARK-29741][WEBUI] Spark Application UI- In Environment tab add "Search" option URL: https://github.com/apache/spark/pull/26580#issuecomment-558237123 In some ways if we are going to enhance it, I would rather see it in datatables like the

[GitHub] [spark] koeninger commented on a change in pull request #26655: [SPARK-29293][BUILD] Update scalafmt plugin to 1.0.2 for compatibility with Scala 2.13

2019-11-25 Thread GitBox
koeninger commented on a change in pull request #26655: [SPARK-29293][BUILD] Update scalafmt plugin to 1.0.2 for compatibility with Scala 2.13 URL: https://github.com/apache/spark/pull/26655#discussion_r350290158 ## File path: pom.xml ## @@ -166,7 +166,6 @@ 3.2.2

[GitHub] [spark] koeninger commented on a change in pull request #26655: [SPARK-29293][BUILD] Update scalafmt plugin to 1.0.2 for compatibility with Scala 2.13

2019-11-25 Thread GitBox
koeninger commented on a change in pull request #26655: [SPARK-29293][BUILD] Update scalafmt plugin to 1.0.2 for compatibility with Scala 2.13 URL: https://github.com/apache/spark/pull/26655#discussion_r350290496 ## File path: dev/scalafmt ## @@ -17,7 +17,4 @@ #

[GitHub] [spark] Ngone51 commented on a change in pull request #26665: [MINOR][CORE] Make EventLogger codec be consistent between EventLogFileWriter and SparkContext

2019-11-25 Thread GitBox
Ngone51 commented on a change in pull request #26665: [MINOR][CORE] Make EventLogger codec be consistent between EventLogFileWriter and SparkContext URL: https://github.com/apache/spark/pull/26665#discussion_r350286803 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#issuecomment-558230798 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
AmplabJenkins removed a comment on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#issuecomment-558230814 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#issuecomment-558230814 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
AmplabJenkins commented on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#issuecomment-558230798 Merged build finished. Test PASSed. This

[GitHub] [spark] SparkQA commented on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions

2019-11-25 Thread GitBox
SparkQA commented on issue #26629: [SPARK-29768][SQL] Column pruning through nondeterministic expressions URL: https://github.com/apache/spark/pull/26629#issuecomment-558230251 **[Test build #114414 has

[GitHub] [spark] tgravescs commented on issue #25299: [SPARK-27651][Core] Avoid the network when shuffle blocks are fetched from the same host

2019-11-25 Thread GitBox
tgravescs commented on issue #25299: [SPARK-27651][Core] Avoid the network when shuffle blocks are fetched from the same host URL: https://github.com/apache/spark/pull/25299#issuecomment-558228346 ok that makes sense. thanks. So it seems we fetch all the local blocks in first and then

<    1   2   3   4   5   6   7   8   9   10   >