[GitHub] [spark] SparkQA commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

2019-08-20 Thread GitBox
SparkQA commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-523264562 **[Test build #109451 has

[GitHub] [spark] AmplabJenkins commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-523264143 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-523264138 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-523264143 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-523264138 Merged build finished. Test PASSed.

[GitHub] [spark] HeartSaVioR commented on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners()

2019-08-20 Thread GitBox
HeartSaVioR commented on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners() URL: https://github.com/apache/spark/pull/25518#issuecomment-523263403 FYI: a50959a7f692f77754a36cfe4e9baabfcc6fa52d doesn't seem to refer the commit you described.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network URL: https://github.com/apache/spark/pull/25500#issuecomment-523262436 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network URL: https://github.com/apache/spark/pull/25500#issuecomment-523262432 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network URL: https://github.com/apache/spark/pull/25500#issuecomment-523262432 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network URL: https://github.com/apache/spark/pull/25500#issuecomment-523262436 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer URL: https://github.com/apache/spark/pull/22138#issuecomment-523262131 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer URL: https://github.com/apache/spark/pull/22138#issuecomment-523262135 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network

2019-08-20 Thread GitBox
SparkQA commented on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network URL: https://github.com/apache/spark/pull/25500#issuecomment-523262063 **[Test build #109445 has

[GitHub] [spark] AmplabJenkins commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer URL: https://github.com/apache/spark/pull/22138#issuecomment-523262135 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer URL: https://github.com/apache/spark/pull/22138#issuecomment-523262131 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network

2019-08-20 Thread GitBox
SparkQA removed a comment on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network URL: https://github.com/apache/spark/pull/25500#issuecomment-523232290 **[Test build #109445 has

[GitHub] [spark] SparkQA removed a comment on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer

2019-08-20 Thread GitBox
SparkQA removed a comment on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer URL: https://github.com/apache/spark/pull/22138#issuecomment-523230538 **[Test build #109444 has

[GitHub] [spark] SparkQA commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer

2019-08-20 Thread GitBox
SparkQA commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer URL: https://github.com/apache/spark/pull/22138#issuecomment-523261732 **[Test build #109444 has

[GitHub] [spark] ajithme commented on issue #18975: [SPARK-4131] Support "Writing data into the filesystem from queries"

2019-08-20 Thread GitBox
ajithme commented on issue #18975: [SPARK-4131] Support "Writing data into the filesystem from queries" URL: https://github.com/apache/spark/pull/18975#issuecomment-523261355 https://github.com/apache/spark/pull/18975#discussion_r136682501 @gatorsmile @janewangfb i have a question

[GitHub] [spark] AmplabJenkins removed a comment on issue #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths URL: https://github.com/apache/spark/pull/25348#issuecomment-523259813 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths URL: https://github.com/apache/spark/pull/25348#issuecomment-523259820 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths URL: https://github.com/apache/spark/pull/25348#issuecomment-523259820 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths URL: https://github.com/apache/spark/pull/25348#issuecomment-523259813 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths

2019-08-20 Thread GitBox
SparkQA removed a comment on issue #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths URL: https://github.com/apache/spark/pull/25348#issuecomment-523205550 **[Test build #109435 has

[GitHub] [spark] SparkQA commented on issue #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths

2019-08-20 Thread GitBox
SparkQA commented on issue #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths URL: https://github.com/apache/spark/pull/25348#issuecomment-523259436 **[Test build #109435 has

[GitHub] [spark] cloud-fan commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

2019-08-20 Thread GitBox
cloud-fan commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#issuecomment-523255746 > I'm seeing a lot of renaming from USE_V1_SOURCE_READER_LIST to USE_V1_SOURCE_LIST in test classes This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#issuecomment-523255039 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#issuecomment-523255030 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#issuecomment-523255030 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#issuecomment-523255039 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

2019-08-20 Thread GitBox
SparkQA commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#issuecomment-523253999 **[Test build #109450 has

[GitHub] [spark] srowen commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page

2019-08-20 Thread GitBox
srowen commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-523253084 Merged to master This is an automated message from the Apache Git Service. To

[GitHub] [spark] srowen closed pull request #25445: [SPARK-28541][WEBUI] Document Storage page

2019-08-20 Thread GitBox
srowen closed pull request #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] cloud-fan commented on a change in pull request #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

2019-08-20 Thread GitBox
cloud-fan commented on a change in pull request #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#discussion_r315963356 ## File path:

[GitHub] [spark] SparkQA commented on issue #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths

2019-08-20 Thread GitBox
SparkQA commented on issue #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths URL: https://github.com/apache/spark/pull/25348#issuecomment-523252601 **[Test build #109449 has

[GitHub] [spark] SparkQA commented on issue #25515: [SPARK-27659][PYTHON] Allow PySpark to prefetch during toLocalItr

2019-08-20 Thread GitBox
SparkQA commented on issue #25515: [SPARK-27659][PYTHON] Allow PySpark to prefetch during toLocalItr URL: https://github.com/apache/spark/pull/25515#issuecomment-523252585 **[Test build #109448 has

[GitHub] [spark] cloud-fan commented on a change in pull request #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

2019-08-20 Thread GitBox
cloud-fan commented on a change in pull request #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#discussion_r315962894 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala

[GitHub] [spark] cloud-fan commented on a change in pull request #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

2019-08-20 Thread GitBox
cloud-fan commented on a change in pull request #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#discussion_r315962976 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #25515: [SPARK-27659][PYTHON] Allow PySpark to prefetch during toLocalItr

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25515: [SPARK-27659][PYTHON] Allow PySpark to prefetch during toLocalItr URL: https://github.com/apache/spark/pull/25515#issuecomment-523252107 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths URL: https://github.com/apache/spark/pull/25348#issuecomment-523252095 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths URL: https://github.com/apache/spark/pull/25348#issuecomment-523252104 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #25515: [SPARK-27659][PYTHON] Allow PySpark to prefetch during toLocalItr

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25515: [SPARK-27659][PYTHON] Allow PySpark to prefetch during toLocalItr URL: https://github.com/apache/spark/pull/25515#issuecomment-523252097 Merged build finished. Test PASSed.

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners()

2019-08-20 Thread GitBox
HyukjinKwon commented on a change in pull request #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners() URL: https://github.com/apache/spark/pull/25518#discussion_r315962816 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths URL: https://github.com/apache/spark/pull/25348#issuecomment-523252095 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25515: [SPARK-27659][PYTHON] Allow PySpark to prefetch during toLocalItr

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25515: [SPARK-27659][PYTHON] Allow PySpark to prefetch during toLocalItr URL: https://github.com/apache/spark/pull/25515#issuecomment-523252097 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25515: [SPARK-27659][PYTHON] Allow PySpark to prefetch during toLocalItr

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25515: [SPARK-27659][PYTHON] Allow PySpark to prefetch during toLocalItr URL: https://github.com/apache/spark/pull/25515#issuecomment-523252107 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths URL: https://github.com/apache/spark/pull/25348#issuecomment-523252104 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] cloud-fan commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

2019-08-20 Thread GitBox
cloud-fan commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#issuecomment-523251380 > We know that v2 already introduces breaking behavior changes and we can't avoid them. read/write

[GitHub] [spark] maropu commented on a change in pull request #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

2019-08-20 Thread GitBox
maropu commented on a change in pull request #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#discussion_r315959198 ## File path:

[GitHub] [spark] dilipbiswal commented on a change in pull request #24759: [SPARK-27395][SQL][WIP] Improve EXPLAIN command

2019-08-20 Thread GitBox
dilipbiswal commented on a change in pull request #24759: [SPARK-27395][SQL][WIP] Improve EXPLAIN command URL: https://github.com/apache/spark/pull/24759#discussion_r315922832 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/command/commands.scala ##

[GitHub] [spark] maropu commented on a change in pull request #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

2019-08-20 Thread GitBox
maropu commented on a change in pull request #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#discussion_r315958663 ## File path:

[GitHub] [spark] maropu commented on a change in pull request #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

2019-08-20 Thread GitBox
maropu commented on a change in pull request #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#discussion_r315955141 ## File path:

[GitHub] [spark] maropu commented on a change in pull request #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

2019-08-20 Thread GitBox
maropu commented on a change in pull request #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#discussion_r315958596 ## File path:

[GitHub] [spark] maropu commented on a change in pull request #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

2019-08-20 Thread GitBox
maropu commented on a change in pull request #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#discussion_r315956635 ## File path:

[GitHub] [spark] maropu commented on a change in pull request #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

2019-08-20 Thread GitBox
maropu commented on a change in pull request #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#discussion_r315955954 ## File path:

[GitHub] [spark] holdenk commented on a change in pull request #25515: [SPARK-27659][PYTHON] Allow PySpark to prefetch during toLocalItr

2019-08-20 Thread GitBox
holdenk commented on a change in pull request #25515: [SPARK-27659][PYTHON] Allow PySpark to prefetch during toLocalItr URL: https://github.com/apache/spark/pull/25515#discussion_r315958407 ## File path: python/pyspark/sql/dataframe.py ## @@ -520,11 +520,14 @@ def

[GitHub] [spark] cloud-fan commented on issue #25239: [WIP][SPARK-28495][SQL] Table insertion: follow store assignment rules of ANSI SQL

2019-08-20 Thread GitBox
cloud-fan commented on issue #25239: [WIP][SPARK-28495][SQL] Table insertion: follow store assignment rules of ANSI SQL URL: https://github.com/apache/spark/pull/25239#issuecomment-523246234 Yes, it's blocked by #25453 This

[GitHub] [spark] rdblue commented on issue #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths

2019-08-20 Thread GitBox
rdblue commented on issue #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths URL: https://github.com/apache/spark/pull/25348#issuecomment-523242510 +1 when tests pass This is an

[GitHub] [spark] rdblue commented on a change in pull request #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths

2019-08-20 Thread GitBox
rdblue commented on a change in pull request #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths URL: https://github.com/apache/spark/pull/25348#discussion_r315952596 ## File path:

[GitHub] [spark] rdblue commented on a change in pull request #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths

2019-08-20 Thread GitBox
rdblue commented on a change in pull request #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths URL: https://github.com/apache/spark/pull/25348#discussion_r315952503 ## File path:

[GitHub] [spark] rdblue commented on a change in pull request #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths

2019-08-20 Thread GitBox
rdblue commented on a change in pull request #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths URL: https://github.com/apache/spark/pull/25348#discussion_r315952358 ## File path:

[GitHub] [spark] rdblue commented on a change in pull request #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths

2019-08-20 Thread GitBox
rdblue commented on a change in pull request #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths URL: https://github.com/apache/spark/pull/25348#discussion_r315952014 ## File path:

[GitHub] [spark] maropu commented on issue #25347: [SPARK-28610][SQL] Allow having a decimal buffer for long sum

2019-08-20 Thread GitBox
maropu commented on issue #25347: [SPARK-28610][SQL] Allow having a decimal buffer for long sum URL: https://github.com/apache/spark/pull/25347#issuecomment-523240616 SQLServer throws an exception when results overflowed? @wangyum Do you know a Oracle behaviour for that?

[GitHub] [spark] AmplabJenkins removed a comment on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners()

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners() URL: https://github.com/apache/spark/pull/25518#issuecomment-523236682 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA commented on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners()

2019-08-20 Thread GitBox
SparkQA commented on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners() URL: https://github.com/apache/spark/pull/25518#issuecomment-523237250 **[Test build #109447 has

[GitHub] [spark] maropu commented on issue #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide

2019-08-20 Thread GitBox
maropu commented on issue #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide URL: https://github.com/apache/spark/pull/25136#issuecomment-523237223 Thanks, @mgaido91! Merged to master. This is an

[GitHub] [spark] maropu closed pull request #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide

2019-08-20 Thread GitBox
maropu closed pull request #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide URL: https://github.com/apache/spark/pull/25136 This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] HeartSaVioR edited a comment on issue #19096: [SPARK-21869][SS] A cached Kafka producer should not be closed if any task is using it - adds inuse tracking.

2019-08-20 Thread GitBox
HeartSaVioR edited a comment on issue #19096: [SPARK-21869][SS] A cached Kafka producer should not be closed if any task is using it - adds inuse tracking. URL: https://github.com/apache/spark/pull/19096#issuecomment-523236896 > To say that we will never release a resource until a task

[GitHub] [spark] HeartSaVioR commented on issue #19096: [SPARK-21869][SS] A cached Kafka producer should not be closed if any task is using it - adds inuse tracking.

2019-08-20 Thread GitBox
HeartSaVioR commented on issue #19096: [SPARK-21869][SS] A cached Kafka producer should not be closed if any task is using it - adds inuse tracking. URL: https://github.com/apache/spark/pull/19096#issuecomment-523236896 > To say that we will never release a resource until a task says it's

[GitHub] [spark] AmplabJenkins removed a comment on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners()

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners() URL: https://github.com/apache/spark/pull/25518#issuecomment-523236575 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners()

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners() URL: https://github.com/apache/spark/pull/25518#issuecomment-523236682 Can one of the admins verify this patch? This

[GitHub] [spark] AmplabJenkins commented on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners()

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners() URL: https://github.com/apache/spark/pull/25518#issuecomment-523236575 Can one of the admins verify this patch? This

[GitHub] [spark] mukulmurthy commented on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners()

2019-08-20 Thread GitBox
mukulmurthy commented on issue #25518: [SPARK-26046][SS] Add StreamingQueryManager.removeAllListeners() URL: https://github.com/apache/spark/pull/25518#issuecomment-523236646 Hey @AmplabJenkins , I thought I was whitelisted :(

[GitHub] [spark] rdblue commented on a change in pull request #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths

2019-08-20 Thread GitBox
rdblue commented on a change in pull request #25348: [SPARK-28554][SQL] Adds a v1 fallback writer implementation for v2 data source codepaths URL: https://github.com/apache/spark/pull/25348#discussion_r315947600 ## File path:

[GitHub] [spark] mukulmurthy opened a new pull request #25518: [SPARK-26046][SS} Add StreamingQueryManager.removeAllListeners()

2019-08-20 Thread GitBox
mukulmurthy opened a new pull request #25518: [SPARK-26046][SS} Add StreamingQueryManager.removeAllListeners() URL: https://github.com/apache/spark/pull/25518 ### What changes were proposed in this pull request? Add a removeAllListeners() method to StreamingQueryManager that removes

[GitHub] [spark] srowen commented on a change in pull request #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network

2019-08-20 Thread GitBox
srowen commented on a change in pull request #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network URL: https://github.com/apache/spark/pull/25500#discussion_r315946854 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#issuecomment-523235225 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#issuecomment-523235223 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#issuecomment-523235225 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#issuecomment-523235223 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25489: [PYTHON][WIP] pyspark.sql.functions.col as C

2019-08-20 Thread GitBox
HyukjinKwon commented on a change in pull request #25489: [PYTHON][WIP] pyspark.sql.functions.col as C URL: https://github.com/apache/spark/pull/25489#discussion_r315945214 ## File path: python/pyspark/sql/functions.py ## @@ -315,6 +312,46 @@ def _options_to_str(options):

[GitHub] [spark] SparkQA commented on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-08-20 Thread GitBox
SparkQA commented on issue #25354: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25354#issuecomment-523234016 **[Test build #109446 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109446/testReport)** for PR 25354 at

[GitHub] [spark] AmplabJenkins removed a comment on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network URL: https://github.com/apache/spark/pull/25500#issuecomment-523233524 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network URL: https://github.com/apache/spark/pull/25500#issuecomment-523233528 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network URL: https://github.com/apache/spark/pull/25500#issuecomment-523233528 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network URL: https://github.com/apache/spark/pull/25500#issuecomment-523233524 Merged build finished. Test PASSed.

[GitHub] [spark] akirillov commented on a change in pull request #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network

2019-08-20 Thread GitBox
akirillov commented on a change in pull request #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network URL: https://github.com/apache/spark/pull/25500#discussion_r315942450 ## File path:

[GitHub] [spark] SparkQA commented on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network

2019-08-20 Thread GitBox
SparkQA commented on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network URL: https://github.com/apache/spark/pull/25500#issuecomment-523232290 **[Test build #109445 has

[GitHub] [spark] akirillov commented on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network

2019-08-20 Thread GitBox
akirillov commented on issue #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network URL: https://github.com/apache/spark/pull/25500#issuecomment-523232177 Thanks for the review, @srowen. Updated the PR to address review comments.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25507: [SPARK-28667][SQL] Support InsertInto through the V2SessionCatalog

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25507: [SPARK-28667][SQL] Support InsertInto through the V2SessionCatalog URL: https://github.com/apache/spark/pull/25507#issuecomment-523231814 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25507: [SPARK-28667][SQL] Support InsertInto through the V2SessionCatalog

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #25507: [SPARK-28667][SQL] Support InsertInto through the V2SessionCatalog URL: https://github.com/apache/spark/pull/25507#issuecomment-523231809 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #25507: [SPARK-28667][SQL] Support InsertInto through the V2SessionCatalog

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25507: [SPARK-28667][SQL] Support InsertInto through the V2SessionCatalog URL: https://github.com/apache/spark/pull/25507#issuecomment-523231814 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #25507: [SPARK-28667][SQL] Support InsertInto through the V2SessionCatalog

2019-08-20 Thread GitBox
SparkQA removed a comment on issue #25507: [SPARK-28667][SQL] Support InsertInto through the V2SessionCatalog URL: https://github.com/apache/spark/pull/25507#issuecomment-523205512 **[Test build #109434 has

[GitHub] [spark] akirillov commented on a change in pull request #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network

2019-08-20 Thread GitBox
akirillov commented on a change in pull request #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network URL: https://github.com/apache/spark/pull/25500#discussion_r315942570 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #25507: [SPARK-28667][SQL] Support InsertInto through the V2SessionCatalog

2019-08-20 Thread GitBox
AmplabJenkins commented on issue #25507: [SPARK-28667][SQL] Support InsertInto through the V2SessionCatalog URL: https://github.com/apache/spark/pull/25507#issuecomment-523231809 Merged build finished. Test FAILed. This is

[GitHub] [spark] SparkQA commented on issue #25507: [SPARK-28667][SQL] Support InsertInto through the V2SessionCatalog

2019-08-20 Thread GitBox
SparkQA commented on issue #25507: [SPARK-28667][SQL] Support InsertInto through the V2SessionCatalog URL: https://github.com/apache/spark/pull/25507#issuecomment-523231680 **[Test build #109434 has

[GitHub] [spark] akirillov commented on a change in pull request #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network

2019-08-20 Thread GitBox
akirillov commented on a change in pull request #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network URL: https://github.com/apache/spark/pull/25500#discussion_r315942450 ## File path:

[GitHub] [spark] akirillov commented on a change in pull request #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network

2019-08-20 Thread GitBox
akirillov commented on a change in pull request #25500: [SPARK-28778][MESOS] Fixed executors advertised address when running in virtual network URL: https://github.com/apache/spark/pull/25500#discussion_r315942450 ## File path:

[GitHub] [spark] SparkQA commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer

2019-08-20 Thread GitBox
SparkQA commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer URL: https://github.com/apache/spark/pull/22138#issuecomment-523230538 **[Test build #109444 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24759: [SPARK-27395][SQL][WIP] Improve EXPLAIN command

2019-08-20 Thread GitBox
AmplabJenkins removed a comment on issue #24759: [SPARK-27395][SQL][WIP] Improve EXPLAIN command URL: https://github.com/apache/spark/pull/24759#issuecomment-523228214 Test PASSed. Refer to this link for build results (access rights to CI server needed):

<    1   2   3   4   5   6   7   8   9   10   >