[GitHub] [spark] kiszk commented on a change in pull request #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour

2019-09-26 Thread GitBox
kiszk commented on a change in pull request #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#discussion_r328722232 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameFunctionsSuite.scala ## @@

[GitHub] [spark] kiszk commented on a change in pull request #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour

2019-09-26 Thread GitBox
kiszk commented on a change in pull request #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#discussion_r328722053 ## File path:

[GitHub] [spark] SparkQA commented on issue #25932: [SPARK-29250][BUILD][test-hadoop3.2][test-maven] Upgrade to Hadoop 3.2.1

2019-09-26 Thread GitBox
SparkQA commented on issue #25932: [SPARK-29250][BUILD][test-hadoop3.2][test-maven] Upgrade to Hadoop 3.2.1 URL: https://github.com/apache/spark/pull/25932#issuecomment-535593567 **[Test build #111436 has

[GitHub] [spark] kiszk commented on a change in pull request #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour

2019-09-26 Thread GitBox
kiszk commented on a change in pull request #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#discussion_r328722377 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25859: [SPARK-29142][PYTHON][ML] Pyspark clustering models support column setters/getters/predict

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25859: [SPARK-29142][PYTHON][ML] Pyspark clustering models support column setters/getters/predict URL: https://github.com/apache/spark/pull/25859#issuecomment-535603427 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25859: [SPARK-29142][PYTHON][ML] Pyspark clustering models support column setters/getters/predict

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25859: [SPARK-29142][PYTHON][ML] Pyspark clustering models support column setters/getters/predict URL: https://github.com/apache/spark/pull/25859#issuecomment-535603439 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] yaooqinn edited a comment on issue #25941: [WIP][SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle

2019-09-26 Thread GitBox
yaooqinn edited a comment on issue #25941: [WIP][SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle URL: https://github.com/apache/spark/pull/25941#issuecomment-535545941 We will not create duplicate shuffle files at all. The

[GitHub] [spark] LantaoJin opened a new pull request #25944: [SPARK-29254][SQL] Failed to include jars passed in through --jars when isolatedLoader is enabled

2019-09-26 Thread GitBox
LantaoJin opened a new pull request #25944: [SPARK-29254][SQL] Failed to include jars passed in through --jars when isolatedLoader is enabled URL: https://github.com/apache/spark/pull/25944 ### What changes were proposed in this pull request? Failed to include jars passed in through

[GitHub] [spark] SparkQA removed a comment on issue #25883: [SPARK-28476][SQL] Support ALTER DATABASE SET LOCATION

2019-09-26 Thread GitBox
SparkQA removed a comment on issue #25883: [SPARK-28476][SQL] Support ALTER DATABASE SET LOCATION URL: https://github.com/apache/spark/pull/25883#issuecomment-535463221 **[Test build #111423 has

[GitHub] [spark] rdblue commented on issue #25931: [SPARK-29249][SQL] V2 writer: Don't allow tableProperty for existing tables

2019-09-26 Thread GitBox
rdblue commented on issue #25931: [SPARK-29249][SQL] V2 writer: Don't allow tableProperty for existing tables URL: https://github.com/apache/spark/pull/25931#issuecomment-535576472 Thanks for reviewing, @cloud-fan! This is

[GitHub] [spark] Ngone51 commented on a change in pull request #25670: [SPARK-28869][CORE] Roll over event log files

2019-09-26 Thread GitBox
Ngone51 commented on a change in pull request #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#discussion_r328684993 ## File path: core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala ## @@

[GitHub] [spark] Ngone51 commented on a change in pull request #25670: [SPARK-28869][CORE] Roll over event log files

2019-09-26 Thread GitBox
Ngone51 commented on a change in pull request #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#discussion_r328706130 ## File path: core/src/main/scala/org/apache/spark/deploy/history/EventLogFileWriters.scala ## @@

[GitHub] [spark] Ngone51 commented on a change in pull request #25670: [SPARK-28869][CORE] Roll over event log files

2019-09-26 Thread GitBox
Ngone51 commented on a change in pull request #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#discussion_r328646408 ## File path: core/src/main/scala/org/apache/spark/deploy/history/EventLogFileReaders.scala ## @@

[GitHub] [spark] Ngone51 commented on a change in pull request #25670: [SPARK-28869][CORE] Roll over event log files

2019-09-26 Thread GitBox
Ngone51 commented on a change in pull request #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#discussion_r328658496 ## File path: core/src/main/scala/org/apache/spark/deploy/history/EventLogFileReaders.scala ## @@

[GitHub] [spark] Ngone51 commented on a change in pull request #25670: [SPARK-28869][CORE] Roll over event log files

2019-09-26 Thread GitBox
Ngone51 commented on a change in pull request #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#discussion_r328643158 ## File path: core/src/main/scala/org/apache/spark/deploy/history/EventLogFileReaders.scala ## @@

[GitHub] [spark] sev7e0 edited a comment on issue #25927: [SPARK-29246][CORE][TEST] Remove unnecessary imports in CoarseGrainedExecutorBackendSuite

2019-09-26 Thread GitBox
sev7e0 edited a comment on issue #25927: [SPARK-29246][CORE][TEST] Remove unnecessary imports in CoarseGrainedExecutorBackendSuite URL: https://github.com/apache/spark/pull/25927#issuecomment-535576026 Hi, @dongjoon-hyun . I have checked the imports in all the files in `core` and

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25942: [SPARK-29242][SQL][TEST] Check results of expression examples

2019-09-26 Thread GitBox
dongjoon-hyun commented on a change in pull request #25942: [SPARK-29242][SQL][TEST] Check results of expression examples URL: https://github.com/apache/spark/pull/25942#discussion_r328710559 ## File path:

[GitHub] [spark] MaxGekk commented on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples

2019-09-26 Thread GitBox
MaxGekk commented on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples URL: https://github.com/apache/spark/pull/25942#issuecomment-535586418 @dongjoon-hyun Thank you for your review. The test detects such case indirectly, actually (it should fail) ;-) I can

[GitHub] [spark] SparkQA commented on issue #25908: [SPARK-29143][PYTHON][ML] Pyspark feature models support column setters/getters

2019-09-26 Thread GitBox
SparkQA commented on issue #25908: [SPARK-29143][PYTHON][ML] Pyspark feature models support column setters/getters URL: https://github.com/apache/spark/pull/25908#issuecomment-535596590 **[Test build #111437 has

[GitHub] [spark] SparkQA removed a comment on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples

2019-09-26 Thread GitBox
SparkQA removed a comment on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples URL: https://github.com/apache/spark/pull/25942#issuecomment-535441852 **[Test build #111420 has

[GitHub] [spark] SparkQA commented on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples

2019-09-26 Thread GitBox
SparkQA commented on issue #25942: [SPARK-29242][SQL][TEST] Check results of expression examples URL: https://github.com/apache/spark/pull/25942#issuecomment-535531458 **[Test build #111420 has

[GitHub] [spark] SparkQA removed a comment on issue #25670: [SPARK-28869][CORE] Roll over event log files

2019-09-26 Thread GitBox
SparkQA removed a comment on issue #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#issuecomment-535489985 **[Test build #111426 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111426/testReport)** for

[GitHub] [spark] AmplabJenkins commented on issue #25670: [SPARK-28869][CORE] Roll over event log files

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#issuecomment-535564041 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #25670: [SPARK-28869][CORE] Roll over event log files

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#issuecomment-535564048 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] viirya commented on a change in pull request #25928: [SPARK-29259][SQL] call fs.exists only when necessary

2019-09-26 Thread GitBox
viirya commented on a change in pull request #25928: [SPARK-29259][SQL] call fs.exists only when necessary URL: https://github.com/apache/spark/pull/25928#discussion_r328688045 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25670: [SPARK-28869][CORE] Roll over event log files

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#issuecomment-535564041 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #25670: [SPARK-28869][CORE] Roll over event log files

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#issuecomment-535564048 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] srowen commented on issue #24609: [SPARK-27715][SQL][UI] SQL query details in UI does not show in correct format.

2019-09-26 Thread GitBox
srowen commented on issue #24609: [SPARK-27715][SQL][UI] SQL query details in UI does not show in correct format. URL: https://github.com/apache/spark/pull/24609#issuecomment-535568104 (I fixed the title.) This is an

[GitHub] [spark] MaxGekk commented on issue #25834: [WIP][SPARK-29155][SQL] Support special date/timestamp values in the PostgreSQL dialect only

2019-09-26 Thread GitBox
MaxGekk commented on issue #25834: [WIP][SPARK-29155][SQL] Support special date/timestamp values in the PostgreSQL dialect only URL: https://github.com/apache/spark/pull/25834#issuecomment-535567793 Please, let me know what I should do next 1. either rebase this PR or 2. open another one

[GitHub] [spark] cloud-fan commented on issue #25941: [WIP][SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle

2019-09-26 Thread GitBox
cloud-fan commented on issue #25941: [WIP][SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle URL: https://github.com/apache/spark/pull/25941#issuecomment-535575488 ok I get your point now. Please notice that, after

[GitHub] [spark] MaxGekk commented on a change in pull request #25942: [SPARK-29242][SQL][TEST] Check results of expression examples

2019-09-26 Thread GitBox
MaxGekk commented on a change in pull request #25942: [SPARK-29242][SQL][TEST] Check results of expression examples URL: https://github.com/apache/spark/pull/25942#discussion_r328707496 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25932: [SPARK-29250][BUILD][test-hadoop3.2][test-maven] Upgrade to Hadoop 3.2.1

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25932: [SPARK-29250][BUILD][test-hadoop3.2][test-maven] Upgrade to Hadoop 3.2.1 URL: https://github.com/apache/spark/pull/25932#issuecomment-535594190 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25932: [SPARK-29250][BUILD][test-hadoop3.2][test-maven] Upgrade to Hadoop 3.2.1

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25932: [SPARK-29250][BUILD][test-hadoop3.2][test-maven] Upgrade to Hadoop 3.2.1 URL: https://github.com/apache/spark/pull/25932#issuecomment-535594195 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] kiszk commented on a change in pull request #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour

2019-09-26 Thread GitBox
kiszk commented on a change in pull request #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#discussion_r328723965 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25908: [SPARK-29143][PYTHON][ML] Pyspark feature models support column setters/getters

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25908: [SPARK-29143][PYTHON][ML] Pyspark feature models support column setters/getters URL: https://github.com/apache/spark/pull/25908#issuecomment-535609337 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operati

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operati

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25940: [SPARK-29258][ML][PYSPARK] parity between ml.evaluator and mllib.metrics

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25940: [SPARK-29258][ML][PYSPARK] parity between ml.evaluator and mllib.metrics URL: https://github.com/apache/spark/pull/25940#issuecomment-535456624 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25940: [SPARK-29258][ML][PYSPARK] parity between ml.evaluator and mllib.metrics

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25940: [SPARK-29258][ML][PYSPARK] parity between ml.evaluator and mllib.metrics URL: https://github.com/apache/spark/pull/25940#issuecomment-535456632 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] wangyum commented on a change in pull request #25883: [SPARK-28476][SQL] Support ALTER DATABASE SET LOCATION

2019-09-26 Thread GitBox
wangyum commented on a change in pull request #25883: [SPARK-28476][SQL] Support ALTER DATABASE SET LOCATION URL: https://github.com/apache/spark/pull/25883#discussion_r328569925 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala

[GitHub] [spark] wangyum commented on a change in pull request #25883: [SPARK-28476][SQL] Support ALTER DATABASE SET LOCATION

2019-09-26 Thread GitBox
wangyum commented on a change in pull request #25883: [SPARK-28476][SQL] Support ALTER DATABASE SET LOCATION URL: https://github.com/apache/spark/pull/25883#discussion_r328569977 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/client/VersionsSuite.scala ##

[GitHub] [spark] AmplabJenkins commented on issue #25883: [SPARK-28476][SQL] Support ALTER DATABASE SET LOCATION

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25883: [SPARK-28476][SQL] Support ALTER DATABASE SET LOCATION URL: https://github.com/apache/spark/pull/25883#issuecomment-535463586 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25883: [SPARK-28476][SQL] Support ALTER DATABASE SET LOCATION

2019-09-26 Thread GitBox
SparkQA commented on issue #25883: [SPARK-28476][SQL] Support ALTER DATABASE SET LOCATION URL: https://github.com/apache/spark/pull/25883#issuecomment-535463221 **[Test build #111423 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111423/testReport)** for

[GitHub] [spark] AmplabJenkins removed a comment on issue #25883: [SPARK-28476][SQL] Support ALTER DATABASE SET LOCATION

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25883: [SPARK-28476][SQL] Support ALTER DATABASE SET LOCATION URL: https://github.com/apache/spark/pull/25883#issuecomment-535463586 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25883: [SPARK-28476][SQL] Support ALTER DATABASE SET LOCATION

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25883: [SPARK-28476][SQL] Support ALTER DATABASE SET LOCATION URL: https://github.com/apache/spark/pull/25883#issuecomment-535463579 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25883: [SPARK-28476][SQL] Support ALTER DATABASE SET LOCATION

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25883: [SPARK-28476][SQL] Support ALTER DATABASE SET LOCATION URL: https://github.com/apache/spark/pull/25883#issuecomment-535463579 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities.

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities. URL: https://github.com/apache/spark/pull/25933#issuecomment-535470565 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities.

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities. URL: https://github.com/apache/spark/pull/25933#issuecomment-535470572 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25936: [SPARK-29255][SQL][TESTS] Rename package pgSQL to postgreSQL

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25936: [SPARK-29255][SQL][TESTS] Rename package pgSQL to postgreSQL URL: https://github.com/apache/spark/pull/25936#issuecomment-535476818 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25936: [SPARK-29255][SQL][TESTS] Rename package pgSQL to postgreSQL

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25936: [SPARK-29255][SQL][TESTS] Rename package pgSQL to postgreSQL URL: https://github.com/apache/spark/pull/25936#issuecomment-535476825 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] wangyum commented on issue #25936: [SPARK-29255][SQL][TESTS] Rename package pgSQL to postgreSQL

2019-09-26 Thread GitBox
wangyum commented on issue #25936: [SPARK-29255][SQL][TESTS] Rename package pgSQL to postgreSQL URL: https://github.com/apache/spark/pull/25936#issuecomment-535482760 Merged to master. This is an automated message from the

[GitHub] [spark] SparkQA commented on issue #25670: [SPARK-28869][CORE] Roll over event log files

2019-09-26 Thread GitBox
SparkQA commented on issue #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#issuecomment-535489985 **[Test build #111426 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111426/testReport)** for PR 25670

[GitHub] [spark] AmplabJenkins commented on issue #25940: [SPARK-29258][ML][PYSPARK] parity between ml.evaluator and mllib.metrics

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25940: [SPARK-29258][ML][PYSPARK] parity between ml.evaluator and mllib.metrics URL: https://github.com/apache/spark/pull/25940#issuecomment-535495620 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #25940: [SPARK-29258][ML][PYSPARK] parity between ml.evaluator and mllib.metrics

2019-09-26 Thread GitBox
SparkQA removed a comment on issue #25940: [SPARK-29258][ML][PYSPARK] parity between ml.evaluator and mllib.metrics URL: https://github.com/apache/spark/pull/25940#issuecomment-535472248 **[Test build #111424 has

[GitHub] [spark] SparkQA commented on issue #25940: [SPARK-29258][ML][PYSPARK] parity between ml.evaluator and mllib.metrics

2019-09-26 Thread GitBox
SparkQA commented on issue #25940: [SPARK-29258][ML][PYSPARK] parity between ml.evaluator and mllib.metrics URL: https://github.com/apache/spark/pull/25940#issuecomment-535495141 **[Test build #111424 has

[GitHub] [spark] AmplabJenkins commented on issue #25940: [SPARK-29258][ML][PYSPARK] parity between ml.evaluator and mllib.metrics

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25940: [SPARK-29258][ML][PYSPARK] parity between ml.evaluator and mllib.metrics URL: https://github.com/apache/spark/pull/25940#issuecomment-535495624 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] srowen commented on a change in pull request #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities.

2019-09-26 Thread GitBox
srowen commented on a change in pull request #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities. URL: https://github.com/apache/spark/pull/25933#discussion_r328603765 ## File path: pom.xml ## @@ -125,7 +125,7 @@ 2.7.4 2.5.0

[GitHub] [spark] srowen commented on a change in pull request #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities.

2019-09-26 Thread GitBox
srowen commented on a change in pull request #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities. URL: https://github.com/apache/spark/pull/25933#discussion_r328604897 ## File path: dev/deps/spark-deps-hadoop-2.7 ## @@ -20,6 +20,7 @@

[GitHub] [spark] srowen commented on a change in pull request #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities.

2019-09-26 Thread GitBox
srowen commented on a change in pull request #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities. URL: https://github.com/apache/spark/pull/25933#discussion_r328605927 ## File path: dev/deps/spark-deps-hadoop-3.2 ## @@ -211,6 +211,7 @@

[GitHub] [spark] srowen commented on issue #25937: [SPARK-29256][DOCS] Fix typo in building document

2019-09-26 Thread GitBox
srowen commented on issue #25937: [SPARK-29256][DOCS] Fix typo in building document URL: https://github.com/apache/spark/pull/25937#issuecomment-535500169 Merged to master. You don't need a JIRA for MINOR issues This is an

[GitHub] [spark] cloud-fan commented on a change in pull request #25651: [SPARK-28948][SQL] Support passing all Table metadata in TableProvider

2019-09-26 Thread GitBox
cloud-fan commented on a change in pull request #25651: [SPARK-28948][SQL] Support passing all Table metadata in TableProvider URL: https://github.com/apache/spark/pull/25651#discussion_r328626270 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #25849: [SPARK-29175][SQL] Make additional remote maven repository in IsolatedClientLoader configurable

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25849: [SPARK-29175][SQL] Make additional remote maven repository in IsolatedClientLoader configurable URL: https://github.com/apache/spark/pull/25849#issuecomment-535520509 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25849: [SPARK-29175][SQL] Make additional remote maven repository in IsolatedClientLoader configurable

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25849: [SPARK-29175][SQL] Make additional remote maven repository in IsolatedClientLoader configurable URL: https://github.com/apache/spark/pull/25849#issuecomment-535520537 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations writ

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL:

[GitHub] [spark] AmplabJenkins commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations writ

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL:

[GitHub] [spark] tomasbartalos commented on issue #23749: [SPARK-26841][SQL] Kafka timestamp pushdown

2019-09-26 Thread GitBox
tomasbartalos commented on issue #23749: [SPARK-26841][SQL] Kafka timestamp pushdown URL: https://github.com/apache/spark/pull/23749#issuecomment-535455763 Hello, can anyone review this patch ? @jose-torres did initial review and all the requirements have been solved.

[GitHub] [spark] SparkQA commented on issue #25940: [SPARK-29258][ML][PYSPARK] parity between ml.evaluator and mllib.metrics

2019-09-26 Thread GitBox
SparkQA commented on issue #25940: [SPARK-29258][ML][PYSPARK] parity between ml.evaluator and mllib.metrics URL: https://github.com/apache/spark/pull/25940#issuecomment-535456123 **[Test build #111422 has

[GitHub] [spark] SparkQA commented on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect`

2019-09-26 Thread GitBox
SparkQA commented on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect` URL: https://github.com/apache/spark/pull/25697#issuecomment-535459801 **[Test build #111401 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111401/testReport)** for PR 25697 at

[GitHub] [spark] SparkQA removed a comment on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect`

2019-09-26 Thread GitBox
SparkQA removed a comment on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect` URL: https://github.com/apache/spark/pull/25697#issuecomment-535372868 **[Test build #111401 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111401/testReport)** for PR

[GitHub] [spark] AmplabJenkins removed a comment on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect`

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect` URL: https://github.com/apache/spark/pull/25697#issuecomment-535460406 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect`

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect` URL: https://github.com/apache/spark/pull/25697#issuecomment-535460399 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect`

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect` URL: https://github.com/apache/spark/pull/25697#issuecomment-535460399 Merged build finished. Test PASSed. This is an automated message from

[GitHub] [spark] wangyum closed pull request #25938: [SPARK-29203][SQL][TESTS][2.4] Reduce shuffle partitions in SQLQueryTestSuite

2019-09-26 Thread GitBox
wangyum closed pull request #25938: [SPARK-29203][SQL][TESTS][2.4] Reduce shuffle partitions in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25938 This is an automated message from the Apache Git Service. To

[GitHub] [spark] wangyum commented on issue #25938: [SPARK-29203][SQL][TESTS][2.4] Reduce shuffle partitions in SQLQueryTestSuite

2019-09-26 Thread GitBox
wangyum commented on issue #25938: [SPARK-29203][SQL][TESTS][2.4] Reduce shuffle partitions in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25938#issuecomment-535463169 Merged to branch-2.4. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities.

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities. URL: https://github.com/apache/spark/pull/25933#issuecomment-535470572 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities.

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities. URL: https://github.com/apache/spark/pull/25933#issuecomment-535470565 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities.

2019-09-26 Thread GitBox
SparkQA removed a comment on issue #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities. URL: https://github.com/apache/spark/pull/25933#issuecomment-535423425 **[Test build #111418 has

[GitHub] [spark] wangyum closed pull request #25936: [SPARK-29255][SQL][TESTS] Rename package pgSQL to postgreSQL

2019-09-26 Thread GitBox
wangyum closed pull request #25936: [SPARK-29255][SQL][TESTS] Rename package pgSQL to postgreSQL URL: https://github.com/apache/spark/pull/25936 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins commented on issue #25943: [WIP][SPARK-29261][SQL][CORE] Support recover live entities from KVStore for (SQL)AppStatusListener

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25943: [WIP][SPARK-29261][SQL][CORE] Support recover live entities from KVStore for (SQL)AppStatusListener URL: https://github.com/apache/spark/pull/25943#issuecomment-535487728 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] gengliangwang commented on issue #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table"

2019-09-26 Thread GitBox
gengliangwang commented on issue #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table" URL: https://github.com/apache/spark/pull/24938#issuecomment-535487729 cc @gatorsmile This is an

[GitHub] [spark] AmplabJenkins commented on issue #25943: [WIP][SPARK-29261][SQL][CORE] Support recover live entities from KVStore for (SQL)AppStatusListener

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25943: [WIP][SPARK-29261][SQL][CORE] Support recover live entities from KVStore for (SQL)AppStatusListener URL: https://github.com/apache/spark/pull/25943#issuecomment-535487722 Merged build finished. Test PASSed.

[GitHub] [spark] cloud-fan commented on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect`

2019-09-26 Thread GitBox
cloud-fan commented on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect` URL: https://github.com/apache/spark/pull/25697#issuecomment-535491126 thanks, merging to master! This is an automated message from the Apache

[GitHub] [spark] cloud-fan closed pull request #25697: [SPARK-28997][SQL] Add `spark.sql.dialect`

2019-09-26 Thread GitBox
cloud-fan closed pull request #25697: [SPARK-28997][SQL] Add `spark.sql.dialect` URL: https://github.com/apache/spark/pull/25697 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [spark] SparkQA commented on issue #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic

2019-09-26 Thread GitBox
SparkQA commented on issue #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic URL: https://github.com/apache/spark/pull/25747#issuecomment-535501792 **[Test build #111427 has

[GitHub] [spark] xmubeta commented on issue #14430: [SPARK-16825] [SQL] Replace hive.default.fileformat by spark.sql.default.fileformat

2019-09-26 Thread GitBox
xmubeta commented on issue #14430: [SPARK-16825] [SQL] Replace hive.default.fileformat by spark.sql.default.fileformat URL: https://github.com/apache/spark/pull/14430#issuecomment-535518143 Please bear me if my question is silly. I have the same request to set the default file

[GitHub] [spark] AmplabJenkins removed a comment on issue #25869: [SPARK-29189][SQL] Add an option to ignore block locations when listing file

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25869: [SPARK-29189][SQL] Add an option to ignore block locations when listing file URL: https://github.com/apache/spark/pull/25869#issuecomment-535523238 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25869: [SPARK-29189][SQL] Add an option to ignore block locations when listing file

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25869: [SPARK-29189][SQL] Add an option to ignore block locations when listing file URL: https://github.com/apache/spark/pull/25869#issuecomment-535523221 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25869: [SPARK-29189][SQL] Add an option to ignore block locations when listing file

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25869: [SPARK-29189][SQL] Add an option to ignore block locations when listing file URL: https://github.com/apache/spark/pull/25869#issuecomment-535523238 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25869: [SPARK-29189][SQL] Add an option to ignore block locations when listing file

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25869: [SPARK-29189][SQL] Add an option to ignore block locations when listing file URL: https://github.com/apache/spark/pull/25869#issuecomment-535523221 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25939: [SPARK-27463][PYTHON][FOLLOW-UP] Miscellaneous documentation and code cleanup of cogroup pandas UDF

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25939: [SPARK-27463][PYTHON][FOLLOW-UP] Miscellaneous documentation and code cleanup of cogroup pandas UDF URL: https://github.com/apache/spark/pull/25939#issuecomment-535526847 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #25939: [SPARK-27463][PYTHON][FOLLOW-UP] Miscellaneous documentation and code cleanup of cogroup pandas UDF

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25939: [SPARK-27463][PYTHON][FOLLOW-UP] Miscellaneous documentation and code cleanup of cogroup pandas UDF URL: https://github.com/apache/spark/pull/25939#issuecomment-535526835 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25939: [SPARK-27463][PYTHON][FOLLOW-UP] Miscellaneous documentation and code cleanup of cogroup pandas UDF

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25939: [SPARK-27463][PYTHON][FOLLOW-UP] Miscellaneous documentation and code cleanup of cogroup pandas UDF URL: https://github.com/apache/spark/pull/25939#issuecomment-535526835 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25939: [SPARK-27463][PYTHON][FOLLOW-UP] Miscellaneous documentation and code cleanup of cogroup pandas UDF

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25939: [SPARK-27463][PYTHON][FOLLOW-UP] Miscellaneous documentation and code cleanup of cogroup pandas UDF URL: https://github.com/apache/spark/pull/25939#issuecomment-535526847 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] SparkQA commented on issue #25869: [SPARK-29189][SQL] Add an option to ignore block locations when listing file

2019-09-26 Thread GitBox
SparkQA commented on issue #25869: [SPARK-29189][SQL] Add an option to ignore block locations when listing file URL: https://github.com/apache/spark/pull/25869#issuecomment-535526320 **[Test build #111429 has

[GitHub] [spark] SparkQA removed a comment on issue #25941: [WIP][SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle

2019-09-26 Thread GitBox
SparkQA removed a comment on issue #25941: [WIP][SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle URL: https://github.com/apache/spark/pull/25941#issuecomment-535406010 **[Test build #111413 has

[GitHub] [spark] SparkQA removed a comment on issue #25941: [WIP][SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle

2019-09-26 Thread GitBox
SparkQA removed a comment on issue #25941: [WIP][SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle URL: https://github.com/apache/spark/pull/25941#issuecomment-535408959 **[Test build #111414 has

[GitHub] [spark] SparkQA commented on issue #25941: [WIP][SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle

2019-09-26 Thread GitBox
SparkQA commented on issue #25941: [WIP][SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle URL: https://github.com/apache/spark/pull/25941#issuecomment-535450177 **[Test build #111414 has

[GitHub] [spark] AmplabJenkins commented on issue #25941: [WIP][SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25941: [WIP][SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle URL: https://github.com/apache/spark/pull/25941#issuecomment-535450488 Test FAILed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins commented on issue #25941: [WIP][SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25941: [WIP][SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle URL: https://github.com/apache/spark/pull/25941#issuecomment-535450475 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #25941: [WIP][SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle

2019-09-26 Thread GitBox
SparkQA commented on issue #25941: [WIP][SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle URL: https://github.com/apache/spark/pull/25941#issuecomment-535450254 **[Test build #111413 has

<    1   2   3   4   5   6   7   8   9   10   >