[GitHub] [spark] wangyum commented on a change in pull request #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4

2019-03-27 Thread GitBox
wangyum commented on a change in pull request #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4 URL: https://github.com/apache/spark/pull/23788#discussion_r269870723 ## File path: pom.xml ## @@ -1762,6 +1833,11 @@ org.code

[GitHub] [spark] kiszk commented on issue #20965: [SPARK-21870][SQL] Split aggregation code into small functions

2019-03-27 Thread GitBox
kiszk commented on issue #20965: [SPARK-21870][SQL] Split aggregation code into small functions URL: https://github.com/apache/spark/pull/20965#issuecomment-477466558 Some people want to address the IR codegen as a long term approach to improve performance, too. I agree that this is

[GitHub] [spark] felixcheung commented on a change in pull request #24195: [SPARK-25496][SQL] Deprecate from_utc_timestamp and to_utc_timestamp

2019-03-27 Thread GitBox
felixcheung commented on a change in pull request #24195: [SPARK-25496][SQL] Deprecate from_utc_timestamp and to_utc_timestamp URL: https://github.com/apache/spark/pull/24195#discussion_r269868529 ## File path: R/pkg/R/functions.R ## @@ -2517,6 +2518,7 @@ setMethod("next_d

[GitHub] [spark] felixcheung commented on a change in pull request #24195: [SPARK-25496][SQL] Deprecate from_utc_timestamp and to_utc_timestamp

2019-03-27 Thread GitBox
felixcheung commented on a change in pull request #24195: [SPARK-25496][SQL] Deprecate from_utc_timestamp and to_utc_timestamp URL: https://github.com/apache/spark/pull/24195#discussion_r269868511 ## File path: R/pkg/R/functions.R ## @@ -2459,6 +2459,7 @@ setMethod("schema

[GitHub] [spark] wangyum commented on a change in pull request #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4

2019-03-27 Thread GitBox
wangyum commented on a change in pull request #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4 URL: https://github.com/apache/spark/pull/23788#discussion_r269867575 ## File path: pom.xml ## @@ -1414,6 +1414,23 @@ commons-

[GitHub] [spark] wangyum commented on a change in pull request #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4

2019-03-27 Thread GitBox
wangyum commented on a change in pull request #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4 URL: https://github.com/apache/spark/pull/23788#discussion_r269867575 ## File path: pom.xml ## @@ -1414,6 +1414,23 @@ commons-

[GitHub] [spark] EshwarSR commented on issue #24230: [SPARK-27295][GraphX] Provision to provide the initial scores for source nodes while running Personalized Page Rank

2019-03-27 Thread GitBox
EshwarSR commented on issue #24230: [SPARK-27295][GraphX] Provision to provide the initial scores for source nodes while running Personalized Page Rank URL: https://github.com/apache/spark/pull/24230#issuecomment-477461391 I have added a new API with the same name. I tried avoiding the priv

[GitHub] [spark] SparkQA commented on issue #24222: [MINOR] Move java file to java directory

2019-03-27 Thread GitBox
SparkQA commented on issue #24222: [MINOR] Move java file to java directory URL: https://github.com/apache/spark/pull/24222#issuecomment-477458508 **[Test build #104038 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104038/testReport)** for PR 24222 at comm

[GitHub] [spark] AmplabJenkins removed a comment on issue #24222: [MINOR] Move java file to java directory

2019-03-27 Thread GitBox
AmplabJenkins removed a comment on issue #24222: [MINOR] Move java file to java directory URL: https://github.com/apache/spark/pull/24222#issuecomment-477458086 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #24222: [MINOR] Move java file to java directory

2019-03-27 Thread GitBox
AmplabJenkins commented on issue #24222: [MINOR] Move java file to java directory URL: https://github.com/apache/spark/pull/24222#issuecomment-477458090 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job

[GitHub] [spark] AmplabJenkins commented on issue #24222: [MINOR] Move java file to java directory

2019-03-27 Thread GitBox
AmplabJenkins commented on issue #24222: [MINOR] Move java file to java directory URL: https://github.com/apache/spark/pull/24222#issuecomment-477458086 Merged build finished. Test PASSed. This is an automated message from th

[GitHub] [spark] AmplabJenkins removed a comment on issue #24222: [MINOR] Move java file to java directory

2019-03-27 Thread GitBox
AmplabJenkins removed a comment on issue #24222: [MINOR] Move java file to java directory URL: https://github.com/apache/spark/pull/24222#issuecomment-477458090 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenk

[GitHub] [spark] ConeyLiu commented on issue #24222: [MINOR] Move java file to java directory

2019-03-27 Thread GitBox
ConeyLiu commented on issue #24222: [MINOR] Move java file to java directory URL: https://github.com/apache/spark/pull/24222#issuecomment-477457210 thanks @cloud-fan, just move those files to java directory. Hi @srowen, `Offset.java` already under java directory. ---

[GitHub] [spark] SparkQA commented on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2

2019-03-27 Thread GitBox
SparkQA commented on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2 URL: https://github.com/apache/spark/pull/24233#issuecomment-477451979 **[Test build #104037 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104037/testReport)** for P

[GitHub] [spark] AmplabJenkins removed a comment on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2

2019-03-27 Thread GitBox
AmplabJenkins removed a comment on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2 URL: https://github.com/apache/spark/pull/24233#issuecomment-477451604 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.ber

[GitHub] [spark] AmplabJenkins removed a comment on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2

2019-03-27 Thread GitBox
AmplabJenkins removed a comment on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2 URL: https://github.com/apache/spark/pull/24233#issuecomment-477451602 Merged build finished. Test PASSed. This is an aut

[GitHub] [spark] AmplabJenkins commented on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2

2019-03-27 Thread GitBox
AmplabJenkins commented on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2 URL: https://github.com/apache/spark/pull/24233#issuecomment-477451602 Merged build finished. Test PASSed. This is an automated m

[GitHub] [spark] AmplabJenkins commented on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2

2019-03-27 Thread GitBox
AmplabJenkins commented on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2 URL: https://github.com/apache/spark/pull/24233#issuecomment-477451604 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.ed

[GitHub] [spark] AmplabJenkins removed a comment on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2

2019-03-27 Thread GitBox
AmplabJenkins removed a comment on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2 URL: https://github.com/apache/spark/pull/24233#issuecomment-477449497 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berk

[GitHub] [spark] AmplabJenkins removed a comment on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2

2019-03-27 Thread GitBox
AmplabJenkins removed a comment on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2 URL: https://github.com/apache/spark/pull/24233#issuecomment-477449494 Merged build finished. Test FAILed. This is an aut

[GitHub] [spark] AmplabJenkins commented on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2

2019-03-27 Thread GitBox
AmplabJenkins commented on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2 URL: https://github.com/apache/spark/pull/24233#issuecomment-477449497 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu

[GitHub] [spark] wangyum commented on a change in pull request #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4

2019-03-27 Thread GitBox
wangyum commented on a change in pull request #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4 URL: https://github.com/apache/spark/pull/23788#discussion_r269858264 ## File path: pom.xml ## @@ -1414,6 +1414,23 @@ commons-

[GitHub] [spark] SparkQA removed a comment on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2

2019-03-27 Thread GitBox
SparkQA removed a comment on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2 URL: https://github.com/apache/spark/pull/24233#issuecomment-477447429 **[Test build #104036 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104036/testReport)*

[GitHub] [spark] AmplabJenkins commented on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2

2019-03-27 Thread GitBox
AmplabJenkins commented on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2 URL: https://github.com/apache/spark/pull/24233#issuecomment-477449494 Merged build finished. Test FAILed. This is an automated m

[GitHub] [spark] SparkQA removed a comment on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas

2019-03-27 Thread GitBox
SparkQA removed a comment on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas URL: https://github.com/apache/spark/pull/24234#issuecomment-477447430 **[Test build #104035 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104035/tes

[GitHub] [spark] AmplabJenkins removed a comment on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas

2019-03-27 Thread GitBox
AmplabJenkins removed a comment on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas URL: https://github.com/apache/spark/pull/24234#issuecomment-477449282 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] SparkQA commented on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2

2019-03-27 Thread GitBox
SparkQA commented on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2 URL: https://github.com/apache/spark/pull/24233#issuecomment-477449475 **[Test build #104036 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104036/testReport)** for

[GitHub] [spark] AmplabJenkins removed a comment on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas

2019-03-27 Thread GitBox
AmplabJenkins removed a comment on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas URL: https://github.com/apache/spark/pull/24234#issuecomment-477449277 Merged build finished. Test PASSed. This

[GitHub] [spark] SparkQA commented on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas

2019-03-27 Thread GitBox
SparkQA commented on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas URL: https://github.com/apache/spark/pull/24234#issuecomment-477449222 **[Test build #104035 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104035/testReport

[GitHub] [spark] AmplabJenkins commented on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas

2019-03-27 Thread GitBox
AmplabJenkins commented on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas URL: https://github.com/apache/spark/pull/24234#issuecomment-477449282 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.ber

[GitHub] [spark] AmplabJenkins commented on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas

2019-03-27 Thread GitBox
AmplabJenkins commented on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas URL: https://github.com/apache/spark/pull/24234#issuecomment-477449277 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] wangyum commented on a change in pull request #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4

2019-03-27 Thread GitBox
wangyum commented on a change in pull request #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4 URL: https://github.com/apache/spark/pull/23788#discussion_r269857350 ## File path: pom.xml ## @@ -1532,6 +1549,31 @@ org.json

[GitHub] [spark] wangyum commented on a change in pull request #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4

2019-03-27 Thread GitBox
wangyum commented on a change in pull request #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4 URL: https://github.com/apache/spark/pull/23788#discussion_r269857395 ## File path: pom.xml ## @@ -1697,6 +1739,35 @@ org.code

[GitHub] [spark] HyukjinKwon edited a comment on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas

2019-03-27 Thread GitBox
HyukjinKwon edited a comment on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas URL: https://github.com/apache/spark/pull/24234#issuecomment-477447661 Hi, @gatorsmile, @BryanCutler, @ueshin, @rxin, @viirya, @thunterdb I realised the difference is too va

[GitHub] [spark] HyukjinKwon commented on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas

2019-03-27 Thread GitBox
HyukjinKwon commented on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas URL: https://github.com/apache/spark/pull/24234#issuecomment-477447950 adding @srowen too. This is an automated message fr

[GitHub] [spark] HyukjinKwon commented on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas

2019-03-27 Thread GitBox
HyukjinKwon commented on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas URL: https://github.com/apache/spark/pull/24234#issuecomment-477447928 Please let me know if you guys have some opinion about 1. Deduction or addition of a topic 2. General comme

[GitHub] [spark] AmplabJenkins removed a comment on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas

2019-03-27 Thread GitBox
AmplabJenkins removed a comment on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas URL: https://github.com/apache/spark/pull/24234#issuecomment-477447073 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] HyukjinKwon commented on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas

2019-03-27 Thread GitBox
HyukjinKwon commented on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas URL: https://github.com/apache/spark/pull/24234#issuecomment-477447661 Hi, @gatorsmile, @BryanCutler, @ueshin, @rxin, @viirya, @thunterdb I realised the difference is too vast so I

[GitHub] [spark] AmplabJenkins removed a comment on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas

2019-03-27 Thread GitBox
AmplabJenkins removed a comment on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas URL: https://github.com/apache/spark/pull/24234#issuecomment-477447070 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2

2019-03-27 Thread GitBox
AmplabJenkins removed a comment on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2 URL: https://github.com/apache/spark/pull/24233#issuecomment-477447108 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.ber

[GitHub] [spark] AmplabJenkins removed a comment on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2

2019-03-27 Thread GitBox
AmplabJenkins removed a comment on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2 URL: https://github.com/apache/spark/pull/24233#issuecomment-477447104 Merged build finished. Test PASSed. This is an aut

[GitHub] [spark] SparkQA commented on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2

2019-03-27 Thread GitBox
SparkQA commented on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2 URL: https://github.com/apache/spark/pull/24233#issuecomment-477447429 **[Test build #104036 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104036/testReport)** for P

[GitHub] [spark] SparkQA commented on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas

2019-03-27 Thread GitBox
SparkQA commented on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas URL: https://github.com/apache/spark/pull/24234#issuecomment-477447430 **[Test build #104035 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104035/testReport)

[GitHub] [spark] AmplabJenkins commented on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2

2019-03-27 Thread GitBox
AmplabJenkins commented on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2 URL: https://github.com/apache/spark/pull/24233#issuecomment-477447104 Merged build finished. Test PASSed. This is an automated m

[GitHub] [spark] AmplabJenkins commented on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas

2019-03-27 Thread GitBox
AmplabJenkins commented on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas URL: https://github.com/apache/spark/pull/24234#issuecomment-477447073 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins commented on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2

2019-03-27 Thread GitBox
AmplabJenkins commented on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2 URL: https://github.com/apache/spark/pull/24233#issuecomment-477447108 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.ed

[GitHub] [spark] AmplabJenkins commented on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas

2019-03-27 Thread GitBox
AmplabJenkins commented on issue #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas URL: https://github.com/apache/spark/pull/24234#issuecomment-477447070 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] cloud-fan commented on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2

2019-03-27 Thread GitBox
cloud-fan commented on issue #24233: [SPARK-26356][SQL] remove SaveMode from data source v2 URL: https://github.com/apache/spark/pull/24233#issuecomment-477446769 cc @rdblue @gengliangwang @gatorsmile This is an automated me

[GitHub] [spark] cloud-fan commented on a change in pull request #24233: [SPARK-26356][SQL] remove SaveMode from data source v2

2019-03-27 Thread GitBox
cloud-fan commented on a change in pull request #24233: [SPARK-26356][SQL] remove SaveMode from data source v2 URL: https://github.com/apache/spark/pull/24233#discussion_r269856104 ## File path: sql/core/src/test/scala/org/apache/spark/sql/sources/v2/DataSourceV2Suite.scala ##

[GitHub] [spark] HyukjinKwon opened a new pull request #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas

2019-03-27 Thread GitBox
HyukjinKwon opened a new pull request #24234: [WIP][SPARK_26022][PYTHON][DOCS] PySpark Comparison with Pandas URL: https://github.com/apache/spark/pull/24234 ## What changes were proposed in this pull request? This is WIP. I think I should collect some feedback on this. * Over

[GitHub] [spark] cloud-fan opened a new pull request #24233: [SPARK-26356][SQL] remove SaveMode from data source v2

2019-03-27 Thread GitBox
cloud-fan opened a new pull request #24233: [SPARK-26356][SQL] remove SaveMode from data source v2 URL: https://github.com/apache/spark/pull/24233 ## What changes were proposed in this pull request? In data source v1, save mode specified in `DataFrameWriter` is passed to data source

[GitHub] [spark] AmplabJenkins removed a comment on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory

2019-03-27 Thread GitBox
AmplabJenkins removed a comment on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory URL: https://github.com/apache/spark/pull/23841#issuecomment-477444348 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory

2019-03-27 Thread GitBox
AmplabJenkins commented on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory URL: https://github.com/apache/spark/pull/23841#issuecomment-477444348 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory

2019-03-27 Thread GitBox
AmplabJenkins removed a comment on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory URL: https://github.com/apache/spark/pull/23841#issuecomment-477444349 Test PASSed. Refer to this link for build results (ac

[GitHub] [spark] AmplabJenkins commented on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory

2019-03-27 Thread GitBox
AmplabJenkins commented on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory URL: https://github.com/apache/spark/pull/23841#issuecomment-477444349 Test PASSed. Refer to this link for build results (access righ

[GitHub] [spark] SparkQA removed a comment on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory

2019-03-27 Thread GitBox
SparkQA removed a comment on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory URL: https://github.com/apache/spark/pull/23841#issuecomment-477415195 **[Test build #104033 has started](https://amplab.cs.berkeley.

[GitHub] [spark] SparkQA commented on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory

2019-03-27 Thread GitBox
SparkQA commented on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory URL: https://github.com/apache/spark/pull/23841#issuecomment-477444098 **[Test build #104033 has finished](https://amplab.cs.berkeley.edu/jen

[GitHub] [spark] cloud-fan commented on a change in pull request #24118: [SPARK-26736][SQL] if filter condition `And` has non-determined sub function it does not do partition prunning

2019-03-27 Thread GitBox
cloud-fan commented on a change in pull request #24118: [SPARK-26736][SQL] if filter condition `And` has non-determined sub function it does not do partition prunning URL: https://github.com/apache/spark/pull/24118#discussion_r269848499 ## File path: sql/catalyst/src/main/scala/or

[GitHub] [spark] AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-03-27 Thread GitBox
AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-477435724 Can one of the admins verify this patch? This

[GitHub] [spark] SparkQA commented on issue #24231: [minor] remove import scala.collection.Set in TaskSchedulerImpl

2019-03-27 Thread GitBox
SparkQA commented on issue #24231: [minor] remove import scala.collection.Set in TaskSchedulerImpl URL: https://github.com/apache/spark/pull/24231#issuecomment-477436163 **[Test build #104034 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104034/testReport)

[GitHub] [spark] AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-03-27 Thread GitBox
AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-477436102 Can one of the admins verify this patch? This is an a

[GitHub] [spark] AmplabJenkins removed a comment on issue #24231: [minor] remove import scala.collection.Set in TaskSchedulerImpl

2019-03-27 Thread GitBox
AmplabJenkins removed a comment on issue #24231: [minor] remove import scala.collection.Set in TaskSchedulerImpl URL: https://github.com/apache/spark/pull/24231#issuecomment-477435832 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24231: [minor] remove import scala.collection.Set in TaskSchedulerImpl

2019-03-27 Thread GitBox
AmplabJenkins removed a comment on issue #24231: [minor] remove import scala.collection.Set in TaskSchedulerImpl URL: https://github.com/apache/spark/pull/24231#issuecomment-477435839 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins commented on issue #24231: [minor] remove import scala.collection.Set in TaskSchedulerImpl

2019-03-27 Thread GitBox
AmplabJenkins commented on issue #24231: [minor] remove import scala.collection.Set in TaskSchedulerImpl URL: https://github.com/apache/spark/pull/24231#issuecomment-477435839 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins commented on issue #24231: [minor] remove import scala.collection.Set in TaskSchedulerImpl

2019-03-27 Thread GitBox
AmplabJenkins commented on issue #24231: [minor] remove import scala.collection.Set in TaskSchedulerImpl URL: https://github.com/apache/spark/pull/24231#issuecomment-477435832 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-03-27 Thread GitBox
AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-477435724 Can one of the admins verify this patch? This is an a

[GitHub] [spark] AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-03-27 Thread GitBox
AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-477435639 Can one of the admins verify this patch? This is an a

[GitHub] [spark] AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-03-27 Thread GitBox
AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-477435639 Can one of the admins verify this patch? This

[GitHub] [spark] nvander1 opened a new pull request #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

2019-03-27 Thread GitBox
nvander1 opened a new pull request #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232 ## What changes were proposed in this pull request? There is currently no existing Scala API equivalent for the higher order functio

[GitHub] [spark] maropu commented on issue #24212: [SPARK-26771][SQL][FOLLOWUP] Make all the uncache operations non-blocking by default

2019-03-27 Thread GitBox
maropu commented on issue #24212: [SPARK-26771][SQL][FOLLOWUP] Make all the uncache operations non-blocking by default URL: https://github.com/apache/spark/pull/24212#issuecomment-477431257 ok This is an automated message fro

[GitHub] [spark] HeartSaVioR commented on a change in pull request #23747: [SPARK-26848][SQL] Introduce new option to Kafka source: offset by timestamp (starting/ending)

2019-03-27 Thread GitBox
HeartSaVioR commented on a change in pull request #23747: [SPARK-26848][SQL] Introduce new option to Kafka source: offset by timestamp (starting/ending) URL: https://github.com/apache/spark/pull/23747#discussion_r269410616 ## File path: external/kafka-0-10-sql/src/main/scala/org/ap

[GitHub] [spark] wangyum commented on a change in pull request #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4

2019-03-27 Thread GitBox
wangyum commented on a change in pull request #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4 URL: https://github.com/apache/spark/pull/23788#discussion_r269842487 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala

[GitHub] [spark] wangyum commented on a change in pull request #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4

2019-03-27 Thread GitBox
wangyum commented on a change in pull request #23788: [SPARK-27176][SQL] Upgrade hadoop-3's built-in Hive maven dependencies to 2.3.4 URL: https://github.com/apache/spark/pull/23788#discussion_r269842487 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala

[GitHub] [spark] beliefer commented on a change in pull request #24229: [SPARK-27275][CORE] Fix potential corruption in EncryptedMessage.transferTo (2.4)

2019-03-27 Thread GitBox
beliefer commented on a change in pull request #24229: [SPARK-27275][CORE] Fix potential corruption in EncryptedMessage.transferTo (2.4) URL: https://github.com/apache/spark/pull/24229#discussion_r269842095 ## File path: common/network-common/src/main/java/org/apache/spark/network/

[GitHub] [spark] beliefer commented on a change in pull request #24229: [SPARK-27275][CORE] Fix potential corruption in EncryptedMessage.transferTo (2.4)

2019-03-27 Thread GitBox
beliefer commented on a change in pull request #24229: [SPARK-27275][CORE] Fix potential corruption in EncryptedMessage.transferTo (2.4) URL: https://github.com/apache/spark/pull/24229#discussion_r269841713 ## File path: common/network-common/src/main/java/org/apache/spark/network/

[GitHub] [spark] AmplabJenkins removed a comment on issue #24209: [SPARK-27255][SQL] Aggregate functions should not be allowed in WHERE

2019-03-27 Thread GitBox
AmplabJenkins removed a comment on issue #24209: [SPARK-27255][SQL] Aggregate functions should not be allowed in WHERE URL: https://github.com/apache/spark/pull/24209#issuecomment-477424378 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] [spark] AmplabJenkins removed a comment on issue #24209: [SPARK-27255][SQL] Aggregate functions should not be allowed in WHERE

2019-03-27 Thread GitBox
AmplabJenkins removed a comment on issue #24209: [SPARK-27255][SQL] Aggregate functions should not be allowed in WHERE URL: https://github.com/apache/spark/pull/24209#issuecomment-477424375 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24209: [SPARK-27255][SQL] Aggregate functions should not be allowed in WHERE

2019-03-27 Thread GitBox
AmplabJenkins commented on issue #24209: [SPARK-27255][SQL] Aggregate functions should not be allowed in WHERE URL: https://github.com/apache/spark/pull/24209#issuecomment-477424375 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #24231: [minor] remove import scala.collection.Set in TaskSchedulerImpl

2019-03-27 Thread GitBox
AmplabJenkins removed a comment on issue #24231: [minor] remove import scala.collection.Set in TaskSchedulerImpl URL: https://github.com/apache/spark/pull/24231#issuecomment-477423955 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] gatorsmile commented on issue #24212: [SPARK-26771][SQL][FOLLOWUP] Make all the uncache operations non-blocking by default

2019-03-27 Thread GitBox
gatorsmile commented on issue #24212: [SPARK-26771][SQL][FOLLOWUP] Make all the uncache operations non-blocking by default URL: https://github.com/apache/spark/pull/24212#issuecomment-477423990 @maropu Could you update the migration guide in SQL doc? ---

[GitHub] [spark] AmplabJenkins commented on issue #24209: [SPARK-27255][SQL] Aggregate functions should not be allowed in WHERE

2019-03-27 Thread GitBox
AmplabJenkins commented on issue #24209: [SPARK-27255][SQL] Aggregate functions should not be allowed in WHERE URL: https://github.com/apache/spark/pull/24209#issuecomment-477424378 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] beliefer edited a comment on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory

2019-03-27 Thread GitBox
beliefer edited a comment on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory URL: https://github.com/apache/spark/pull/23841#issuecomment-477421714 > Yes I get all that, but here: > `val qualifiedPath = FileU

[GitHub] [spark] AmplabJenkins removed a comment on issue #24231: [minor] remove import scala.collection.Set in TaskSchedulerImpl

2019-03-27 Thread GitBox
AmplabJenkins removed a comment on issue #24231: [minor] remove import scala.collection.Set in TaskSchedulerImpl URL: https://github.com/apache/spark/pull/24231#issuecomment-477423954 Merged build finished. Test PASSed. This

[GitHub] [spark] SparkQA removed a comment on issue #24209: [SPARK-27255][SQL] Aggregate functions should not be allowed in WHERE

2019-03-27 Thread GitBox
SparkQA removed a comment on issue #24209: [SPARK-27255][SQL] Aggregate functions should not be allowed in WHERE URL: https://github.com/apache/spark/pull/24209#issuecomment-477373091 **[Test build #104031 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1040

[GitHub] [spark] SparkQA commented on issue #24209: [SPARK-27255][SQL] Aggregate functions should not be allowed in WHERE

2019-03-27 Thread GitBox
SparkQA commented on issue #24209: [SPARK-27255][SQL] Aggregate functions should not be allowed in WHERE URL: https://github.com/apache/spark/pull/24209#issuecomment-477423948 **[Test build #104031 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104031/test

[GitHub] [spark] AmplabJenkins commented on issue #24231: [minor] remove import scala.collection.Set in TaskSchedulerImpl

2019-03-27 Thread GitBox
AmplabJenkins commented on issue #24231: [minor] remove import scala.collection.Set in TaskSchedulerImpl URL: https://github.com/apache/spark/pull/24231#issuecomment-477423955 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.ber

[GitHub] [spark] AmplabJenkins commented on issue #24231: [minor] remove import scala.collection.Set in TaskSchedulerImpl

2019-03-27 Thread GitBox
AmplabJenkins commented on issue #24231: [minor] remove import scala.collection.Set in TaskSchedulerImpl URL: https://github.com/apache/spark/pull/24231#issuecomment-477423954 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] SparkQA commented on issue #24231: [minor] remove import scala.collection.Set in TaskSchedulerImpl

2019-03-27 Thread GitBox
SparkQA commented on issue #24231: [minor] remove import scala.collection.Set in TaskSchedulerImpl URL: https://github.com/apache/spark/pull/24231#issuecomment-477423522 **[Test build #104029 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104029/testReport

[GitHub] [spark] SparkQA removed a comment on issue #24231: [minor] remove import scala.collection.Set in TaskSchedulerImpl

2019-03-27 Thread GitBox
SparkQA removed a comment on issue #24231: [minor] remove import scala.collection.Set in TaskSchedulerImpl URL: https://github.com/apache/spark/pull/24231#issuecomment-477364014 **[Test build #104029 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104029/tes

[GitHub] [spark] beliefer edited a comment on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory

2019-03-27 Thread GitBox
beliefer edited a comment on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory URL: https://github.com/apache/spark/pull/23841#issuecomment-477421714 > Yes I get all that, but here: > `val qualifiedPath = FileU

[GitHub] [spark] beliefer edited a comment on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory

2019-03-27 Thread GitBox
beliefer edited a comment on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory URL: https://github.com/apache/spark/pull/23841#issuecomment-477421714 > Yes I get all that, but here: > `val qualifiedPath = FileU

[GitHub] [spark] beliefer edited a comment on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory

2019-03-27 Thread GitBox
beliefer edited a comment on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory URL: https://github.com/apache/spark/pull/23841#issuecomment-477421714 > Yes I get all that, but here: > `val qualifiedPath = FileU

[GitHub] [spark] beliefer edited a comment on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory

2019-03-27 Thread GitBox
beliefer edited a comment on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory URL: https://github.com/apache/spark/pull/23841#issuecomment-477421714 > Yes I get all that, but here: > `val qualifiedPath = FileU

[GitHub] [spark] beliefer edited a comment on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory

2019-03-27 Thread GitBox
beliefer edited a comment on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory URL: https://github.com/apache/spark/pull/23841#issuecomment-477421714 > Yes I get all that, but here: > `val qualifiedPath = FileU

[GitHub] [spark] beliefer commented on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory

2019-03-27 Thread GitBox
beliefer commented on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory URL: https://github.com/apache/spark/pull/23841#issuecomment-477421714 > Yes I get all that, but here: > `val qualifiedPath = FileUtils.ma

[GitHub] [spark] beliefer commented on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory

2019-03-27 Thread GitBox
beliefer commented on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory URL: https://github.com/apache/spark/pull/23841#issuecomment-477421389 > It is great.I have merged it into my production environment.

[GitHub] [spark] srowen commented on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory

2019-03-27 Thread GitBox
srowen commented on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory URL: https://github.com/apache/spark/pull/23841#issuecomment-477421282 Yes I get all that, but here: `val qualifiedPath = FileUtils.makeQual

[GitHub] [spark] cloud-fan commented on a change in pull request #24231: [minor] remove import scala.collection.Set in TaskSchedulerImpl

2019-03-27 Thread GitBox
cloud-fan commented on a change in pull request #24231: [minor] remove import scala.collection.Set in TaskSchedulerImpl URL: https://github.com/apache/spark/pull/24231#discussion_r269837473 ## File path: core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala ##

[GitHub] [spark] beliefer edited a comment on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory

2019-03-27 Thread GitBox
beliefer edited a comment on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory URL: https://github.com/apache/spark/pull/23841#issuecomment-477418658 > OK it's probably that I don't know this code well. Maybe my q

[GitHub] [spark] beliefer commented on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory

2019-03-27 Thread GitBox
beliefer commented on issue #23841: [SPARK-26936][SQL] Fix bug of insert overwrite local dir can not create temporary path in local staging directory URL: https://github.com/apache/spark/pull/23841#issuecomment-477418658 > OK it's probably that I don't know this code well. Maybe my question

  1   2   3   4   5   6   7   >