[GitHub] [spark] AmplabJenkins removed a comment on pull request #28932: [SPARK-32088][PYTHON] Pin the timezone in timestamp_seconds doctest

2020-06-26 Thread GitBox
AmplabJenkins removed a comment on pull request #28932: URL: https://github.com/apache/spark/pull/28932#issuecomment-650204062 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #27983: [SPARK-32105][SQL]Implement ScriptTransformation in sql/core

2020-06-26 Thread GitBox
AngersZh commented on a change in pull request #27983: URL: https://github.com/apache/spark/pull/27983#discussion_r446215106 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/ScriptTransformationExec.scala ## @@ -1,468 +0,0 @@ -/* Review comment:

[GitHub] [spark] SparkQA commented on pull request #27983: [SPARK-32105][SQL]Implement ScriptTransformation in sql/core

2020-06-26 Thread GitBox
SparkQA commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-650206470 **[Test build #124549 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124549/testReport)** for PR 27983 at commit [`bb6676b`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #28912: [SPARK-32057][SQL] ExecuteStatement: cancel and close should not transiently ERROR

2020-06-26 Thread GitBox
SparkQA commented on pull request #28912: URL: https://github.com/apache/spark/pull/28912#issuecomment-650206872 **[Test build #124548 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124548/testReport)** for PR 28912 at commit [`d68e77b`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #27983: [SPARK-32105][SQL]Implement ScriptTransformation in sql/core

2020-06-26 Thread GitBox
SparkQA removed a comment on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-650206470 **[Test build #124549 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124549/testReport)** for PR 27983 at commit [`bb6676b`](https://gi

[GitHub] [spark] SparkQA commented on pull request #27983: [SPARK-32105][SQL]Implement ScriptTransformation in sql/core

2020-06-26 Thread GitBox
SparkQA commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-650207232 **[Test build #124549 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124549/testReport)** for PR 27983 at commit [`bb6676b`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28912: [SPARK-32057][SQL] ExecuteStatement: cancel and close should not transiently ERROR

2020-06-26 Thread GitBox
AmplabJenkins removed a comment on pull request #28912: URL: https://github.com/apache/spark/pull/28912#issuecomment-650207110 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #27983: [SPARK-32105][SQL]Implement ScriptTransformation in sql/core

2020-06-26 Thread GitBox
AmplabJenkins commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-650207045 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28912: [SPARK-32057][SQL] ExecuteStatement: cancel and close should not transiently ERROR

2020-06-26 Thread GitBox
AmplabJenkins commented on pull request #28912: URL: https://github.com/apache/spark/pull/28912#issuecomment-650207110 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #27983: [SPARK-32105][SQL]Implement ScriptTransformation in sql/core

2020-06-26 Thread GitBox
AmplabJenkins commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-650207254 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28912: [SPARK-32057][SQL] ExecuteStatement: cancel and close should not transiently ERROR

2020-06-26 Thread GitBox
SparkQA removed a comment on pull request #28912: URL: https://github.com/apache/spark/pull/28912#issuecomment-650192258 **[Test build #124548 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124548/testReport)** for PR 28912 at commit [`d68e77b`](https://gi

[GitHub] [spark] AngersZhuuuu commented on pull request #27983: [SPARK-32105][SQL]Implement ScriptTransformation in sql/core

2020-06-26 Thread GitBox
AngersZh commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-650207104 > @AngersZh, I think what @viirya suggested is just refactor it first without new codes, and add `ScriptTransformationExec.scala` in a separate PR because it's difficul

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27983: [SPARK-32105][SQL]Implement ScriptTransformation in sql/core

2020-06-26 Thread GitBox
AmplabJenkins removed a comment on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-650207045 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27983: [SPARK-32105][SQL]Implement ScriptTransformation in sql/core

2020-06-26 Thread GitBox
AmplabJenkins removed a comment on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-650207263 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28912: [SPARK-32057][SQL] ExecuteStatement: cancel and close should not transiently ERROR

2020-06-26 Thread GitBox
AmplabJenkins removed a comment on pull request #28912: URL: https://github.com/apache/spark/pull/28912#issuecomment-650207119 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] SparkQA commented on pull request #28860: [SPARK-32002][SQL]Support ExtractValue from nested ArrayStruct

2020-06-26 Thread GitBox
SparkQA commented on pull request #28860: URL: https://github.com/apache/spark/pull/28860#issuecomment-650210279 **[Test build #124544 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124544/testReport)** for PR 28860 at commit [`b6e92c0`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #28860: [SPARK-32002][SQL]Support ExtractValue from nested ArrayStruct

2020-06-26 Thread GitBox
SparkQA removed a comment on pull request #28860: URL: https://github.com/apache/spark/pull/28860#issuecomment-650094811 **[Test build #124544 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124544/testReport)** for PR 28860 at commit [`b6e92c0`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #28860: [SPARK-32002][SQL]Support ExtractValue from nested ArrayStruct

2020-06-26 Thread GitBox
AmplabJenkins commented on pull request #28860: URL: https://github.com/apache/spark/pull/28860#issuecomment-650211398 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] baohe-zhang commented on a change in pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-06-26 Thread GitBox
baohe-zhang commented on a change in pull request #28412: URL: https://github.com/apache/spark/pull/28412#discussion_r446221919 ## File path: core/src/main/scala/org/apache/spark/deploy/history/HistoryServerMemoryManager.scala ## @@ -0,0 +1,82 @@ +/* + * Licensed to the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28860: [SPARK-32002][SQL]Support ExtractValue from nested ArrayStruct

2020-06-26 Thread GitBox
AmplabJenkins removed a comment on pull request #28860: URL: https://github.com/apache/spark/pull/28860#issuecomment-650211398 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #28863: [SPARK-31336][SQL] Support Oracle Kerberos login in JDBC connector

2020-06-26 Thread GitBox
gaborgsomogyi commented on a change in pull request #28863: URL: https://github.com/apache/spark/pull/28863#discussion_r44687 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/connection/OracleConnectionProvider.scala ## @@ -0,0 +1,63 @@

[GitHub] [spark] SparkQA commented on pull request #27983: [SPARK-32105][SQL]Implement ScriptTransformation in sql/core

2020-06-26 Thread GitBox
SparkQA commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-650217619 **[Test build #124550 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124550/testReport)** for PR 27983 at commit [`f8142f1`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #27983: [SPARK-32105][SQL]Implement ScriptTransformation in sql/core

2020-06-26 Thread GitBox
AmplabJenkins commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-650218443 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27983: [SPARK-32105][SQL]Implement ScriptTransformation in sql/core

2020-06-26 Thread GitBox
AmplabJenkins removed a comment on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-650218443 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #27983: [SPARK-32105][SQL]Implement ScriptTransformation in sql/core

2020-06-26 Thread GitBox
AmplabJenkins commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-650222050 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #27983: [SPARK-32105][SQL]Implement ScriptTransformation in sql/core

2020-06-26 Thread GitBox
SparkQA commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-650222023 **[Test build #124550 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124550/testReport)** for PR 27983 at commit [`f8142f1`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #27983: [SPARK-32105][SQL]Implement ScriptTransformation in sql/core

2020-06-26 Thread GitBox
SparkQA removed a comment on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-650217619 **[Test build #124550 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124550/testReport)** for PR 27983 at commit [`f8142f1`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27983: [SPARK-32105][SQL]Implement ScriptTransformation in sql/core

2020-06-26 Thread GitBox
AmplabJenkins removed a comment on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-650222050 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27983: [SPARK-32105][SQL]Implement ScriptTransformation in sql/core

2020-06-26 Thread GitBox
AmplabJenkins removed a comment on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-650222064 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #28863: [SPARK-31336][SQL] Support Oracle Kerberos login in JDBC connector

2020-06-26 Thread GitBox
gaborgsomogyi commented on a change in pull request #28863: URL: https://github.com/apache/spark/pull/28863#discussion_r446243027 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/connection/OracleConnectionProvider.scala ## @@ -0,0 +1,63 @@

[GitHub] [spark] SparkQA commented on pull request #27983: [SPARK-32105][SQL]Implement ScriptTransformation in sql/core

2020-06-26 Thread GitBox
SparkQA commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-650233512 **[Test build #124551 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124551/testReport)** for PR 27983 at commit [`0e21f18`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #27983: [SPARK-32105][SQL]Implement ScriptTransformation in sql/core

2020-06-26 Thread GitBox
AmplabJenkins commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-650234188 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27983: [SPARK-32105][SQL]Implement ScriptTransformation in sql/core

2020-06-26 Thread GitBox
AmplabJenkins removed a comment on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-650234188 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28841: [SPARK-31962][SQL][SS] Provide option to load files after a specified date when reading from a folder path

2020-06-26 Thread GitBox
SparkQA commented on pull request #28841: URL: https://github.com/apache/spark/pull/28841#issuecomment-650238046 **[Test build #124547 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124547/testReport)** for PR 28841 at commit [`5de1b44`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #28841: [SPARK-31962][SQL][SS] Provide option to load files after a specified date when reading from a folder path

2020-06-26 Thread GitBox
SparkQA removed a comment on pull request #28841: URL: https://github.com/apache/spark/pull/28841#issuecomment-650112339 **[Test build #124547 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124547/testReport)** for PR 28841 at commit [`5de1b44`](https://gi

[GitHub] [spark] juliuszsompolski commented on a change in pull request #28912: [SPARK-32057][SQL] ExecuteStatement: cancel and close should not transiently ERROR

2020-06-26 Thread GitBox
juliuszsompolski commented on a change in pull request #28912: URL: https://github.com/apache/spark/pull/28912#discussion_r446250332 ## File path: sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/SparkExecuteStatementOperationSuite.scala ## @@ -42,4

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28841: [SPARK-31962][SQL][SS] Provide option to load files after a specified date when reading from a folder path

2020-06-26 Thread GitBox
AmplabJenkins removed a comment on pull request #28841: URL: https://github.com/apache/spark/pull/28841#issuecomment-650239439 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28841: [SPARK-31962][SQL][SS] Provide option to load files after a specified date when reading from a folder path

2020-06-26 Thread GitBox
AmplabJenkins commented on pull request #28841: URL: https://github.com/apache/spark/pull/28841#issuecomment-650239439 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] tgravescs commented on a change in pull request #28874: [SPARK-32036] Replace references to blacklist/whitelist language with more appropriate terminology, excluding the blacklisting

2020-06-26 Thread GitBox
tgravescs commented on a change in pull request #28874: URL: https://github.com/apache/spark/pull/28874#discussion_r445553889 ## File path: core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala ## @@ -1235,7 +1236,7 @@ private[history] class FsHistoryProv

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #28863: [SPARK-31336][SQL] Support Oracle Kerberos login in JDBC connector

2020-06-26 Thread GitBox
gaborgsomogyi commented on a change in pull request #28863: URL: https://github.com/apache/spark/pull/28863#discussion_r446255388 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/connection/OracleConnectionProvider.scala ## @@ -0,0 +1,63 @@

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #28863: [SPARK-31336][SQL] Support Oracle Kerberos login in JDBC connector

2020-06-26 Thread GitBox
gaborgsomogyi commented on a change in pull request #28863: URL: https://github.com/apache/spark/pull/28863#discussion_r446255388 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/connection/OracleConnectionProvider.scala ## @@ -0,0 +1,63 @@

[GitHub] [spark] sririshindra commented on a change in pull request #28885: [SPARK-29375][SPARK-28940][SPARK-32041][SQL] Whole plan exchange and subquery reuse

2020-06-26 Thread GitBox
sririshindra commented on a change in pull request #28885: URL: https://github.com/apache/spark/pull/28885#discussion_r445859500 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/reuse/Reuse.scala ## @@ -0,0 +1,95 @@ +/* + * Licensed to the Apache Software F

[GitHub] [spark] rdblue commented on pull request #27331: [SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API

2020-06-26 Thread GitBox
rdblue commented on pull request #27331: URL: https://github.com/apache/spark/pull/27331#issuecomment-650262769 > This isn't a great way to discuss To clarify, this isn't a discussion. There isn't more for me to say since I've already added my perspective. -

[GitHub] [spark] xkrogen commented on a change in pull request #28874: [SPARK-32036] Replace references to blacklist/whitelist language with more appropriate terminology, excluding the blacklisting fe

2020-06-26 Thread GitBox
xkrogen commented on a change in pull request #28874: URL: https://github.com/apache/spark/pull/28874#discussion_r446289499 ## File path: core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala ## @@ -1235,7 +1236,7 @@ private[history] class FsHistoryProvid

[GitHub] [spark] SparkQA commented on pull request #28874: [SPARK-32036] Replace references to blacklist/whitelist language with more appropriate terminology, excluding the blacklisting feature.

2020-06-26 Thread GitBox
SparkQA commented on pull request #28874: URL: https://github.com/apache/spark/pull/28874#issuecomment-650276131 **[Test build #124552 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124552/testReport)** for PR 28874 at commit [`09ec2e8`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28874: [SPARK-32036] Replace references to blacklist/whitelist language with more appropriate terminology, excluding the blacklisting

2020-06-26 Thread GitBox
AmplabJenkins removed a comment on pull request #28874: URL: https://github.com/apache/spark/pull/28874#issuecomment-650276940 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28874: [SPARK-32036] Replace references to blacklist/whitelist language with more appropriate terminology, excluding the blacklisting feature.

2020-06-26 Thread GitBox
AmplabJenkins commented on pull request #28874: URL: https://github.com/apache/spark/pull/28874#issuecomment-650276940 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28863: [SPARK-31336][SQL] Support Oracle Kerberos login in JDBC connector

2020-06-26 Thread GitBox
dongjoon-hyun commented on a change in pull request #28863: URL: https://github.com/apache/spark/pull/28863#discussion_r446319174 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/connection/OracleConnectionProvider.scala ## @@ -0,0 +1,63 @@

[GitHub] [spark] rdblue commented on a change in pull request #28864: [SPARK-32004][ALL] Drop references to slave

2020-06-26 Thread GitBox
rdblue commented on a change in pull request #28864: URL: https://github.com/apache/spark/pull/28864#discussion_r446318223 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManagerMessages.scala ## @@ -24,37 +24,37 @@ import org.apache.spark.util.Utils private

[GitHub] [spark] srowen closed pull request #28903: [SPARK-19939] [ML] Add support for association rules in ML

2020-06-26 Thread GitBox
srowen closed pull request #28903: URL: https://github.com/apache/spark/pull/28903 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [spark] srowen commented on pull request #28903: [SPARK-19939] [ML] Add support for association rules in ML

2020-06-26 Thread GitBox
srowen commented on pull request #28903: URL: https://github.com/apache/spark/pull/28903#issuecomment-650315230 Merged to master This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [spark] srowen closed pull request #28884: [SPARK-20249][ML][PYSPARK] Add training summary for LinearSVCModel

2020-06-26 Thread GitBox
srowen closed pull request #28884: URL: https://github.com/apache/spark/pull/28884 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [spark] juliuszsompolski commented on pull request #28912: [SPARK-32057][SQL] ExecuteStatement: cancel and close should not transiently ERROR

2020-06-26 Thread GitBox
juliuszsompolski commented on pull request #28912: URL: https://github.com/apache/spark/pull/28912#issuecomment-650317130 ``` sbt.ForkMain$ForkError: org.mockito.exceptions.base.MockitoException: ClassCastException occurred while creating the mockito mock : class to mock : 'org.a

[GitHub] [spark] huaxingao commented on pull request #28903: [SPARK-19939] [ML] Add support for association rules in ML

2020-06-26 Thread GitBox
huaxingao commented on pull request #28903: URL: https://github.com/apache/spark/pull/28903#issuecomment-650319450 Thanks! @srowen @zhengruifeng This is an automated message from the Apache Git Service. To respond to the mes

[GitHub] [spark] huaxingao commented on pull request #28884: [SPARK-20249][ML][PYSPARK] Add training summary for LinearSVCModel

2020-06-26 Thread GitBox
huaxingao commented on pull request #28884: URL: https://github.com/apache/spark/pull/28884#issuecomment-650319852 Thanks! @srowen @zhengruifeng This is an automated message from the Apache Git Service. To respond to the mes

[GitHub] [spark] SparkQA commented on pull request #28874: [SPARK-32036] Replace references to blacklist/whitelist language with more appropriate terminology, excluding the blacklisting feature.

2020-06-26 Thread GitBox
SparkQA commented on pull request #28874: URL: https://github.com/apache/spark/pull/28874#issuecomment-650353598 **[Test build #124552 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124552/testReport)** for PR 28874 at commit [`09ec2e8`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #28874: [SPARK-32036] Replace references to blacklist/whitelist language with more appropriate terminology, excluding the blacklisting featur

2020-06-26 Thread GitBox
SparkQA removed a comment on pull request #28874: URL: https://github.com/apache/spark/pull/28874#issuecomment-650276131 **[Test build #124552 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124552/testReport)** for PR 28874 at commit [`09ec2e8`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #28874: [SPARK-32036] Replace references to blacklist/whitelist language with more appropriate terminology, excluding the blacklisting feature.

2020-06-26 Thread GitBox
AmplabJenkins commented on pull request #28874: URL: https://github.com/apache/spark/pull/28874#issuecomment-650354705 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28874: [SPARK-32036] Replace references to blacklist/whitelist language with more appropriate terminology, excluding the blacklisting

2020-06-26 Thread GitBox
AmplabJenkins removed a comment on pull request #28874: URL: https://github.com/apache/spark/pull/28874#issuecomment-650354705 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #27983: [SPARK-32105][SQL]Implement ScriptTransformation in sql/core

2020-06-26 Thread GitBox
SparkQA commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-650369306 **[Test build #124551 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124551/testReport)** for PR 27983 at commit [`0e21f18`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #27983: [SPARK-32105][SQL]Implement ScriptTransformation in sql/core

2020-06-26 Thread GitBox
SparkQA removed a comment on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-650233512 **[Test build #124551 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124551/testReport)** for PR 27983 at commit [`0e21f18`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #27983: [SPARK-32105][SQL]Implement ScriptTransformation in sql/core

2020-06-26 Thread GitBox
AmplabJenkins commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-650370504 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27983: [SPARK-32105][SQL]Implement ScriptTransformation in sql/core

2020-06-26 Thread GitBox
AmplabJenkins removed a comment on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-650370504 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] attilapiros commented on a change in pull request #28618: [SPARK-31801][API][SHUFFLE] Register map output metadata

2020-06-26 Thread GitBox
attilapiros commented on a change in pull request #28618: URL: https://github.com/apache/spark/pull/28618#discussion_r446384655 ## File path: core/src/main/scala/org/apache/spark/shuffle/MemoizingShuffleDataIO.scala ## @@ -0,0 +1,51 @@ +/* + * Licensed to the Apache Software F

[GitHub] [spark] attilapiros commented on a change in pull request #28618: [SPARK-31801][API][SHUFFLE] Register map output metadata

2020-06-26 Thread GitBox
attilapiros commented on a change in pull request #28618: URL: https://github.com/apache/spark/pull/28618#discussion_r446384655 ## File path: core/src/main/scala/org/apache/spark/shuffle/MemoizingShuffleDataIO.scala ## @@ -0,0 +1,51 @@ +/* + * Licensed to the Apache Software F

[GitHub] [spark] mccheah commented on a change in pull request #28618: [SPARK-31801][API][SHUFFLE] Register map output metadata

2020-06-26 Thread GitBox
mccheah commented on a change in pull request #28618: URL: https://github.com/apache/spark/pull/28618#discussion_r446392830 ## File path: core/src/main/scala/org/apache/spark/shuffle/MemoizingShuffleDataIO.scala ## @@ -0,0 +1,51 @@ +/* + * Licensed to the Apache Software Found

[GitHub] [spark] attilapiros commented on a change in pull request #28618: [SPARK-31801][API][SHUFFLE] Register map output metadata

2020-06-26 Thread GitBox
attilapiros commented on a change in pull request #28618: URL: https://github.com/apache/spark/pull/28618#discussion_r446394432 ## File path: core/src/main/scala/org/apache/spark/shuffle/MemoizingShuffleDataIO.scala ## @@ -0,0 +1,51 @@ +/* + * Licensed to the Apache Software F

[GitHub] [spark] mccheah commented on a change in pull request #28618: [SPARK-31801][API][SHUFFLE] Register map output metadata

2020-06-26 Thread GitBox
mccheah commented on a change in pull request #28618: URL: https://github.com/apache/spark/pull/28618#discussion_r446401053 ## File path: core/src/main/scala/org/apache/spark/shuffle/MemoizingShuffleDataIO.scala ## @@ -0,0 +1,51 @@ +/* + * Licensed to the Apache Software Found

[GitHub] [spark] dongjoon-hyun commented on pull request #28897: [SPARK-32058][BUILD] Use Apache Hadoop 3.2.0 dependency by default

2020-06-26 Thread GitBox
dongjoon-hyun commented on pull request #28897: URL: https://github.com/apache/spark/pull/28897#issuecomment-650401065 Gentle ping once again. This is an automated message from the Apache Git Service. To respond to the messag

[GitHub] [spark] dbtsai commented on pull request #28897: [SPARK-32058][BUILD] Use Apache Hadoop 3.2.0 dependency by default

2020-06-26 Thread GitBox
dbtsai commented on pull request #28897: URL: https://github.com/apache/spark/pull/28897#issuecomment-650403512 +1 from me. Users still have the option to use Hadoop 2.7, so I feel it's safe. This is an automated message fro

[GitHub] [spark] dongjoon-hyun commented on pull request #28897: [SPARK-32058][BUILD] Use Apache Hadoop 3.2.0 dependency by default

2020-06-26 Thread GitBox
dongjoon-hyun commented on pull request #28897: URL: https://github.com/apache/spark/pull/28897#issuecomment-650408514 Thank you so much, @dbtsai ! This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [spark] sap1ens commented on a change in pull request #28852: [SPARK-30616][SQL] Introduce TTL config option for SQL Metadata Cache

2020-06-26 Thread GitBox
sap1ens commented on a change in pull request #28852: URL: https://github.com/apache/spark/pull/28852#discussion_r446422811 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveMetadataCacheSuite.scala ## @@ -126,4 +129,39 @@ class HiveMetadataCacheSuite extends

[GitHub] [spark] holdenk commented on pull request #28897: [SPARK-32058][BUILD] Use Apache Hadoop 3.2.0 dependency by default

2020-06-26 Thread GitBox
holdenk commented on pull request #28897: URL: https://github.com/apache/spark/pull/28897#issuecomment-650418721 LGTM, we can continue the PyPI discussion separately. This is an automated message from the Apache Git Service.

[GitHub] [spark] dongjoon-hyun commented on pull request #28897: [SPARK-32058][BUILD] Use Apache Hadoop 3.2.0 dependency by default

2020-06-26 Thread GitBox
dongjoon-hyun commented on pull request #28897: URL: https://github.com/apache/spark/pull/28897#issuecomment-650428500 Thank you so much, @holdenk ! Yes, we can discuss and improve it separately later. This is an automated m

[GitHub] [spark] dongjoon-hyun commented on pull request #28919: [SPARK-32038][SQL][FOLLOWUP] Make the alias name pretty after float/double normalization

2020-06-26 Thread GitBox
dongjoon-hyun commented on pull request #28919: URL: https://github.com/apache/spark/pull/28919#issuecomment-650433094 Retest this please. I guess we are waiting for @HyukjinKwon 's request https://github.com/apache/spark/pull/28919#issuecomment-649213796 .

[GitHub] [spark] maropu commented on a change in pull request #28863: [SPARK-31336][SQL] Support Oracle Kerberos login in JDBC connector

2020-06-26 Thread GitBox
maropu commented on a change in pull request #28863: URL: https://github.com/apache/spark/pull/28863#discussion_r446438925 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/connection/OracleConnectionProvider.scala ## @@ -0,0 +1,63 @@ +/* +

[GitHub] [spark] wypoon commented on a change in pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-06-26 Thread GitBox
wypoon commented on a change in pull request #28848: URL: https://github.com/apache/spark/pull/28848#discussion_r446445843 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -170,13 +170,29 @@ private[spark] class DAGScheduler( */ priva

[GitHub] [spark] wypoon commented on a change in pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-06-26 Thread GitBox
wypoon commented on a change in pull request #28848: URL: https://github.com/apache/spark/pull/28848#discussion_r446445975 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -170,13 +170,29 @@ private[spark] class DAGScheduler( */ priva

[GitHub] [spark] wypoon commented on a change in pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-06-26 Thread GitBox
wypoon commented on a change in pull request #28848: URL: https://github.com/apache/spark/pull/28848#discussion_r446446147 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -1933,29 +1946,43 @@ private[spark] class DAGScheduler( maybeE

[GitHub] [spark] wypoon commented on a change in pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-06-26 Thread GitBox
wypoon commented on a change in pull request #28848: URL: https://github.com/apache/spark/pull/28848#discussion_r446446304 ## File path: core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala ## @@ -764,6 +825,7 @@ class DAGSchedulerSuite extends SparkFunSuite

[GitHub] [spark] wypoon commented on a change in pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-06-26 Thread GitBox
wypoon commented on a change in pull request #28848: URL: https://github.com/apache/spark/pull/28848#discussion_r446447794 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -1939,24 +1941,24 @@ private[spark] class DAGScheduler( hostTo

[GitHub] [spark] SparkQA commented on pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-06-26 Thread GitBox
SparkQA commented on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-650446036 **[Test build #124553 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124553/testReport)** for PR 28848 at commit [`5e233ac`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-06-26 Thread GitBox
AmplabJenkins commented on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-650446374 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is l

2020-06-26 Thread GitBox
AmplabJenkins removed a comment on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-650446374 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] HeartSaVioR commented on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink to avoid memory issue

2020-06-26 Thread GitBox
HeartSaVioR commented on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-650460286 I've been running sustain tests (still running) and here's some observation: - SPARK-30946 + SPARK-30462 just wrote compact batch 7309 (73,100,000 entries) which size

[GitHub] [spark] HeartSaVioR edited a comment on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink to avoid memory issue

2020-06-26 Thread GitBox
HeartSaVioR edited a comment on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-650460286 I've been running sustain tests (still running) and here's some observation: - SPARK-30946 + SPARK-30462 just wrote compact batch 7309 (73,100,000 entries) whic

[GitHub] [spark] github-actions[bot] closed pull request #25721: [WIP][SPARK-29018][SQL] Implement Spark Thrift Server with it's own code base on PROTOCOL_VERSION_V9

2020-06-26 Thread GitBox
github-actions[bot] closed pull request #25721: URL: https://github.com/apache/spark/pull/25721 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [spark] github-actions[bot] closed pull request #27377: [SPARK-30666][Core][WIP] Reliable single-stage accumulators

2020-06-26 Thread GitBox
github-actions[bot] closed pull request #27377: URL: https://github.com/apache/spark/pull/27377 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [spark] SparkQA commented on pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-06-26 Thread GitBox
SparkQA commented on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-650472356 **[Test build #124553 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124553/testReport)** for PR 28848 at commit [`5e233ac`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-06-26 Thread GitBox
SparkQA removed a comment on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-650446036 **[Test build #124553 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124553/testReport)** for PR 28848 at commit [`5e233ac`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-06-26 Thread GitBox
AmplabJenkins commented on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-650472551 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is l

2020-06-26 Thread GitBox
AmplabJenkins removed a comment on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-650472551 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] dongjoon-hyun commented on pull request #28857: [SPARK-32023][Streaming]Generate spark streaming test jar with maven plugin maven-jar-plugin

2020-06-26 Thread GitBox
dongjoon-hyun commented on pull request #28857: URL: https://github.com/apache/spark/pull/28857#issuecomment-650473151 Oh, thank you for confirmation, @wankunde . Then, I close this PR and SPARK-32023. In any way, thank you for your contribution on this issue. Please don't hesitate to r

[GitHub] [spark] dongjoon-hyun closed pull request #28857: [SPARK-32023][Streaming]Generate spark streaming test jar with maven plugin maven-jar-plugin

2020-06-26 Thread GitBox
dongjoon-hyun closed pull request #28857: URL: https://github.com/apache/spark/pull/28857 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] dongjoon-hyun closed pull request #28932: [SPARK-32088][PYTHON] Pin the timezone in timestamp_seconds doctest

2020-06-26 Thread GitBox
dongjoon-hyun closed pull request #28932: URL: https://github.com/apache/spark/pull/28932 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] dongjoon-hyun closed pull request #28927: [SPARK-32099][DOCS] Remove broken link in cloud integration documentation

2020-06-26 Thread GitBox
dongjoon-hyun closed pull request #28927: URL: https://github.com/apache/spark/pull/28927 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] dongjoon-hyun commented on pull request #28919: [SPARK-32038][SQL][FOLLOWUP] Make the alias name pretty after float/double normalization

2020-06-26 Thread GitBox
dongjoon-hyun commented on pull request #28919: URL: https://github.com/apache/spark/pull/28919#issuecomment-650474740 Retest this please. This is an automated message from the Apache Git Service. To respond to the message, p

[GitHub] [spark] dongjoon-hyun commented on pull request #28895: [SPARK-32055][CORE][SQL] Unify getReader and getReaderForRange in ShuffleManager

2020-06-26 Thread GitBox
dongjoon-hyun commented on pull request #28895: URL: https://github.com/apache/spark/pull/28895#issuecomment-650475112 Retest this please. This is an automated message from the Apache Git Service. To respond to the message, p

[GitHub] [spark] dongjoon-hyun commented on pull request #28866: [SPARK-31845][SPARK-31843][CORE][TESTS] DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure and DAGSchedulerSuite: For the patte

2020-06-26 Thread GitBox
dongjoon-hyun commented on pull request #28866: URL: https://github.com/apache/spark/pull/28866#issuecomment-650475206 Retest this please. This is an automated message from the Apache Git Service. To respond to the message, p

[GitHub] [spark] SparkQA commented on pull request #28919: [SPARK-32038][SQL][FOLLOWUP] Make the alias name pretty after float/double normalization

2020-06-26 Thread GitBox
SparkQA commented on pull request #28919: URL: https://github.com/apache/spark/pull/28919#issuecomment-650475410 **[Test build #124554 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124554/testReport)** for PR 28919 at commit [`c1d4321`](https://github.com

<    1   2   3   4   >