[GitHub] [spark] SparkQA commented on pull request #28912: [SPARK-32057][SQL][test-hive1.2] ExecuteStatement: cancel and close should not transiently ERROR

2020-07-01 Thread GitBox
SparkQA commented on pull request #28912: URL: https://github.com/apache/spark/pull/28912#issuecomment-652350091 **[Test build #124767 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124767/testReport)** for PR 28912 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
SparkQA removed a comment on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-652327470 **[Test build #124766 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124766/testReport)** for PR 28833 at commit

[GitHub] [spark] SparkQA commented on pull request #27735: [RFC][SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-07-01 Thread GitBox
SparkQA commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-652381166 **[Test build #124777 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124777/testReport)** for PR 27735 at commit

[GitHub] [spark] SparkQA commented on pull request #28948: [SPARK-31935][SQL][FOLLOWUP] Hadoop file system config should be effective in data source options

2020-07-01 Thread GitBox
SparkQA commented on pull request #28948: URL: https://github.com/apache/spark/pull/28948#issuecomment-652381178 **[Test build #124776 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124776/testReport)** for PR 28948 at commit

[GitHub] [spark] AngersZhuuuu commented on pull request #27983: [SPARK-32105][SQL]Refactor current ScriptTransformationExec code

2020-07-01 Thread GitBox
AngersZh commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-652398703 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28940: [SPARK-32121][SHUFFLE] Support Windows OS in ExecutorDiskUtils

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28940: URL: https://github.com/apache/spark/pull/28940#issuecomment-652403216 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28940: [SPARK-32121][SHUFFLE] Support Windows OS in ExecutorDiskUtils

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28940: URL: https://github.com/apache/spark/pull/28940#issuecomment-652403204 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] gengliangwang commented on a change in pull request #28942: [SPARK-32125][UI] Support get taskList by status in Web UI and SHS Rest API

2020-07-01 Thread GitBox
gengliangwang commented on a change in pull request #28942: URL: https://github.com/apache/spark/pull/28942#discussion_r448354522 ## File path: core/src/main/scala/org/apache/spark/status/api/v1/StagesResource.scala ## @@ -96,8 +96,9 @@ private[v1] class StagesResource

[GitHub] [spark] SparkQA removed a comment on pull request #28948: [SPARK-31935][SQL][FOLLOWUP] Hadoop file system config should be effective in data source options

2020-07-01 Thread GitBox
SparkQA removed a comment on pull request #28948: URL: https://github.com/apache/spark/pull/28948#issuecomment-652184175 **[Test build #124742 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124742/testReport)** for PR 28948 at commit

[GitHub] [spark] alismess-db commented on a change in pull request #28912: [SPARK-32057][SQL][test-hive1.2] ExecuteStatement: cancel and close should not transiently ERROR

2020-07-01 Thread GitBox
alismess-db commented on a change in pull request #28912: URL: https://github.com/apache/spark/pull/28912#discussion_r448252971 ## File path: sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/SparkExecuteStatementOperationSuite.scala ## @@ -42,4

[GitHub] [spark] LantaoJin commented on a change in pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
LantaoJin commented on a change in pull request #28833: URL: https://github.com/apache/spark/pull/28833#discussion_r448252184 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/rules.scala ## @@ -292,6 +293,8 @@ case class

[GitHub] [spark] AmplabJenkins commented on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-652328201 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] PavithraRamachandran commented on pull request #28931: [SPARK-32103][YARN] Handle IPv6 host/port split in YarnRMClient

2020-07-01 Thread GitBox
PavithraRamachandran commented on pull request #28931: URL: https://github.com/apache/spark/pull/28931#issuecomment-652342616 @dongjoon-hyun thank you for identifying the missed scenario, i shall handle it and update the PR

[GitHub] [spark] SparkQA commented on pull request #28964: [SPARK-32144][SQL] Retain EXTERNAL property in hive table properties

2020-07-01 Thread GitBox
SparkQA commented on pull request #28964: URL: https://github.com/apache/spark/pull/28964#issuecomment-652356816 **[Test build #124768 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124768/testReport)** for PR 28964 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28965: [SPARK-32124][CORE][FOLLOW-UP] Use the invalid value -2 to fill the map index when the event logs from the old Spark version

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28965: URL: https://github.com/apache/spark/pull/28965#issuecomment-652367551 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28965: [SPARK-32124][CORE][FOLLOW-UP] Use the invalid value -2 to fill the map index when the event logs from the old Spark version

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28965: URL: https://github.com/apache/spark/pull/28965#issuecomment-652367545 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28966: [SPARK-32130][SQL] Disable the JSON option `inferTimestamp` by default

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28966: URL: https://github.com/apache/spark/pull/28966#issuecomment-652367972 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28966: [SPARK-32130][SQL] Disable the JSON option `inferTimestamp` by default

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28966: URL: https://github.com/apache/spark/pull/28966#issuecomment-652367972 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28962: [SPARK-32136][SQL] NormalizeFloatingNumbers should work on null struct

2020-07-01 Thread GitBox
SparkQA removed a comment on pull request #28962: URL: https://github.com/apache/spark/pull/28962#issuecomment-652212688 **[Test build #124746 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124746/testReport)** for PR 28962 at commit

[GitHub] [spark] HeartSaVioR commented on pull request #27620: [SPARK-30866][SS] FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-07-01 Thread GitBox
HeartSaVioR commented on pull request #27620: URL: https://github.com/apache/spark/pull/27620#issuecomment-652372793 HiveSuite failed This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HeartSaVioR commented on pull request #27620: [SPARK-30866][SS] FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-07-01 Thread GitBox
HeartSaVioR commented on pull request #27620: URL: https://github.com/apache/spark/pull/27620#issuecomment-652372863 retest this, please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #28962: [SPARK-32136][SQL] NormalizeFloatingNumbers should work on null struct

2020-07-01 Thread GitBox
SparkQA commented on pull request #28962: URL: https://github.com/apache/spark/pull/28962#issuecomment-652372981 **[Test build #124746 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124746/testReport)** for PR 28962 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28962: [SPARK-32136][SQL] NormalizeFloatingNumbers should work on null struct

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28962: URL: https://github.com/apache/spark/pull/28962#issuecomment-652375106 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #27735: [RFC][SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-07-01 Thread GitBox
SparkQA commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-652375553 **[Test build #124772 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124772/testReport)** for PR 27735 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #27735: [RFC][SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-652375564 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #27735: [RFC][SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-07-01 Thread GitBox
SparkQA removed a comment on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-652374547 **[Test build #124772 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124772/testReport)** for PR 27735 at commit

[GitHub] [spark] cloud-fan commented on pull request #28962: [SPARK-32136][SQL] NormalizeFloatingNumbers should work on null struct

2020-07-01 Thread GitBox
cloud-fan commented on pull request #28962: URL: https://github.com/apache/spark/pull/28962#issuecomment-652375713 The test failure is legitimate, can you take a look? Seems we need to skip the `NormalizeFloatingNumbers` rule if the input expression contains `KnownFloatingPointNormalized`

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27620: [SPARK-30866][SS] FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #27620: URL: https://github.com/apache/spark/pull/27620#issuecomment-652375096 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] LantaoJin edited a comment on pull request #28963: [SPARK-32145][SQL] ThriftCLIService.GetOperationStatus should include exception's stack trace to the error message

2020-07-01 Thread GitBox
LantaoJin edited a comment on pull request #28963: URL: https://github.com/apache/spark/pull/28963#issuecomment-652396532 > Personally, I don't think we need an extra configuration for this, because we use HiveJDBC to operate with Spark thrift server. For the default Hive 2.3.7 we use,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-652400790 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27983: [SPARK-32105][SQL]Refactor current ScriptTransformationExec code

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-652400314 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] LantaoJin edited a comment on pull request #28963: [SPARK-32145][SQL] ThriftCLIService.GetOperationStatus should include exception's stack trace to the error message

2020-07-01 Thread GitBox
LantaoJin edited a comment on pull request #28963: URL: https://github.com/apache/spark/pull/28963#issuecomment-652399895 > I could not reproduce the case you provided in that PR, the query didn't fail. But to this question, the answer is obviously yes. You'd better to test it

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28868: [SPARK-32029][SQL] Check active session if spark context is stop

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28868: URL: https://github.com/apache/spark/pull/28868#issuecomment-652400254 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-652400790 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28961: [SPARK-32143][SQL] Prevent a skewed join from producing too many partition splits

2020-07-01 Thread GitBox
SparkQA commented on pull request #28961: URL: https://github.com/apache/spark/pull/28961#issuecomment-652409477 **[Test build #124782 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124782/testReport)** for PR 28961 at commit

[GitHub] [spark] LantaoJin commented on a change in pull request #28947: [SPARK-32129][SQL] Support AQE skew join with Union

2020-07-01 Thread GitBox
LantaoJin commented on a change in pull request #28947: URL: https://github.com/apache/spark/pull/28947#discussion_r448352093 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewedJoin.scala ## @@ -286,6 +283,36 @@ case class

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28940: [SPARK-32121][SHUFFLE] Support Windows OS in ExecutorDiskUtils

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28940: URL: https://github.com/apache/spark/pull/28940#issuecomment-652408737 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #28961: [SPARK-32143][SQL] Prevent a skewed join from producing too many partition splits

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28961: URL: https://github.com/apache/spark/pull/28961#issuecomment-652409489 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] LantaoJin commented on a change in pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
LantaoJin commented on a change in pull request #28833: URL: https://github.com/apache/spark/pull/28833#discussion_r448255880 ## File path: sql/core/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveSessionCatalog.scala ## @@ -319,6 +323,7 @@ class

[GitHub] [spark] attilapiros commented on pull request #28940: [SPARK-32121][SHUFFLE] Support Windows OS in ExecutorDiskUtils

2020-07-01 Thread GitBox
attilapiros commented on pull request #28940: URL: https://github.com/apache/spark/pull/28940#issuecomment-652331458 Regarding the changes below I will create a PR and open a new Jira ticket (so it will be taken care of). > We have to measure it for sure. > > Regarding

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28912: [SPARK-32057][SQL][test-hive1.2] ExecuteStatement: cancel and close should not transiently ERROR

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28912: URL: https://github.com/apache/spark/pull/28912#issuecomment-652358468 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28962: [SPARK-32136][SQL] NormalizeFloatingNumbers should work on null struct

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28962: URL: https://github.com/apache/spark/pull/28962#issuecomment-652373586 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28962: [SPARK-32136][SQL] NormalizeFloatingNumbers should work on null struct

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28962: URL: https://github.com/apache/spark/pull/28962#issuecomment-652373597 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HyukjinKwon commented on pull request #28962: [SPARK-32136][SQL] NormalizeFloatingNumbers should work on null struct

2020-07-01 Thread GitBox
HyukjinKwon commented on pull request #28962: URL: https://github.com/apache/spark/pull/28962#issuecomment-652373549 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-652381500 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-652381500 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
SparkQA commented on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-652381356 **[Test build #124766 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124766/testReport)** for PR 28833 at commit

[GitHub] [spark] yaooqinn commented on pull request #28912: [SPARK-32057][SQL][test-hive1.2] ExecuteStatement: cancel and close should not transiently ERROR

2020-07-01 Thread GitBox
yaooqinn commented on pull request #28912: URL: https://github.com/apache/spark/pull/28912#issuecomment-652392159 The test failures look like that we need to set up a dedicated JVM for this newly added test This is an

[GitHub] [spark] SparkQA commented on pull request #27983: [SPARK-32105][SQL]Refactor current ScriptTransformationExec code

2020-07-01 Thread GitBox
SparkQA commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-652399554 **[Test build #124781 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124781/testReport)** for PR 27983 at commit

[GitHub] [spark] LantaoJin commented on pull request #28963: [SPARK-32145][SQL] ThriftCLIService.GetOperationStatus should include exception's stack trace to the error message

2020-07-01 Thread GitBox
LantaoJin commented on pull request #28963: URL: https://github.com/apache/spark/pull/28963#issuecomment-652399895 > I could not reproduce the case you provided in that PR, the query didn't fail. But to this question, the answer is obviously yes. You'd better to test it before

[GitHub] [spark] SparkQA commented on pull request #28868: [SPARK-32029][SQL] Check active session if spark context is stop

2020-07-01 Thread GitBox
SparkQA commented on pull request #28868: URL: https://github.com/apache/spark/pull/28868#issuecomment-652399570 **[Test build #124780 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124780/testReport)** for PR 28868 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #28940: [SPARK-32121][SHUFFLE] Support Windows OS in ExecutorDiskUtils

2020-07-01 Thread GitBox
HyukjinKwon commented on pull request #28940: URL: https://github.com/apache/spark/pull/28940#issuecomment-652405146 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] LantaoJin commented on pull request #28947: [SPARK-32129][SQL] Support AQE skew join with Union

2020-07-01 Thread GitBox
LantaoJin commented on pull request #28947: URL: https://github.com/apache/spark/pull/28947#issuecomment-652412903 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27983: [SPARK-32105][SQL]Refactor current ScriptTransformationExec code

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-652412072 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #28948: [SPARK-31935][SQL][FOLLOWUP] Hadoop file system config should be effective in data source options

2020-07-01 Thread GitBox
SparkQA commented on pull request #28948: URL: https://github.com/apache/spark/pull/28948#issuecomment-652319699 **[Test build #124742 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124742/testReport)** for PR 28948 at commit

[GitHub] [spark] SparkQA commented on pull request #28964: [SPARK-32144][SQL] Retain EXTERNAL property in hive table properties

2020-07-01 Thread GitBox
SparkQA commented on pull request #28964: URL: https://github.com/apache/spark/pull/28964#issuecomment-652360239 **[Test build #124769 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124769/testReport)** for PR 28964 at commit

[GitHub] [spark] SparkQA commented on pull request #28917: [SPARK-31847][CORE][TESTS] DAGSchedulerSuite: Rewrite the test framework to support apply specified spark configurations.

2020-07-01 Thread GitBox
SparkQA commented on pull request #28917: URL: https://github.com/apache/spark/pull/28917#issuecomment-652360603 **[Test build #124756 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124756/testReport)** for PR 28917 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28917: [SPARK-31847][CORE][TESTS] DAGSchedulerSuite: Rewrite the test framework to support apply specified spark configurations.

2020-07-01 Thread GitBox
SparkQA removed a comment on pull request #28917: URL: https://github.com/apache/spark/pull/28917#issuecomment-652252749 **[Test build #124756 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124756/testReport)** for PR 28917 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28917: [SPARK-31847][CORE][TESTS] DAGSchedulerSuite: Rewrite the test framework to support apply specified spark configurations.

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28917: URL: https://github.com/apache/spark/pull/28917#issuecomment-652361587 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28917: [SPARK-31847][CORE][TESTS] DAGSchedulerSuite: Rewrite the test framework to support apply specified spark configurations.

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28917: URL: https://github.com/apache/spark/pull/28917#issuecomment-652361587 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28952: [SPARK-32056][SQL][Follow-up] Coalesce partitions for repartiotion hint and sql when AQE is enabled

2020-07-01 Thread GitBox
SparkQA commented on pull request #28952: URL: https://github.com/apache/spark/pull/28952#issuecomment-652377739 **[Test build #124774 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124774/testReport)** for PR 28952 at commit

[GitHub] [spark] SparkQA commented on pull request #24939: [SPARK-18569][ML][R] Support RFormula arithmetic, I() and spark functions

2020-07-01 Thread GitBox
SparkQA commented on pull request #24939: URL: https://github.com/apache/spark/pull/24939#issuecomment-652377764 **[Test build #124775 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124775/testReport)** for PR 24939 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #27735: [RFC][SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-652385738 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #27735: [RFC][SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-07-01 Thread GitBox
SparkQA commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-652385711 **[Test build #124777 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124777/testReport)** for PR 27735 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #27735: [RFC][SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-07-01 Thread GitBox
SparkQA removed a comment on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-652381166 **[Test build #124777 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124777/testReport)** for PR 27735 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27735: [RFC][SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-652385738 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #27735: [RFC][SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-652390714 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] yaooqinn edited a comment on pull request #28963: [SPARK-32145][SQL] ThriftCLIService.GetOperationStatus should include exception's stack trace to the error message

2020-07-01 Thread GitBox
yaooqinn edited a comment on pull request #28963: URL: https://github.com/apache/spark/pull/28963#issuecomment-652390360 I guess the current approach is able to uncover the real reason for task failures via printing all suppressed exceptions if any. Too much important information is

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27735: [RFC][SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-652390714 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #28940: [SPARK-32121][SHUFFLE] Support Windows OS in ExecutorDiskUtils

2020-07-01 Thread GitBox
SparkQA commented on pull request #28940: URL: https://github.com/apache/spark/pull/28940#issuecomment-652401587 **[Test build #124765 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124765/testReport)** for PR 28940 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28868: [SPARK-32029][SQL] Check active session if spark context is stop

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28868: URL: https://github.com/apache/spark/pull/28868#issuecomment-652401703 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #27735: [RFC][SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-652401779 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28885: [SPARK-29375][SPARK-28940][SPARK-32041][SQL] Whole plan exchange and subquery reuse

2020-07-01 Thread GitBox
SparkQA removed a comment on pull request #28885: URL: https://github.com/apache/spark/pull/28885#issuecomment-652241921 **[Test build #124753 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124753/testReport)** for PR 28885 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-652414132 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #28885: [SPARK-29375][SPARK-28940][SPARK-32041][SQL] Whole plan exchange and subquery reuse

2020-07-01 Thread GitBox
SparkQA commented on pull request #28885: URL: https://github.com/apache/spark/pull/28885#issuecomment-652414513 **[Test build #124753 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124753/testReport)** for PR 28885 at commit

[GitHub] [spark] LantaoJin commented on a change in pull request #28947: [SPARK-32129][SQL] Support AQE skew join with Union

2020-07-01 Thread GitBox
LantaoJin commented on a change in pull request #28947: URL: https://github.com/apache/spark/pull/28947#discussion_r448352093 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/OptimizeSkewedJoin.scala ## @@ -286,6 +283,36 @@ case class

[GitHub] [spark] AmplabJenkins commented on pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-652414132 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28833: [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

2020-07-01 Thread GitBox
SparkQA commented on pull request #28833: URL: https://github.com/apache/spark/pull/28833#issuecomment-652327470 **[Test build #124766 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124766/testReport)** for PR 28833 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28912: [SPARK-32057][SQL][test-hive1.2] ExecuteStatement: cancel and close should not transiently ERROR

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28912: URL: https://github.com/apache/spark/pull/28912#issuecomment-652350646 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] juliuszsompolski commented on a change in pull request #28912: [SPARK-32057][SQL][test-hive1.2] ExecuteStatement: cancel and close should not transiently ERROR

2020-07-01 Thread GitBox
juliuszsompolski commented on a change in pull request #28912: URL: https://github.com/apache/spark/pull/28912#discussion_r448285230 ## File path: sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/SparkExecuteStatementOperationSuite.scala ## @@ -42,4

[GitHub] [spark] SparkQA commented on pull request #28966: [SPARK-32130][SQL] Disable the JSON option `inferTimestamp` by default

2020-07-01 Thread GitBox
SparkQA commented on pull request #28966: URL: https://github.com/apache/spark/pull/28966#issuecomment-652367481 **[Test build #124770 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124770/testReport)** for PR 28966 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28965: [SPARK-32124][CORE][FOLLOW-UP] Use the invalid value -2 to fill the map index when the event logs from the old Spark version

2020-07-01 Thread GitBox
SparkQA removed a comment on pull request #28965: URL: https://github.com/apache/spark/pull/28965#issuecomment-652272809 **[Test build #124760 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124760/testReport)** for PR 28965 at commit

[GitHub] [spark] SparkQA commented on pull request #28965: [SPARK-32124][CORE][FOLLOW-UP] Use the invalid value -2 to fill the map index when the event logs from the old Spark version

2020-07-01 Thread GitBox
SparkQA commented on pull request #28965: URL: https://github.com/apache/spark/pull/28965#issuecomment-652366865 **[Test build #124760 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124760/testReport)** for PR 28965 at commit

[GitHub] [spark] MaxGekk opened a new pull request #28966: [SPARK-32130][SQL] Disable the JSON option `inferTimestamp` by default

2020-07-01 Thread GitBox
MaxGekk opened a new pull request #28966: URL: https://github.com/apache/spark/pull/28966 ### What changes were proposed in this pull request? Set the JSON option `inferTimestamp` to `false` if an user don't pass it as datasource option. ### Why are the changes needed? To

[GitHub] [spark] AmplabJenkins commented on pull request #28965: [SPARK-32124][CORE][FOLLOW-UP] Use the invalid value -2 to fill the map index when the event logs from the old Spark version

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28965: URL: https://github.com/apache/spark/pull/28965#issuecomment-652367545 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #27620: [SPARK-30866][SS] FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #27620: URL: https://github.com/apache/spark/pull/27620#issuecomment-652371165 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HyukjinKwon commented on pull request #28940: [SPARK-32121][SHUFFLE] Support Windows OS in ExecutorDiskUtils

2020-07-01 Thread GitBox
HyukjinKwon commented on pull request #28940: URL: https://github.com/apache/spark/pull/28940#issuecomment-652371340 Sure, @attilapiros. Thanks you for following up and investigating deep. I will merge this one as soon as the tests pass.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27620: [SPARK-30866][SS] FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #27620: URL: https://github.com/apache/spark/pull/27620#issuecomment-652371165 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] MaxGekk commented on pull request #28966: [SPARK-32130][SQL] Disable the JSON option `inferTimestamp` by default

2020-07-01 Thread GitBox
MaxGekk commented on pull request #28966: URL: https://github.com/apache/spark/pull/28966#issuecomment-652371322 I am running JSONBenchmark now. If it will show significantly different numbers, I will push the changes to this PR.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27620: [SPARK-30866][SS] FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #27620: URL: https://github.com/apache/spark/pull/27620#issuecomment-652371173 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #27620: [SPARK-30866][SS] FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-07-01 Thread GitBox
SparkQA removed a comment on pull request #27620: URL: https://github.com/apache/spark/pull/27620#issuecomment-652294630 **[Test build #124763 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124763/testReport)** for PR 27620 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28962: [SPARK-32136][SQL] NormalizeFloatingNumbers should work on null struct

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28962: URL: https://github.com/apache/spark/pull/28962#issuecomment-652373597 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #27735: [RFC][SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-07-01 Thread GitBox
SparkQA commented on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-652374547 **[Test build #124772 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124772/testReport)** for PR 27735 at commit

[GitHub] [spark] SparkQA commented on pull request #28962: [SPARK-32136][SQL] NormalizeFloatingNumbers should work on null struct

2020-07-01 Thread GitBox
SparkQA commented on pull request #28962: URL: https://github.com/apache/spark/pull/28962#issuecomment-652374708 **[Test build #124771 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124771/testReport)** for PR 28962 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #27620: [SPARK-30866][SS] FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #27620: URL: https://github.com/apache/spark/pull/27620#issuecomment-652375096 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28962: [SPARK-32136][SQL] NormalizeFloatingNumbers should work on null struct

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28962: URL: https://github.com/apache/spark/pull/28962#issuecomment-652375106 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28952: [SPARK-32056][SQL][Follow-up] Coalesce partitions for repartiotion hint and sql when AQE is enabled

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28952: URL: https://github.com/apache/spark/pull/28952#issuecomment-652378396 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28948: [SPARK-31935][SQL][FOLLOWUP] Hadoop file system config should be effective in data source options

2020-07-01 Thread GitBox
AmplabJenkins commented on pull request #28948: URL: https://github.com/apache/spark/pull/28948#issuecomment-652378387 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28952: [SPARK-32056][SQL][Follow-up] Coalesce partitions for repartiotion hint and sql when AQE is enabled

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28952: URL: https://github.com/apache/spark/pull/28952#issuecomment-652378409 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28948: [SPARK-31935][SQL][FOLLOWUP] Hadoop file system config should be effective in data source options

2020-07-01 Thread GitBox
AmplabJenkins removed a comment on pull request #28948: URL: https://github.com/apache/spark/pull/28948#issuecomment-652378387 This is an automated message from the Apache Git Service. To respond to the message, please log on

  1   2   3   4   5   6   7   8   9   10   >