[GitHub] [spark] beliefer commented on a change in pull request #29747: [SPARK-31848][CORE][TEST] DAGSchedulerSuite: Break down the very huge test file

beliefer commented on a change in pull request #29747: URL: https://github.com/apache/spark/pull/29747#discussion_r488407225 ## File path: core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerTestHelper.scala ## @@ -0,0 +1,614 @@ +/* + * Licensed to the Apache Software

[GitHub] [spark] AmplabJenkins commented on pull request #29756: [SPARK-32885][SS] Add DataStreamReader.table API

AmplabJenkins commented on pull request #29756: URL: https://github.com/apache/spark/pull/29756#issuecomment-692514096 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

AmplabJenkins commented on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-692514640 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

AmplabJenkins removed a comment on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-692514640 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29515: [SPARK-32688][SQL][TESTS] Add special values to LiteralGenerator for float and double

AmplabJenkins commented on pull request #29515: URL: https://github.com/apache/spark/pull/29515#issuecomment-692514762 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29747: [SPARK-31848][CORE][TEST] DAGSchedulerSuite: Break down the very huge test file

AmplabJenkins removed a comment on pull request #29747: URL: https://github.com/apache/spark/pull/29747#issuecomment-692536890 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #29515: [SPARK-32688][SQL][TEST] Add special values to LiteralGenerator for float and double

SparkQA commented on pull request #29515: URL: https://github.com/apache/spark/pull/29515#issuecomment-692538599 **[Test build #128707 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128707/testReport)** for PR 29515 at commit

[GitHub] [spark] HeartSaVioR commented on a change in pull request #29729: [SPARK-32032][SS] Avoid infinite wait in driver because of KafkaConsumer.poll(long) API

HeartSaVioR commented on a change in pull request #29729: URL: https://github.com/apache/spark/pull/29729#discussion_r488463637 ## File path: external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaMicroBatchSourceSuite.scala ## @@ -689,57 +691,6 @@ abstract

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #29729: [SPARK-32032][SS] Avoid infinite wait in driver because of KafkaConsumer.poll(long) API

gaborgsomogyi commented on a change in pull request #29729: URL: https://github.com/apache/spark/pull/29729#discussion_r488470443 ## File path: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaOffsetReader.scala ## @@ -213,64 +180,70 @@

[GitHub] [spark] maropu commented on pull request #29755: [SPARK-32884][TESTS] Mark TPCDSQuery*Suite as ExtendedSQLTest

maropu commented on pull request #29755: URL: https://github.com/apache/spark/pull/29755#issuecomment-692544802 Nice update! (To get a report `Report test results`, I often wait for the longest job to be completed... ) This

[GitHub] [spark] zhli1142015 commented on pull request #29757: [SPARK-32886][WEBUI] fix 'undefined' link in event timeline view

zhli1142015 commented on pull request #29757: URL: https://github.com/apache/spark/pull/29757#issuecomment-692554880 @sarutak , @dongjoon-hyun, could you please take a look, thanks. This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29757: [SPARK-32886][WEBUI] fix 'undefined' link in event timeline view

AmplabJenkins removed a comment on pull request #29757: URL: https://github.com/apache/spark/pull/29757#issuecomment-692553777 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins commented on pull request #29757: [SPARK-32886][WEBUI] fix 'undefined' link in event timeline view

AmplabJenkins commented on pull request #29757: URL: https://github.com/apache/spark/pull/29757#issuecomment-692554527 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #29729: [SPARK-32032][SS] Avoid infinite wait in driver because of KafkaConsumer.poll(long) API

SparkQA commented on pull request #29729: URL: https://github.com/apache/spark/pull/29729#issuecomment-692570887 **[Test build #128708 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128708/testReport)** for PR 29729 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29739: [SPARK-32867][SQL] When explain, HiveTableRelation show limited message

SparkQA removed a comment on pull request #29739: URL: https://github.com/apache/spark/pull/29739#issuecomment-692513408 **[Test build #128700 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128700/testReport)** for PR 29739 at commit

[GitHub] [spark] SparkQA commented on pull request #29739: [SPARK-32867][SQL] When explain, HiveTableRelation show limited message

SparkQA commented on pull request #29739: URL: https://github.com/apache/spark/pull/29739#issuecomment-692598608 **[Test build #128700 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128700/testReport)** for PR 29739 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29739: [SPARK-32867][SQL] When explain, HiveTableRelation show limited message

AmplabJenkins commented on pull request #29739: URL: https://github.com/apache/spark/pull/29739#issuecomment-692598918 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29739: [SPARK-32867][SQL] When explain, HiveTableRelation show limited message

AmplabJenkins removed a comment on pull request #29739: URL: https://github.com/apache/spark/pull/29739#issuecomment-692598918 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] viirya commented on pull request #29587: [SPARK-32376][SQL] Make unionByName null-filling behavior work with struct columns

viirya commented on pull request #29587: URL: https://github.com/apache/spark/pull/29587#issuecomment-692497877 @maropu @dongjoon-hyun Per @fqaiser94's comment, I refactored the code a little bit. Please let me know what you think about the change now. Thanks.

[GitHub] [spark] SparkQA commented on pull request #29743: [SPARK-32870][DOCS][SQL] Make sure that all expressions have their ExpressionDescription filled

SparkQA commented on pull request #29743: URL: https://github.com/apache/spark/pull/29743#issuecomment-692498146 **[Test build #128697 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128697/testReport)** for PR 29743 at commit

[GitHub] [spark] SparkQA commented on pull request #29749: [SPARK-32877][SQL] Fix Hive UDF not support decimal type in complex type

SparkQA commented on pull request #29749: URL: https://github.com/apache/spark/pull/29749#issuecomment-692512288 **[Test build #128696 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128696/testReport)** for PR 29749 at commit

[GitHub] [spark] SparkQA commented on pull request #29591: [SPARK-32714][PYTHON] Initial pyspark-stubs port.

SparkQA commented on pull request #29591: URL: https://github.com/apache/spark/pull/29591#issuecomment-692512299 **[Test build #128698 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128698/testReport)** for PR 29591 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #27649: [SPARK-30900][SS] FileStreamSource: Avoid reading compact metadata log twice if the query restarts from compact batch

AmplabJenkins commented on pull request #27649: URL: https://github.com/apache/spark/pull/27649#issuecomment-692512260 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29515: [SPARK-32688][SQL][TESTS] Add special values to LiteralGenerator for float and double

SparkQA commented on pull request #29515: URL: https://github.com/apache/spark/pull/29515#issuecomment-692512305 **[Test build #128688 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128688/testReport)** for PR 29515 at commit

[GitHub] [spark] SparkQA commented on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

SparkQA commented on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-692512306 **[Test build #128678 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128678/testReport)** for PR 26935 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27649: [SPARK-30900][SS] FileStreamSource: Avoid reading compact metadata log twice if the query restarts from compact batch

AmplabJenkins removed a comment on pull request #27649: URL: https://github.com/apache/spark/pull/27649#issuecomment-692512260 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29743: [SPARK-32870][DOCS][SQL] Make sure that all expressions have their ExpressionDescription filled

SparkQA commented on pull request #29743: URL: https://github.com/apache/spark/pull/29743#issuecomment-692512283 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] xuanyuanking commented on a change in pull request #29756: [SPARK-32885][SS] Add DataStreamReader.table API

xuanyuanking commented on a change in pull request #29756: URL: https://github.com/apache/spark/pull/29756#discussion_r488433490 ## File path: sql/core/src/main/scala/org/apache/spark/sql/streaming/DataStreamReader.scala ## @@ -475,6 +476,23 @@ final class DataStreamReader

[GitHub] [spark] SparkQA commented on pull request #29756: [SPARK-32885][SS] Add DataStreamReader.table API

SparkQA commented on pull request #29756: URL: https://github.com/apache/spark/pull/29756#issuecomment-692512071 **[Test build #128699 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128699/testReport)** for PR 29756 at commit

[GitHub] [spark] SparkQA commented on pull request #29739: [SPARK-32867][SQL] When explain, HiveTableRelation show limited message

SparkQA commented on pull request #29739: URL: https://github.com/apache/spark/pull/29739#issuecomment-692512297 **[Test build #128691 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128691/testReport)** for PR 29739 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29591: [SPARK-32714][PYTHON] Initial pyspark-stubs port.

AmplabJenkins commented on pull request #29591: URL: https://github.com/apache/spark/pull/29591#issuecomment-692512473 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28422: [SPARK-17604][SS] FileStreamSource: provide a new option to have retention on input files

SparkQA commented on pull request #28422: URL: https://github.com/apache/spark/pull/28422#issuecomment-692512307 **[Test build #128682 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128682/testReport)** for PR 28422 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29756: [SPARK-32885][SS] Add DataStreamReader.table API

AmplabJenkins commented on pull request #29756: URL: https://github.com/apache/spark/pull/29756#issuecomment-692512108 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29755: [SPARK-32884][TESTS] Mark TPCDSQuery*Suite as ExtendedSQLTest

SparkQA commented on pull request #29755: URL: https://github.com/apache/spark/pull/29755#issuecomment-692512282 **[Test build #128695 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128695/testReport)** for PR 29755 at commit

[GitHub] [spark] SparkQA commented on pull request #25965: [SPARK-26425][SS] Add more constraint checks to avoid checkpoint corruption

SparkQA commented on pull request #25965: URL: https://github.com/apache/spark/pull/25965#issuecomment-692512284 **[Test build #128679 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128679/testReport)** for PR 25965 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29756: [SPARK-32885][SS] Add DataStreamReader.table API

SparkQA removed a comment on pull request #29756: URL: https://github.com/apache/spark/pull/29756#issuecomment-692506992 **[Test build #128699 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128699/testReport)** for PR 29756 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29754: [WIP][SPARK-32875][CORE][TEST] TaskSchedulerImplSuite: For the pattern of submitTasks + resourceOffers + assert, extract the ge

AmplabJenkins removed a comment on pull request #29754: URL: https://github.com/apache/spark/pull/29754#issuecomment-692535334 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29747: [SPARK-31848][CORE][TEST] DAGSchedulerSuite: Break down the very huge test file

AmplabJenkins removed a comment on pull request #29747: URL: https://github.com/apache/spark/pull/29747#issuecomment-692535325 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29754: [WIP][SPARK-32875][CORE][TEST] TaskSchedulerImplSuite: For the pattern of submitTasks + resourceOffers + assert, extract the general me

AmplabJenkins commented on pull request #29754: URL: https://github.com/apache/spark/pull/29754#issuecomment-692535334 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29747: [SPARK-31848][CORE][TEST] DAGSchedulerSuite: Break down the very huge test file

AmplabJenkins commented on pull request #29747: URL: https://github.com/apache/spark/pull/29747#issuecomment-692535325 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29747: [SPARK-31848][CORE][TEST] DAGSchedulerSuite: Break down the very huge test file

SparkQA commented on pull request #29747: URL: https://github.com/apache/spark/pull/29747#issuecomment-692534824 **[Test build #128706 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128706/testReport)** for PR 29747 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29515: [SPARK-32688][SQL][TEST] Add special values to LiteralGenerator for float and double

AmplabJenkins commented on pull request #29515: URL: https://github.com/apache/spark/pull/29515#issuecomment-692535425 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29515: [SPARK-32688][SQL][TEST] Add special values to LiteralGenerator for float and double

AmplabJenkins removed a comment on pull request #29515: URL: https://github.com/apache/spark/pull/29515#issuecomment-692535425 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #29729: [SPARK-32032][SS] Avoid infinite wait in driver because of KafkaConsumer.poll(long) API

gaborgsomogyi commented on a change in pull request #29729: URL: https://github.com/apache/spark/pull/29729#discussion_r48841 ## File path: external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaMicroBatchSourceSuite.scala ## @@ -689,57 +691,6 @@

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #29729: [SPARK-32032][SS] Avoid infinite wait in driver because of KafkaConsumer.poll(long) API

gaborgsomogyi commented on a change in pull request #29729: URL: https://github.com/apache/spark/pull/29729#discussion_r488467044 ## File path: external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaRelationSuite.scala ## @@ -465,41 +463,6 @@ abstract class

[GitHub] [spark] cchighman commented on pull request #28841: [SPARK-31962][SQL] Provide modifiedAfter and modifiedBefore options when filtering from a batch-based file data source

cchighman commented on pull request #28841: URL: https://github.com/apache/spark/pull/28841#issuecomment-692617087 @HeartSaVioR @maropu @Dooyoung-Hwang @cloud-fan @gengliangwang Following up as last feedback was 15 days ago, anything else remaining for this one?

[GitHub] [spark] cloud-fan commented on pull request #29580: [SPARK-32738][CORE] Should reduce the number of active threads if fatal error happens in `Inbox.process`

cloud-fan commented on pull request #29580: URL: https://github.com/apache/spark/pull/29580#issuecomment-692503946 @wzhfy can you open backport PRs for 3.0 and 2.4? thanks! This is an automated message from the Apache Git

[GitHub] [spark] cloud-fan commented on pull request #29580: [SPARK-32738][CORE] Should reduce the number of active threads if fatal error happens in `Inbox.process`

cloud-fan commented on pull request #29580: URL: https://github.com/apache/spark/pull/29580#issuecomment-692503625 thanks, merging to master! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] cloud-fan closed pull request #29580: [SPARK-32738][CORE] Should reduce the number of active threads if fatal error happens in `Inbox.process`

cloud-fan closed pull request #29580: URL: https://github.com/apache/spark/pull/29580 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #29729: [SPARK-32032][SS] Avoid infinite wait in driver because of KafkaConsumer.poll(long) API

gaborgsomogyi commented on a change in pull request #29729: URL: https://github.com/apache/spark/pull/29729#discussion_r488469495 ## File path: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaOffsetReader.scala ## @@ -305,11 +277,12 @@

[GitHub] [spark] AmplabJenkins removed a comment on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

AmplabJenkins removed a comment on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-692552957 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

SparkQA commented on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-692552797 **[Test build #128703 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128703/testReport)** for PR 26935 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

AmplabJenkins commented on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-692552957 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29758: [SPARK-32887][DOC] Correct the typo for SHOW TABLE

AmplabJenkins commented on pull request #29758: URL: https://github.com/apache/spark/pull/29758#issuecomment-692609631 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] HyukjinKwon opened a new pull request #29759: [SPARK-32481][SQL][TESTS] Skip the test if trash directory cannot be created

HyukjinKwon opened a new pull request #29759: URL: https://github.com/apache/spark/pull/29759 ### What changes were proposed in this pull request? This PR skips the test if trash directory cannot be created. It is possible that the trash directory cannot be created, for example, by

[GitHub] [spark] Udbhav30 opened a new pull request #29758: [SPARK-32887][DOC] Correct the typo for SHOW TABLE

Udbhav30 opened a new pull request #29758: URL: https://github.com/apache/spark/pull/29758 ### What changes were proposed in this pull request? Correct the typo in Show Table document ### Why are the changes needed? Current Document of Show Table returns in parse error, so it

[GitHub] [spark] beliefer commented on a change in pull request #29747: [SPARK-31848][CORE][TEST] DAGSchedulerSuite: Break down the very huge test file

beliefer commented on a change in pull request #29747: URL: https://github.com/apache/spark/pull/29747#discussion_r488405786 ## File path: core/src/test/scala/org/apache/spark/scheduler/IndeterminateStageSuite.scala ## @@ -0,0 +1,99 @@ +/* + * Licensed to the Apache Software

[GitHub] [spark] SparkQA commented on pull request #27649: [SPARK-30900][SS] FileStreamSource: Avoid reading compact metadata log twice if the query restarts from compact batch

SparkQA commented on pull request #27649: URL: https://github.com/apache/spark/pull/27649#issuecomment-692510903 **[Test build #128676 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128676/testReport)** for PR 27649 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #27649: [SPARK-30900][SS] FileStreamSource: Avoid reading compact metadata log twice if the query restarts from compact batch

SparkQA removed a comment on pull request #27649: URL: https://github.com/apache/spark/pull/27649#issuecomment-692387275 **[Test build #128676 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128676/testReport)** for PR 27649 at commit

[GitHub] [spark] SparkQA commented on pull request #25965: [SPARK-26425][SS] Add more constraint checks to avoid checkpoint corruption

SparkQA commented on pull request #25965: URL: https://github.com/apache/spark/pull/25965#issuecomment-692523843 **[Test build #128704 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128704/testReport)** for PR 25965 at commit

[GitHub] [spark] SparkQA commented on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

SparkQA commented on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-692523800 **[Test build #128703 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128703/testReport)** for PR 26935 at commit

[GitHub] [spark] dlutleixin commented on pull request #29490: [SPARK-32668][SQL] HiveGenericUDTF initialize UDTF should use StructObjectInspector method

dlutleixin commented on pull request #29490: URL: https://github.com/apache/spark/pull/29490#issuecomment-692523318 yes, I have the same problem while using hive UDTF in spark-sql or spark.sql because of not override `public StructObjectInspector initialize(ObjectInspector[] args)`

[GitHub] [spark] HeartSaVioR commented on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

HeartSaVioR commented on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-692523289 retest this, please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #28422: [SPARK-17604][SS] FileStreamSource: provide a new option to have retention on input files

SparkQA commented on pull request #28422: URL: https://github.com/apache/spark/pull/28422#issuecomment-692523805 **[Test build #128702 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128702/testReport)** for PR 28422 at commit

[GitHub] [spark] HeartSaVioR commented on pull request #28422: [SPARK-17604][SS] FileStreamSource: provide a new option to have retention on input files

HeartSaVioR commented on pull request #28422: URL: https://github.com/apache/spark/pull/28422#issuecomment-692523314 retest this, please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HeartSaVioR commented on pull request #25965: [SPARK-26425][SS] Add more constraint checks to avoid checkpoint corruption

HeartSaVioR commented on pull request #25965: URL: https://github.com/apache/spark/pull/25965#issuecomment-692523262 retest this, please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] beliefer commented on pull request #29754: [WIP][SPARK-32875][CORE][TEST] TaskSchedulerImplSuite: For the pattern of submitTasks + resourceOffers + assert, extract the general method.

beliefer commented on pull request #29754: URL: https://github.com/apache/spark/pull/29754#issuecomment-692532672 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #29729: [SPARK-32032][SS] Avoid infinite wait in driver because of KafkaConsumer.poll(long) API

gaborgsomogyi commented on a change in pull request #29729: URL: https://github.com/apache/spark/pull/29729#discussion_r488456887 ## File path: external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaMicroBatchSourceSuite.scala ## @@ -689,57 +691,6 @@

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29747: [SPARK-31848][CORE][TEST] DAGSchedulerSuite: Break down the very huge test file

AmplabJenkins removed a comment on pull request #29747: URL: https://github.com/apache/spark/pull/29747#issuecomment-692536883 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #29747: [SPARK-31848][CORE][TEST] DAGSchedulerSuite: Break down the very huge test file

SparkQA removed a comment on pull request #29747: URL: https://github.com/apache/spark/pull/29747#issuecomment-692534824 **[Test build #128706 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128706/testReport)** for PR 29747 at commit

[GitHub] [spark] wangyum commented on pull request #29728: [SPARK-32856][SQL] Prohibit binary comparisons chain

wangyum commented on pull request #29728: URL: https://github.com/apache/spark/pull/29728#issuecomment-692491090 @srowen Standard SQL does not have this definition. In fact, `a = b = c` is the same as `a = b = cast(c as boolean)`. examples: ```sql spark-sql> select 0 = 0 = 0;

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29268: [SPARK-29544] Collect the row count info and optimize the skewed conditions with row count info in the OptimizeSkewedJoin rule

AmplabJenkins removed a comment on pull request #29268: URL: https://github.com/apache/spark/pull/29268#issuecomment-692498128 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

AmplabJenkins commented on pull request #27333: URL: https://github.com/apache/spark/pull/27333#issuecomment-692497937 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29268: [SPARK-29544] Collect the row count info and optimize the skewed conditions with row count info in the OptimizeSkewedJoin rule

AmplabJenkins commented on pull request #29268: URL: https://github.com/apache/spark/pull/29268#issuecomment-692498128 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29756: [SPARK-32885][SS] Add DataStreamReader.table API

AmplabJenkins commented on pull request #29756: URL: https://github.com/apache/spark/pull/29756#issuecomment-692498084 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

AmplabJenkins removed a comment on pull request #27333: URL: https://github.com/apache/spark/pull/27333#issuecomment-692497937 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29591: [SPARK-32714][PYTHON] Initial pyspark-stubs port.

SparkQA commented on pull request #29591: URL: https://github.com/apache/spark/pull/29591#issuecomment-692506530 **[Test build #128698 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128698/testReport)** for PR 29591 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29756: [SPARK-32885][SS] Add DataStreamReader.table API

AmplabJenkins removed a comment on pull request #29756: URL: https://github.com/apache/spark/pull/29756#issuecomment-692498084 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29756: [SPARK-32885][SS] Add DataStreamReader.table API

SparkQA commented on pull request #29756: URL: https://github.com/apache/spark/pull/29756#issuecomment-692506992 **[Test build #128699 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128699/testReport)** for PR 29756 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

AmplabJenkins commented on pull request #24173: URL: https://github.com/apache/spark/pull/24173#issuecomment-692506869 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

AmplabJenkins removed a comment on pull request #24173: URL: https://github.com/apache/spark/pull/24173#issuecomment-692506869 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29739: [SPARK-32867][SQL] When explain, HiveTableRelation show limited message

AmplabJenkins removed a comment on pull request #29739: URL: https://github.com/apache/spark/pull/29739#issuecomment-692512996 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29755: [SPARK-32884][TESTS] Mark TPCDSQuery*Suite as ExtendedSQLTest

AmplabJenkins removed a comment on pull request #29755: URL: https://github.com/apache/spark/pull/29755#issuecomment-692512452 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29743: [SPARK-32870][DOCS][SQL] Make sure that all expressions have their ExpressionDescription filled

AmplabJenkins removed a comment on pull request #29743: URL: https://github.com/apache/spark/pull/29743#issuecomment-692512748 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29591: [SPARK-32714][PYTHON] Initial pyspark-stubs port.

AmplabJenkins removed a comment on pull request #29591: URL: https://github.com/apache/spark/pull/29591#issuecomment-692512480 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29749: [SPARK-32877][SQL] Fix Hive UDF not support decimal type in complex type

AmplabJenkins removed a comment on pull request #29749: URL: https://github.com/apache/spark/pull/29749#issuecomment-692512438 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29722: [SPARK-32850][CORE] Simplify the RPC message flow of decommission

AmplabJenkins removed a comment on pull request #29722: URL: https://github.com/apache/spark/pull/29722#issuecomment-692513177 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29587: [SPARK-32376][SQL] Make unionByName null-filling behavior work with struct columns

AmplabJenkins commented on pull request #29587: URL: https://github.com/apache/spark/pull/29587#issuecomment-692513411 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29591: [SPARK-32714][PYTHON] Initial pyspark-stubs port.

AmplabJenkins removed a comment on pull request #29591: URL: https://github.com/apache/spark/pull/29591#issuecomment-692512473 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29749: [SPARK-32877][SQL] Fix Hive UDF not support decimal type in complex type

AmplabJenkins commented on pull request #29749: URL: https://github.com/apache/spark/pull/29749#issuecomment-692512430 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29591: [SPARK-32714][PYTHON] Initial pyspark-stubs port.

SparkQA removed a comment on pull request #29591: URL: https://github.com/apache/spark/pull/29591#issuecomment-692506530 **[Test build #128698 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128698/testReport)** for PR 29591 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29754: [WIP][SPARK-32875][CORE][TEST] TaskSchedulerImplSuite: For the pattern of submitTasks + resourceOffers + assert, extract the general me

AmplabJenkins commented on pull request #29754: URL: https://github.com/apache/spark/pull/29754#issuecomment-692512935 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29743: [SPARK-32870][DOCS][SQL] Make sure that all expressions have their ExpressionDescription filled

AmplabJenkins commented on pull request #29743: URL: https://github.com/apache/spark/pull/29743#issuecomment-692512737 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28422: [SPARK-17604][SS] FileStreamSource: provide a new option to have retention on input files

SparkQA removed a comment on pull request #28422: URL: https://github.com/apache/spark/pull/28422#issuecomment-692389547 **[Test build #128682 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128682/testReport)** for PR 28422 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29722: [SPARK-32850][CORE] Simplify the RPC message flow of decommission

SparkQA removed a comment on pull request #29722: URL: https://github.com/apache/spark/pull/29722#issuecomment-692455812 **[Test build #128693 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128693/testReport)** for PR 29722 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29743: [SPARK-32870][DOCS][SQL] Make sure that all expressions have their ExpressionDescription filled

AmplabJenkins removed a comment on pull request #29743: URL: https://github.com/apache/spark/pull/29743#issuecomment-692512404 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29749: [SPARK-32877][SQL] Fix Hive UDF not support decimal type in complex type

SparkQA removed a comment on pull request #29749: URL: https://github.com/apache/spark/pull/29749#issuecomment-692496696 **[Test build #128696 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/128696/testReport)** for PR 29749 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29755: [SPARK-32884][TESTS] Mark TPCDSQuery*Suite as ExtendedSQLTest

AmplabJenkins removed a comment on pull request #29755: URL: https://github.com/apache/spark/pull/29755#issuecomment-692512443 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29756: [SPARK-32885][SS] Add DataStreamReader.table API

AmplabJenkins removed a comment on pull request #29756: URL: https://github.com/apache/spark/pull/29756#issuecomment-692512113 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #29587: [SPARK-32376][SQL] Make unionByName null-filling behavior work with struct columns

SparkQA removed a comment on pull request #29587: URL: https://github.com/apache/spark/pull/29587#issuecomment-692396939 This is an automated message from the Apache Git Service. To respond to the message, please log on to

  1   2   3   4   5   6   >