[GitHub] [spark] SparkQA commented on pull request #29303: [SPARK-32492][SQL] Fulfill missing column meta information for thriftserver client tools
SparkQA commented on pull request #29303: URL: https://github.com/apache/spark/pull/29303#issuecomment-666942749 **[Test build #126852 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126852/testReport)** for PR 29303 at commit [`2a319ff`](https://github.com/apache/spark/commit/2a319ff00d0dde63209f6df7427abe26ece2f85d). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #28902: [SPARK-31801][API][SHUFFLE][TESTS] Tests for registering map output metadata
AmplabJenkins commented on pull request #28902: URL: https://github.com/apache/spark/pull/28902#issuecomment-666942651 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] cloud-fan commented on pull request #29277: [SPARK-32421][SQL] Add code-gen for shuffled hash join
cloud-fan commented on pull request #29277: URL: https://github.com/apache/spark/pull/29277#issuecomment-666942596 @c21 thanks for your great work! If you want to work on the [followup](https://github.com/apache/spark/pull/29277#discussion_r463415144) , please let me know. I can create a JIRA ticket and we can discuss there. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #28902: [SPARK-31801][API][SHUFFLE][TESTS] Tests for registering map output metadata
SparkQA removed a comment on pull request #28902: URL: https://github.com/apache/spark/pull/28902#issuecomment-666878201 **[Test build #126834 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126834/testReport)** for PR 28902 at commit [`5b2373a`](https://github.com/apache/spark/commit/5b2373a03a7a275a0b696bea64116cc2df499b16). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29289: [SPARK-32482][SS][TESTS] Eliminate deprecated poll(long) API calls to avoid infinite wait in tests
AmplabJenkins removed a comment on pull request #29289: URL: https://github.com/apache/spark/pull/29289#issuecomment-666941978 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29146: [SPARK-32257][SQL] Reports explicit errors for invalid usage of SET/RESET command
SparkQA commented on pull request #29146: URL: https://github.com/apache/spark/pull/29146#issuecomment-666942100 **[Test build #126851 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126851/testReport)** for PR 29146 at commit [`6d2221d`](https://github.com/apache/spark/commit/6d2221daadb7e7934982ed4be8d1700c59c90ad0). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #28902: [SPARK-31801][API][SHUFFLE][TESTS] Tests for registering map output metadata
SparkQA commented on pull request #28902: URL: https://github.com/apache/spark/pull/28902#issuecomment-666942073 **[Test build #126834 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126834/testReport)** for PR 28902 at commit [`5b2373a`](https://github.com/apache/spark/commit/5b2373a03a7a275a0b696bea64116cc2df499b16). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #27432: [SPARK-28325][SQL]Support ANSI SQL: SIMILAR TO ... ESCAPE syntax
AmplabJenkins removed a comment on pull request #27432: URL: https://github.com/apache/spark/pull/27432#issuecomment-666941895 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #27432: [SPARK-28325][SQL]Support ANSI SQL: SIMILAR TO ... ESCAPE syntax
AmplabJenkins commented on pull request #27432: URL: https://github.com/apache/spark/pull/27432#issuecomment-666941895 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29289: [SPARK-32482][SS][TESTS] Eliminate deprecated poll(long) API calls to avoid infinite wait in tests
AmplabJenkins commented on pull request #29289: URL: https://github.com/apache/spark/pull/29289#issuecomment-666941978 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #27432: [SPARK-28325][SQL]Support ANSI SQL: SIMILAR TO ... ESCAPE syntax
SparkQA removed a comment on pull request #27432: URL: https://github.com/apache/spark/pull/27432#issuecomment-666775225 **[Test build #126824 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126824/testReport)** for PR 27432 at commit [`e4805a8`](https://github.com/apache/spark/commit/e4805a82db49628ee535ae53f8e5b4de43a21053). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HeartSaVioR commented on pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests
HeartSaVioR commented on pull request #29272: URL: https://github.com/apache/spark/pull/29272#issuecomment-666941121 Thanks, merged to master! This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HeartSaVioR closed pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests
HeartSaVioR closed pull request #29272: URL: https://github.com/apache/spark/pull/29272 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #27432: [SPARK-28325][SQL]Support ANSI SQL: SIMILAR TO ... ESCAPE syntax
SparkQA commented on pull request #27432: URL: https://github.com/apache/spark/pull/27432#issuecomment-666940968 **[Test build #126824 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126824/testReport)** for PR 27432 at commit [`e4805a8`](https://github.com/apache/spark/commit/e4805a82db49628ee535ae53f8e5b4de43a21053). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] c21 commented on pull request #29277: [SPARK-32421][SQL] Add code-gen for shuffled hash join
c21 commented on pull request #29277: URL: https://github.com/apache/spark/pull/29277#issuecomment-666940910 Thank you @cloud-fan and @viirya for review and discussion! This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HeartSaVioR commented on pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests
HeartSaVioR commented on pull request #29272: URL: https://github.com/apache/spark/pull/29272#issuecomment-666940701 lol, somehow it passes Jenkins build. Merging. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] cloud-fan closed pull request #29277: [SPARK-32421][SQL] Add code-gen for shuffled hash join
cloud-fan closed pull request #29277: URL: https://github.com/apache/spark/pull/29277 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] c21 commented on a change in pull request #29277: [SPARK-32421][SQL] Add code-gen for shuffled hash join
c21 commented on a change in pull request #29277: URL: https://github.com/apache/spark/pull/29277#discussion_r463417776 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/WholeStageCodegenExec.scala ## @@ -903,6 +904,10 @@ case class CollapseCodegenStages( // The children of SortMergeJoin should do codegen separately. j.withNewChildren(j.children.map( child => InputAdapter(insertWholeStageCodegen(child + case j: ShuffledHashJoinExec => +// The children of ShuffledHashJoin should do codegen separately. +j.withNewChildren(j.children.map( Review comment: > We need to accumulate the CodegenSupport.inputRDDs, but WholeStageCodegenExec only supports up to 2 input RDDs for now. Yes. Agreed. `SortMergeJoinExec` took the decision to do codegen for children separately, it's just simpler without getting into these limitations. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] c21 commented on a change in pull request #29277: [SPARK-32421][SQL] Add code-gen for shuffled hash join
c21 commented on a change in pull request #29277: URL: https://github.com/apache/spark/pull/29277#discussion_r463417776 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/WholeStageCodegenExec.scala ## @@ -903,6 +904,10 @@ case class CollapseCodegenStages( // The children of SortMergeJoin should do codegen separately. j.withNewChildren(j.children.map( child => InputAdapter(insertWholeStageCodegen(child + case j: ShuffledHashJoinExec => +// The children of ShuffledHashJoin should do codegen separately. +j.withNewChildren(j.children.map( Review comment: > We need to accumulate the CodegenSupport.inputRDDs, but WholeStageCodegenExec only supports up to 2 input RDDs for now. Yes. Agreed. That's why I think `SortMergeJoinExec` took the decision to do codegen for children separately. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] cloud-fan commented on pull request #29277: [SPARK-32421][SQL] Add code-gen for shuffled hash join
cloud-fan commented on pull request #29277: URL: https://github.com/apache/spark/pull/29277#issuecomment-666940536 thanks, merging to master! This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] cloud-fan commented on a change in pull request #29277: [SPARK-32421][SQL] Add code-gen for shuffled hash join
cloud-fan commented on a change in pull request #29277: URL: https://github.com/apache/spark/pull/29277#discussion_r463417316 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/WholeStageCodegenExec.scala ## @@ -903,6 +904,10 @@ case class CollapseCodegenStages( // The children of SortMergeJoin should do codegen separately. j.withNewChildren(j.children.map( child => InputAdapter(insertWholeStageCodegen(child + case j: ShuffledHashJoinExec => +// The children of ShuffledHashJoin should do codegen separately. +j.withNewChildren(j.children.map( Review comment: And there are more problems if we have many shuffle hash join stay together. We need to accumulate the `CodegenSupport.inputRDDs`, but `WholeStageCodegenExec` only supports up to 2 input RDDs for now. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] c21 commented on a change in pull request #29277: [SPARK-32421][SQL] Add code-gen for shuffled hash join
c21 commented on a change in pull request #29277: URL: https://github.com/apache/spark/pull/29277#discussion_r463416899 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/WholeStageCodegenExec.scala ## @@ -903,6 +904,10 @@ case class CollapseCodegenStages( // The children of SortMergeJoin should do codegen separately. j.withNewChildren(j.children.map( child => InputAdapter(insertWholeStageCodegen(child + case j: ShuffledHashJoinExec => +// The children of ShuffledHashJoin should do codegen separately. +j.withNewChildren(j.children.map( Review comment: @cloud-fan - sounds good, non-trivial for me now as well. Will try to resolve it in the future. Thanks. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests
AmplabJenkins removed a comment on pull request #29272: URL: https://github.com/apache/spark/pull/29272#issuecomment-666935675 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests
AmplabJenkins commented on pull request #29272: URL: https://github.com/apache/spark/pull/29272#issuecomment-666935675 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29179: [WIP][SPARK-32381][CORE][SQL] Explore allowing parallel listing & non-location sensitive listing in core
SparkQA commented on pull request #29179: URL: https://github.com/apache/spark/pull/29179#issuecomment-666936200 **[Test build #126849 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126849/testReport)** for PR 29179 at commit [`9e84e88`](https://github.com/apache/spark/commit/9e84e8802264232d2c5ed71686d4af1ec469a95f). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] cloud-fan commented on a change in pull request #29277: [SPARK-32421][SQL] Add code-gen for shuffled hash join
cloud-fan commented on a change in pull request #29277: URL: https://github.com/apache/spark/pull/29277#discussion_r463415144 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/WholeStageCodegenExec.scala ## @@ -903,6 +904,10 @@ case class CollapseCodegenStages( // The children of SortMergeJoin should do codegen separately. j.withNewChildren(j.children.map( child => InputAdapter(insertWholeStageCodegen(child + case j: ShuffledHashJoinExec => +// The children of ShuffledHashJoin should do codegen separately. +j.withNewChildren(j.children.map( Review comment: Makes sense to me. It's possible to make the input index dynamic, so one join node can use `input[0]` and the other can use `input[1]`. But I don't have a good idea about how to do it now. Let's leave it for future work. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests
SparkQA removed a comment on pull request #29272: URL: https://github.com/apache/spark/pull/29272#issuecomment-666912015 **[Test build #126840 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126840/testReport)** for PR 29272 at commit [`4c3a9f1`](https://github.com/apache/spark/commit/4c3a9f1b054e67d7a362c40364b15f5558993246). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests
SparkQA commented on pull request #29272: URL: https://github.com/apache/spark/pull/29272#issuecomment-666935207 **[Test build #126840 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126840/testReport)** for PR 29272 at commit [`4c3a9f1`](https://github.com/apache/spark/commit/4c3a9f1b054e67d7a362c40364b15f5558993246). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests
AmplabJenkins removed a comment on pull request #29272: URL: https://github.com/apache/spark/pull/29272#issuecomment-666934662 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29279: [SPARK-31418][CORE][FOLLOW-UP][MINOR] Fix log messages to print stage id instead of the object name
SparkQA commented on pull request #29279: URL: https://github.com/apache/spark/pull/29279#issuecomment-666934791 **[Test build #126848 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126848/testReport)** for PR 29279 at commit [`ad847b1`](https://github.com/apache/spark/commit/ad847b185fffbe0f2feace23c0b263369d39edd3). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests
SparkQA commented on pull request #29272: URL: https://github.com/apache/spark/pull/29272#issuecomment-666934511 **[Test build #126842 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126842/testReport)** for PR 29272 at commit [`4c3a9f1`](https://github.com/apache/spark/commit/4c3a9f1b054e67d7a362c40364b15f5558993246). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests
AmplabJenkins commented on pull request #29272: URL: https://github.com/apache/spark/pull/29272#issuecomment-666934662 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29294: [SPARK-32160][CORE][PYSPARK][3.0] Add a config to switch allow/disallow to create SparkContext in executors.
AmplabJenkins removed a comment on pull request #29294: URL: https://github.com/apache/spark/pull/29294#issuecomment-666934213 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29313: [DO-NOT-MERGE] Debug the flaky test added in SPARK-32175
AmplabJenkins removed a comment on pull request #29313: URL: https://github.com/apache/spark/pull/29313#issuecomment-666934304 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #28781: [SPARK-31953][SS] Add Spark Structured Streaming History Server Support
SparkQA commented on pull request #28781: URL: https://github.com/apache/spark/pull/28781#issuecomment-666934489 **[Test build #126847 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126847/testReport)** for PR 28781 at commit [`aa7a682`](https://github.com/apache/spark/commit/aa7a6828628da713dc17b6f15760eb21fef21378). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests
SparkQA removed a comment on pull request #29272: URL: https://github.com/apache/spark/pull/29272#issuecomment-666920684 **[Test build #126842 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126842/testReport)** for PR 29272 at commit [`4c3a9f1`](https://github.com/apache/spark/commit/4c3a9f1b054e67d7a362c40364b15f5558993246). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29294: [SPARK-32160][CORE][PYSPARK][3.0] Add a config to switch allow/disallow to create SparkContext in executors.
AmplabJenkins commented on pull request #29294: URL: https://github.com/apache/spark/pull/29294#issuecomment-666934213 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29313: [DO-NOT-MERGE] Debug the flaky test added in SPARK-32175
AmplabJenkins commented on pull request #29313: URL: https://github.com/apache/spark/pull/29313#issuecomment-666934304 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #27507: [SPARK-24884][SQL] Support regexp function regexp_extract_all
AmplabJenkins removed a comment on pull request #27507: URL: https://github.com/apache/spark/pull/27507#issuecomment-666929563 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage
SparkQA removed a comment on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-666761730 **[Test build #126822 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126822/testReport)** for PR 27690 at commit [`44ce61e`](https://github.com/apache/spark/commit/44ce61eb4cc129c285131525b99b20f82774d107). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29307: [SPARK-32083][SQL] AQE coalesce should at least return one partition
AmplabJenkins removed a comment on pull request #29307: URL: https://github.com/apache/spark/pull/29307#issuecomment-666922671 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #29313: [DO-NOT-MERGE] Debug the flaky test added in SPARK-32175
SparkQA removed a comment on pull request #29313: URL: https://github.com/apache/spark/pull/29313#issuecomment-666849944 **[Test build #126829 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126829/testReport)** for PR 29313 at commit [`22b647f`](https://github.com/apache/spark/commit/22b647f82ab0af6edba1c6a6d43c491b1b5fdae3). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #29294: [SPARK-32160][CORE][PYSPARK][3.0] Add a config to switch allow/disallow to create SparkContext in executors.
SparkQA removed a comment on pull request #29294: URL: https://github.com/apache/spark/pull/29294#issuecomment-666863818 **[Test build #126833 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126833/testReport)** for PR 29294 at commit [`4531bad`](https://github.com/apache/spark/commit/4531badac46ab7d2f0f3e94eb44710151b7d9d01). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29297: [SPARK-32406][SQL][FOLLOWUP] Make RESET fail against static and core configs
AmplabJenkins removed a comment on pull request #29297: URL: https://github.com/apache/spark/pull/29297#issuecomment-666911286 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/126808/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #27246: [SPARK-30536][CORE][SQL] Sort-merge join operator spilling performance improvements
AmplabJenkins removed a comment on pull request #27246: URL: https://github.com/apache/spark/pull/27246#issuecomment-648481691 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29294: [SPARK-32160][CORE][PYSPARK][3.0] Add a config to switch allow/disallow to create SparkContext in executors.
AmplabJenkins removed a comment on pull request #29294: URL: https://github.com/apache/spark/pull/29294#issuecomment-666930533 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage
AmplabJenkins removed a comment on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-666931777 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #27507: [SPARK-24884][SQL] Support regexp function regexp_extract_all
SparkQA removed a comment on pull request #27507: URL: https://github.com/apache/spark/pull/27507#issuecomment-666764664 **[Test build #126823 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126823/testReport)** for PR 27507 at commit [`c096de4`](https://github.com/apache/spark/commit/c096de43021a269c9b45a57a3d8897e0568a47c2). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] ueshin commented on pull request #29294: [SPARK-32160][CORE][PYSPARK][3.0] Add a config to switch allow/disallow to create SparkContext in executors.
ueshin commented on pull request #29294: URL: https://github.com/apache/spark/pull/29294#issuecomment-666932574 Jenkins, retest this please. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29313: [DO-NOT-MERGE] Debug the flaky test added in SPARK-32175
SparkQA commented on pull request #29313: URL: https://github.com/apache/spark/pull/29313#issuecomment-666932074 **[Test build #126829 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126829/testReport)** for PR 29313 at commit [`22b647f`](https://github.com/apache/spark/commit/22b647f82ab0af6edba1c6a6d43c491b1b5fdae3). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29297: [SPARK-32406][SQL][FOLLOWUP] Make RESET fail against static and core configs
SparkQA commented on pull request #29297: URL: https://github.com/apache/spark/pull/29297#issuecomment-666931894 **[Test build #126846 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126846/testReport)** for PR 29297 at commit [`406c101`](https://github.com/apache/spark/commit/406c101072bd6e41a0fe763a30198fb02077b7f1). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage
AmplabJenkins commented on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-666931777 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on pull request #29306: [SPARK-32497][INFRA] Installs qpdf package for CRAN check in GitHub Actions
HyukjinKwon commented on pull request #29306: URL: https://github.com/apache/spark/pull/29306#issuecomment-666931393 cc @ScrapCodes and @zhengruifeng FYI. The CRAN check _might_ fail with the error in the PR description with R 4.0.0. In that case, `qpdf` will have to be installed. I can't reproduce in my local but it fails in GitHub Actions. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29303: [SPARK-32492][SQL] Fulfill missing column meta information for thriftserver client tools
SparkQA commented on pull request #29303: URL: https://github.com/apache/spark/pull/29303#issuecomment-666930652 **[Test build #126845 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126845/testReport)** for PR 29303 at commit [`2a319ff`](https://github.com/apache/spark/commit/2a319ff00d0dde63209f6df7427abe26ece2f85d). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29294: [SPARK-32160][CORE][PYSPARK][3.0] Add a config to switch allow/disallow to create SparkContext in executors.
AmplabJenkins commented on pull request #29294: URL: https://github.com/apache/spark/pull/29294#issuecomment-666930533 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage
SparkQA commented on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-666930303 **[Test build #126822 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126822/testReport)** for PR 27690 at commit [`44ce61e`](https://github.com/apache/spark/commit/44ce61eb4cc129c285131525b99b20f82774d107). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29294: [SPARK-32160][CORE][PYSPARK][3.0] Add a config to switch allow/disallow to create SparkContext in executors.
SparkQA commented on pull request #29294: URL: https://github.com/apache/spark/pull/29294#issuecomment-666929852 **[Test build #126833 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126833/testReport)** for PR 29294 at commit [`4531bad`](https://github.com/apache/spark/commit/4531badac46ab7d2f0f3e94eb44710151b7d9d01). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29310: [SPARK-32332][SQL][3.0] Support columnar exchanges
SparkQA commented on pull request #29310: URL: https://github.com/apache/spark/pull/29310#issuecomment-666929667 **[Test build #126844 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126844/testReport)** for PR 29310 at commit [`7aaa0cf`](https://github.com/apache/spark/commit/7aaa0cf1024c0a66d7ff0091d98f5ae2fd634621). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #27507: [SPARK-24884][SQL] Support regexp function regexp_extract_all
AmplabJenkins commented on pull request #27507: URL: https://github.com/apache/spark/pull/27507#issuecomment-666929563 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #27246: [SPARK-30536][CORE][SQL] Sort-merge join operator spilling performance improvements
AmplabJenkins commented on pull request #27246: URL: https://github.com/apache/spark/pull/27246#issuecomment-666928670 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #27507: [SPARK-24884][SQL] Support regexp function regexp_extract_all
SparkQA commented on pull request #27507: URL: https://github.com/apache/spark/pull/27507#issuecomment-666928459 **[Test build #126823 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126823/testReport)** for PR 27507 at commit [`c096de4`](https://github.com/apache/spark/commit/c096de43021a269c9b45a57a3d8897e0568a47c2). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] gatorsmile commented on pull request #27246: [SPARK-30536][CORE][SQL] Sort-merge join operator spilling performance improvements
gatorsmile commented on pull request #27246: URL: https://github.com/apache/spark/pull/27246#issuecomment-666927481 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29307: [SPARK-32083][SQL] AQE coalesce should at least return one partition
AmplabJenkins commented on pull request #29307: URL: https://github.com/apache/spark/pull/29307#issuecomment-666922671 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] MaxGekk commented on pull request #29311: [SPARK-32501][SQL] Convert null to "null" in structs, maps and arrays while casting to strings
MaxGekk commented on pull request #29311: URL: https://github.com/apache/spark/pull/29311#issuecomment-666921137 @cloud-fan @HyukjinKwon @maropu Please, take a look at this. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #28902: [SPARK-31801][API][SHUFFLE][TESTS] Tests for registering map output metadata
AmplabJenkins removed a comment on pull request #28902: URL: https://github.com/apache/spark/pull/28902#issuecomment-666920549 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/126832/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29211: [SPARK-31197][CORE] Shutdown executor once we are done decommissioning
AmplabJenkins removed a comment on pull request #29211: URL: https://github.com/apache/spark/pull/29211#issuecomment-666921216 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29291: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT
SparkQA commented on pull request #29291: URL: https://github.com/apache/spark/pull/29291#issuecomment-666921348 **[Test build #126843 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126843/testReport)** for PR 29291 at commit [`7362dfb`](https://github.com/apache/spark/commit/7362dfbdc165f0ff24e24ac02074601852447cf8). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29211: [SPARK-31197][CORE] Shutdown executor once we are done decommissioning
AmplabJenkins commented on pull request #29211: URL: https://github.com/apache/spark/pull/29211#issuecomment-666921216 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #28902: [SPARK-31801][API][SHUFFLE][TESTS] Tests for registering map output metadata
AmplabJenkins commented on pull request #28902: URL: https://github.com/apache/spark/pull/28902#issuecomment-666920540 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #28902: [SPARK-31801][API][SHUFFLE][TESTS] Tests for registering map output metadata
AmplabJenkins removed a comment on pull request #28902: URL: https://github.com/apache/spark/pull/28902#issuecomment-666920540 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests
SparkQA commented on pull request #29272: URL: https://github.com/apache/spark/pull/29272#issuecomment-666920684 **[Test build #126842 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126842/testReport)** for PR 29272 at commit [`4c3a9f1`](https://github.com/apache/spark/commit/4c3a9f1b054e67d7a362c40364b15f5558993246). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29211: [SPARK-31197][CORE] Shutdown executor once we are done decommissioning
AmplabJenkins removed a comment on pull request #29211: URL: https://github.com/apache/spark/pull/29211#issuecomment-666849822 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/126816/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #29211: [SPARK-31197][CORE] Shutdown executor once we are done decommissioning
SparkQA removed a comment on pull request #29211: URL: https://github.com/apache/spark/pull/29211#issuecomment-666849351 **[Test build #126828 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126828/testReport)** for PR 29211 at commit [`0ee7c4b`](https://github.com/apache/spark/commit/0ee7c4b0ad40f825249e0c732cc26441319a3d94). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29211: [SPARK-31197][CORE] Shutdown executor once we are done decommissioning
SparkQA commented on pull request #29211: URL: https://github.com/apache/spark/pull/29211#issuecomment-666919881 **[Test build #126828 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126828/testReport)** for PR 29211 at commit [`0ee7c4b`](https://github.com/apache/spark/commit/0ee7c4b0ad40f825249e0c732cc26441319a3d94). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #28902: [SPARK-31801][API][SHUFFLE][TESTS] Tests for registering map output metadata
SparkQA removed a comment on pull request #28902: URL: https://github.com/apache/spark/pull/28902#issuecomment-666861319 **[Test build #126832 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126832/testReport)** for PR 28902 at commit [`72dfb1e`](https://github.com/apache/spark/commit/72dfb1ec7eee02693fc1861e9f5bc4850512d7a6). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #28902: [SPARK-31801][API][SHUFFLE][TESTS] Tests for registering map output metadata
SparkQA commented on pull request #28902: URL: https://github.com/apache/spark/pull/28902#issuecomment-666919754 **[Test build #126832 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126832/testReport)** for PR 28902 at commit [`72dfb1e`](https://github.com/apache/spark/commit/72dfb1ec7eee02693fc1861e9f5bc4850512d7a6). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] MaxGekk commented on pull request #29308: [SPARK-32499][SQL] Use `{}` in conversions maps and structs to strings
MaxGekk commented on pull request #29308: URL: https://github.com/apache/spark/pull/29308#issuecomment-666918864 @maropu @cloud-fan Please, review this PR. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] c21 commented on a change in pull request #29277: [SPARK-32421][SQL] Add code-gen for shuffled hash join
c21 commented on a change in pull request #29277:
URL: https://github.com/apache/spark/pull/29277#discussion_r463403584
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/WholeStageCodegenExec.scala
##
@@ -903,6 +904,10 @@ case class CollapseCodegenStages(
// The children of SortMergeJoin should do codegen separately.
j.withNewChildren(j.children.map(
child => InputAdapter(insertWholeStageCodegen(child
+ case j: ShuffledHashJoinExec =>
+// The children of ShuffledHashJoin should do codegen separately.
+j.withNewChildren(j.children.map(
Review comment:
So here is the problematic query (same as above)
```
test("ShuffledHashJoin should be included in WholeStageCodegen") {
withSQLConf(SQLConf.AUTO_BROADCASTJOIN_THRESHOLD.key -> "30",
SQLConf.SHUFFLE_PARTITIONS.key -> "2",
SQLConf.PREFER_SORTMERGEJOIN.key -> "false") {
val df1 = spark.range(5).select($"id".as("k1"))
val df2 = spark.range(15).select($"id".as("k2"))
val df3 = spark.range(6).select($"id".as("k3"))
val twoJoinsDF = df1.join(df2, $"k1" === $"k2").join(df3, $"k1" ===
$"k3")
}
}
```
if we only codegen separately build side:
```
case j: ShuffledHashJoinExec =>
// The children of ShuffledHashJoin should do codegen separately.
val newChildren = j.buildSide match {
case BuildLeft =>
val buildChild = InputAdapter(insertWholeStageCodegen(j.left))
val streamChild = insertInputAdapter(j.right)
Seq(buildChild, streamChild)
case BuildRight =>
val buildChild = InputAdapter(insertWholeStageCodegen(j.right))
val streamChild = insertInputAdapter(j.left)
Seq(streamChild, buildChild)
}
j.withNewChildren(newChildren)
```
generated code where `shj_relation_0` and `shj_relation_1` both are
building relation on `input[1]`, but shouldn't be:
```
== Subtree 4 / 4 (maxMethodCodeSize:190; maxConstantPoolSize:129(0.20%
used); numInnerClasses:0) ==
*(4) ShuffledHashJoin [k1#2L], [k3#10L], Inner, BuildRight
:- *(4) ShuffledHashJoin [k1#2L], [k2#6L], Inner, BuildLeft
: :- Exchange hashpartitioning(k1#2L, 2), true, [id=#111]
: : +- *(2) Project [id#0L AS k1#2L]
: : +- *(2) Range (0, 5, step=1, splits=2)
: +- Exchange hashpartitioning(k2#6L, 2), true, [id=#114]
: +- *(3) Project [id#4L AS k2#6L]
:+- *(3) Range (0, 15, step=1, splits=2)
+- Exchange hashpartitioning(k3#10L, 2), true, [id=#108]
+- *(1) Project [id#8L AS k3#10L]
+- *(1) Range (0, 6, step=1, splits=2)
Generated code:
/* 001 */ public Object generate(Object[] references) {
/* 002 */ return new GeneratedIteratorForCodegenStage4(references);
/* 003 */ }
/* 004 */
/* 005 */ // codegenStageId=4
/* 006 */ final class GeneratedIteratorForCodegenStage4 extends
org.apache.spark.sql.execution.BufferedRowIterator {
/* 007 */ private Object[] references;
/* 008 */ private scala.collection.Iterator[] inputs;
/* 009 */ private scala.collection.Iterator inputadapter_input_0;
/* 010 */ private org.apache.spark.sql.execution.joins.HashedRelation
shj_relation_0;
/* 011 */ private org.apache.spark.sql.execution.joins.HashedRelation
shj_relation_1;
/* 012 */ private
org.apache.spark.sql.catalyst.expressions.codegen.UnsafeRowWriter[]
shj_mutableStateArray_0 = new
org.apache.spark.sql.catalyst.expressions.codegen.UnsafeRowWriter[2];
/* 013 */
/* 014 */ public GeneratedIteratorForCodegenStage4(Object[] references) {
/* 015 */ this.references = references;
/* 016 */ }
/* 017 */
/* 018 */ public void init(int index, scala.collection.Iterator[] inputs) {
/* 019 */ partitionIndex = index;
/* 020 */ this.inputs = inputs;
/* 021 */ inputadapter_input_0 = inputs[0];
/* 022 */ shj_relation_0 =
((org.apache.spark.sql.execution.joins.ShuffledHashJoinExec) references[0] /*
plan */).buildHashedRelation(inputs[1]);
/* 023 */ shj_mutableStateArray_0[0] = new
org.apache.spark.sql.catalyst.expressions.codegen.UnsafeRowWriter(2, 0);
/* 024 */ shj_relation_1 =
((org.apache.spark.sql.execution.joins.ShuffledHashJoinExec) references[2] /*
plan */).buildHashedRelation(inputs[1]);
/* 025 */ shj_mutableStateArray_0[1] = new
org.apache.spark.sql.catalyst.expressions.codegen.UnsafeRowWriter(3, 0);
/* 026 */
/* 027 */ }
/* 028 */
/* 029 */ private void shj_doConsume_0(InternalRow inputadapter_row_0,
long shj_expr_0_0) throws java.io.IOException {
/* 030 */ // generate join key for stream side
/* 031 */
/* 032 */ // find matches from HashRelation
/* 033 */ scala.collection.Iterator shj_matches_0 = false ?
/* 034 */ null :
[GitHub] [spark] HyukjinKwon commented on pull request #29312: [SPARK-32503][CORE][TESTS] Add Scala 2.13 `core` and related module test in GitHub Action
HyukjinKwon commented on pull request #29312: URL: https://github.com/apache/spark/pull/29312#issuecomment-666918177 Oh, just to be clear I wasn't against the idea itself but sure we think about it more and proceed in a different way. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] dongjoon-hyun commented on pull request #29312: [SPARK-32503][CORE][TESTS] Add Scala 2.13 `core` and related module test in GitHub Action
dongjoon-hyun commented on pull request #29312: URL: https://github.com/apache/spark/pull/29312#issuecomment-666917629 Never mind. I closed my proposal. Thanks. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] dongjoon-hyun closed pull request #29312: [SPARK-32503][CORE][TESTS] Add Scala 2.13 `core` and related module test in GitHub Action
dongjoon-hyun closed pull request #29312: URL: https://github.com/apache/spark/pull/29312 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on a change in pull request #29312: [SPARK-32503][CORE][TESTS] Add Scala 2.13 `core` and related module test in GitHub Action
HyukjinKwon commented on a change in pull request #29312:
URL: https://github.com/apache/spark/pull/29312#discussion_r463402736
##
File path: .github/workflows/master.yml
##
@@ -271,3 +271,29 @@ jobs:
mkdir -p ~/.m2
./build/mvn $MAVEN_CLI_OPTS -DskipTests -Pyarn -Pmesos -Pkubernetes
-Phive -Phive-thriftserver -Phadoop-cloud -Djava.version=11 install
rm -rf ~/.m2/repository/org/apache/spark
+
+ scala213:
+name: Scala 2.13
+runs-on: ubuntu-latest
+steps:
+- name: Checkout Spark repository
+ uses: actions/checkout@v2
+- name: Cache Maven local repository
+ uses: actions/cache@v2
+ with:
+path: ~/.m2/repository
+key: scala213-maven-${{ hashFiles('**/pom.xml') }}
+restore-keys: |
+ scala213-maven-
+- name: Install Java 11
+ uses: actions/setup-java@v1
+ with:
+java-version: 11
+- name: Test with Maven
+ run: |
+export MAVEN_OPTS="-Xmx2g -XX:ReservedCodeCacheSize=1g
-Dorg.slf4j.simpleLogger.defaultLogLevel=WARN"
+export MAVEN_CLI_OPTS="--no-transfer-progress"
+mkdir -p ~/.m2
+dev/change-scala-version.sh 2.13
+build/mvn test -pl core --am -Pscala-2.13
Review comment:
My only concern is that it becomes difficult to port these to periodical
GitHub Actions jobs or merge it to the main GitHub Actions job (`Build modules:
...` above) later.
Eventually I would like to:
- put those different profiles build into the matrix in the main job `Build
modules: ...` above so we can leverage the optimization in `run-tests.py`
(running only relevant jobs, etc.). We could decide which profiles to run by
default or optionally.
- provide a way to set other optional profiles, for example, via GitHub PR
title or tags, which we currently does via Jenkins.
- set periodical jobs for other profiles for Maven, Scala, JDK, Hive,
Hadoop, etc. that we run in Jenkins, or possibly more. I think we need to
resolve SPARK-32264 first to do this.
Currently `run-tests.py` runs the build for all components always if Maven
is used. So, I was also thinking about fixing `run-tests.py` script to support
for Maven to run tests for only relevant components just like we do for SBT,
and then we only have one main job (`Build modules: ...`) that adds tests by
matrix or environment control in this file rather than adding separate jobs for
different profiles.
I guess I am okay with this as a temporary status for the time being if we
all agree with this plan. I would like to encourage us to stick to this plan in
long run.
Maybe we could alternatively just think about setting a Jenkins that that
runs all tests too, which will ideally be converted into periodic Jenkins jobs.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #28939: [SPARK-32119][CORE] ExecutorPlugin doesn't work with Standalone Cluster
AmplabJenkins removed a comment on pull request #28939: URL: https://github.com/apache/spark/pull/28939#issuecomment-666915969 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/126830/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29299: [SPARK-32490][BUILD] Upgrade netty-all to 4.1.51.Final
SparkQA commented on pull request #29299: URL: https://github.com/apache/spark/pull/29299#issuecomment-666916162 **[Test build #126841 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126841/testReport)** for PR 29299 at commit [`06a2b0d`](https://github.com/apache/spark/commit/06a2b0d83262b4e3744573529093df0b363ee6a6). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #28939: [SPARK-32119][CORE] ExecutorPlugin doesn't work with Standalone Cluster
AmplabJenkins removed a comment on pull request #28939: URL: https://github.com/apache/spark/pull/28939#issuecomment-666915961 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #28939: [SPARK-32119][CORE] ExecutorPlugin doesn't work with Standalone Cluster
AmplabJenkins commented on pull request #28939: URL: https://github.com/apache/spark/pull/28939#issuecomment-666915961 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HeartSaVioR commented on pull request #29289: [SPARK-32482][SS][TESTS] Eliminate deprecated poll(long) API calls to avoid infinite wait in tests
HeartSaVioR commented on pull request #29289: URL: https://github.com/apache/spark/pull/29289#issuecomment-666915336 Thanks! Merged into master. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HeartSaVioR closed pull request #29289: [SPARK-32482][SS][TESTS] Eliminate deprecated poll(long) API calls to avoid infinite wait in tests
HeartSaVioR closed pull request #29289: URL: https://github.com/apache/spark/pull/29289 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #28939: [SPARK-32119][CORE] ExecutorPlugin doesn't work with Standalone Cluster
SparkQA commented on pull request #28939: URL: https://github.com/apache/spark/pull/28939#issuecomment-666914576 **[Test build #126830 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126830/testReport)** for PR 28939 at commit [`73d2157`](https://github.com/apache/spark/commit/73d2157ac1119b181315040cb453406177dbaa87). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #28939: [SPARK-32119][CORE] ExecutorPlugin doesn't work with Standalone Cluster
SparkQA removed a comment on pull request #28939: URL: https://github.com/apache/spark/pull/28939#issuecomment-666851072 **[Test build #126830 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126830/testReport)** for PR 28939 at commit [`73d2157`](https://github.com/apache/spark/commit/73d2157ac1119b181315040cb453406177dbaa87). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] HeartSaVioR commented on pull request #29289: [SPARK-32482][SS][TESTS] Eliminate deprecated poll(long) API calls to avoid infinite wait in tests
HeartSaVioR commented on pull request #29289: URL: https://github.com/apache/spark/pull/29289#issuecomment-666914562 Thanks @HyukjinKwon for reminding! I'll go ahead merging this. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #28618: [SPARK-31801][API][SHUFFLE] Register map output metadata
AmplabJenkins removed a comment on pull request #28618: URL: https://github.com/apache/spark/pull/28618#issuecomment-666911829 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/126831/ Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #28618: [SPARK-31801][API][SHUFFLE] Register map output metadata
AmplabJenkins removed a comment on pull request #28618: URL: https://github.com/apache/spark/pull/28618#issuecomment-666911820 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests
SparkQA commented on pull request #29272: URL: https://github.com/apache/spark/pull/29272#issuecomment-666912015 **[Test build #126840 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126840/testReport)** for PR 29272 at commit [`4c3a9f1`](https://github.com/apache/spark/commit/4c3a9f1b054e67d7a362c40364b15f5558993246). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #28618: [SPARK-31801][API][SHUFFLE] Register map output metadata
AmplabJenkins commented on pull request #28618: URL: https://github.com/apache/spark/pull/28618#issuecomment-666911820 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins removed a comment on pull request #29297: [SPARK-32406][SQL][FOLLOWUP] Make RESET fail against static and core configs
AmplabJenkins removed a comment on pull request #29297: URL: https://github.com/apache/spark/pull/29297#issuecomment-666911279 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #29278: [SPARK-32160][CORE][PYSPARK] Add a config to switch allow/disallow to create SparkContext in executors.
SparkQA commented on pull request #29278: URL: https://github.com/apache/spark/pull/29278#issuecomment-666911491 **[Test build #126839 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126839/testReport)** for PR 29278 at commit [`0ea7ea9`](https://github.com/apache/spark/commit/0ea7ea956b3867b67c869fddcc294cb268157a92). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] AmplabJenkins commented on pull request #29297: [SPARK-32406][SQL][FOLLOWUP] Make RESET fail against static and core configs
AmplabJenkins commented on pull request #29297: URL: https://github.com/apache/spark/pull/29297#issuecomment-666911279 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA removed a comment on pull request #28618: [SPARK-31801][API][SHUFFLE] Register map output metadata
SparkQA removed a comment on pull request #28618: URL: https://github.com/apache/spark/pull/28618#issuecomment-666860636 **[Test build #126831 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126831/testReport)** for PR 28618 at commit [`edd5c05`](https://github.com/apache/spark/commit/edd5c0541fe14a412d073d9ed1f7019d294c3425). This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] SparkQA commented on pull request #28618: [SPARK-31801][API][SHUFFLE] Register map output metadata
SparkQA commented on pull request #28618: URL: https://github.com/apache/spark/pull/28618#issuecomment-666910876 **[Test build #126831 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126831/testReport)** for PR 28618 at commit [`edd5c05`](https://github.com/apache/spark/commit/edd5c0541fe14a412d073d9ed1f7019d294c3425). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
