AngersZh opened a new pull request #30145:
URL: https://github.com/apache/spark/pull/30145
### What changes were proposed in this pull request?
Currently, we can't support use ordinal in CUBE/ROLLUP/GROUPING SETS,
this pr make CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal
AmplabJenkins removed a comment on pull request #30138:
URL: https://github.com/apache/spark/pull/30138#issuecomment-715772704
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #30138:
URL: https://github.com/apache/spark/pull/30138#issuecomment-715772704
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA commented on pull request #30138:
URL: https://github.com/apache/spark/pull/30138#issuecomment-715772657
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34828/
AmplabJenkins commented on pull request #27649:
URL: https://github.com/apache/spark/pull/27649#issuecomment-715822285
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
HeartSaVioR commented on a change in pull request #27333:
URL: https://github.com/apache/spark/pull/27333#discussion_r511329896
##
File path:
sql/core/src/test/scala/org/apache/spark/sql/streaming/FlatMapGroupsWithStateSuite.scala
##
@@ -1019,6 +1019,56 @@ class
SparkQA removed a comment on pull request #27649:
URL: https://github.com/apache/spark/pull/27649#issuecomment-715660984
**[Test build #130221 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130221/testReport)**
for PR 27649 at commit
SparkQA commented on pull request #27649:
URL: https://github.com/apache/spark/pull/27649#issuecomment-715819519
**[Test build #130221 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130221/testReport)**
for PR 27649 at commit
SparkQA removed a comment on pull request #28363:
URL: https://github.com/apache/spark/pull/28363#issuecomment-715661905
**[Test build #130224 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130224/testReport)**
for PR 28363 at commit
AmplabJenkins removed a comment on pull request #30138:
URL: https://github.com/apache/spark/pull/30138#issuecomment-715830756
Merged build finished. Test FAILed.
This is an automated message from the Apache Git Service.
To
SparkQA commented on pull request #30145:
URL: https://github.com/apache/spark/pull/30145#issuecomment-715829887
**[Test build #130229 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130229/testReport)**
for PR 30145 at commit
SparkQA commented on pull request #30138:
URL: https://github.com/apache/spark/pull/30138#issuecomment-715829881
**[Test build #130228 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130228/testReport)**
for PR 30138 at commit
SparkQA removed a comment on pull request #30138:
URL: https://github.com/apache/spark/pull/30138#issuecomment-715710242
**[Test build #130228 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130228/testReport)**
for PR 30138 at commit
SparkQA removed a comment on pull request #30145:
URL: https://github.com/apache/spark/pull/30145#issuecomment-715760936
**[Test build #130229 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130229/testReport)**
for PR 30145 at commit
SparkQA removed a comment on pull request #30144:
URL: https://github.com/apache/spark/pull/30144#issuecomment-715680465
**[Test build #130227 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130227/testReport)**
for PR 30144 at commit
AmplabJenkins removed a comment on pull request #30145:
URL: https://github.com/apache/spark/pull/30145#issuecomment-715830054
Merged build finished. Test FAILed.
This is an automated message from the Apache Git Service.
To
AmplabJenkins commented on pull request #30144:
URL: https://github.com/apache/spark/pull/30144#issuecomment-715830759
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #24173:
URL: https://github.com/apache/spark/pull/24173#issuecomment-715832074
Merged build finished. Test FAILed.
This is an automated message from the Apache Git Service.
To
AmplabJenkins removed a comment on pull request #30138:
URL: https://github.com/apache/spark/pull/30138#issuecomment-715830786
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
AmplabJenkins commented on pull request #24173:
URL: https://github.com/apache/spark/pull/24173#issuecomment-715832074
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #30144:
URL: https://github.com/apache/spark/pull/30144#issuecomment-715830789
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
AmplabJenkins commented on pull request #28363:
URL: https://github.com/apache/spark/pull/28363#issuecomment-715832296
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #28363:
URL: https://github.com/apache/spark/pull/28363#issuecomment-715832296
Merged build finished. Test FAILed.
This is an automated message from the Apache Git Service.
To
SparkQA commented on pull request #30143:
URL: https://github.com/apache/spark/pull/30143#issuecomment-715833374
**[Test build #130230 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130230/testReport)**
for PR 30143 at commit
AmplabJenkins removed a comment on pull request #30145:
URL: https://github.com/apache/spark/pull/30145#issuecomment-715830055
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
AmplabJenkins commented on pull request #30138:
URL: https://github.com/apache/spark/pull/30138#issuecomment-715830756
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #30144:
URL: https://github.com/apache/spark/pull/30144#issuecomment-715830759
Merged build finished. Test FAILed.
This is an automated message from the Apache Git Service.
To
SparkQA commented on pull request #30145:
URL: https://github.com/apache/spark/pull/30145#issuecomment-715760936
**[Test build #130229 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130229/testReport)**
for PR 30145 at commit
AmplabJenkins removed a comment on pull request #27649:
URL: https://github.com/apache/spark/pull/27649#issuecomment-715822285
This is an automated message from the Apache Git Service.
To respond to the message, please log on
SparkQA commented on pull request #24173:
URL: https://github.com/apache/spark/pull/24173#issuecomment-715825878
**[Test build #130223 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130223/testReport)**
for PR 24173 at commit
SparkQA removed a comment on pull request #24173:
URL: https://github.com/apache/spark/pull/24173#issuecomment-715661007
**[Test build #130223 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130223/testReport)**
for PR 24173 at commit
zero323 commented on pull request #30094:
URL: https://github.com/apache/spark/pull/30094#issuecomment-715842306
Thanks @HyukjinKwon!
This is an automated message from the Apache Git Service.
To respond to the message,
SparkQA commented on pull request #30145:
URL: https://github.com/apache/spark/pull/30145#issuecomment-715843160
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34829/
AmplabJenkins commented on pull request #30145:
URL: https://github.com/apache/spark/pull/30145#issuecomment-715843164
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #30145:
URL: https://github.com/apache/spark/pull/30145#issuecomment-715843164
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #30143:
URL: https://github.com/apache/spark/pull/30143#issuecomment-715859220
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA commented on pull request #30145:
URL: https://github.com/apache/spark/pull/30145#issuecomment-715809580
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34829/
HeartSaVioR closed pull request #27333:
URL: https://github.com/apache/spark/pull/27333
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
AmplabJenkins removed a comment on pull request #28363:
URL: https://github.com/apache/spark/pull/28363#issuecomment-715832319
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
AmplabJenkins removed a comment on pull request #24173:
URL: https://github.com/apache/spark/pull/24173#issuecomment-715832093
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
SparkQA commented on pull request #30143:
URL: https://github.com/apache/spark/pull/30143#issuecomment-715858168
**[Test build #130230 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130230/testReport)**
for PR 30143 at commit
HeartSaVioR opened a new pull request #27333:
URL: https://github.com/apache/spark/pull/27333
### What changes were proposed in this pull request?
This patch adds new UTs to prevent SPARK-29438 for streaming aggregation as
well as flatMapGroupsWithState, as we agree about the review
HeartSaVioR commented on pull request #27333:
URL: https://github.com/apache/spark/pull/27333#issuecomment-715810779
Accidentally closed this - don't get the UX on Github mobile app. (Don't
know how to reopen in the app.) Will reopen soon.
AmplabJenkins removed a comment on pull request #24173:
URL: https://github.com/apache/spark/pull/24173#issuecomment-715828422
This is an automated message from the Apache Git Service.
To respond to the message, please log on
SparkQA removed a comment on pull request #24173:
URL: https://github.com/apache/spark/pull/24173#issuecomment-715661919
**[Test build #130225 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130225/testReport)**
for PR 24173 at commit
AmplabJenkins commented on pull request #30145:
URL: https://github.com/apache/spark/pull/30145#issuecomment-715830054
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA commented on pull request #30144:
URL: https://github.com/apache/spark/pull/30144#issuecomment-715829884
**[Test build #130227 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130227/testReport)**
for PR 30144 at commit
SparkQA commented on pull request #24173:
URL: https://github.com/apache/spark/pull/24173#issuecomment-715829885
**[Test build #130225 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130225/testReport)**
for PR 24173 at commit
SparkQA commented on pull request #28363:
URL: https://github.com/apache/spark/pull/28363#issuecomment-715829883
**[Test build #130224 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130224/testReport)**
for PR 28363 at commit
AmplabJenkins commented on pull request #24173:
URL: https://github.com/apache/spark/pull/24173#issuecomment-715828422
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA commented on pull request #30143:
URL: https://github.com/apache/spark/pull/30143#issuecomment-715851068
**[Test build #130231 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130231/testReport)**
for PR 30143 at commit
SparkQA removed a comment on pull request #30143:
URL: https://github.com/apache/spark/pull/30143#issuecomment-715833374
**[Test build #130230 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130230/testReport)**
for PR 30143 at commit
AmplabJenkins removed a comment on pull request #30143:
URL: https://github.com/apache/spark/pull/30143#issuecomment-715859220
This is an automated message from the Apache Git Service.
To respond to the message, please log on
SparkQA removed a comment on pull request #30143:
URL: https://github.com/apache/spark/pull/30143#issuecomment-715851068
**[Test build #130231 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130231/testReport)**
for PR 30143 at commit
AmplabJenkins commented on pull request #30143:
URL: https://github.com/apache/spark/pull/30143#issuecomment-715875784
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #30143:
URL: https://github.com/apache/spark/pull/30143#issuecomment-715875784
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins removed a comment on pull request #30143:
URL: https://github.com/apache/spark/pull/30143#issuecomment-715879506
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins removed a comment on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-715879581
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
AmplabJenkins commented on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-715879580
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-715879580
Merged build finished. Test FAILed.
This is an automated message from the Apache Git Service.
To
SparkQA removed a comment on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-715879029
**[Test build #130232 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130232/testReport)**
for PR 30097 at commit
SparkQA commented on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-715879577
**[Test build #130232 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130232/testReport)**
for PR 30097 at commit
SparkQA commented on pull request #30143:
URL: https://github.com/apache/spark/pull/30143#issuecomment-715879502
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34830/
AmplabJenkins commented on pull request #30143:
URL: https://github.com/apache/spark/pull/30143#issuecomment-715879506
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
mridulm commented on pull request #29906:
URL: https://github.com/apache/spark/pull/29906#issuecomment-715880777
Thanks for working on this Tom ! Looks good to me.
This is an automated message from the Apache Git Service.
To
mridulm commented on pull request #30126:
URL: https://github.com/apache/spark/pull/30126#issuecomment-715882396
Also, CC @zhouyejoe
This is an automated message from the Apache Git Service.
To respond to the message,
AmplabJenkins removed a comment on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-715882828
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
SparkQA commented on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-715887837
**[Test build #130234 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130234/testReport)**
for PR 30097 at commit
AngersZh commented on pull request #30131:
URL: https://github.com/apache/spark/pull/30131#issuecomment-715889934
> if there is heavy gc after sending rpc request, but before task completes
- fixed delay will be gc time + wait time vs just wait time.
Double check the code of
SparkQA commented on pull request #30143:
URL: https://github.com/apache/spark/pull/30143#issuecomment-715876900
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34831/
SparkQA commented on pull request #30143:
URL: https://github.com/apache/spark/pull/30143#issuecomment-715876868
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34830/
mridulm commented on pull request #30131:
URL: https://github.com/apache/spark/pull/30131#issuecomment-715882017
Are you seeing issues with use of `scheduleAtFixedRate` which are fixed by
`scheduleWithFixedDelay` ?
There are nuances in the difference, which can have subtle impact. In
AmplabJenkins commented on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-715882824
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA removed a comment on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-715880935
**[Test build #130233 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130233/testReport)**
for PR 30097 at commit
AmplabJenkins removed a comment on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-715882824
Merged build finished. Test FAILed.
This is an automated message from the Apache Git Service.
To
SparkQA commented on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-715882814
**[Test build #130233 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130233/testReport)**
for PR 30097 at commit
ScrapCodes commented on pull request #30089:
URL: https://github.com/apache/spark/pull/30089#issuecomment-715884109
Hi @huaxingao, I wasn't aware of this parallel work here. And created
another PR #30142. I am going to copy your rename test and may be you could
take a look at the other
SparkQA commented on pull request #30143:
URL: https://github.com/apache/spark/pull/30143#issuecomment-715875705
**[Test build #130231 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130231/testReport)**
for PR 30143 at commit
SparkQA commented on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-715879029
**[Test build #130232 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130232/testReport)**
for PR 30097 at commit
AmplabJenkins commented on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-715879838
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-715879838
Merged build finished. Test FAILed.
This is an automated message from the Apache Git Service.
To
SparkQA commented on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-715886332
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34833/
AmplabJenkins commented on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-715889562
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA commented on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-715889557
Kubernetes integration test status failure
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34833/
AmplabJenkins removed a comment on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-715889562
Merged build finished. Test FAILed.
This is an automated message from the Apache Git Service.
To
AmplabJenkins removed a comment on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-715889564
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
AmplabJenkins commented on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-715895020
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA commented on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-715895016
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34834/
AmplabJenkins removed a comment on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-715895020
This is an automated message from the Apache Git Service.
To respond to the message, please log on
SparkQA commented on pull request #30143:
URL: https://github.com/apache/spark/pull/30143#issuecomment-715879219
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34831/
AmplabJenkins removed a comment on pull request #30143:
URL: https://github.com/apache/spark/pull/30143#issuecomment-715879227
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #30143:
URL: https://github.com/apache/spark/pull/30143#issuecomment-715879227
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-715879841
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
mridulm commented on pull request #30139:
URL: https://github.com/apache/spark/pull/30139#issuecomment-715881337
+CC @otterc
This is an automated message from the Apache Git Service.
To respond to the message, please log on
SparkQA commented on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-715880935
**[Test build #130233 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130233/testReport)**
for PR 30097 at commit
mridulm commented on pull request #30126:
URL: https://github.com/apache/spark/pull/30126#issuecomment-715881096
+CC @zoelin7
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AngersZh edited a comment on pull request #30131:
URL: https://github.com/apache/spark/pull/30131#issuecomment-715889934
> if there is heavy gc after sending rpc request, but before task completes
- fixed delay will be gc time + wait time vs just wait time.
Double check the code
SparkQA commented on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-715892694
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34834/
github-actions[bot] closed pull request #29028:
URL: https://github.com/apache/spark/pull/29028
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
SparkQA commented on pull request #29695:
URL: https://github.com/apache/spark/pull/29695#issuecomment-716058607
**[Test build #130238 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130238/testReport)**
for PR 29695 at commit
1 - 100 of 178 matches
Mail list logo