holdenk opened a new pull request #30155:
URL: https://github.com/apache/spark/pull/30155
### What changes were proposed in this pull request?
Make pod allocation executor timeouts configurable. Keep all known pods in
mind when allocating executors to avoid over allocating if
AmplabJenkins removed a comment on pull request #30093:
URL: https://github.com/apache/spark/pull/30093#issuecomment-716870239
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #30093:
URL: https://github.com/apache/spark/pull/30093#issuecomment-716870239
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA removed a comment on pull request #30093:
URL: https://github.com/apache/spark/pull/30093#issuecomment-716748700
**[Test build #130296 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130296/testReport)**
for PR 30093 at commit
SparkQA commented on pull request #30093:
URL: https://github.com/apache/spark/pull/30093#issuecomment-716869601
**[Test build #130296 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130296/testReport)**
for PR 30093 at commit
huaxingao opened a new pull request #30154:
URL: https://github.com/apache/spark/pull/30154
### What changes were proposed in this pull request?
Currently in JDBCTableCatalog, we ignore the table options when creating
table.
```
// TODO (SPARK-32405): Apply table options
SparkQA removed a comment on pull request #30130:
URL: https://github.com/apache/spark/pull/30130#issuecomment-716860126
**[Test build #130299 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130299/testReport)**
for PR 30130 at commit
AmplabJenkins removed a comment on pull request #30130:
URL: https://github.com/apache/spark/pull/30130#issuecomment-716865122
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #30130:
URL: https://github.com/apache/spark/pull/30130#issuecomment-716865122
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA commented on pull request #30130:
URL: https://github.com/apache/spark/pull/30130#issuecomment-716864965
**[Test build #130299 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130299/testReport)**
for PR 30130 at commit
HeartSaVioR commented on a change in pull request #26935:
URL: https://github.com/apache/spark/pull/26935#discussion_r512313839
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala
##
@@ -89,16 +116,16 @@ trait StateStore {
HeartSaVioR commented on a change in pull request #26935:
URL: https://github.com/apache/spark/pull/26935#discussion_r512312263
##
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala
##
@@ -81,6 +74,40 @@ trait StateStore {
SparkQA commented on pull request #29970:
URL: https://github.com/apache/spark/pull/29970#issuecomment-716862852
**[Test build #130300 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130300/testReport)**
for PR 29970 at commit
HeartSaVioR commented on pull request #29970:
URL: https://github.com/apache/spark/pull/29970#issuecomment-716861018
retest this, please
This is an automated message from the Apache Git Service.
To respond to the message,
HeartSaVioR commented on pull request #30147:
URL: https://github.com/apache/spark/pull/30147#issuecomment-716860727
cc. @cloud-fan @rdblue
This is an automated message from the Apache Git Service.
To respond to the
SparkQA commented on pull request #30130:
URL: https://github.com/apache/spark/pull/30130#issuecomment-716860126
**[Test build #130299 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130299/testReport)**
for PR 30130 at commit
dongjoon-hyun commented on pull request #30130:
URL: https://github.com/apache/spark/pull/30130#issuecomment-716859380
Retest this please
This is an automated message from the Apache Git Service.
To respond to the message,
dongjoon-hyun closed pull request #30153:
URL: https://github.com/apache/spark/pull/30153
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
dongjoon-hyun commented on pull request #30153:
URL: https://github.com/apache/spark/pull/30153#issuecomment-716858640
Thank you, @viirya !
This is an automated message from the Apache Git Service.
To respond to the message,
otterc commented on a change in pull request #30062:
URL: https://github.com/apache/spark/pull/30062#discussion_r512300825
##
File path:
common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/RemoteBlockPushResolver.java
##
@@ -0,0 +1,899 @@
+/*
+ * Licensed to
otterc commented on a change in pull request #30062:
URL: https://github.com/apache/spark/pull/30062#discussion_r512298080
##
File path:
common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/RemoteBlockPushResolver.java
##
@@ -0,0 +1,905 @@
+/*
+ * Licensed to
AmplabJenkins removed a comment on pull request #30153:
URL: https://github.com/apache/spark/pull/30153#issuecomment-716850189
This is an automated message from the Apache Git Service.
To respond to the message, please log on
dongjoon-hyun commented on pull request #30153:
URL: https://github.com/apache/spark/pull/30153#issuecomment-716850248
Hi, @holdenk and @viirya and @srowen .
Could you review this PR, please?
This is an automated message
AmplabJenkins commented on pull request #30153:
URL: https://github.com/apache/spark/pull/30153#issuecomment-716850189
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA commented on pull request #30153:
URL: https://github.com/apache/spark/pull/30153#issuecomment-716850170
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34899/
maropu commented on pull request #30140:
URL: https://github.com/apache/spark/pull/30140#issuecomment-716846073
okay, I will today.
This is an automated message from the Apache Git Service.
To respond to the message, please
tgravescs commented on a change in pull request #30062:
URL: https://github.com/apache/spark/pull/30062#discussion_r512281688
##
File path:
common/network-yarn/src/main/java/org/apache/spark/network/yarn/YarnShuffleService.java
##
@@ -94,6 +95,9 @@
static final String
SparkQA commented on pull request #30153:
URL: https://github.com/apache/spark/pull/30153#issuecomment-716841256
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34899/
otterc commented on a change in pull request #30062:
URL: https://github.com/apache/spark/pull/30062#discussion_r512285083
##
File path:
common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/RemoteBlockPushResolver.java
##
@@ -0,0 +1,905 @@
+/*
+ * Licensed to
otterc commented on a change in pull request #30062:
URL: https://github.com/apache/spark/pull/30062#discussion_r512280774
##
File path:
common/network-yarn/src/main/java/org/apache/spark/network/yarn/YarnShuffleService.java
##
@@ -172,7 +178,9 @@ protected void
otterc commented on a change in pull request #30062:
URL: https://github.com/apache/spark/pull/30062#discussion_r512279242
##
File path:
common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/RemoteBlockPushResolver.java
##
@@ -0,0 +1,905 @@
+/*
+ * Licensed to
SparkQA commented on pull request #30153:
URL: https://github.com/apache/spark/pull/30153#issuecomment-716825697
**[Test build #130298 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130298/testReport)**
for PR 30153 at commit
SparkQA removed a comment on pull request #30153:
URL: https://github.com/apache/spark/pull/30153#issuecomment-716820189
**[Test build #130298 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130298/testReport)**
for PR 30153 at commit
AmplabJenkins commented on pull request #30153:
URL: https://github.com/apache/spark/pull/30153#issuecomment-716825889
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #30153:
URL: https://github.com/apache/spark/pull/30153#issuecomment-716825889
This is an automated message from the Apache Git Service.
To respond to the message, please log on
SparkQA commented on pull request #30153:
URL: https://github.com/apache/spark/pull/30153#issuecomment-716820189
**[Test build #130298 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130298/testReport)**
for PR 30153 at commit
dongjoon-hyun commented on pull request #30153:
URL: https://github.com/apache/spark/pull/30153#issuecomment-716817713
Retest this please
This is an automated message from the Apache Git Service.
To respond to the message,
Victsm commented on a change in pull request #30062:
URL: https://github.com/apache/spark/pull/30062#discussion_r512259560
##
File path:
common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/RemoteBlockPushResolver.java
##
@@ -0,0 +1,905 @@
+/*
+ * Licensed to
zero323 commented on pull request #30150:
URL: https://github.com/apache/spark/pull/30150#issuecomment-716807149
LGTM.
On a side note, it highlights how sparse are `Column` docs (and that we miss
even basic examples for dunder methods). Do we have any ticket to track that?
mridulm commented on pull request #30131:
URL: https://github.com/apache/spark/pull/30131#issuecomment-716804124
+CC @otterc
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins removed a comment on pull request #30153:
URL: https://github.com/apache/spark/pull/30153#issuecomment-716803034
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
AmplabJenkins removed a comment on pull request #30153:
URL: https://github.com/apache/spark/pull/30153#issuecomment-716803022
Merged build finished. Test FAILed.
This is an automated message from the Apache Git Service.
To
SparkQA commented on pull request #30153:
URL: https://github.com/apache/spark/pull/30153#issuecomment-716803000
Kubernetes integration test status failure
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34898/
AmplabJenkins commented on pull request #30153:
URL: https://github.com/apache/spark/pull/30153#issuecomment-716803022
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
tgravescs commented on a change in pull request #30062:
URL: https://github.com/apache/spark/pull/30062#discussion_r512238046
##
File path:
common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/RemoteBlockPushResolver.java
##
@@ -0,0 +1,905 @@
+/*
+ * Licensed
SparkQA commented on pull request #30152:
URL: https://github.com/apache/spark/pull/30152#issuecomment-716787342
**[Test build #130295 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130295/testReport)**
for PR 30152 at commit
AmplabJenkins commented on pull request #30152:
URL: https://github.com/apache/spark/pull/30152#issuecomment-716788005
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA removed a comment on pull request #30152:
URL: https://github.com/apache/spark/pull/30152#issuecomment-716677497
**[Test build #130295 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130295/testReport)**
for PR 30152 at commit
tgravescs commented on a change in pull request #30062:
URL: https://github.com/apache/spark/pull/30062#discussion_r512232873
##
File path:
common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/RemoteBlockPushResolver.java
##
@@ -0,0 +1,905 @@
+/*
+ * Licensed
SparkQA commented on pull request #30153:
URL: https://github.com/apache/spark/pull/30153#issuecomment-716789761
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34898/
AmplabJenkins removed a comment on pull request #30152:
URL: https://github.com/apache/spark/pull/30152#issuecomment-716788005
This is an automated message from the Apache Git Service.
To respond to the message, please log on
otterc commented on a change in pull request #30062:
URL: https://github.com/apache/spark/pull/30062#discussion_r512229942
##
File path:
common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/RemoteBlockPushResolver.java
##
@@ -0,0 +1,899 @@
+/*
+ * Licensed to
AmplabJenkins removed a comment on pull request #30093:
URL: https://github.com/apache/spark/pull/30093#issuecomment-716784916
This is an automated message from the Apache Git Service.
To respond to the message, please log on
SparkQA commented on pull request #30093:
URL: https://github.com/apache/spark/pull/30093#issuecomment-716784902
Kubernetes integration test status success
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34897/
AmplabJenkins commented on pull request #30093:
URL: https://github.com/apache/spark/pull/30093#issuecomment-716784916
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
viirya commented on pull request #30152:
URL: https://github.com/apache/spark/pull/30152#issuecomment-716782854
Thanks @dongjoon-hyun
This is an automated message from the Apache Git Service.
To respond to the message,
tgravescs commented on a change in pull request #30062:
URL: https://github.com/apache/spark/pull/30062#discussion_r512225133
##
File path:
common/network-yarn/src/main/java/org/apache/spark/network/yarn/YarnShuffleService.java
##
@@ -172,7 +178,9 @@ protected void
tgravescs commented on a change in pull request #30062:
URL: https://github.com/apache/spark/pull/30062#discussion_r512221375
##
File path:
common/network-common/src/main/java/org/apache/spark/network/util/TransportConf.java
##
@@ -363,4 +363,26 @@ public boolean
tgravescs commented on a change in pull request #30062:
URL: https://github.com/apache/spark/pull/30062#discussion_r512220482
##
File path:
common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/RemoteBlockPushResolver.java
##
@@ -0,0 +1,899 @@
+/*
+ * Licensed
dongjoon-hyun commented on pull request #30140:
URL: https://github.com/apache/spark/pull/30140#issuecomment-716778229
@maropu . Could you make a backporting PR to branch-2.4?
This is an automated message from the Apache Git
dongjoon-hyun closed pull request #30152:
URL: https://github.com/apache/spark/pull/30152
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
dongjoon-hyun commented on pull request #30152:
URL: https://github.com/apache/spark/pull/30152#issuecomment-71680
Merged to branch-2.4.
This is an automated message from the Apache Git Service.
To respond to the
dongjoon-hyun commented on pull request #30152:
URL: https://github.com/apache/spark/pull/30152#issuecomment-716777364
In Jenkins, Python tests passed.
```
...
Finished test(python3.6): pyspark.ml.tests (187s)
Tests passed in 951 seconds
```
dongjoon-hyun commented on pull request #30141:
URL: https://github.com/apache/spark/pull/30141#issuecomment-716775382
cc @cloud-fan
This is an automated message from the Apache Git Service.
To respond to the message,
dongjoon-hyun closed pull request #30141:
URL: https://github.com/apache/spark/pull/30141
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
SparkQA removed a comment on pull request #30153:
URL: https://github.com/apache/spark/pull/30153#issuecomment-716768684
**[Test build #130297 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130297/testReport)**
for PR 30153 at commit
AmplabJenkins removed a comment on pull request #30153:
URL: https://github.com/apache/spark/pull/30153#issuecomment-716774481
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #30153:
URL: https://github.com/apache/spark/pull/30153#issuecomment-716774481
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA commented on pull request #30153:
URL: https://github.com/apache/spark/pull/30153#issuecomment-716774302
**[Test build #130297 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130297/testReport)**
for PR 30153 at commit
SparkQA commented on pull request #30093:
URL: https://github.com/apache/spark/pull/30093#issuecomment-716770165
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34897/
SparkQA commented on pull request #30153:
URL: https://github.com/apache/spark/pull/30153#issuecomment-716768684
**[Test build #130297 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130297/testReport)**
for PR 30153 at commit
dongjoon-hyun commented on pull request #30153:
URL: https://github.com/apache/spark/pull/30153#issuecomment-716766241
Hi, @shaneknapp . I made a PR from Spark side first.
This is an automated message from the Apache Git
dongjoon-hyun opened a new pull request #30153:
URL: https://github.com/apache/spark/pull/30153
### What changes were proposed in this pull request?
### Why are the changes needed?
### Does this PR introduce _any_ user-facing change?
### How was
AmplabJenkins commented on pull request #30145:
URL: https://github.com/apache/spark/pull/30145#issuecomment-716762323
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #30145:
URL: https://github.com/apache/spark/pull/30145#issuecomment-716762323
This is an automated message from the Apache Git Service.
To respond to the message, please log on
SparkQA removed a comment on pull request #30145:
URL: https://github.com/apache/spark/pull/30145#issuecomment-716583128
**[Test build #130293 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130293/testReport)**
for PR 30145 at commit
SparkQA commented on pull request #30145:
URL: https://github.com/apache/spark/pull/30145#issuecomment-716761264
**[Test build #130293 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130293/testReport)**
for PR 30145 at commit
AmplabJenkins removed a comment on pull request #30089:
URL: https://github.com/apache/spark/pull/30089#issuecomment-716753175
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #30089:
URL: https://github.com/apache/spark/pull/30089#issuecomment-716753175
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA removed a comment on pull request #30089:
URL: https://github.com/apache/spark/pull/30089#issuecomment-716640452
**[Test build #130294 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130294/testReport)**
for PR 30089 at commit
SparkQA commented on pull request #30089:
URL: https://github.com/apache/spark/pull/30089#issuecomment-716752086
**[Test build #130294 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130294/testReport)**
for PR 30089 at commit
AmplabJenkins commented on pull request #29414:
URL: https://github.com/apache/spark/pull/29414#issuecomment-716749723
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins commented on pull request #30145:
URL: https://github.com/apache/spark/pull/30145#issuecomment-716749652
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #30145:
URL: https://github.com/apache/spark/pull/30145#issuecomment-716749652
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins removed a comment on pull request #29414:
URL: https://github.com/apache/spark/pull/29414#issuecomment-716749723
This is an automated message from the Apache Git Service.
To respond to the message, please log on
SparkQA removed a comment on pull request #30145:
URL: https://github.com/apache/spark/pull/30145#issuecomment-716546948
**[Test build #130290 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130290/testReport)**
for PR 30145 at commit
SparkQA commented on pull request #30093:
URL: https://github.com/apache/spark/pull/30093#issuecomment-716748700
**[Test build #130296 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130296/testReport)**
for PR 30093 at commit
SparkQA removed a comment on pull request #29414:
URL: https://github.com/apache/spark/pull/29414#issuecomment-716546987
**[Test build #130291 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130291/testReport)**
for PR 29414 at commit
SparkQA commented on pull request #30145:
URL: https://github.com/apache/spark/pull/30145#issuecomment-716748379
**[Test build #130290 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130290/testReport)**
for PR 30145 at commit
SparkQA commented on pull request #29414:
URL: https://github.com/apache/spark/pull/29414#issuecomment-716748439
**[Test build #130291 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130291/testReport)**
for PR 29414 at commit
AmplabJenkins removed a comment on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-716744287
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-716744287
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #30134:
URL: https://github.com/apache/spark/pull/30134#issuecomment-716743923
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #30134:
URL: https://github.com/apache/spark/pull/30134#issuecomment-716743923
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA removed a comment on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-716538184
**[Test build #130289 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130289/testReport)**
for PR 30097 at commit
SparkQA commented on pull request #30097:
URL: https://github.com/apache/spark/pull/30097#issuecomment-716743114
**[Test build #130289 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130289/testReport)**
for PR 30097 at commit
SparkQA commented on pull request #30134:
URL: https://github.com/apache/spark/pull/30134#issuecomment-716742913
**[Test build #130292 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130292/testReport)**
for PR 30134 at commit
SparkQA removed a comment on pull request #30134:
URL: https://github.com/apache/spark/pull/30134#issuecomment-716551877
**[Test build #130292 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130292/testReport)**
for PR 30134 at commit
allisonwang-db commented on a change in pull request #30093:
URL: https://github.com/apache/spark/pull/30093#discussion_r512162304
##
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
##
@@ -1242,6 +1242,13 @@ object SQLConf {
allisonwang-db commented on a change in pull request #30093:
URL: https://github.com/apache/spark/pull/30093#discussion_r512162304
##
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
##
@@ -1242,6 +1242,13 @@ object SQLConf {
201 - 300 of 798 matches
Mail list logo
