AmplabJenkins commented on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631197828
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631197365
Merged build finished. Test FAILed.
This is an automated message from the Apache Git Service.
To
SparkQA removed a comment on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631154251
**[Test build #122862 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122862/testReport)**
for PR 28584 at commit
AmplabJenkins commented on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631197365
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA commented on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631197540
**[Test build #122865 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122865/testReport)**
for PR 28584 at commit
SparkQA commented on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631197104
**[Test build #122862 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122862/testReport)**
for PR 28584 at commit
Ngone51 commented on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631196426
retest this please.
This is an automated message from the Apache Git Service.
To respond to the message, please
maropu edited a comment on pull request #28574:
URL: https://github.com/apache/spark/pull/28574#issuecomment-631140668
Adding a doc for this looks nice and okay to me. How about splitting the
Data Types pages into three sub-sections like this?
```
SQL Reference
- Data Types
--
AmplabJenkins removed a comment on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631195079
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
AmplabJenkins removed a comment on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631194884
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631195076
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631194879
Merged build finished. Test FAILed.
This is an automated message from the Apache Git Service.
To
SparkQA removed a comment on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631157795
**[Test build #122864 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122864/testReport)**
for PR 28584 at commit
AmplabJenkins commented on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631194879
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA commented on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631194766
**[Test build #122864 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122864/testReport)**
for PR 28584 at commit
SparkQA removed a comment on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631151919
**[Test build #122860 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122860/testReport)**
for PR 28584 at commit
SparkQA commented on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631194348
**[Test build #122860 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122860/testReport)**
for PR 28584 at commit
HyukjinKwon commented on pull request #28572:
URL: https://github.com/apache/spark/pull/28572#issuecomment-631193835
Okay, seems already failed. I merged to branch-3.0 as well.
This is an automated message from the Apache
Ngone51 commented on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631190294
sure, thanks!
This is an automated message from the Apache Git Service.
To respond to the message, please log
jiangxb1987 commented on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631189377
"SPARK-31485: barrier stage should fail if only partial tasks are launched"
This test case is flaky, @Ngone51 can you take a look?
yaooqinn commented on a change in pull request #28580:
URL: https://github.com/apache/spark/pull/28580#discussion_r427699845
##
File path: sbin/spark-daemon.sh
##
@@ -74,10 +75,13 @@ shift
spark_rotate_log ()
{
log=$1;
-num=5;
-if [ -n "$2" ]; then
-
HyukjinKwon commented on pull request #28572:
URL: https://github.com/apache/spark/pull/28572#issuecomment-631188474
Merged to master.
I think we can backport this to branch-3.0 if RC2 actually fails.
This is an
HyukjinKwon edited a comment on pull request #28572:
URL: https://github.com/apache/spark/pull/28572#issuecomment-631188474
Merged to master.
I think we can backport this to branch-3.0 if RC2 officially fails.
This is
HyukjinKwon closed pull request #28572:
URL: https://github.com/apache/spark/pull/28572
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
kiszk commented on pull request #28577:
URL: https://github.com/apache/spark/pull/28577#issuecomment-631184554
late LGTM
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631184165
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
AmplabJenkins removed a comment on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631184156
Merged build finished. Test FAILed.
This is an automated message from the Apache Git Service.
To
AmplabJenkins commented on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631184156
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA removed a comment on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631138701
**[Test build #122856 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122856/testReport)**
for PR 28584 at commit
SparkQA commented on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631183835
**[Test build #122856 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122856/testReport)**
for PR 28584 at commit
maropu commented on a change in pull request #28580:
URL: https://github.com/apache/spark/pull/28580#discussion_r427678940
##
File path: sbin/spark-daemon.sh
##
@@ -74,10 +75,13 @@ shift
spark_rotate_log ()
{
log=$1;
-num=5;
-if [ -n "$2" ]; then
- num=$2
HyukjinKwon commented on pull request #28569:
URL: https://github.com/apache/spark/pull/28569#issuecomment-631165795
Thank you all!
This is an automated message from the Apache Git Service.
To respond to the message, please
tdas commented on pull request #28523:
URL: https://github.com/apache/spark/pull/28523#issuecomment-631158485
LGTM. Primarily because all tests seem to work without the hack in the
StreamExecution that force v1 sink execution.
dongjoon-hyun removed a comment on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631157380
Retest this please.
This is an automated message from the Apache Git Service.
To respond to the
SparkQA commented on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631157795
**[Test build #122864 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122864/testReport)**
for PR 28584 at commit
dongjoon-hyun commented on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631157380
Retest this please.
This is an automated message from the Apache Git Service.
To respond to the message,
dongjoon-hyun commented on a change in pull request #28569:
URL: https://github.com/apache/spark/pull/28569#discussion_r427669935
##
File path: python/pyspark/resource/information.py
##
@@ -26,8 +26,10 @@ class ResourceInformation(object):
One example is GPUs, where the
dongjoon-hyun closed pull request #28569:
URL: https://github.com/apache/spark/pull/28569
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to
AmplabJenkins commented on pull request #28578:
URL: https://github.com/apache/spark/pull/28578#issuecomment-631154654
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #28578:
URL: https://github.com/apache/spark/pull/28578#issuecomment-631154654
This is an automated message from the Apache Git Service.
To respond to the message, please log on
SparkQA commented on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631154251
**[Test build #122862 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122862/testReport)**
for PR 28584 at commit
dongjoon-hyun removed a comment on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631153901
Retest this please.
This is an automated message from the Apache Git Service.
To respond to the
SparkQA commented on pull request #28578:
URL: https://github.com/apache/spark/pull/28578#issuecomment-631154272
**[Test build #122863 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122863/testReport)**
for PR 28578 at commit
dongjoon-hyun removed a comment on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631150467
Retest this please
This is an automated message from the Apache Git Service.
To respond to the
dongjoon-hyun commented on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631153901
Retest this please.
This is an automated message from the Apache Git Service.
To respond to the message,
AmplabJenkins commented on pull request #28544:
URL: https://github.com/apache/spark/pull/28544#issuecomment-631152255
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #28544:
URL: https://github.com/apache/spark/pull/28544#issuecomment-631152255
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins removed a comment on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631152208
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631152208
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA commented on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631151919
**[Test build #122860 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122860/testReport)**
for PR 28584 at commit
SparkQA commented on pull request #28544:
URL: https://github.com/apache/spark/pull/28544#issuecomment-631151915
**[Test build #122861 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122861/testReport)**
for PR 28544 at commit
dongjoon-hyun commented on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631150467
Retest this please
This is an automated message from the Apache Git Service.
To respond to the message,
dongjoon-hyun commented on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631149735
Thank you so much, @jiangxb1987 .
This is an automated message from the Apache Git Service.
To respond to
dongjoon-hyun commented on pull request #28544:
URL: https://github.com/apache/spark/pull/28544#issuecomment-631149318
Retest this please.
This is an automated message from the Apache Git Service.
To respond to the message,
dongjoon-hyun commented on a change in pull request #28544:
URL: https://github.com/apache/spark/pull/28544#discussion_r427664699
##
File path:
sql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/cli/session/HiveSessionImpl.java
##
@@ -674,11 +678,15 @@ private
dongjoon-hyun commented on a change in pull request #28544:
URL: https://github.com/apache/spark/pull/28544#discussion_r427663759
##
File path:
sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/ui/HiveThriftServer2ListenerSuite.scala
##
@@ -140,6
AmplabJenkins removed a comment on pull request #28527:
URL: https://github.com/apache/spark/pull/28527#issuecomment-631146414
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins removed a comment on pull request #28544:
URL: https://github.com/apache/spark/pull/28544#issuecomment-631146404
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #28544:
URL: https://github.com/apache/spark/pull/28544#issuecomment-631146404
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
maropu commented on a change in pull request #28544:
URL: https://github.com/apache/spark/pull/28544#discussion_r427662014
##
File path:
sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/ui/HiveThriftServer2Listener.scala
##
@@ -131,60 +132,81 @@
AmplabJenkins commented on pull request #28527:
URL: https://github.com/apache/spark/pull/28527#issuecomment-631146414
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA commented on pull request #28544:
URL: https://github.com/apache/spark/pull/28544#issuecomment-631146065
**[Test build #122858 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122858/testReport)**
for PR 28544 at commit
SparkQA commented on pull request #28527:
URL: https://github.com/apache/spark/pull/28527#issuecomment-631146068
**[Test build #122859 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122859/testReport)**
for PR 28527 at commit
SparkQA commented on pull request #28575:
URL: https://github.com/apache/spark/pull/28575#issuecomment-631146069
**[Test build #122857 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122857/testReport)**
for PR 28575 at commit
dongjoon-hyun commented on pull request #28544:
URL: https://github.com/apache/spark/pull/28544#issuecomment-631145624
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
HeartSaVioR commented on pull request #28523:
URL: https://github.com/apache/spark/pull/28523#issuecomment-631145268
Personally I don't see any risk on 1, because we haven't make changes on
major release (via merging this in), and master is for next minor release which
has more risk to
AmplabJenkins commented on pull request #28575:
URL: https://github.com/apache/spark/pull/28575#issuecomment-631144239
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #28575:
URL: https://github.com/apache/spark/pull/28575#issuecomment-631144239
This is an automated message from the Apache Git Service.
To respond to the message, please log on
maropu commented on pull request #28527:
URL: https://github.com/apache/spark/pull/28527#issuecomment-631144107
retest this please
This is an automated message from the Apache Git Service.
To respond to the message, please
maropu commented on pull request #28575:
URL: https://github.com/apache/spark/pull/28575#issuecomment-631143972
retest this please
This is an automated message from the Apache Git Service.
To respond to the message, please
maropu commented on pull request #28574:
URL: https://github.com/apache/spark/pull/28574#issuecomment-631140668
Adding a doc for this looks nice and okay to me. How about splitting the
Data Types pages into three sub-sections like this?
```
SQL Reference
- Data Types
--
AmplabJenkins removed a comment on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631139371
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631139371
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA commented on pull request #28584:
URL: https://github.com/apache/spark/pull/28584#issuecomment-631138701
**[Test build #122856 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122856/testReport)**
for PR 28584 at commit
jiangxb1987 opened a new pull request #28584:
URL: https://github.com/apache/spark/pull/28584
### What changes were proposed in this pull request?
To wait until all the executors have started before submitting any job. This
could avoid the flakiness caused by waiting for executors
AmplabJenkins removed a comment on pull request #28582:
URL: https://github.com/apache/spark/pull/28582#issuecomment-631106162
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
AmplabJenkins removed a comment on pull request #28582:
URL: https://github.com/apache/spark/pull/28582#issuecomment-631106156
Merged build finished. Test FAILed.
This is an automated message from the Apache Git Service.
To
AmplabJenkins commented on pull request #28582:
URL: https://github.com/apache/spark/pull/28582#issuecomment-631106156
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA removed a comment on pull request #28582:
URL: https://github.com/apache/spark/pull/28582#issuecomment-631048836
**[Test build #122854 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122854/testReport)**
for PR 28582 at commit
SparkQA commented on pull request #28582:
URL: https://github.com/apache/spark/pull/28582#issuecomment-631105816
**[Test build #122854 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122854/testReport)**
for PR 28582 at commit
dongjoon-hyun commented on pull request #28577:
URL: https://github.com/apache/spark/pull/28577#issuecomment-631098172
Thank you, @srowen !
This is an automated message from the Apache Git Service.
To respond to the message,
AmplabJenkins commented on pull request #28572:
URL: https://github.com/apache/spark/pull/28572#issuecomment-631097449
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #28572:
URL: https://github.com/apache/spark/pull/28572#issuecomment-631097449
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #28579:
URL: https://github.com/apache/spark/pull/28579#issuecomment-631097518
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #28579:
URL: https://github.com/apache/spark/pull/28579#issuecomment-631097518
This is an automated message from the Apache Git Service.
To respond to the message, please log on
SparkQA commented on pull request #28572:
URL: https://github.com/apache/spark/pull/28572#issuecomment-631096629
**[Test build #122852 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122852/testReport)**
for PR 28572 at commit
SparkQA removed a comment on pull request #28579:
URL: https://github.com/apache/spark/pull/28579#issuecomment-630961488
**[Test build #122853 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122853/testReport)**
for PR 28579 at commit
SparkQA commented on pull request #28579:
URL: https://github.com/apache/spark/pull/28579#issuecomment-631096636
**[Test build #122853 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122853/testReport)**
for PR 28579 at commit
SparkQA removed a comment on pull request #28572:
URL: https://github.com/apache/spark/pull/28572#issuecomment-630903093
**[Test build #122852 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122852/testReport)**
for PR 28572 at commit
AmplabJenkins removed a comment on pull request #28583:
URL: https://github.com/apache/spark/pull/28583#issuecomment-631091554
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins commented on pull request #28583:
URL: https://github.com/apache/spark/pull/28583#issuecomment-631091554
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
SparkQA commented on pull request #28583:
URL: https://github.com/apache/spark/pull/28583#issuecomment-631090950
**[Test build #122855 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122855/testReport)**
for PR 28583 at commit
sarutak opened a new pull request #28583:
URL: https://github.com/apache/spark/pull/28583
### What changes were proposed in this pull request?
This PR changes JsonProtocol to write RDDInfos#isBarrier.
### Why are the changes needed?
JsonProtocol reads RDDInfos#isBarrier
srowen commented on pull request #28577:
URL: https://github.com/apache/spark/pull/28577#issuecomment-631072584
I was running tests on this patch in 2.11 and 2.12 and it looked good here
too.
This is an automated message
dongjoon-hyun commented on pull request #28577:
URL: https://github.com/apache/spark/pull/28577#issuecomment-631050916
Thank you so much, @rednaxelafx and @dbtsai .
This is an automated message from the Apache Git Service.
AmplabJenkins commented on pull request #28582:
URL: https://github.com/apache/spark/pull/28582#issuecomment-631049476
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
AmplabJenkins removed a comment on pull request #28582:
URL: https://github.com/apache/spark/pull/28582#issuecomment-631049476
This is an automated message from the Apache Git Service.
To respond to the message, please log on
AmplabJenkins removed a comment on pull request #28572:
URL: https://github.com/apache/spark/pull/28572#issuecomment-631048558
This is an automated message from the Apache Git Service.
To respond to the message, please log on
SparkQA commented on pull request #28582:
URL: https://github.com/apache/spark/pull/28582#issuecomment-631048836
**[Test build #122854 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122854/testReport)**
for PR 28582 at commit
AmplabJenkins commented on pull request #28572:
URL: https://github.com/apache/spark/pull/28572#issuecomment-631048558
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
101 - 200 of 524 matches
Mail list logo
