Github user watermen closed the pull request at:
https://github.com/apache/spark/pull/7536
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user srowen commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-137452070
(PS Yeah I meant that I wasn't sure whether `getLength` always returned a
meaningful value, as I sort of distantly remember a problem with this, but, it
might be
Github user tgravescs commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-137443861
On the hadoop size getLength() is part of the required interface so the
function would be there. With all the inputs formats I've seen this is always
set to
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-136876027
@watermen can you add a unit test for this? The high level motivation
sounds reasonable to me, but like @srowen I'm not familiar enough with the
Hadoop code to merge
Github user srowen commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-129725352
That seems reasonable to me, although I am not sure if inputLength is
necessarily set in all cases? this is just because I don't know the code. Also
are there other
Github user watermen commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-129724941
@andrewor14 @srowen Any more comment on this?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-128304673
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-128266964
[Test build #39997 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39997/consoleFull)
for PR 7536 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-128266269
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-128266282
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-128266349
[Test build #244 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SlowSparkPullRequestBuilder/244/consoleFull)
for PR 7536 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-128266428
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-128266447
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-128294849
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-128294804
[Test build #244 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SlowSparkPullRequestBuilder/244/console)
for PR 7536 at commit
Github user watermen commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-128265855
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-128304274
[Test build #39997 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39997/console)
for PR 7536 at commit
Github user hellertime commented on a diff in the pull request:
https://github.com/apache/spark/pull/7536#discussion_r36336003
--- Diff: core/src/main/scala/org/apache/spark/rdd/CoalescedRDD.scala ---
@@ -295,7 +295,15 @@ private class PartitionCoalescer(maxPartitions: Int,
prev:
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-128223737
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user watermen commented on a diff in the pull request:
https://github.com/apache/spark/pull/7536#discussion_r36378157
--- Diff: core/src/main/scala/org/apache/spark/rdd/CoalescedRDD.scala ---
@@ -295,7 +295,15 @@ private class PartitionCoalescer(maxPartitions: Int,
prev:
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-128223727
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-128225032
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user watermen commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-127143653
@andrewor14 Any comment on this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user watermen commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-125810242
@andrewor14
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user watermen commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-124995874
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-124997200
[Test build #38473 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38473/consoleFull)
for PR 7536 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-124996458
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-124996423
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-124996181
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-124996132
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-124996292
[Test build #108 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SlowSparkPullRequestBuilder/108/consoleFull)
for PR 7536 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-125013245
[Test build #108 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SlowSparkPullRequestBuilder/108/console)
for PR 7536 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-125014724
[Test build #38473 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38473/console)
for PR 7536 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-125014763
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user watermen commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-125054895
@andrewor14
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-125013285
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123647114
[Test build #57 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SlowSparkPullRequestBuilder/57/console)
for PR 7536 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123647111
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123647086
[Test build #57 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SlowSparkPullRequestBuilder/57/consoleFull)
for PR 7536 at commit
Github user scwf commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123646763
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123646917
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123646893
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123647119
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123647084
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123647968
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123647914
[Test build #38066 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38066/consoleFull)
for PR 7536 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123647961
[Test build #38066 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38066/console)
for PR 7536 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123924613
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123924655
[Test build #38141 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38141/consoleFull)
for PR 7536 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123924621
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123925941
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123925924
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123925952
[Test build #67 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SlowSparkPullRequestBuilder/67/consoleFull)
for PR 7536 at commit
Github user watermen commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123924520
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123947656
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123947630
[Test build #38141 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38141/console)
for PR 7536 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123952630
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123952614
[Test build #67 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SlowSparkPullRequestBuilder/67/console)
for PR 7536 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123370835
[Test build #37951 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37951/console)
for PR 7536 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123366165
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123366100
[Test build #42 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SlowSparkPullRequestBuilder/42/console)
for PR 7536 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123370978
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123523934
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123523978
[Test build #38004 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38004/consoleFull)
for PR 7536 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123523982
[Test build #38004 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38004/console)
for PR 7536 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123523616
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123523752
[Test build #47 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SlowSparkPullRequestBuilder/47/consoleFull)
for PR 7536 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123523984
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123523959
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123548664
[Test build #47 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SlowSparkPullRequestBuilder/47/console)
for PR 7536 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123548686
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user watermen commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123522578
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123523573
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123179583
[Test build #37909 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37909/console)
for PR 7536 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123179616
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user watermen commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123193051
@andrewor14 retest it?
`[error] SERVER ERROR: Service Temporarily Unavailable
Github user liancheng commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123284940
@watermen You can retest it yourself now as Andrew has put you into the
whitelist.
---
If your project is set up for it, you can reply to this email and have your
Github user liancheng commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123285169
Jenkins is being shut down for maintenance purposes. You may retest this PR
after it comes back.
---
If your project is set up for it, you can reply to this email
Github user watermen commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123300978
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123301169
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123301189
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123301261
[Test build #42 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SlowSparkPullRequestBuilder/42/consoleFull)
for PR 7536 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123301405
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123301426
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123302261
[Test build #37951 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37951/consoleFull)
for PR 7536 at commit
Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123149805
add to whitelist
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123150172
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123150190
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/7536#issuecomment-123151033
[Test build #37909 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37909/consoleFull)
for PR 7536 at commit
89 matches
Mail list logo
