Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21288
Sure
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/21288
Thanks for the check! btw, `DataSourceReadBenchmark` has the same issue
(`spark.master` setup), so is it ok to fix this as follow-up?
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21288
LGTM
Thanks! Merged to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91946/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21288
**[Test build #91946 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91946/testReport)**
for PR 21288 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/220/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/4112/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21288
**[Test build #91946 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91946/testReport)**
for PR 21288 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/21288
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/21288
Yep. Thank you for progressing this, @maropu !
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91914/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21288
**[Test build #91914 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91914/testReport)**
for PR 21288 at commit
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/21288
I've check the metrics and I found that GC happend in case of
`--diriver-memory 3g`.
---
-
To unsubscribe, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21288
**[Test build #91914 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91914/testReport)**
for PR 21288 at commit
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/21288
@dongjoon-hyun I got the same result in case of the same condition (enough
memory), but, if `--diriver-memory 3g` (smaller memory), I got a little
different results;
```
//
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/191/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/4082/
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/21288
I noticed why the big performance value changes happened in
https://github.com/apache/spark/pull/21288#discussion_r191280132; that's
because [the
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91857/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21288
**[Test build #91857 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91857/testReport)**
for PR 21288 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/4037/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21288
**[Test build #91857 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91857/testReport)**
for PR 21288 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/147/
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21288
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/21288
yea, I also agree with the opinion; we'd be better to run benchmarks on the
same machine.
I'll re-run the benchmark on `r3.xlarge` to check if I could get the same
result.
> There is
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91821/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21288
**[Test build #91821 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91821/testReport)**
for PR 21288 at commit
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/21288
One more thing; I prefer Macbook performance tests because the cost of EC2
is always a barrier to developers.
---
-
To
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/21288
@gatorsmile and @maropu . I really appreciate this effort. Thanks.
Since this is a cloud benchmark, I have one thing to recommend. Can we use
`r3.xlarge` for all benchmarks
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/4014/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/125/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21288
**[Test build #91821 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91821/testReport)**
for PR 21288 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/21288
ok
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21288
@maropu Could you fix the style?
BTW, based on the latest result, Parquet is generally faster than ORC. cc
@dongjoon-hyun @rdblue
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/4011/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91815/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21288
**[Test build #91815 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91815/testReport)**
for PR 21288 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21288
**[Test build #91815 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91815/testReport)**
for PR 21288 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/122/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21288
**[Test build #91795 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91795/testReport)**
for PR 21288 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91795/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21288
**[Test build #91795 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91795/testReport)**
for PR 21288 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91228/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21288
**[Test build #91228 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91228/testReport)**
for PR 21288 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3644/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21288
**[Test build #91228 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91228/testReport)**
for PR 21288 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91219/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21288
**[Test build #91219 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91219/testReport)**
for PR 21288 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3635/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21288
**[Test build #91219 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91219/testReport)**
for PR 21288 at commit
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/21288
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91211/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91210/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21288
**[Test build #91210 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91210/testReport)**
for PR 21288 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21288
**[Test build #91211 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91211/testReport)**
for PR 21288 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3628/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3627/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21288
**[Test build #91211 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91211/testReport)**
for PR 21288 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21288
**[Test build #91210 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91210/testReport)**
for PR 21288 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90904/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21288
**[Test build #90904 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90904/testReport)**
for PR 21288 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3418/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21288
**[Test build #90904 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90904/testReport)**
for PR 21288 at commit
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/21288
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90883/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21288
**[Test build #90883 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90883/testReport)**
for PR 21288 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3409/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/21288
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21288
**[Test build #90883 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90883/testReport)**
for PR 21288 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90878/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21288
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21288
**[Test build #90878 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90878/testReport)**
for PR 21288 at commit
1 - 100 of 128 matches
Mail list logo
