[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15425497#comment-15425497
]
Yin Huai commented on SPARK-16320:
--
[~maver1ck] Seems we can close this jira?
> Spark 2
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15421731#comment-15421731
]
Sean Owen commented on SPARK-16320:
---
I think that was the problem being solved there th
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15421728#comment-15421728
]
Maciej Bryński commented on SPARK-16320:
Maybe we can change SPARK-12384 a little
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15421719#comment-15421719
]
Sean Owen commented on SPARK-16320:
---
I see, I wonder if this deserves a bit of document
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15421699#comment-15421699
]
Maciej Bryński commented on SPARK-16320:
[~srowen], [~michael],
I found the reaso
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15406430#comment-15406430
]
Michael Allman commented on SPARK-16320:
Thank you for the new benchmarks, [~mave
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15406372#comment-15406372
]
Maciej Bryński commented on SPARK-16320:
Yes.
I also added Spark 1.6 with G1GC.
H
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15406125#comment-15406125
]
Michael Allman commented on SPARK-16320:
Hi [~maver1ck]. These are excellent find
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15405765#comment-15405765
]
Maciej Bryński commented on SPARK-16320:
Yes. But, it will be default on Java 9.
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15405682#comment-15405682
]
Sean Owen commented on SPARK-16320:
---
OK is this one "not a problem" then? G1GC is non d
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15405603#comment-15405603
]
Maciej Bryński commented on SPARK-16320:
PS.
When using https://github.com/apach
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15405576#comment-15405576
]
Maciej Bryński commented on SPARK-16320:
You're right.
I think I found solution f
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15405057#comment-15405057
]
Sean Zhong commented on SPARK-16320:
[~maver1ck] Did you use the test case in this ji
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15404675#comment-15404675
]
Apache Spark commented on SPARK-16320:
--
User 'maver1ck' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15404646#comment-15404646
]
Maciej Bryński commented on SPARK-16320:
[~michael], [~yhuai]
I think this is sma
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15404620#comment-15404620
]
Maciej Bryński commented on SPARK-16320:
I think that problem is already resolved
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15404619#comment-15404619
]
Maciej Bryński commented on SPARK-16320:
Yes.
That's it.
With this PR Spark 2.0 i
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15404369#comment-15404369
]
Yin Huai commented on SPARK-16320:
--
Can you also try https://github.com/apache/spark/pul
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15404361#comment-15404361
]
Michael Allman commented on SPARK-16320:
[~maver1ck] I'm having trouble reproduci
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15404114#comment-15404114
]
Maciej Bryński commented on SPARK-16320:
[~clockfly]
I tested your patch. Results
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15403470#comment-15403470
]
Maciej Bryński commented on SPARK-16320:
Yes. I'll do check tomorrow.
> Spark 2.
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15403238#comment-15403238
]
Sean Zhong commented on SPARK-16320:
[~loziniak] Can you check whether the PR works f
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15402961#comment-15402961
]
Apache Spark commented on SPARK-16320:
--
User 'clockfly' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386586#comment-15386586
]
Michael Allman commented on SPARK-16320:
Okay, so the metastore is not a factor.
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386552#comment-15386552
]
Maciej Bryński commented on SPARK-16320:
[~michael]
Could you check SPARK-16321 ?
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386395#comment-15386395
]
Michael Allman commented on SPARK-16320:
The code path for reading data from parq
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386333#comment-15386333
]
Michael Allman commented on SPARK-16320:
[~maver1ck] Would it be possible for you
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15384465#comment-15384465
]
Maciej Bryński commented on SPARK-16320:
OK. I think we have general problem with
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15361781#comment-15361781
]
Maciej Bryński commented on SPARK-16320:
[~rxin]
I created benchmark script and a
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15357213#comment-15357213
]
Maciej Bryński commented on SPARK-16320:
OK.
I'll try to confirm this issue on g
[
https://issues.apache.org/jira/browse/SPARK-16320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1535#comment-1535
]
Reynold Xin commented on SPARK-16320:
-
Can you try just generating a simple file with
31 matches
Mail list logo
