Speedup HFile.Writer append
---
Key: HBASE-3514
URL: https://issues.apache.org/jira/browse/HBASE-3514
Project: HBase
Issue Type: Improvement
Components: io
Affects Versions: 0.90.0
Reporter:
[
https://issues.apache.org/jira/browse/HBASE-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matteo Bertozzi updated HBASE-3514:
---
Attachment: (was: HBASE-3514-append.patch)
Speedup HFile.Writer append
[
https://issues.apache.org/jira/browse/HBASE-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matteo Bertozzi updated HBASE-3514:
---
Attachment: HBASE-3514-metaBlock-bsearch.patch
Speedup HFile.Writer append
[
https://issues.apache.org/jira/browse/HBASE-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matteo Bertozzi updated HBASE-3514:
---
Attachment: HBASE-3514-append.patch
Speedup HFile.Writer append
[
https://issues.apache.org/jira/browse/HBASE-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12991836#comment-12991836
]
ryan rawson commented on HBASE-3514:
how does the performance numbers look like on a
[
https://issues.apache.org/jira/browse/HBASE-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12991837#comment-12991837
]
Matteo Bertozzi commented on HBASE-3514:
@ryan I've only a single node cluster, so
[
https://issues.apache.org/jira/browse/HBASE-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992008#comment-12992008
]
stack commented on HBASE-3514:
--
@Matteo Patch looks great. The speedup comes from not doing
[
https://issues.apache.org/jira/browse/HBASE-3257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992013#comment-12992013
]
stack commented on HBASE-3257:
--
Sorry I didn't get to a review. This is a great addition.
[
https://issues.apache.org/jira/browse/HBASE-3257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992022#comment-12992022
]
stack commented on HBASE-3257:
--
Did a quick review. +1 on commit. There are a few things
[
https://issues.apache.org/jira/browse/HBASE-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992067#comment-12992067
]
stack commented on HBASE-3478:
--
This looks like something hbase-3446 would fix. What you
[
https://issues.apache.org/jira/browse/HBASE-3465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992073#comment-12992073
]
stack commented on HBASE-3465:
--
bq. I am not suggesting a new hadoop lib dir. I am suggesting
[
https://issues.apache.org/jira/browse/HBASE-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992077#comment-12992077
]
stack commented on HBASE-3464:
--
Thanks for filing the issue James. This is an interesting
[
https://issues.apache.org/jira/browse/HBASE-3465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992080#comment-12992080
]
Ted Dunning commented on HBASE-3465:
My suggestion is that there be an hbase jar that
[
https://issues.apache.org/jira/browse/HBASE-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992089#comment-12992089
]
James Kennedy commented on HBASE-3478:
--
I'm not 100% convinced. Even if
[
https://issues.apache.org/jira/browse/HBASE-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992091#comment-12992091
]
Matteo Bertozzi commented on HBASE-3514:
@stack The first patch that I've written
[
https://issues.apache.org/jira/browse/HBASE-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992094#comment-12992094
]
James Kennedy commented on HBASE-3464:
--
Not sure. I haven't dug into this very far
[
https://issues.apache.org/jira/browse/HBASE-3374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992093#comment-12992093
]
stack commented on HBASE-3374:
--
Thanks @Charles. We'll wait on RC2 release then bring it in
[replication] ReplicationSource can miss a log after RS comes out of GC
---
Key: HBASE-3515
URL: https://issues.apache.org/jira/browse/HBASE-3515
Project: HBase
Issue Type:
[
https://issues.apache.org/jira/browse/HBASE-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992099#comment-12992099
]
stack commented on HBASE-3478:
--
Your fix up in hbase-3445 was because the new class
[
https://issues.apache.org/jira/browse/HBASE-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992121#comment-12992121
]
stack commented on HBASE-2965:
--
Akash, do you have a patch?
Implement MultipleTableInputs
[
https://issues.apache.org/jira/browse/HBASE-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jean-Daniel Cryans updated HBASE-3515:
--
Attachment: HBASE-3515.patch
This patch simply adds a check if the region server is
Coprocessors: add test cases for loading coprocessor jars from hdfs and local
fs.
--
Key: HBASE-3516
URL: https://issues.apache.org/jira/browse/HBASE-3516
Project:
[
https://issues.apache.org/jira/browse/HBASE-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992147#comment-12992147
]
stack commented on HBASE-3515:
--
+1 Is it needed in 0.90 too?
[replication]
[
https://issues.apache.org/jira/browse/HBASE-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992149#comment-12992149
]
Jean-Daniel Cryans commented on HBASE-3515:
---
Yes, I was planning to putting this
[
https://issues.apache.org/jira/browse/HBASE-3507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992151#comment-12992151
]
Ted Yu commented on HBASE-3507:
---
TestHeapSize would fail without the following change in
[
https://issues.apache.org/jira/browse/HBASE-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992172#comment-12992172
]
Ophir Cohen commented on HBASE-2965:
Actually I ment to start work on that - but held
[
https://issues.apache.org/jira/browse/HBASE-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jean-Daniel Cryans resolved HBASE-3515.
---
Resolution: Fixed
Hadoop Flags: [Reviewed]
Committed to branch and trunk.
[
https://issues.apache.org/jira/browse/HBASE-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992214#comment-12992214
]
Dave Latham commented on HBASE-3514:
{quote}
// pre-allocates the byte stream to the
HBASE-3470 breaks ability to submit MR jobs from hbase jar
--
Key: HBASE-3517
URL: https://issues.apache.org/jira/browse/HBASE-3517
Project: HBase
Issue Type: Bug
Affects Versions:
[
https://issues.apache.org/jira/browse/HBASE-3465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992248#comment-12992248
]
ryan rawson commented on HBASE-3465:
we should consider using jarjar:
[
https://issues.apache.org/jira/browse/HBASE-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992250#comment-12992250
]
Jonathan Gray commented on HBASE-3514:
--
I didn't review the code just now, but I
[
https://issues.apache.org/jira/browse/HBASE-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992252#comment-12992252
]
ryan rawson commented on HBASE-3514:
the hfile writer append code does:
private
[
https://issues.apache.org/jira/browse/HBASE-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon updated HBASE-3517:
---
Attachment: hbase-3517.txt
Something like this, maybe?
HBASE-3470 breaks ability to submit MR jobs
[
https://issues.apache.org/jira/browse/HBASE-3465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992269#comment-12992269
]
Ted Dunning commented on HBASE-3465:
The problem I had was not a matter of conflicting
[
https://issues.apache.org/jira/browse/HBASE-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992273#comment-12992273
]
Jonathan Gray commented on HBASE-3514:
--
Thanks for looking that up Ryan. Sorry for
[
https://issues.apache.org/jira/browse/HBASE-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992278#comment-12992278
]
ryan rawson commented on HBASE-3514:
if you file a jira and post a patch i'll review
shade some of our dependencies to make some client's life easier
Key: HBASE-3518
URL: https://issues.apache.org/jira/browse/HBASE-3518
Project: HBase
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/HBASE-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ryan rawson updated HBASE-3518:
---
Attachment: HBASE-shade-jar.txt
initial stab, it seems to work, but needs to have the assembly fixed
[
https://issues.apache.org/jira/browse/HBASE-3519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992294#comment-12992294
]
stack commented on HBASE-3519:
--
Here is what it looks like in hbase-default.xml near the
[
https://issues.apache.org/jira/browse/HBASE-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992299#comment-12992299
]
Hudson commented on HBASE-3517:
---
Integrated in HBase-TRUNK #1739 (See
[
https://issues.apache.org/jira/browse/HBASE-3499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992298#comment-12992298
]
Hudson commented on HBASE-3499:
---
Integrated in HBase-TRUNK #1739 (See
[
https://issues.apache.org/jira/browse/HBASE-3470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992300#comment-12992300
]
Hudson commented on HBASE-3470:
---
Integrated in HBase-TRUNK #1739 (See
[
https://issues.apache.org/jira/browse/HBASE-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992297#comment-12992297
]
Hudson commented on HBASE-3515:
---
Integrated in HBase-TRUNK #1739 (See
[
https://issues.apache.org/jira/browse/HBASE-3519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992301#comment-12992301
]
Todd Lipcon commented on HBASE-3519:
Did you see HBASE-3517?
Add hbase version to
[
https://issues.apache.org/jira/browse/HBASE-3455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992302#comment-12992302
]
Otis Gospodnetic commented on HBASE-3455:
-
In plain English, what's the end effect
[
https://issues.apache.org/jira/browse/HBASE-3455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992311#comment-12992311
]
Todd Lipcon commented on HBASE-3455:
Yes, elimination of stop-the-world GC pauses for
[
https://issues.apache.org/jira/browse/HBASE-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12992318#comment-12992318
]
stack commented on HBASE-3517:
--
Does this work?
{code}
+echoReplace in
47 matches
Mail list logo