[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13215798#comment-13215798
]
Jean-Daniel Cryans commented on HBASE-4365:
---
FWIW running a 5TB upload took 18h.
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13215803#comment-13215803
]
Jean-Daniel Cryans commented on HBASE-4365:
---
Oh and no concurrent mode failures,
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13215080#comment-13215080
]
Jean-Daniel Cryans commented on HBASE-4365:
---
Conclusion for the 1TB upload:
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13215088#comment-13215088
]
Todd Lipcon commented on HBASE-4365:
Great results! Very cool.
Add a
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13215176#comment-13215176
]
stack commented on HBASE-4365:
--
@Lars You want to put an upper bound on the number of
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13215189#comment-13215189
]
Lars Hofhansl commented on HBASE-4365:
--
@Stack: I trust J-D's test far more than my
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13215226#comment-13215226
]
Jean-Daniel Cryans commented on HBASE-4365:
---
bq. One question I had: Did you
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13215360#comment-13215360
]
Lars Hofhansl commented on HBASE-4365:
--
Ah nice :)
Add a decent
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13215368#comment-13215368
]
Lars Hofhansl commented on HBASE-4365:
--
Wanna have KeyPrefixRegionSplitPolicy extend
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13215384#comment-13215384
]
Hadoop QA commented on HBASE-4365:
--
-1 overall. Here are the results of testing the
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13215386#comment-13215386
]
Zhihong Yu commented on HBASE-4365:
---
Minor comment:
{code}
+ // If any of the
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13215390#comment-13215390
]
Hadoop QA commented on HBASE-4365:
--
-1 overall. Here are the results of testing the
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13215426#comment-13215426
]
Hadoop QA commented on HBASE-4365:
--
-1 overall. Here are the results of testing the
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13215427#comment-13215427
]
Lars Hofhansl commented on HBASE-4365:
--
+1 on V5
Add a decent
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13215454#comment-13215454
]
Lars Hofhansl commented on HBASE-4365:
--
Thanks for also changing
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13214122#comment-13214122
]
Jean-Daniel Cryans commented on HBASE-4365:
---
The latest patch is looking good on
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13214129#comment-13214129
]
Todd Lipcon commented on HBASE-4365:
Got any comparison numbers for total import time,
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13214134#comment-13214134
]
Jean-Daniel Cryans commented on HBASE-4365:
---
bq. Got any comparison numbers for
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13214147#comment-13214147
]
Todd Lipcon commented on HBASE-4365:
OK :)
Add a decent heuristic
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13214226#comment-13214226
]
Jean-Daniel Cryans commented on HBASE-4365:
---
Alright I did a macrotest with
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13214369#comment-13214369
]
Lars Hofhansl commented on HBASE-4365:
--
I like N^3. In the scenarios above it would
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13214374#comment-13214374
]
Lars Hofhansl commented on HBASE-4365:
--
Also I wonder now whether it is time to
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13214378#comment-13214378
]
Zhihong Yu commented on HBASE-4365:
---
The above concern makes sense.
We'd better make
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13213389#comment-13213389
]
stack commented on HBASE-4365:
--
If I understand correctly a regionserver would still split at
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13212142#comment-13212142
]
stack commented on HBASE-4365:
--
bq. Wouldn't we potentially do a lot of splitting when there
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13212424#comment-13212424
]
Lars Hofhansl commented on HBASE-4365:
--
Was thinking that before each region server
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13211619#comment-13211619
]
Lars Hofhansl commented on HBASE-4365:
--
Wouldn't we potentially do a lot of splitting
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13211620#comment-13211620
]
Lars Hofhansl commented on HBASE-4365:
--
Never use a calculator... 10gb/128mb = 80,
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13209379#comment-13209379
]
Zhihong Yu commented on HBASE-4365:
---
Thanks for the patch.
{code}
+boolean force =
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13209478#comment-13209478
]
stack commented on HBASE-4365:
--
I can add the above changes (will fix the superclass from
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13209621#comment-13209621
]
stack commented on HBASE-4365:
--
Chatting w/ J-D, probably less disruptive if we do square of
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13103073#comment-13103073
]
Ted Yu commented on HBASE-4365:
---
For pre-splitting tables, consider this scenario:
The
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13103076#comment-13103076
]
Todd Lipcon commented on HBASE-4365:
Hmm, that would suggest a heuristic based not on
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13103089#comment-13103089
]
Ted Yu commented on HBASE-4365:
---
+1 on Todd's idea.
Minor comment: the pluggable policy
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13101996#comment-13101996
]
Todd Lipcon commented on HBASE-4365:
bq. Load balancer currently doesn't balance the
[
https://issues.apache.org/jira/browse/HBASE-4365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13102022#comment-13102022
]
Ted Yu commented on HBASE-4365:
---
I understand the proposal provides better heuristic for
36 matches
Mail list logo
