[
https://issues.apache.org/jira/browse/HBASE-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13270734#comment-13270734
]
Liyin Tang commented on HBASE-5776:
-----------------------------------
@Otis,
Good questions:)
The motivation of HTableMultipler is NOT to replace the existing HTable but to
provide a new alternative solutions for some high-throughput realtime
applications. Usually, these applications can tolerate some data-loss during
the region failover or other region-unavailable time instead of caching them in
memory.
In these cases, HTableMultiplexer tries its best to ONLY drop the data for
these unavailable regions, instead of slowing down the overall multiput
throughput which may cause more data dropping since the client fails to buffer
any more incoming data across all the regions.
Also, there is no call-back function if the put is finally failed after N
attempts. And if client uses the multiput api in HTable, there is no such call
back as well. However, we could have a way to config the HTableMultiplex to
intelligently call back for some put operations.
> HTableMultiplexer
> ------------------
>
> Key: HBASE-5776
> URL: https://issues.apache.org/jira/browse/HBASE-5776
> Project: HBase
> Issue Type: Improvement
> Reporter: Liyin Tang
> Assignee: Liyin Tang
> Attachments: D2775.1.patch, D2775.1.patch, D2775.2.patch,
> D2775.2.patch
>
>
> There is a known issue in HBase client that single slow/dead region server
> could slow down the multiput operations across all the region servers. So the
> HBase client will be as slow as the slowest region server in the cluster.
>
> To solve this problem, HTableMultiplexer will separate the multiput
> submitting threads with the flush threads, which means the multiput operation
> will be a nonblocking operation.
> The submitting thread will shard all the puts into different queues based on
> its destination region server and return immediately. The flush threads will
> flush these puts from each queue to its destination region server.
> Currently the HTableMultiplexer only supports the put operation.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
