[
https://issues.apache.org/jira/browse/HADOOP-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Henry Wang updated HADOOP-10641:
--------------------------------
Attachment: zkbench.pdf
NNThroughputBenchmark Results.pdf
I ran zookeeper-benchmark and NNThroughputBenchMark.
Zookeeper write throughput on HDD is comparable to NameNode write operations
throughput while zookeeper throughput on SSD is higher than NameNode
throughput. Based on the results, zookeeper is not expected to be the
bottleneck.
> Introduce Coordination Engine interface
> ---------------------------------------
>
> Key: HADOOP-10641
> URL: https://issues.apache.org/jira/browse/HADOOP-10641
> Project: Hadoop Common
> Issue Type: New Feature
> Affects Versions: 3.0.0
> Reporter: Konstantin Shvachko
> Assignee: Plamen Jeliazkov
> Attachments: HADOOP-10641.patch, HADOOP-10641.patch,
> HADOOP-10641.patch, HADOOP-10641.patch, NNThroughputBenchmark Results.pdf,
> ce-tla.zip, hadoop-coordination.patch, zkbench.pdf
>
>
> Coordination Engine (CE) is a system, which allows to agree on a sequence of
> events in a distributed system. In order to be reliable CE should be
> distributed by itself.
> Coordination Engine can be based on different algorithms (paxos, raft, 2PC,
> zab) and have different implementations, depending on use cases, reliability,
> availability, and performance requirements.
> CE should have a common API, so that it could serve as a pluggable component
> in different projects. The immediate beneficiaries are HDFS (HDFS-6469) and
> HBase (HBASE-10909).
> First implementation is proposed to be based on ZooKeeper.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
