[
https://issues.apache.org/jira/browse/HBASE-21246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654524#comment-16654524
]
Josh Elser commented on HBASE-21246:
------------------------------------
{quote}in the replication tracking system, we need to serialize the WALIdentity?
{quote}
Precisely.
{quote}we plan to let the WAL system to provide a subscribe/consume style API,
and maybe we could abstract concepts other than the wal file
{quote}
That's something we would want to enable, but I don't think we expect to build
fully. That'd be a massive undertaking on top of a massive undertaking already.
Having looked into this, I think we would want to just be making changes to
ReplicationSourceWALReader and leave the rest of the control-flow the same. I
know that Ted is thinking about this now.
{quote}For regionserver, it only needs the WAL instance? And for replaying
recover edits for a region, I think our decision is to provide a method in the
WAL system API to get a stream of the recovered edits for a region?
{quote}
Right and right :)
{quote}I do not think the upper layer needs to know whether we have multiple
wal files, or multiple topics or something other such things...
{quote}
If I'm interpreting correctly, yes. Really, all parts of hbase don't need to
know about the physical storage details (much like Multi-WAL did compared to
FSHLog).
> Introduce WALIdentity interface
> -------------------------------
>
> Key: HBASE-21246
> URL: https://issues.apache.org/jira/browse/HBASE-21246
> Project: HBase
> Issue Type: Sub-task
> Reporter: Ted Yu
> Assignee: Ted Yu
> Priority: Major
> Fix For: HBASE-20952
>
> Attachments: 21246.003.patch, 21246.HBASE-20952.001.patch,
> 21246.HBASE-20952.002.patch, 21246.HBASE-20952.004.patch,
> 21246.HBASE-20952.005.patch
>
>
> We are introducing WALIdentity interface so that the WAL representation can
> be decoupled from distributed filesystem.
> The interface provides getName method whose return value can represent
> filename in distributed filesystem environment or, the name of the stream
> when the WAL is backed by log stream.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
