[
https://issues.apache.org/jira/browse/HDFS-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15365824#comment-15365824
]
Surendra Singh Lilhore commented on HDFS-8940:
----------------------------------------------
Hi All,
Why we will not use JournalNode as a {{Inotify Service}} instead of adding one
new service ?
*One suggestion from my side :*
We can use JournalNode as {{Inotify Service}}. In HDFS cluster we can install
multiple Journal Node, in that we can choose one Journal Node for Inotify
service.
1. We can configure one JounalNode as Inotify service.
{noformat}
<property>
<name>dfs.inotify.service</name>
<value>true</value>
</property>
{noformat}
2. Client will connect with this JournalNode and pull the events. If client is
connecting with some other JournalNode which is not supporting Inotify, then it
will throw {{NotSupportInotifyException}}.
3. SNN will not read edits from the InotifyService Journal Node. For this we
can configure {{dfs.namenode.shared.edits.dir}} like this in NN.
{noformat}
<property>
<name>dfs.namenode.shared.edits.dir</name>
<value>qjournal://x.x.x.x:8485;y.y.y.y:8485;z.z.z.z:8485;[Inotify]s.s.s.s:8485/cluster</value>
</property>
{noformat}
Here {{\[Inotify\]}} indicate it is only for write not for read, so SNN will
not try to read edits from this node.
> Support for large-scale multi-tenant inotify service
> ----------------------------------------------------
>
> Key: HDFS-8940
> URL: https://issues.apache.org/jira/browse/HDFS-8940
> Project: Hadoop HDFS
> Issue Type: Improvement
> Reporter: Ming Ma
> Attachments: Large-Scale-Multi-Tenant-Inotify-Service.pdf
>
>
> HDFS-6634 provides the core inotify functionality. We would like to extend
> that to provide a large-scale service that ten of thousands of clients can
> subscribe to.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
