[
https://issues.apache.org/jira/browse/HDFS-12773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16395435#comment-16395435
]
Íñigo Goiri commented on HDFS-12773:
------------------------------------
Thanks [~linyiqun] for the comments.
Basically the change is to allow multiple writers.
Currently, when 2 Routers are writing to the file (say stored in HDFS), there
is a high chance of both of them writing at the same time.
In this approach, we use temporary files for the writes and renaming
"atomically" to the final value.
All the implementation is done in the {{StateStoreFileBaseImpl}} which instead
of writing to the final location, it will go to a temporary one and then rename
to the final destination.
Once this is done, it should be usable already.
> RBF: Improve State Store FS implementation
> ------------------------------------------
>
> Key: HDFS-12773
> URL: https://issues.apache.org/jira/browse/HDFS-12773
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Íñigo Goiri
> Assignee: Íñigo Goiri
> Priority: Major
> Attachments: HDFS-12773.000.patch, HDFS-12773.001.patch,
> HDFS-12773.002.patch, HDFS-12773.003.patch
>
>
> HDFS-10630 introduced a filesystem implementation of the State Store for unit
> tests. However, this implementation doesn't handle multiple writers
> concurrently.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
