[jira] [Updated] (HDFS-10646) Federation admin tool
[ https://issues.apache.org/jira/browse/HDFS-10646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10646: --- Attachment: HDFS-10646-HDFS-10467-001.patch * Fixed unit test * Fixed checkstyle * Fixed whitespace > Federation admin tool > - > > Key: HDFS-10646 > URL: https://issues.apache.org/jira/browse/HDFS-10646 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Affects Versions: HDFS-10467 >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-10646-HDFS-10467-000.patch, > HDFS-10646-HDFS-10467-001.patch > > > Tools for administrators to manage HDFS federation. This includes managing > the mount table and decommission subclusters. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10646) Federation admin tool
[ https://issues.apache.org/jira/browse/HDFS-10646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10646: --- Attachment: HDFS-10646-HDFS-10467-000.patch > Federation admin tool > - > > Key: HDFS-10646 > URL: https://issues.apache.org/jira/browse/HDFS-10646 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Affects Versions: HDFS-10467 >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-10646-HDFS-10467-000.patch > > > Tools for administrators to manage HDFS federation. This includes managing > the mount table and decommission subclusters. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10646) Federation admin tool
[ https://issues.apache.org/jira/browse/HDFS-10646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10646: --- Attachment: (was: HDFS-10646-HDFS-10467-000.patch) > Federation admin tool > - > > Key: HDFS-10646 > URL: https://issues.apache.org/jira/browse/HDFS-10646 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Affects Versions: HDFS-10467 >Reporter: Inigo Goiri >Assignee: Inigo Goiri > > Tools for administrators to manage HDFS federation. This includes managing > the mount table and decommission subclusters. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10646) Federation admin tool
[ https://issues.apache.org/jira/browse/HDFS-10646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10646: --- Assignee: Inigo Goiri Affects Version/s: HDFS-10467 Status: Patch Available (was: Open) > Federation admin tool > - > > Key: HDFS-10646 > URL: https://issues.apache.org/jira/browse/HDFS-10646 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Affects Versions: HDFS-10467 >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-10646-HDFS-10467-000.patch > > > Tools for administrators to manage HDFS federation. This includes managing > the mount table and decommission subclusters. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10646) Federation admin tool
[ https://issues.apache.org/jira/browse/HDFS-10646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10646: --- Attachment: HDFS-10646-HDFS-10467-000.patch First version of the admin patch. > Federation admin tool > - > > Key: HDFS-10646 > URL: https://issues.apache.org/jira/browse/HDFS-10646 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Reporter: Inigo Goiri > Attachments: HDFS-10646-HDFS-10467-000.patch > > > Tools for administrators to manage HDFS federation. This includes managing > the mount table and decommission subclusters. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10880) Federation Mount Table State Store internal API
[ https://issues.apache.org/jira/browse/HDFS-10880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10880: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10467 Status: Resolved (was: Patch Available) > Federation Mount Table State Store internal API > --- > > Key: HDFS-10880 > URL: https://issues.apache.org/jira/browse/HDFS-10880 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Reporter: Jason Kace >Assignee: Inigo Goiri > Fix For: HDFS-10467 > > Attachments: HDFS-10880-HDFS-10467-000.patch, > HDFS-10880-HDFS-10467-001.patch, HDFS-10880-HDFS-10467-002.patch, > HDFS-10880-HDFS-10467-003.patch, HDFS-10880-HDFS-10467-004.patch, > HDFS-10880-HDFS-10467-005.patch, HDFS-10880-HDFS-10467-006.patch, > HDFS-10880-HDFS-10467-007.patch, HDFS-10880-HDFS-10467-008.patch > > > The Federation Mount Table State encapsulates the mapping of file paths in > the global namespace to a specific NN(nameservice) and local NN path. The > mount table is shared by all router instances and represents a unified view > of the global namespace. The state store API for the mount table allows the > related records to be queried, updated and deleted. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-10880) Federation Mount Table State Store internal API
[ https://issues.apache.org/jira/browse/HDFS-10880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16115174#comment-16115174 ] Inigo Goiri commented on HDFS-10880: 008 is clean (unrelated unit test failure), going with the commit. Thanks [~chris.douglas] for the review! > Federation Mount Table State Store internal API > --- > > Key: HDFS-10880 > URL: https://issues.apache.org/jira/browse/HDFS-10880 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Reporter: Jason Kace >Assignee: Inigo Goiri > Attachments: HDFS-10880-HDFS-10467-000.patch, > HDFS-10880-HDFS-10467-001.patch, HDFS-10880-HDFS-10467-002.patch, > HDFS-10880-HDFS-10467-003.patch, HDFS-10880-HDFS-10467-004.patch, > HDFS-10880-HDFS-10467-005.patch, HDFS-10880-HDFS-10467-006.patch, > HDFS-10880-HDFS-10467-007.patch, HDFS-10880-HDFS-10467-008.patch > > > The Federation Mount Table State encapsulates the mapping of file paths in > the global namespace to a specific NN(nameservice) and local NN path. The > mount table is shared by all router instances and represents a unified view > of the global namespace. The state store API for the mount table allows the > related records to be queried, updated and deleted. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10880) Federation Mount Table State Store internal API
[ https://issues.apache.org/jira/browse/HDFS-10880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10880: --- Attachment: HDFS-10880-HDFS-10467-008.patch > Federation Mount Table State Store internal API > --- > > Key: HDFS-10880 > URL: https://issues.apache.org/jira/browse/HDFS-10880 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Reporter: Jason Kace >Assignee: Inigo Goiri > Attachments: HDFS-10880-HDFS-10467-000.patch, > HDFS-10880-HDFS-10467-001.patch, HDFS-10880-HDFS-10467-002.patch, > HDFS-10880-HDFS-10467-003.patch, HDFS-10880-HDFS-10467-004.patch, > HDFS-10880-HDFS-10467-005.patch, HDFS-10880-HDFS-10467-006.patch, > HDFS-10880-HDFS-10467-007.patch, HDFS-10880-HDFS-10467-008.patch > > > The Federation Mount Table State encapsulates the mapping of file paths in > the global namespace to a specific NN(nameservice) and local NN path. The > mount table is shared by all router instances and represents a unified view > of the global namespace. The state store API for the mount table allows the > related records to be queried, updated and deleted. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10880) Federation Mount Table State Store internal API
[
https://issues.apache.org/jira/browse/HDFS-10880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Inigo Goiri updated HDFS-10880:
---
Attachment: HDFS-10880-HDFS-10467-007.patch
[~chris.douglas] comments on {{MountTableResolver}}.
> Federation Mount Table State Store internal API
> ---
>
> Key: HDFS-10880
> URL: https://issues.apache.org/jira/browse/HDFS-10880
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: fs
>Reporter: Jason Kace
>Assignee: Inigo Goiri
> Attachments: HDFS-10880-HDFS-10467-000.patch,
> HDFS-10880-HDFS-10467-001.patch, HDFS-10880-HDFS-10467-002.patch,
> HDFS-10880-HDFS-10467-003.patch, HDFS-10880-HDFS-10467-004.patch,
> HDFS-10880-HDFS-10467-005.patch, HDFS-10880-HDFS-10467-006.patch,
> HDFS-10880-HDFS-10467-007.patch
>
>
> The Federation Mount Table State encapsulates the mapping of file paths in
> the global namespace to a specific NN(nameservice) and local NN path. The
> mount table is shared by all router instances and represents a unified view
> of the global namespace. The state store API for the mount table allows the
> related records to be queried, updated and deleted.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10880) Federation Mount Table State Store internal API
[ https://issues.apache.org/jira/browse/HDFS-10880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10880: --- Attachment: HDFS-10880-HDFS-10467-006.patch Small fix after testing in production. > Federation Mount Table State Store internal API > --- > > Key: HDFS-10880 > URL: https://issues.apache.org/jira/browse/HDFS-10880 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Reporter: Jason Kace >Assignee: Inigo Goiri > Attachments: HDFS-10880-HDFS-10467-000.patch, > HDFS-10880-HDFS-10467-001.patch, HDFS-10880-HDFS-10467-002.patch, > HDFS-10880-HDFS-10467-003.patch, HDFS-10880-HDFS-10467-004.patch, > HDFS-10880-HDFS-10467-005.patch, HDFS-10880-HDFS-10467-006.patch > > > The Federation Mount Table State encapsulates the mapping of file paths in > the global namespace to a specific NN(nameservice) and local NN path. The > mount table is shared by all router instances and represents a unified view > of the global namespace. The state store API for the mount table allows the > related records to be queried, updated and deleted. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10880) Federation Mount Table State Store internal API
[ https://issues.apache.org/jira/browse/HDFS-10880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10880: --- Attachment: HDFS-10880-HDFS-10467-005.patch Fixed checkstyles. > Federation Mount Table State Store internal API > --- > > Key: HDFS-10880 > URL: https://issues.apache.org/jira/browse/HDFS-10880 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Reporter: Jason Kace >Assignee: Inigo Goiri > Attachments: HDFS-10880-HDFS-10467-000.patch, > HDFS-10880-HDFS-10467-001.patch, HDFS-10880-HDFS-10467-002.patch, > HDFS-10880-HDFS-10467-003.patch, HDFS-10880-HDFS-10467-004.patch, > HDFS-10880-HDFS-10467-005.patch > > > The Federation Mount Table State encapsulates the mapping of file paths in > the global namespace to a specific NN(nameservice) and local NN path. The > mount table is shared by all router instances and represents a unified view > of the global namespace. The state store API for the mount table allows the > related records to be queried, updated and deleted. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10880) Federation Mount Table State Store internal API
[ https://issues.apache.org/jira/browse/HDFS-10880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10880: --- Attachment: HDFS-10880-HDFS-10467-004.patch * Fixed checkstyle * Fixed whitespace * Fixed unit tests > Federation Mount Table State Store internal API > --- > > Key: HDFS-10880 > URL: https://issues.apache.org/jira/browse/HDFS-10880 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Reporter: Jason Kace >Assignee: Inigo Goiri > Attachments: HDFS-10880-HDFS-10467-000.patch, > HDFS-10880-HDFS-10467-001.patch, HDFS-10880-HDFS-10467-002.patch, > HDFS-10880-HDFS-10467-003.patch, HDFS-10880-HDFS-10467-004.patch > > > The Federation Mount Table State encapsulates the mapping of file paths in > the global namespace to a specific NN(nameservice) and local NN path. The > mount table is shared by all router instances and represents a unified view > of the global namespace. The state store API for the mount table allows the > related records to be queried, updated and deleted. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10880) Federation Mount Table State Store internal API
[ https://issues.apache.org/jira/browse/HDFS-10880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10880: --- Attachment: HDFS-10880-HDFS-10467-003.patch Fixing merge with branch. > Federation Mount Table State Store internal API > --- > > Key: HDFS-10880 > URL: https://issues.apache.org/jira/browse/HDFS-10880 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Reporter: Jason Kace >Assignee: Inigo Goiri > Attachments: HDFS-10880-HDFS-10467-000.patch, > HDFS-10880-HDFS-10467-001.patch, HDFS-10880-HDFS-10467-002.patch, > HDFS-10880-HDFS-10467-003.patch > > > The Federation Mount Table State encapsulates the mapping of file paths in > the global namespace to a specific NN(nameservice) and local NN path. The > mount table is shared by all router instances and represents a unified view > of the global namespace. The state store API for the mount table allows the > related records to be queried, updated and deleted. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10880) Federation Mount Table State Store internal API
[ https://issues.apache.org/jira/browse/HDFS-10880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10880: --- Attachment: (was: HDFS-10880-HDFS-10467-003.patch) > Federation Mount Table State Store internal API > --- > > Key: HDFS-10880 > URL: https://issues.apache.org/jira/browse/HDFS-10880 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Reporter: Jason Kace >Assignee: Inigo Goiri > Attachments: HDFS-10880-HDFS-10467-000.patch, > HDFS-10880-HDFS-10467-001.patch, HDFS-10880-HDFS-10467-002.patch > > > The Federation Mount Table State encapsulates the mapping of file paths in > the global namespace to a specific NN(nameservice) and local NN path. The > mount table is shared by all router instances and represents a unified view > of the global namespace. The state store API for the mount table allows the > related records to be queried, updated and deleted. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10880) Federation Mount Table State Store internal API
[
https://issues.apache.org/jira/browse/HDFS-10880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Inigo Goiri updated HDFS-10880:
---
Attachment: HDFS-10880-HDFS-10467-003.patch
Tackled comments from [~chris.douglas]:
* Changed locking model for {{MountTableResolver}}
* Fixed upper key search (e.g., {{invalidateLocationCache()}})
* Removed {{getDestinationOrder()}}
* Tweaked {{PathLocation}} prioritzation.
* Removed classes related to {{CachedRecordStore}} as they were committed in
HDFS-10687
* Removed {{MountTable}} comparators as they are used for metrics
* Removed {{PathTree}}
> Federation Mount Table State Store internal API
> ---
>
> Key: HDFS-10880
> URL: https://issues.apache.org/jira/browse/HDFS-10880
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: fs
>Reporter: Jason Kace
>Assignee: Inigo Goiri
> Attachments: HDFS-10880-HDFS-10467-000.patch,
> HDFS-10880-HDFS-10467-001.patch, HDFS-10880-HDFS-10467-002.patch,
> HDFS-10880-HDFS-10467-003.patch
>
>
> The Federation Mount Table State encapsulates the mapping of file paths in
> the global namespace to a specific NN(nameservice) and local NN path. The
> mount table is shared by all router instances and represents a unified view
> of the global namespace. The state store API for the mount table allows the
> related records to be queried, updated and deleted.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11826) Federation Namenode Heartbeat
[ https://issues.apache.org/jira/browse/HDFS-11826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11826: --- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) > Federation Namenode Heartbeat > - > > Key: HDFS-11826 > URL: https://issues.apache.org/jira/browse/HDFS-11826 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Fix For: HDFS-10467 > > Attachments: HDFS-11826-HDFS-10467-000.patch, > HDFS-11826-HDFS-10467-001.patch, HDFS-11826-HDFS-10467-002.patch > > > Add a service to the Router to check the state of a Namenode and report it > into the State Store. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-11826) Federation Namenode Heartbeat
[ https://issues.apache.org/jira/browse/HDFS-11826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109851#comment-16109851 ] Inigo Goiri commented on HDFS-11826: Committed. [~chris.douglas], thanks for the review! > Federation Namenode Heartbeat > - > > Key: HDFS-11826 > URL: https://issues.apache.org/jira/browse/HDFS-11826 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Fix For: HDFS-10467 > > Attachments: HDFS-11826-HDFS-10467-000.patch, > HDFS-11826-HDFS-10467-001.patch, HDFS-11826-HDFS-10467-002.patch > > > Add a service to the Router to check the state of a Namenode and report it > into the State Store. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-11826) Federation Namenode Heartbeat
[ https://issues.apache.org/jira/browse/HDFS-11826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109476#comment-16109476 ] Inigo Goiri commented on HDFS-11826: The unit tests seem unrelated and the findbugs warnings are from other parts of the code. I'm going to ignore the check style regarding the 8 parameters. [~chris.douglas], if you have no comments, I'll push this based on your previous +1. > Federation Namenode Heartbeat > - > > Key: HDFS-11826 > URL: https://issues.apache.org/jira/browse/HDFS-11826 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Fix For: HDFS-10467 > > Attachments: HDFS-11826-HDFS-10467-000.patch, > HDFS-11826-HDFS-10467-001.patch, HDFS-11826-HDFS-10467-002.patch > > > Add a service to the Router to check the state of a Namenode and report it > into the State Store. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11826) Federation Namenode Heartbeat
[ https://issues.apache.org/jira/browse/HDFS-11826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11826: --- Attachment: HDFS-11826-HDFS-10467-002.patch Fixing check style. > Federation Namenode Heartbeat > - > > Key: HDFS-11826 > URL: https://issues.apache.org/jira/browse/HDFS-11826 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Fix For: HDFS-10467 > > Attachments: HDFS-11826-HDFS-10467-000.patch, > HDFS-11826-HDFS-10467-001.patch, HDFS-11826-HDFS-10467-002.patch > > > Add a service to the Router to check the state of a Namenode and report it > into the State Store. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11826) Federation Namenode Heartbeat
[ https://issues.apache.org/jira/browse/HDFS-11826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11826: --- Attachment: HDFS-11826-HDFS-10467-001.patch * Fixing unit tests. * Fixing check styles. * Adding message when the heartbeating is not properly configured. > Federation Namenode Heartbeat > - > > Key: HDFS-11826 > URL: https://issues.apache.org/jira/browse/HDFS-11826 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Fix For: HDFS-10467 > > Attachments: HDFS-11826-HDFS-10467-000.patch, > HDFS-11826-HDFS-10467-001.patch > > > Add a service to the Router to check the state of a Namenode and report it > into the State Store. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11826) Federation Namenode Heartbeat
[ https://issues.apache.org/jira/browse/HDFS-11826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11826: --- Attachment: HDFS-11826-HDFS-10467-000.patch > Federation Namenode Heartbeat > - > > Key: HDFS-11826 > URL: https://issues.apache.org/jira/browse/HDFS-11826 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Fix For: HDFS-10467 > > Attachments: HDFS-11826-HDFS-10467-000.patch > > > Add a service to the Router to check the state of a Namenode and report it > into the State Store. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11826) Federation Namenode Heartbeat
[ https://issues.apache.org/jira/browse/HDFS-11826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11826: --- Status: Patch Available (was: Open) > Federation Namenode Heartbeat > - > > Key: HDFS-11826 > URL: https://issues.apache.org/jira/browse/HDFS-11826 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Fix For: HDFS-10467 > > Attachments: HDFS-11826-HDFS-10467-000.patch > > > Add a service to the Router to check the state of a Namenode and report it > into the State Store. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10687) Federation Membership State Store internal API
[ https://issues.apache.org/jira/browse/HDFS-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10687: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10467 Status: Resolved (was: Patch Available) > Federation Membership State Store internal API > -- > > Key: HDFS-10687 > URL: https://issues.apache.org/jira/browse/HDFS-10687 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs >Reporter: Inigo Goiri >Assignee: Jason Kace > Fix For: HDFS-10467 > > Attachments: HDFS-10467-HDFS-10687-001.patch, > HDFS-10687-HDFS-10467-002.patch, HDFS-10687-HDFS-10467-003.patch, > HDFS-10687-HDFS-10467-004.patch, HDFS-10687-HDFS-10467-005.patch, > HDFS-10687-HDFS-10467-006.patch, HDFS-10687-HDFS-10467-007.patch, > HDFS-10687-HDFS-10467-008.patch > > > The Federation Membership State encapsulates the information about the > Namenodes of each sub-cluster that are participating in Federation. The > information includes addresses for RPC, Web. This information is stored in > the State Store and later used by the Router to find data in the federation. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-10687) Federation Membership State Store internal API
[ https://issues.apache.org/jira/browse/HDFS-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16107559#comment-16107559 ] Inigo Goiri commented on HDFS-10687: * The FindBugs don't seem related to the patch. * The checkstyle is for number of parameters, I would ignore it. * I don't think the failed unit tests are related to this patch? > Federation Membership State Store internal API > -- > > Key: HDFS-10687 > URL: https://issues.apache.org/jira/browse/HDFS-10687 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs >Reporter: Inigo Goiri >Assignee: Jason Kace > Attachments: HDFS-10467-HDFS-10687-001.patch, > HDFS-10687-HDFS-10467-002.patch, HDFS-10687-HDFS-10467-003.patch, > HDFS-10687-HDFS-10467-004.patch, HDFS-10687-HDFS-10467-005.patch, > HDFS-10687-HDFS-10467-006.patch, HDFS-10687-HDFS-10467-007.patch, > HDFS-10687-HDFS-10467-008.patch > > > The Federation Membership State encapsulates the information about the > Namenodes of each sub-cluster that are participating in Federation. The > information includes addresses for RPC, Web. This information is stored in > the State Store and later used by the Router to find data in the federation. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10687) Federation Membership State Store internal API
[
https://issues.apache.org/jira/browse/HDFS-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Inigo Goiri updated HDFS-10687:
---
Attachment: HDFS-10687-HDFS-10467-008.patch
Fixing {{MockResolver}} compilation issue.
> Federation Membership State Store internal API
> --
>
> Key: HDFS-10687
> URL: https://issues.apache.org/jira/browse/HDFS-10687
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: hdfs
>Reporter: Inigo Goiri
>Assignee: Jason Kace
> Attachments: HDFS-10467-HDFS-10687-001.patch,
> HDFS-10687-HDFS-10467-002.patch, HDFS-10687-HDFS-10467-003.patch,
> HDFS-10687-HDFS-10467-004.patch, HDFS-10687-HDFS-10467-005.patch,
> HDFS-10687-HDFS-10467-006.patch, HDFS-10687-HDFS-10467-007.patch,
> HDFS-10687-HDFS-10467-008.patch
>
>
> The Federation Membership State encapsulates the information about the
> Namenodes of each sub-cluster that are participating in Federation. The
> information includes addresses for RPC, Web. This information is stored in
> the State Store and later used by the Router to find data in the federation.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10687) Federation Membership State Store internal API
[ https://issues.apache.org/jira/browse/HDFS-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10687: --- Attachment: HDFS-10687-HDFS-10467-007.patch Uploading again after rebasing HDFS-10467 in HDFS-12223. > Federation Membership State Store internal API > -- > > Key: HDFS-10687 > URL: https://issues.apache.org/jira/browse/HDFS-10687 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs >Reporter: Inigo Goiri >Assignee: Jason Kace > Attachments: HDFS-10467-HDFS-10687-001.patch, > HDFS-10687-HDFS-10467-002.patch, HDFS-10687-HDFS-10467-003.patch, > HDFS-10687-HDFS-10467-004.patch, HDFS-10687-HDFS-10467-005.patch, > HDFS-10687-HDFS-10467-006.patch, HDFS-10687-HDFS-10467-007.patch > > > The Federation Membership State encapsulates the information about the > Namenodes of each sub-cluster that are participating in Federation. The > information includes addresses for RPC, Web. This information is stored in > the State Store and later used by the Router to find data in the federation. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10687) Federation Membership State Store internal API
[ https://issues.apache.org/jira/browse/HDFS-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10687: --- Attachment: (was: HDFS-10687-HDFS-10467-007.patch) > Federation Membership State Store internal API > -- > > Key: HDFS-10687 > URL: https://issues.apache.org/jira/browse/HDFS-10687 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs >Reporter: Inigo Goiri >Assignee: Jason Kace > Attachments: HDFS-10467-HDFS-10687-001.patch, > HDFS-10687-HDFS-10467-002.patch, HDFS-10687-HDFS-10467-003.patch, > HDFS-10687-HDFS-10467-004.patch, HDFS-10687-HDFS-10467-005.patch, > HDFS-10687-HDFS-10467-006.patch > > > The Federation Membership State encapsulates the information about the > Namenodes of each sub-cluster that are participating in Federation. The > information includes addresses for RPC, Web. This information is stored in > the State Store and later used by the Router to find data in the federation. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Resolved] (HDFS-12223) Rebasing HDFS-10467
[
https://issues.apache.org/jira/browse/HDFS-12223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Inigo Goiri resolved HDFS-12223.
Resolution: Fixed
Assignee: Inigo Goiri
> Rebasing HDFS-10467
> ---
>
> Key: HDFS-12223
> URL: https://issues.apache.org/jira/browse/HDFS-12223
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: fs
>Reporter: Inigo Goiri
>Assignee: Inigo Goiri
> Fix For: HDFS-10467
>
> Attachments: HDFS-12223-HDFS-10467.patch
>
>
> Erasure Coding methods where added to {{ClientProtocol}}. Adding those
> methods to {{RouterRpcServer}}.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-12223) Rebasing HDFS-10467
[
https://issues.apache.org/jira/browse/HDFS-12223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105824#comment-16105824
]
Inigo Goiri commented on HDFS-12223:
Not running Jenkins as the branch is currently not building (see HDFS-10687).
Committed.
> Rebasing HDFS-10467
> ---
>
> Key: HDFS-12223
> URL: https://issues.apache.org/jira/browse/HDFS-12223
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: fs
>Reporter: Inigo Goiri
> Fix For: HDFS-10467
>
> Attachments: HDFS-12223-HDFS-10467.patch
>
>
> Erasure Coding methods where added to {{ClientProtocol}}. Adding those
> methods to {{RouterRpcServer}}.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-12223) Rebasing HDFS-10467
[
https://issues.apache.org/jira/browse/HDFS-12223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Inigo Goiri updated HDFS-12223:
---
Attachment: HDFS-12223-HDFS-10467.patch
> Rebasing HDFS-10467
> ---
>
> Key: HDFS-12223
> URL: https://issues.apache.org/jira/browse/HDFS-12223
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: fs
>Reporter: Inigo Goiri
> Fix For: HDFS-10467
>
> Attachments: HDFS-12223-HDFS-10467.patch
>
>
> Erasure Coding methods where added to {{ClientProtocol}}. Adding those
> methods to {{RouterRpcServer}}.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-12223) Rebasing HDFS-10467
[
https://issues.apache.org/jira/browse/HDFS-12223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105816#comment-16105816
]
Inigo Goiri commented on HDFS-12223:
Adding the following methods as not implemented:
* addErasureCodingPolicies()
* removeErasureCodingPolicy()
* disableErasureCodingPolicy()
* enableErasureCodingPolicy()
* getECBlockGroupsStats()
* getErasureCodingCodecs()
* getBlocksStats()
* listOpenFiles()
> Rebasing HDFS-10467
> ---
>
> Key: HDFS-12223
> URL: https://issues.apache.org/jira/browse/HDFS-12223
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: fs
>Reporter: Inigo Goiri
> Fix For: HDFS-10467
>
>
> Erasure Coding methods where added to {{ClientProtocol}}. Adding those
> methods to {{RouterRpcServer}}.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Created] (HDFS-12223) Rebasing HDFS-10467
Inigo Goiri created HDFS-12223:
--
Summary: Rebasing HDFS-10467
Key: HDFS-12223
URL: https://issues.apache.org/jira/browse/HDFS-12223
Project: Hadoop HDFS
Issue Type: Sub-task
Reporter: Inigo Goiri
Erasure Coding methods where added to {{ClientProtocol}}. Adding those methods
to {{RouterRpcServer}}.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10687) Federation Membership State Store internal API
[ https://issues.apache.org/jira/browse/HDFS-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10687: --- Attachment: HDFS-10687-HDFS-10467-007.patch Tackling [~chris.douglas] comments. > Federation Membership State Store internal API > -- > > Key: HDFS-10687 > URL: https://issues.apache.org/jira/browse/HDFS-10687 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs >Reporter: Inigo Goiri >Assignee: Jason Kace > Attachments: HDFS-10467-HDFS-10687-001.patch, > HDFS-10687-HDFS-10467-002.patch, HDFS-10687-HDFS-10467-003.patch, > HDFS-10687-HDFS-10467-004.patch, HDFS-10687-HDFS-10467-005.patch, > HDFS-10687-HDFS-10467-006.patch, HDFS-10687-HDFS-10467-007.patch > > > The Federation Membership State encapsulates the information about the > Namenodes of each sub-cluster that are participating in Federation. The > information includes addresses for RPC, Web. This information is stored in > the State Store and later used by the Router to find data in the federation. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10865) Datanodemanager adds nodes twice to NetworkTopology
[
https://issues.apache.org/jira/browse/HDFS-10865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Inigo Goiri updated HDFS-10865:
---
Status: Patch Available (was: In Progress)
> Datanodemanager adds nodes twice to NetworkTopology
> ---
>
> Key: HDFS-10865
> URL: https://issues.apache.org/jira/browse/HDFS-10865
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: datanode
>Affects Versions: 2.7.3
>Reporter: Inigo Goiri
>Assignee: Inigo Goiri
> Attachments: HDFS-10865.000.patch
>
>
> {{DatanodeManager}} tries to add datanodes to the {{NetworkTopology}} twice
> in {{registerDatanode()}}.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11868) Backport HDFS-8674 to branch 2.7
[ https://issues.apache.org/jira/browse/HDFS-11868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11868: --- Status: In Progress (was: Patch Available) > Backport HDFS-8674 to branch 2.7 > > > Key: HDFS-11868 > URL: https://issues.apache.org/jira/browse/HDFS-11868 > Project: Hadoop HDFS > Issue Type: Task >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-8674-branch-2.7.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11868) Backport HDFS-8674 to branch 2.7
[ https://issues.apache.org/jira/browse/HDFS-11868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11868: --- Status: Patch Available (was: In Progress) > Backport HDFS-8674 to branch 2.7 > > > Key: HDFS-11868 > URL: https://issues.apache.org/jira/browse/HDFS-11868 > Project: Hadoop HDFS > Issue Type: Task >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-8674-branch-2.7.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11868) Backport HDFS-8674 to branch 2.7
[ https://issues.apache.org/jira/browse/HDFS-11868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11868: --- Status: Patch Available (was: In Progress) > Backport HDFS-8674 to branch 2.7 > > > Key: HDFS-11868 > URL: https://issues.apache.org/jira/browse/HDFS-11868 > Project: Hadoop HDFS > Issue Type: Task >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-8674-branch-2.7.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11868) Backport HDFS-8674 to branch 2.7
[ https://issues.apache.org/jira/browse/HDFS-11868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11868: --- Status: In Progress (was: Patch Available) > Backport HDFS-8674 to branch 2.7 > > > Key: HDFS-11868 > URL: https://issues.apache.org/jira/browse/HDFS-11868 > Project: Hadoop HDFS > Issue Type: Task >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-8674-branch-2.7.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11869) Backport HDFS-11078 to branch 2.7
[ https://issues.apache.org/jira/browse/HDFS-11869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11869: --- Status: Patch Available (was: In Progress) > Backport HDFS-11078 to branch 2.7 > - > > Key: HDFS-11869 > URL: https://issues.apache.org/jira/browse/HDFS-11869 > Project: Hadoop HDFS > Issue Type: Task >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-11078-branch-2.7.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-11868) Backport HDFS-8674 to branch 2.7
[ https://issues.apache.org/jira/browse/HDFS-11868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16024051#comment-16024051 ] Inigo Goiri commented on HDFS-11868: Moved to PA. > Backport HDFS-8674 to branch 2.7 > > > Key: HDFS-11868 > URL: https://issues.apache.org/jira/browse/HDFS-11868 > Project: Hadoop HDFS > Issue Type: Task >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-8674-branch-2.7.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11868) Backport HDFS-8674 to branch 2.7
[ https://issues.apache.org/jira/browse/HDFS-11868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11868: --- Status: Patch Available (was: In Progress) > Backport HDFS-8674 to branch 2.7 > > > Key: HDFS-11868 > URL: https://issues.apache.org/jira/browse/HDFS-11868 > Project: Hadoop HDFS > Issue Type: Task >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-8674-branch-2.7.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11078) NPE in LazyPersistFileScrubber
[ https://issues.apache.org/jira/browse/HDFS-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11078: --- Attachment: HDFS-11078-branch-2.7.patch > NPE in LazyPersistFileScrubber > -- > > Key: HDFS-11078 > URL: https://issues.apache.org/jira/browse/HDFS-11078 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-11078.000.patch, HDFS-11078.001.patch, > HDFS-11078-branch-2.7.patch > > > If a block is removed, it will be removed from the block map. When the > clearCorruptLazyPersistFiles() tries to delete the block, it may already be > deleted and generate a null pointer exception. > java.lang.NullPointerException > at > org.apache.hadoop.hdfs.server.namenode.FSNamesystem$LazyPersistFileScrubber.clearCorruptLazyPersistFiles(FSNamesystem.java:3820) > at > org.apache.hadoop.hdfs.server.namenode.FSNamesystem$LazyPersistFileScrubber.run(FSNamesystem.java:3851) > at java.lang.Thread.run(Thread.java:745) -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11078) NPE in LazyPersistFileScrubber
[ https://issues.apache.org/jira/browse/HDFS-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11078: --- Target Version/s: 2.7.4 Status: In Progress (was: Patch Available) > NPE in LazyPersistFileScrubber > -- > > Key: HDFS-11078 > URL: https://issues.apache.org/jira/browse/HDFS-11078 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-11078.000.patch, HDFS-11078.001.patch, > HDFS-11078-branch-2.7.patch > > > If a block is removed, it will be removed from the block map. When the > clearCorruptLazyPersistFiles() tries to delete the block, it may already be > deleted and generate a null pointer exception. > java.lang.NullPointerException > at > org.apache.hadoop.hdfs.server.namenode.FSNamesystem$LazyPersistFileScrubber.clearCorruptLazyPersistFiles(FSNamesystem.java:3820) > at > org.apache.hadoop.hdfs.server.namenode.FSNamesystem$LazyPersistFileScrubber.run(FSNamesystem.java:3851) > at java.lang.Thread.run(Thread.java:745) -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Created] (HDFS-11869) Backport HDFS-11078 to branch 2.7
Inigo Goiri created HDFS-11869: -- Summary: Backport HDFS-11078 to branch 2.7 Key: HDFS-11869 URL: https://issues.apache.org/jira/browse/HDFS-11869 Project: Hadoop HDFS Issue Type: Task Reporter: Inigo Goiri Assignee: Inigo Goiri Attachments: HDFS-11078-branch-2.7.patch -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11869) Backport HDFS-11078 to branch 2.7
[ https://issues.apache.org/jira/browse/HDFS-11869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11869: --- Attachment: HDFS-11078-branch-2.7.patch > Backport HDFS-11078 to branch 2.7 > - > > Key: HDFS-11869 > URL: https://issues.apache.org/jira/browse/HDFS-11869 > Project: Hadoop HDFS > Issue Type: Task >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-11078-branch-2.7.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11869) Backport HDFS-11078 to branch 2.7
[ https://issues.apache.org/jira/browse/HDFS-11869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11869: --- Status: In Progress (was: Patch Available) > Backport HDFS-11078 to branch 2.7 > - > > Key: HDFS-11869 > URL: https://issues.apache.org/jira/browse/HDFS-11869 > Project: Hadoop HDFS > Issue Type: Task >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-11078-branch-2.7.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11869) Backport HDFS-11078 to branch 2.7
[ https://issues.apache.org/jira/browse/HDFS-11869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11869: --- Status: Patch Available (was: Open) > Backport HDFS-11078 to branch 2.7 > - > > Key: HDFS-11869 > URL: https://issues.apache.org/jira/browse/HDFS-11869 > Project: Hadoop HDFS > Issue Type: Task >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-11078-branch-2.7.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11868) Backport HDFS-8674 to branch 2.7
[ https://issues.apache.org/jira/browse/HDFS-11868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11868: --- Status: In Progress (was: Patch Available) > Backport HDFS-8674 to branch 2.7 > > > Key: HDFS-11868 > URL: https://issues.apache.org/jira/browse/HDFS-11868 > Project: Hadoop HDFS > Issue Type: Task >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-8674-branch-2.7.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Created] (HDFS-11868) Backport HDFS-8674 to branch 2.7
Inigo Goiri created HDFS-11868: -- Summary: Backport HDFS-8674 to branch 2.7 Key: HDFS-11868 URL: https://issues.apache.org/jira/browse/HDFS-11868 Project: Hadoop HDFS Issue Type: Task Reporter: Inigo Goiri Assignee: Inigo Goiri Attachments: HDFS-8674-branch-2.7.patch -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11868) Backport HDFS-8674 to branch 2.7
[ https://issues.apache.org/jira/browse/HDFS-11868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11868: --- Attachment: HDFS-8674-branch-2.7.patch > Backport HDFS-8674 to branch 2.7 > > > Key: HDFS-11868 > URL: https://issues.apache.org/jira/browse/HDFS-11868 > Project: Hadoop HDFS > Issue Type: Task >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-8674-branch-2.7.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11868) Backport HDFS-8674 to branch 2.7
[ https://issues.apache.org/jira/browse/HDFS-11868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11868: --- Status: Patch Available (was: Open) > Backport HDFS-8674 to branch 2.7 > > > Key: HDFS-11868 > URL: https://issues.apache.org/jira/browse/HDFS-11868 > Project: Hadoop HDFS > Issue Type: Task >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-8674-branch-2.7.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11867) Backport HDFS-6291 to branch 2.7
[ https://issues.apache.org/jira/browse/HDFS-11867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11867: --- Attachment: HDFS-6291-branch-2.7.patch > Backport HDFS-6291 to branch 2.7 > > > Key: HDFS-11867 > URL: https://issues.apache.org/jira/browse/HDFS-11867 > Project: Hadoop HDFS > Issue Type: Task >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-6291-branch-2.7.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11867) Backport HDFS-6291 to branch 2.7
[ https://issues.apache.org/jira/browse/HDFS-11867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11867: --- Status: In Progress (was: Patch Available) > Backport HDFS-6291 to branch 2.7 > > > Key: HDFS-11867 > URL: https://issues.apache.org/jira/browse/HDFS-11867 > Project: Hadoop HDFS > Issue Type: Task >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-6291-branch-2.7.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11867) Backport HDFS-6291 to branch 2.7
[ https://issues.apache.org/jira/browse/HDFS-11867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11867: --- Status: Patch Available (was: Open) > Backport HDFS-6291 to branch 2.7 > > > Key: HDFS-11867 > URL: https://issues.apache.org/jira/browse/HDFS-11867 > Project: Hadoop HDFS > Issue Type: Task >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-6291-branch-2.7.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Created] (HDFS-11867) Backport HDFS-6291 to branch 2.7
Inigo Goiri created HDFS-11867: -- Summary: Backport HDFS-6291 to branch 2.7 Key: HDFS-11867 URL: https://issues.apache.org/jira/browse/HDFS-11867 Project: Hadoop HDFS Issue Type: Task Reporter: Inigo Goiri Assignee: Inigo Goiri -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10687) Federation Membership State Store internal API
[ https://issues.apache.org/jira/browse/HDFS-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10687: --- Attachment: HDFS-10687-HDFS-10467-006.patch * Fix unit test * Fix check style * Fix white space > Federation Membership State Store internal API > -- > > Key: HDFS-10687 > URL: https://issues.apache.org/jira/browse/HDFS-10687 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs >Reporter: Inigo Goiri >Assignee: Jason Kace > Attachments: HDFS-10467-HDFS-10687-001.patch, > HDFS-10687-HDFS-10467-002.patch, HDFS-10687-HDFS-10467-003.patch, > HDFS-10687-HDFS-10467-004.patch, HDFS-10687-HDFS-10467-005.patch, > HDFS-10687-HDFS-10467-006.patch > > > The Federation Membership State encapsulates the information about the > Namenodes of each sub-cluster that are participating in Federation. The > information includes addresses for RPC, Web. This information is stored in > the State Store and later used by the Router to find data in the federation. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10687) Federation Membership State Store internal API
[ https://issues.apache.org/jira/browse/HDFS-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10687: --- Attachment: HDFS-10687-HDFS-10467-005.patch * Add unit test * Fix checkstyle > Federation Membership State Store internal API > -- > > Key: HDFS-10687 > URL: https://issues.apache.org/jira/browse/HDFS-10687 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs >Reporter: Inigo Goiri >Assignee: Jason Kace > Attachments: HDFS-10467-HDFS-10687-001.patch, > HDFS-10687-HDFS-10467-002.patch, HDFS-10687-HDFS-10467-003.patch, > HDFS-10687-HDFS-10467-004.patch, HDFS-10687-HDFS-10467-005.patch > > > The Federation Membership State encapsulates the information about the > Namenodes of each sub-cluster that are participating in Federation. The > information includes addresses for RPC, Web. This information is stored in > the State Store and later used by the Router to find data in the federation. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-2538) option to disable fsck dots
[ https://issues.apache.org/jira/browse/HDFS-2538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015090#comment-16015090 ] Inigo Goiri commented on HDFS-2538: --- [~brahmareddy] mentions, this is an incompatible change and there was some controversy. [~shv], feel free to ignore and close the JIRA again but remove the 2.7.4 flag. > option to disable fsck dots > > > Key: HDFS-2538 > URL: https://issues.apache.org/jira/browse/HDFS-2538 > Project: Hadoop HDFS > Issue Type: Improvement >Affects Versions: 2.2.0 >Reporter: Allen Wittenauer >Assignee: Mohammad Kamrul Islam >Priority: Minor > Labels: newbie, release-blocker > Fix For: 3.0.0-alpha1 > > Attachments: HDFS-2538.1.patch, HDFS-2538.2.patch, HDFS-2538.3.patch, > HDFS-2538-branch-0.20-security-204.patch, > HDFS-2538-branch-0.20-security-204.patch, HDFS-2538-branch-1.0.patch, > HDFS-2538-branch-2.7.patch > > > this patch turns the dots during fsck off by default and provides an option > to turn them back on if you have a fetish for millions and millions of dots > on your terminal. i haven't done any benchmarks, but i suspect fsck is now > 300% faster to boot. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-2538) option to disable fsck dots
[ https://issues.apache.org/jira/browse/HDFS-2538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-2538: -- Attachment: HDFS-2538-branch-2.7.patch Backport for 2.7.4. > option to disable fsck dots > > > Key: HDFS-2538 > URL: https://issues.apache.org/jira/browse/HDFS-2538 > Project: Hadoop HDFS > Issue Type: Improvement >Affects Versions: 2.2.0 >Reporter: Allen Wittenauer >Assignee: Mohammad Kamrul Islam >Priority: Minor > Labels: newbie, release-blocker > Fix For: 3.0.0-alpha1 > > Attachments: HDFS-2538.1.patch, HDFS-2538.2.patch, HDFS-2538.3.patch, > HDFS-2538-branch-0.20-security-204.patch, > HDFS-2538-branch-0.20-security-204.patch, HDFS-2538-branch-1.0.patch, > HDFS-2538-branch-2.7.patch > > > this patch turns the dots during fsck off by default and provides an option > to turn them back on if you have a fetish for millions and millions of dots > on your terminal. i haven't done any benchmarks, but i suspect fsck is now > 300% faster to boot. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Reopened] (HDFS-2538) option to disable fsck dots
[ https://issues.apache.org/jira/browse/HDFS-2538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri reopened HDFS-2538: --- Backporting to 2.7.4. > option to disable fsck dots > > > Key: HDFS-2538 > URL: https://issues.apache.org/jira/browse/HDFS-2538 > Project: Hadoop HDFS > Issue Type: Improvement >Affects Versions: 2.2.0 >Reporter: Allen Wittenauer >Assignee: Mohammad Kamrul Islam >Priority: Minor > Labels: newbie, release-blocker > Fix For: 3.0.0-alpha1 > > Attachments: HDFS-2538.1.patch, HDFS-2538.2.patch, HDFS-2538.3.patch, > HDFS-2538-branch-0.20-security-204.patch, > HDFS-2538-branch-0.20-security-204.patch, HDFS-2538-branch-1.0.patch > > > this patch turns the dots during fsck off by default and provides an option > to turn them back on if you have a fetish for millions and millions of dots > on your terminal. i haven't done any benchmarks, but i suspect fsck is now > 300% faster to boot. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10880) Federation Mount Table State Store internal API
[ https://issues.apache.org/jira/browse/HDFS-10880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10880: --- Attachment: HDFS-10880-HDFS-10467-002.patch * Fixed unit tests * Fixed check styles * Add new unit tests > Federation Mount Table State Store internal API > --- > > Key: HDFS-10880 > URL: https://issues.apache.org/jira/browse/HDFS-10880 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Reporter: Jason Kace >Assignee: Inigo Goiri > Attachments: HDFS-10880-HDFS-10467-000.patch, > HDFS-10880-HDFS-10467-001.patch, HDFS-10880-HDFS-10467-002.patch > > > The Federation Mount Table State encapsulates the mapping of file paths in > the global namespace to a specific NN(nameservice) and local NN path. The > mount table is shared by all router instances and represents a unified view > of the global namespace. The state store API for the mount table allows the > related records to be queried, updated and deleted. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10687) Federation Membership State Store internal API
[ https://issues.apache.org/jira/browse/HDFS-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10687: --- Attachment: HDFS-10687-HDFS-10467-004.patch Fixed and add unit tests. > Federation Membership State Store internal API > -- > > Key: HDFS-10687 > URL: https://issues.apache.org/jira/browse/HDFS-10687 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs >Reporter: Inigo Goiri >Assignee: Jason Kace > Attachments: HDFS-10467-HDFS-10687-001.patch, > HDFS-10687-HDFS-10467-002.patch, HDFS-10687-HDFS-10467-003.patch, > HDFS-10687-HDFS-10467-004.patch > > > The Federation Membership State encapsulates the information about the > Namenodes of each sub-cluster that are participating in Federation. The > information includes addresses for RPC, Web. This information is stored in > the State Store and later used by the Router to find data in the federation. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10880) Federation Mount Table State Store internal API
[ https://issues.apache.org/jira/browse/HDFS-10880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10880: --- Attachment: HDFS-10880-HDFS-10467-001.patch * Fixing compilation issues * Fixing check styles * Adding unit tests > Federation Mount Table State Store internal API > --- > > Key: HDFS-10880 > URL: https://issues.apache.org/jira/browse/HDFS-10880 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Reporter: Jason Kace >Assignee: Inigo Goiri > Attachments: HDFS-10880-HDFS-10467-000.patch, > HDFS-10880-HDFS-10467-001.patch > > > The Federation Mount Table State encapsulates the mapping of file paths in > the global namespace to a specific NN(nameservice) and local NN path. The > mount table is shared by all router instances and represents a unified view > of the global namespace. The state store API for the mount table allows the > related records to be queried, updated and deleted. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10880) Federation Mount Table State Store internal API
[ https://issues.apache.org/jira/browse/HDFS-10880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10880: --- Attachment: HDFS-10880-HDFS-10467-000.patch First version without unit tests. > Federation Mount Table State Store internal API > --- > > Key: HDFS-10880 > URL: https://issues.apache.org/jira/browse/HDFS-10880 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Reporter: Jason Kace >Assignee: Jason Kace > Attachments: HDFS-10880-HDFS-10467-000.patch > > > The Federation Mount Table State encapsulates the mapping of file paths in > the global namespace to a specific NN(nameservice) and local NN path. The > mount table is shared by all router instances and represents a unified view > of the global namespace. The state store API for the mount table allows the > related records to be queried, updated and deleted. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10880) Federation Mount Table State Store internal API
[ https://issues.apache.org/jira/browse/HDFS-10880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10880: --- Assignee: Inigo Goiri (was: Jason Kace) Status: Patch Available (was: Open) > Federation Mount Table State Store internal API > --- > > Key: HDFS-10880 > URL: https://issues.apache.org/jira/browse/HDFS-10880 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Reporter: Jason Kace >Assignee: Inigo Goiri > Attachments: HDFS-10880-HDFS-10467-000.patch > > > The Federation Mount Table State encapsulates the mapping of file paths in > the global namespace to a specific NN(nameservice) and local NN path. The > mount table is shared by all router instances and represents a unified view > of the global namespace. The state store API for the mount table allows the > related records to be queried, updated and deleted. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Created] (HDFS-11826) Federation Namenode Heartbeat
Inigo Goiri created HDFS-11826: -- Summary: Federation Namenode Heartbeat Key: HDFS-11826 URL: https://issues.apache.org/jira/browse/HDFS-11826 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Inigo Goiri Assignee: Inigo Goiri Add a service to the Router to check the state of a Namenode and report it into the State Store. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-11713) Use MoveFileEx to allow renaming a file when the destination exists
[
https://issues.apache.org/jira/browse/HDFS-11713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011019#comment-16011019
]
Inigo Goiri commented on HDFS-11713:
Anybody available for review? [~arpitagarwal], [~chuanliu], [~sureshms],
[~cnauroth]?
> Use MoveFileEx to allow renaming a file when the destination exists
> ---
>
> Key: HDFS-11713
> URL: https://issues.apache.org/jira/browse/HDFS-11713
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: hdfs, native, rolling upgrades
>Affects Versions: 2.7.1, 2.7.3, 3.0.0-alpha1, 3.0.0-alpha2
>Reporter: Lukas Majercak
>Assignee: Lukas Majercak
> Labels: windows
> Attachments: HDFS-11713.001.patch
>
>
> The {{NativeIO.c#renameTo0}} currently uses {{MoveFile}} Windows system call,
> which fails when renaming a file to a destination that already exists.
> This makes the {{TestRollingUpgrade.testRollback}} test fail on Windows, as
> during that execution, a DataNode tries to rename block's meta file to a
> destination that exists.
> The proposal is to change to using {{MoveFileEx}} Windows call, and passing
> in {{MOVEFILE_REPLACE_EXISTING}} flag to force the renaming.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10687) Federation Membership State Store internal API
[ https://issues.apache.org/jira/browse/HDFS-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10687: --- Component/s: (was: fs) hdfs > Federation Membership State Store internal API > -- > > Key: HDFS-10687 > URL: https://issues.apache.org/jira/browse/HDFS-10687 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs >Reporter: Inigo Goiri >Assignee: Jason Kace > Attachments: HDFS-10467-HDFS-10687-001.patch, > HDFS-10687-HDFS-10467-002.patch, HDFS-10687-HDFS-10467-003.patch > > > The Federation Membership State encapsulates the information about the > Namenodes of each sub-cluster that are participating in Federation. The > information includes addresses for RPC, Web. This information is stored in > the State Store and later used by the Router to find data in the federation. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10687) Federation Membership State Store internal API
[ https://issues.apache.org/jira/browse/HDFS-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10687: --- Attachment: HDFS-10687-HDFS-10467-003.patch Rebased to HDFS-10467. > Federation Membership State Store internal API > -- > > Key: HDFS-10687 > URL: https://issues.apache.org/jira/browse/HDFS-10687 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Reporter: Inigo Goiri >Assignee: Jason Kace > Attachments: HDFS-10467-HDFS-10687-001.patch, > HDFS-10687-HDFS-10467-002.patch, HDFS-10687-HDFS-10467-003.patch > > > The Federation Membership State encapsulates the information about the > Namenodes of each sub-cluster that are participating in Federation. The > information includes addresses for RPC, Web. This information is stored in > the State Store and later used by the Router to find data in the federation. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-11546) Federation Router RPC server
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006783#comment-16006783 ] Inigo Goiri commented on HDFS-11546: Thanks [~chris.douglas] for the review! Committed to the HDFS-10467 branch. > Federation Router RPC server > > > Key: HDFS-11546 > URL: https://issues.apache.org/jira/browse/HDFS-11546 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs >Affects Versions: HDFS-10467 >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Fix For: HDFS-10467 > > Attachments: HDFS-11546-HDFS-10467-000.patch, > HDFS-11546-HDFS-10467-001.patch, HDFS-11546-HDFS-10467-002.patch, > HDFS-11546-HDFS-10467-003.patch, HDFS-11546-HDFS-10467-004.patch, > HDFS-11546-HDFS-10467-005.patch, HDFS-11546-HDFS-10467-007.patch, > HDFS-11546-HDFS-10467-008.patch, HDFS-11546-HDFS-10467-009.patch, > HDFS-11546-HDFS-10467-010.patch, HDFS-11546-HDFS-10467-011.patch > > > RPC server side of the Federation Router implements ClientProtocol. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11546) Federation Router RPC server
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11546: --- Resolution: Resolved Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) > Federation Router RPC server > > > Key: HDFS-11546 > URL: https://issues.apache.org/jira/browse/HDFS-11546 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs >Affects Versions: HDFS-10467 >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-11546-HDFS-10467-000.patch, > HDFS-11546-HDFS-10467-001.patch, HDFS-11546-HDFS-10467-002.patch, > HDFS-11546-HDFS-10467-003.patch, HDFS-11546-HDFS-10467-004.patch, > HDFS-11546-HDFS-10467-005.patch, HDFS-11546-HDFS-10467-007.patch, > HDFS-11546-HDFS-10467-008.patch, HDFS-11546-HDFS-10467-009.patch, > HDFS-11546-HDFS-10467-010.patch, HDFS-11546-HDFS-10467-011.patch > > > RPC server side of the Federation Router implements ClientProtocol. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10467) Router-based HDFS federation
[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10467: --- Hadoop Flags: (was: Reviewed) > Router-based HDFS federation > > > Key: HDFS-10467 > URL: https://issues.apache.org/jira/browse/HDFS-10467 > Project: Hadoop HDFS > Issue Type: New Feature > Components: fs >Affects Versions: 2.8.1 >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Fix For: HDFS-10467 > > Attachments: HDFS-10467.PoC.001.patch, HDFS-10467.PoC.patch, HDFS > Router Federation.pdf, HDFS-Router-Federation-Prototype.patch > > > Add a Router to provide a federated view of multiple HDFS clusters. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11546) Federation Router RPC server
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11546: --- Fix Version/s: HDFS-10467 > Federation Router RPC server > > > Key: HDFS-11546 > URL: https://issues.apache.org/jira/browse/HDFS-11546 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs >Affects Versions: HDFS-10467 >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Fix For: HDFS-10467 > > Attachments: HDFS-11546-HDFS-10467-000.patch, > HDFS-11546-HDFS-10467-001.patch, HDFS-11546-HDFS-10467-002.patch, > HDFS-11546-HDFS-10467-003.patch, HDFS-11546-HDFS-10467-004.patch, > HDFS-11546-HDFS-10467-005.patch, HDFS-11546-HDFS-10467-007.patch, > HDFS-11546-HDFS-10467-008.patch, HDFS-11546-HDFS-10467-009.patch, > HDFS-11546-HDFS-10467-010.patch, HDFS-11546-HDFS-10467-011.patch > > > RPC server side of the Federation Router implements ClientProtocol. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10467) Router-based HDFS federation
[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10467: --- Fix Version/s: HDFS-10467 > Router-based HDFS federation > > > Key: HDFS-10467 > URL: https://issues.apache.org/jira/browse/HDFS-10467 > Project: Hadoop HDFS > Issue Type: New Feature > Components: fs >Affects Versions: 2.8.1 >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Fix For: HDFS-10467 > > Attachments: HDFS-10467.PoC.001.patch, HDFS-10467.PoC.patch, HDFS > Router Federation.pdf, HDFS-Router-Federation-Prototype.patch > > > Add a Router to provide a federated view of multiple HDFS clusters. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Reopened] (HDFS-10467) Router-based HDFS federation
[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri reopened HDFS-10467: > Router-based HDFS federation > > > Key: HDFS-10467 > URL: https://issues.apache.org/jira/browse/HDFS-10467 > Project: Hadoop HDFS > Issue Type: New Feature > Components: fs >Affects Versions: 2.8.1 >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Fix For: HDFS-10467 > > Attachments: HDFS-10467.PoC.001.patch, HDFS-10467.PoC.patch, HDFS > Router Federation.pdf, HDFS-Router-Federation-Prototype.patch > > > Add a Router to provide a federated view of multiple HDFS clusters. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10467) Router-based HDFS federation
[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10467: --- Target Version/s: (was: HDFS-10467) > Router-based HDFS federation > > > Key: HDFS-10467 > URL: https://issues.apache.org/jira/browse/HDFS-10467 > Project: Hadoop HDFS > Issue Type: New Feature > Components: fs >Affects Versions: 2.8.1 >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Fix For: HDFS-10467 > > Attachments: HDFS-10467.PoC.001.patch, HDFS-10467.PoC.patch, HDFS > Router Federation.pdf, HDFS-Router-Federation-Prototype.patch > > > Add a Router to provide a federated view of multiple HDFS clusters. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10467) Router-based HDFS federation
[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10467: --- Resolution: Resolved Hadoop Flags: Reviewed Target Version/s: HDFS-10467 Status: Resolved (was: Patch Available) > Router-based HDFS federation > > > Key: HDFS-10467 > URL: https://issues.apache.org/jira/browse/HDFS-10467 > Project: Hadoop HDFS > Issue Type: New Feature > Components: fs >Affects Versions: 2.8.1 >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-10467.PoC.001.patch, HDFS-10467.PoC.patch, HDFS > Router Federation.pdf, HDFS-Router-Federation-Prototype.patch > > > Add a Router to provide a federated view of multiple HDFS clusters. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Issue Comment Deleted] (HDFS-10467) Router-based HDFS federation
[
https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Inigo Goiri updated HDFS-10467:
---
Comment: was deleted
(was: * Adding more methods to {{RouterRpcServer}}
* Stub handling for safe mode in {{RouterRpcServer}}
* Switched to {{Logger}})
> Router-based HDFS federation
>
>
> Key: HDFS-10467
> URL: https://issues.apache.org/jira/browse/HDFS-10467
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: fs
>Affects Versions: 2.8.1
>Reporter: Inigo Goiri
>Assignee: Inigo Goiri
> Attachments: HDFS-10467.PoC.001.patch, HDFS-10467.PoC.patch, HDFS
> Router Federation.pdf, HDFS-Router-Federation-Prototype.patch
>
>
> Add a Router to provide a federated view of multiple HDFS clusters.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10467) Router-based HDFS federation
[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10467: --- Attachment: (was: HDFS-11546-HDFS-10467-011.patch) > Router-based HDFS federation > > > Key: HDFS-10467 > URL: https://issues.apache.org/jira/browse/HDFS-10467 > Project: Hadoop HDFS > Issue Type: New Feature > Components: fs >Affects Versions: 2.8.1 >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-10467.PoC.001.patch, HDFS-10467.PoC.patch, HDFS > Router Federation.pdf, HDFS-Router-Federation-Prototype.patch > > > Add a Router to provide a federated view of multiple HDFS clusters. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11546) Federation Router RPC server
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11546: --- Attachment: HDFS-11546-HDFS-10467-011.patch Minor style fixes. This has been tested at large scale. > Federation Router RPC server > > > Key: HDFS-11546 > URL: https://issues.apache.org/jira/browse/HDFS-11546 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs >Affects Versions: HDFS-10467 >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-11546-HDFS-10467-000.patch, > HDFS-11546-HDFS-10467-001.patch, HDFS-11546-HDFS-10467-002.patch, > HDFS-11546-HDFS-10467-003.patch, HDFS-11546-HDFS-10467-004.patch, > HDFS-11546-HDFS-10467-005.patch, HDFS-11546-HDFS-10467-007.patch, > HDFS-11546-HDFS-10467-008.patch, HDFS-11546-HDFS-10467-009.patch, > HDFS-11546-HDFS-10467-010.patch, HDFS-11546-HDFS-10467-011.patch > > > RPC server side of the Federation Router implements ClientProtocol. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Issue Comment Deleted] (HDFS-10467) Router-based HDFS federation
[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10467: --- Comment: was deleted (was: Minor style fixes. This version has been tested at large scale and works properly.) > Router-based HDFS federation > > > Key: HDFS-10467 > URL: https://issues.apache.org/jira/browse/HDFS-10467 > Project: Hadoop HDFS > Issue Type: New Feature > Components: fs >Affects Versions: 2.8.1 >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-10467.PoC.001.patch, HDFS-10467.PoC.patch, HDFS > Router Federation.pdf, HDFS-Router-Federation-Prototype.patch > > > Add a Router to provide a federated view of multiple HDFS clusters. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10467) Router-based HDFS federation
[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10467: --- Attachment: HDFS-11546-HDFS-10467-011.patch Minor style fixes. This version has been tested at large scale and works properly. > Router-based HDFS federation > > > Key: HDFS-10467 > URL: https://issues.apache.org/jira/browse/HDFS-10467 > Project: Hadoop HDFS > Issue Type: New Feature > Components: fs >Affects Versions: 2.8.1 >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-10467.PoC.001.patch, HDFS-10467.PoC.patch, > HDFS-11546-HDFS-10467-011.patch, HDFS Router Federation.pdf, > HDFS-Router-Federation-Prototype.patch > > > Add a Router to provide a federated view of multiple HDFS clusters. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11546) Federation Router RPC server
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11546: --- Attachment: HDFS-11546-HDFS-10467-010.patch Fixed: * Unit tests * Findbugs * Check styles > Federation Router RPC server > > > Key: HDFS-11546 > URL: https://issues.apache.org/jira/browse/HDFS-11546 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs >Affects Versions: HDFS-10467 >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-11546-HDFS-10467-000.patch, > HDFS-11546-HDFS-10467-001.patch, HDFS-11546-HDFS-10467-002.patch, > HDFS-11546-HDFS-10467-003.patch, HDFS-11546-HDFS-10467-004.patch, > HDFS-11546-HDFS-10467-005.patch, HDFS-11546-HDFS-10467-007.patch, > HDFS-11546-HDFS-10467-008.patch, HDFS-11546-HDFS-10467-009.patch, > HDFS-11546-HDFS-10467-010.patch > > > RPC server side of the Federation Router implements ClientProtocol. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11546) Federation Router RPC server
[
https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Inigo Goiri updated HDFS-11546:
---
Attachment: HDFS-11546-HDFS-10467-009.patch
* Improving {{ConnectionManager}}
* Fixing {{RouterRpcServer#rename()}}
> Federation Router RPC server
>
>
> Key: HDFS-11546
> URL: https://issues.apache.org/jira/browse/HDFS-11546
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: hdfs
>Affects Versions: HDFS-10467
>Reporter: Inigo Goiri
>Assignee: Inigo Goiri
> Attachments: HDFS-11546-HDFS-10467-000.patch,
> HDFS-11546-HDFS-10467-001.patch, HDFS-11546-HDFS-10467-002.patch,
> HDFS-11546-HDFS-10467-003.patch, HDFS-11546-HDFS-10467-004.patch,
> HDFS-11546-HDFS-10467-005.patch, HDFS-11546-HDFS-10467-007.patch,
> HDFS-11546-HDFS-10467-008.patch, HDFS-11546-HDFS-10467-009.patch
>
>
> RPC server side of the Federation Router implements ClientProtocol.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11546) Federation Router RPC server
[
https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Inigo Goiri updated HDFS-11546:
---
Attachment: HDFS-11546-HDFS-10467-008.patch
* Improved synchronization in the {{ConnectionPool}}
* Added operation category
* Fixed style checks
> Federation Router RPC server
>
>
> Key: HDFS-11546
> URL: https://issues.apache.org/jira/browse/HDFS-11546
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: hdfs
>Affects Versions: HDFS-10467
>Reporter: Inigo Goiri
>Assignee: Inigo Goiri
> Attachments: HDFS-11546-HDFS-10467-000.patch,
> HDFS-11546-HDFS-10467-001.patch, HDFS-11546-HDFS-10467-002.patch,
> HDFS-11546-HDFS-10467-003.patch, HDFS-11546-HDFS-10467-004.patch,
> HDFS-11546-HDFS-10467-005.patch, HDFS-11546-HDFS-10467-007.patch,
> HDFS-11546-HDFS-10467-008.patch
>
>
> RPC server side of the Federation Router implements ClientProtocol.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11546) Federation Router RPC server
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11546: --- Attachment: (was: HDFS-11546-HDFS-10467-007.patch) > Federation Router RPC server > > > Key: HDFS-11546 > URL: https://issues.apache.org/jira/browse/HDFS-11546 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs >Affects Versions: HDFS-10467 >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-11546-HDFS-10467-000.patch, > HDFS-11546-HDFS-10467-001.patch, HDFS-11546-HDFS-10467-002.patch, > HDFS-11546-HDFS-10467-003.patch, HDFS-11546-HDFS-10467-004.patch, > HDFS-11546-HDFS-10467-005.patch, HDFS-11546-HDFS-10467-007.patch > > > RPC server side of the Federation Router implements ClientProtocol. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11546) Federation Router RPC server
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11546: --- Attachment: HDFS-11546-HDFS-10467-007.patch Fixing compilation because of rebase and check style. > Federation Router RPC server > > > Key: HDFS-11546 > URL: https://issues.apache.org/jira/browse/HDFS-11546 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs >Affects Versions: HDFS-10467 >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-11546-HDFS-10467-000.patch, > HDFS-11546-HDFS-10467-001.patch, HDFS-11546-HDFS-10467-002.patch, > HDFS-11546-HDFS-10467-003.patch, HDFS-11546-HDFS-10467-004.patch, > HDFS-11546-HDFS-10467-005.patch, HDFS-11546-HDFS-10467-007.patch > > > RPC server side of the Federation Router implements ClientProtocol. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11546) Federation Router RPC server
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11546: --- Attachment: (was: HDFS-11546-HDFS-10467-006.patch) > Federation Router RPC server > > > Key: HDFS-11546 > URL: https://issues.apache.org/jira/browse/HDFS-11546 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs >Affects Versions: HDFS-10467 >Reporter: Inigo Goiri >Assignee: Inigo Goiri > Attachments: HDFS-11546-HDFS-10467-000.patch, > HDFS-11546-HDFS-10467-001.patch, HDFS-11546-HDFS-10467-002.patch, > HDFS-11546-HDFS-10467-003.patch, HDFS-11546-HDFS-10467-004.patch, > HDFS-11546-HDFS-10467-005.patch, HDFS-11546-HDFS-10467-007.patch > > > RPC server side of the Federation Router implements ClientProtocol. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11546) Federation Router RPC server
[
https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Inigo Goiri updated HDFS-11546:
---
Attachment: HDFS-11546-HDFS-10467-007.patch
* Rebase to HDFS-10467
* Fixing {{ConnectionPool}}
** Manage busy connections better
** Simplifying getting and adding new connections
> Federation Router RPC server
>
>
> Key: HDFS-11546
> URL: https://issues.apache.org/jira/browse/HDFS-11546
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: hdfs
>Affects Versions: HDFS-10467
>Reporter: Inigo Goiri
>Assignee: Inigo Goiri
> Attachments: HDFS-11546-HDFS-10467-000.patch,
> HDFS-11546-HDFS-10467-001.patch, HDFS-11546-HDFS-10467-002.patch,
> HDFS-11546-HDFS-10467-003.patch, HDFS-11546-HDFS-10467-004.patch,
> HDFS-11546-HDFS-10467-005.patch, HDFS-11546-HDFS-10467-006.patch,
> HDFS-11546-HDFS-10467-007.patch
>
>
> RPC server side of the Federation Router implements ClientProtocol.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-10630) Federation State Store FS Implementation
[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994090#comment-15994090 ] Inigo Goiri commented on HDFS-10630: The failed unit test and the find bugs are not related. Comitting this to HDFS-10467. Thanks [~chris.douglas] for the review and [~jakace] for the code! > Federation State Store FS Implementation > > > Key: HDFS-10630 > URL: https://issues.apache.org/jira/browse/HDFS-10630 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs >Reporter: Inigo Goiri >Assignee: Jason Kace > Fix For: HDFS-10467 > > Attachments: HDFS-10630.001.patch, HDFS-10630.002.patch, > HDFS-10630-HDFS-10467-003.patch, HDFS-10630-HDFS-10467-004.patch, > HDFS-10630-HDFS-10467-005.patch, HDFS-10630-HDFS-10467-006.patch, > HDFS-10630-HDFS-10467-007.patch, HDFS-10630-HDFS-10467-008.patch, > HDFS-10630-HDFS-10467-009.patch, HDFS-10630-HDFS-10467-010.patch > > > Interface to store the federation shared state across Routers. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10630) Federation State Store FS Implementation
[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10630: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10467 Status: Resolved (was: Patch Available) > Federation State Store FS Implementation > > > Key: HDFS-10630 > URL: https://issues.apache.org/jira/browse/HDFS-10630 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs >Reporter: Inigo Goiri >Assignee: Jason Kace > Fix For: HDFS-10467 > > Attachments: HDFS-10630.001.patch, HDFS-10630.002.patch, > HDFS-10630-HDFS-10467-003.patch, HDFS-10630-HDFS-10467-004.patch, > HDFS-10630-HDFS-10467-005.patch, HDFS-10630-HDFS-10467-006.patch, > HDFS-10630-HDFS-10467-007.patch, HDFS-10630-HDFS-10467-008.patch, > HDFS-10630-HDFS-10467-009.patch, HDFS-10630-HDFS-10467-010.patch > > > Interface to store the federation shared state across Routers. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10631) Federation State Store ZooKeeper implementation
[ https://issues.apache.org/jira/browse/HDFS-10631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10631: --- Attachment: HDFS-10631-HDFS-10467-005.patch Added curator and fixed check style. > Federation State Store ZooKeeper implementation > --- > > Key: HDFS-10631 > URL: https://issues.apache.org/jira/browse/HDFS-10631 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Reporter: Inigo Goiri >Assignee: Jason Kace > Attachments: HDFS-10631-HDFS-10467-001.patch, > HDFS-10631-HDFS-10467-002.patch, HDFS-10631-HDFS-10467-003.patch, > HDFS-10631-HDFS-10467-004.patch, HDFS-10631-HDFS-10467-005.patch > > > State Store implementation using ZooKeeper. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10631) Federation State Store ZooKeeper implementation
[ https://issues.apache.org/jira/browse/HDFS-10631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10631: --- Attachment: HDFS-10631-HDFS-10467-004.patch Rebased to HDFS-10467 given that HDFS-10630 already covered most of the code. > Federation State Store ZooKeeper implementation > --- > > Key: HDFS-10631 > URL: https://issues.apache.org/jira/browse/HDFS-10631 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: fs >Reporter: Inigo Goiri >Assignee: Jason Kace > Attachments: HDFS-10631-HDFS-10467-001.patch, > HDFS-10631-HDFS-10467-002.patch, HDFS-10631-HDFS-10467-003.patch, > HDFS-10631-HDFS-10467-004.patch > > > State Store implementation using ZooKeeper. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10630) Federation State Store FS Implementation
[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10630: --- Attachment: HDFS-10630-HDFS-10467-010.patch Tackling [~chris.douglas] comments and ready for commit. > Federation State Store FS Implementation > > > Key: HDFS-10630 > URL: https://issues.apache.org/jira/browse/HDFS-10630 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs >Reporter: Inigo Goiri >Assignee: Jason Kace > Attachments: HDFS-10630.001.patch, HDFS-10630.002.patch, > HDFS-10630-HDFS-10467-003.patch, HDFS-10630-HDFS-10467-004.patch, > HDFS-10630-HDFS-10467-005.patch, HDFS-10630-HDFS-10467-006.patch, > HDFS-10630-HDFS-10467-007.patch, HDFS-10630-HDFS-10467-008.patch, > HDFS-10630-HDFS-10467-009.patch, HDFS-10630-HDFS-10467-010.patch > > > Interface to store the federation shared state across Routers. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10630) Federation State Store FS Implementation
[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10630: --- Attachment: HDFS-10630-HDFS-10467-009.patch Fixing FindBug and white space. > Federation State Store FS Implementation > > > Key: HDFS-10630 > URL: https://issues.apache.org/jira/browse/HDFS-10630 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs >Reporter: Inigo Goiri >Assignee: Jason Kace > Attachments: HDFS-10630.001.patch, HDFS-10630.002.patch, > HDFS-10630-HDFS-10467-003.patch, HDFS-10630-HDFS-10467-004.patch, > HDFS-10630-HDFS-10467-005.patch, HDFS-10630-HDFS-10467-006.patch, > HDFS-10630-HDFS-10467-007.patch, HDFS-10630-HDFS-10467-008.patch, > HDFS-10630-HDFS-10467-009.patch > > > Interface to store the federation shared state across Routers. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10630) Federation State Store FS Implementation
[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10630: --- Attachment: (was: HDFS-10630-HDFS-10467-009.patch) > Federation State Store FS Implementation > > > Key: HDFS-10630 > URL: https://issues.apache.org/jira/browse/HDFS-10630 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs >Reporter: Inigo Goiri >Assignee: Jason Kace > Attachments: HDFS-10630.001.patch, HDFS-10630.002.patch, > HDFS-10630-HDFS-10467-003.patch, HDFS-10630-HDFS-10467-004.patch, > HDFS-10630-HDFS-10467-005.patch, HDFS-10630-HDFS-10467-006.patch, > HDFS-10630-HDFS-10467-007.patch, HDFS-10630-HDFS-10467-008.patch > > > Interface to store the federation shared state across Routers. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10630) Federation State Store FS Implementation
[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10630: --- Attachment: HDFS-10630-HDFS-10467-009.patch Fixing FindBug and white space. > Federation State Store FS Implementation > > > Key: HDFS-10630 > URL: https://issues.apache.org/jira/browse/HDFS-10630 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs >Reporter: Inigo Goiri >Assignee: Jason Kace > Attachments: HDFS-10630.001.patch, HDFS-10630.002.patch, > HDFS-10630-HDFS-10467-003.patch, HDFS-10630-HDFS-10467-004.patch, > HDFS-10630-HDFS-10467-005.patch, HDFS-10630-HDFS-10467-006.patch, > HDFS-10630-HDFS-10467-007.patch, HDFS-10630-HDFS-10467-008.patch, > HDFS-10630-HDFS-10467-009.patch > > > Interface to store the federation shared state across Routers. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10630) Federation State Store FS Implementation
[
https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Inigo Goiri updated HDFS-10630:
---
Attachment: HDFS-10630-HDFS-10467-008.patch
Fixed/improved:
* Checkstyles
* Findbugs
* {{PeriodicService}}
> Federation State Store FS Implementation
>
>
> Key: HDFS-10630
> URL: https://issues.apache.org/jira/browse/HDFS-10630
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: hdfs
>Reporter: Inigo Goiri
>Assignee: Jason Kace
> Attachments: HDFS-10630.001.patch, HDFS-10630.002.patch,
> HDFS-10630-HDFS-10467-003.patch, HDFS-10630-HDFS-10467-004.patch,
> HDFS-10630-HDFS-10467-005.patch, HDFS-10630-HDFS-10467-006.patch,
> HDFS-10630-HDFS-10467-007.patch, HDFS-10630-HDFS-10467-008.patch
>
>
> Interface to store the federation shared state across Routers.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-11713) Use MoveFileEx to allow renaming a file when the destination exists
[
https://issues.apache.org/jira/browse/HDFS-11713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987728#comment-15987728
]
Inigo Goiri commented on HDFS-11713:
The change from {{rename()}} to {{MoveFile()}} was done by [~cnauroth] in
HADOOP-9437 as proposed by [~ivanmi].
Any comments here?
I think this matches the semantics from Linux.
> Use MoveFileEx to allow renaming a file when the destination exists
> ---
>
> Key: HDFS-11713
> URL: https://issues.apache.org/jira/browse/HDFS-11713
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: hdfs, native, rolling upgrades
>Affects Versions: 2.7.1, 2.7.3, 3.0.0-alpha1, 3.0.0-alpha2
>Reporter: Lukas Majercak
>Assignee: Lukas Majercak
> Fix For: 3.0.0-alpha2
>
> Attachments: HDFS-11713.001.patch
>
>
> The {{NativeIO.c#renameTo0}} currently uses {{MoveFile}} Windows system call,
> which fails when renaming a file to a destination that already exists.
> This makes the {{TestRollingUpgrade.testRollback}} test fail on Windows, as
> during that execution, a DataNode tries to rename block's meta file to a
> destination that exists.
> The proposal is to change to using {{MoveFileEx}} Windows call, and passing
> in {{MOVEFILE_REPLACE_EXISTING}} flag to force the renaming.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10631) Federation State Store ZooKeeper implementation
[
https://issues.apache.org/jira/browse/HDFS-10631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Inigo Goiri updated HDFS-10631:
---
Attachment: HDFS-10631-HDFS-10467-003.patch
* Updating to {{Logger}}
* Switching to {{Query}}
> Federation State Store ZooKeeper implementation
> ---
>
> Key: HDFS-10631
> URL: https://issues.apache.org/jira/browse/HDFS-10631
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: fs
>Reporter: Inigo Goiri
>Assignee: Jason Kace
> Attachments: HDFS-10631-HDFS-10467-001.patch,
> HDFS-10631-HDFS-10467-002.patch, HDFS-10631-HDFS-10467-003.patch
>
>
> State Store implementation using ZooKeeper.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
