[jira] [Updated] (HDFS-9390) Block management for maintenance states

2016-10-16 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9390: -- Attachment: HDFS-9390-branch-2.002.patch Reload with the proper patch name for Jenkins to run. > Block managemen

[jira] [Updated] (HDFS-9390) Block management for maintenance states

2016-10-16 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9390: -- Attachment: (was: HDFS-9390-2-branch-2.patch) > Block management for maintenance states > ---

[jira] [Updated] (HDFS-9390) Block management for maintenance states

2016-10-16 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9390: -- Attachment: HDFS-9390-2-branch-2.patch Updated branch-2 patches to address some of the checkstyle issues. > Bloc

[jira] [Comment Edited] (HDFS-9390) Block management for maintenance states

2016-10-16 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15580603#comment-15580603 ] Ming Ma edited comment on HDFS-9390 at 10/16/16 9:58 PM: - Updated b

[jira] [Updated] (HDFS-9390) Block management for maintenance states

2016-10-16 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9390: -- Attachment: HDFS-9390-branch-2.patch Here is the patch for branch-2. Note that the backport isn't trivial due to

[jira] [Updated] (HDFS-9390) Block management for maintenance states

2016-10-15 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9390: -- Attachment: HDFS-9390-5.patch Reload the correct patch. > Block management for maintenance states >

[jira] [Updated] (HDFS-9390) Block management for maintenance states

2016-10-15 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9390: -- Attachment: (was: HDFS-9390-5.patch) > Block management for maintenance states >

[jira] [Updated] (HDFS-9390) Block management for maintenance states

2016-10-15 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9390: -- Attachment: HDFS-9390-5.patch Thanks [~eddyxu]! Here is the patch after rebase. > Block management for maintenan

[jira] [Commented] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-11 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15565729#comment-15565729 ] Ming Ma commented on HDFS-10967: Thanks [~zhz] for the summary! * Good idea to merge Avai

[jira] [Comment Edited] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-10 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563120#comment-15563120 ] Ming Ma edited comment on HDFS-10967 at 10/10/16 8:56 PM: -- Thanks

[jira] [Commented] (HDFS-10967) Add configuration for BlockPlacementPolicy to avoid near-full DataNodes

2016-10-10 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563120#comment-15563120 ] Ming Ma commented on HDFS-10967: Thanks [~zhz]. Indeed that is an issue when the cluster h

[jira] [Comment Edited] (HDFS-10629) Federation Router

2016-10-03 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15543484#comment-15543484 ] Ming Ma edited comment on HDFS-10629 at 10/3/16 9:33 PM: - Thanks [

[jira] [Comment Edited] (HDFS-10629) Federation Router

2016-10-03 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15543484#comment-15543484 ] Ming Ma edited comment on HDFS-10629 at 10/3/16 9:31 PM: - Thanks [

[jira] [Commented] (HDFS-10629) Federation Router

2016-10-03 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15543484#comment-15543484 ] Ming Ma commented on HDFS-10629: Thanks [~jakace] for the explanation and new patch. bq.

[jira] [Comment Edited] (HDFS-10629) Federation Router

2016-10-03 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15543484#comment-15543484 ] Ming Ma edited comment on HDFS-10629 at 10/3/16 9:29 PM: - Thanks [

[jira] [Updated] (HDFS-9390) Block management for maintenance states

2016-09-29 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9390: -- Attachment: HDFS-9390-4.patch Updated patch to address checkstyle issues. > Block management for maintenance sta

[jira] [Updated] (HDFS-9390) Block management for maintenance states

2016-09-29 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9390: -- Attachment: HDFS-9390-3.patch Thanks [~eddyxu] for the review! Here is the new patch. bq. If we change it to the

[jira] [Commented] (HDFS-10629) Federation Router

2016-09-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15531543#comment-15531543 ] Ming Ma commented on HDFS-10629: Sorry for [~elgoiri] and [~jakace] for the late reply. Ye

[jira] [Updated] (HDFS-9390) Block management for maintenance states

2016-09-26 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9390: -- Attachment: HDFS-9390-2.patch Updated patch to address the checkstyle and test code issues. > Block management f

[jira] [Updated] (HDFS-9390) Block management for maintenance states

2016-09-23 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9390: -- Attachment: HDFS-9390.patch [~eddyxu] sorry for the delay. Due to the big difference between trunk and 2.6 which

[jira] [Updated] (HDFS-9390) Block management for maintenance states

2016-09-23 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9390: -- Assignee: Ming Ma Status: Patch Available (was: Open) > Block management for maintenance states >

[jira] [Assigned] (HDFS-9392) Admins support for maintenance state

2016-08-30 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma reassigned HDFS-9392: - Assignee: Ming Ma > Admins support for maintenance state > > >

[jira] [Resolved] (HDFS-9392) Admins support for maintenance state

2016-08-30 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma resolved HDFS-9392. --- Resolution: Fixed > Admins support for maintenance state > > >

[jira] [Reopened] (HDFS-9392) Admins support for maintenance state

2016-08-30 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma reopened HDFS-9392: --- > Admins support for maintenance state > > > Key: HDFS-9392 >

[jira] [Updated] (HDFS-9392) Admins support for maintenance state

2016-08-30 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9392: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-9392) Admins support for maintenance state

2016-08-23 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9392: -- Attachment: HDFS-9392-4.patch New patch with additional checkstyle fixes. > Admins support for maintenance state

[jira] [Updated] (HDFS-9392) Admins support for maintenance state

2016-08-22 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9392: -- Attachment: HDFS-9392-3.patch Thanks [~eddyxu]! Here is the new patch with the checkstyle fixes. > Admins suppor

[jira] [Updated] (HDFS-9392) Admins support for maintenance state

2016-08-19 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9392: -- Attachment: HDFS-9392-2.patch Updated patch to fix checkstyle, whitespace and unit tests. > Admins support for m

[jira] [Updated] (HDFS-9392) Admins support for maintenance state

2016-08-19 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9392: -- Status: Patch Available (was: Open) > Admins support for maintenance state > ---

[jira] [Updated] (HDFS-9392) Admins support for maintenance state

2016-08-19 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9392: -- Attachment: HDFS-9392.patch Here is the draft patch. It also includes datanode state machine transition under so

[jira] [Commented] (HDFS-10629) Federation Router

2016-07-25 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15392116#comment-15392116 ] Ming Ma commented on HDFS-10629: Thanks [~jakace] for the patch! Yes it is better to make

[jira] [Commented] (HDFS-10467) Router-based HDFS federation

2016-07-17 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15381726#comment-15381726 ] Ming Ma commented on HDFS-10467: [~elgoiri], nice work! Here are couple more questions abo

[jira] [Commented] (HDFS-8940) Support for large-scale multi-tenant inotify service

2016-07-14 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378555#comment-15378555 ] Ming Ma commented on HDFS-8940: --- [~drankye], it might come from the following assumption. Onl

[jira] [Commented] (HDFS-8940) Support for large-scale multi-tenant inotify service

2016-07-08 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15368029#comment-15368029 ] Ming Ma commented on HDFS-8940: --- [~drankye], that sounds like an interesting idea. Although i

[jira] [Commented] (HDFS-8940) Support for large-scale multi-tenant inotify service

2016-07-07 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15366286#comment-15366286 ] Ming Ma commented on HDFS-8940: --- Thanks [~surendrasingh] and [~drankye]. One of the original

[jira] [Commented] (HDFS-8940) Support for large-scale multi-tenant inotify service

2016-06-22 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345892#comment-15345892 ] Ming Ma commented on HDFS-8940: --- [~zhz], thanks for the follow-up. Shortly after posting the

[jira] [Comment Edited] (HDFS-7541) Upgrade Domains in HDFS

2016-06-15 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15333104#comment-15333104 ] Ming Ma edited comment on HDFS-7541 at 6/16/16 5:13 AM: Thanks ever

[jira] [Resolved] (HDFS-7541) Upgrade Domains in HDFS

2016-06-15 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma resolved HDFS-7541. --- Resolution: Fixed Assignee: Ming Ma Fix Version/s: 2.9.0 Thanks for the everyone's input and co

[jira] [Updated] (HDFS-9922) Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes

2016-06-15 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9922: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-9922) Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes

2016-06-15 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9922: -- Attachment: HDFS-9922-trunk-v4.patch Given Chris is on vacation and the patch is almost ready, here is the update

[jira] [Updated] (HDFS-9922) Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes

2016-06-15 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9922: -- Assignee: Chris Trezzo (was: Ming Ma) > Upgrade Domain placement policy status marks a good block in violation w

[jira] [Assigned] (HDFS-9922) Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes

2016-06-15 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma reassigned HDFS-9922: - Assignee: Ming Ma (was: Chris Trezzo) > Upgrade Domain placement policy status marks a good block in viol

[jira] [Updated] (HDFS-9016) Display upgrade domain information in fsck

2016-06-14 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9016: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Release Note: New fsck option "-upg

[jira] [Updated] (HDFS-9005) Provide configuration support for upgrade domain

2016-06-14 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9005: -- Fix Version/s: (was: 2.8.0) 2.9.0 > Provide configuration support for upgrade domain > ---

[jira] [Updated] (HDFS-9016) Display upgrade domain information in fsck

2016-06-14 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9016: -- Attachment: HDFS-9016-4.patch Thanks Allen. Reload trunk patch. > Display upgrade domain information in fsck > -

[jira] [Updated] (HDFS-9016) Display upgrade domain information in fsck

2016-06-14 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9016: -- Attachment: HDFS-9016-branch-2-2.patch New branch-2 patch to fix checkstyle issues. > Display upgrade domain inf

[jira] [Updated] (HDFS-9016) Display upgrade domain information in fsck

2016-06-13 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9016: -- Attachment: HDFS-9016-branch-2.patch HDFS-9016-4.patch Fix a minor format issue. Also includes th

[jira] [Updated] (HDFS-9016) Display upgrade domain information in fsck

2016-06-13 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9016: -- Attachment: HDFS-9016-3.patch Updated patch to address checkstyle issues. The failed uni tests aren't related. >

[jira] [Updated] (HDFS-9016) Display upgrade domain information in fsck

2016-06-13 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9016: -- Attachment: HDFS-9016-2.patch The new patch adds "-upgradedomains" fsck command option. > Display upgrade domain

[jira] [Comment Edited] (HDFS-9016) Display upgrade domain information in fsck

2016-06-10 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1532#comment-1532 ] Ming Ma edited comment on HDFS-9016 at 6/11/16 2:35 AM: Thanks all

[jira] [Commented] (HDFS-9016) Display upgrade domain information in fsck

2016-06-10 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1532#comment-1532 ] Ming Ma commented on HDFS-9016: --- Thanks all for the input. I will add "-upgradedomain" flag t

[jira] [Commented] (HDFS-9924) [umbrella] Asynchronous HDFS Access

2016-06-08 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15321910#comment-15321910 ] Ming Ma commented on HDFS-9924: --- Based on the discussion so far, it seems like the existing a

[jira] [Comment Edited] (HDFS-8872) Reporting of missing blocks is different in fsck and namenode ui/metasave

2016-06-06 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15317548#comment-15317548 ] Ming Ma edited comment on HDFS-8872 at 6/7/16 12:26 AM: Thanks [~sh

[jira] [Commented] (HDFS-8872) Reporting of missing blocks is different in fsck and namenode ui/metasave

2016-06-06 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15317548#comment-15317548 ] Ming Ma commented on HDFS-8872: --- Thanks [~shahrs87]. Your suggestion to distinguish decommiss

[jira] [Commented] (HDFS-9924) [umbrella] Asynchronous HDFS Access

2016-05-18 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290292#comment-15290292 ] Ming Ma commented on HDFS-9924: --- It seems the thread-pool based solution is a layer on the to

[jira] [Commented] (HDFS-10208) Addendum for HDFS-9579: to handle the case when client machine can't resolve network path

2016-05-16 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15285875#comment-15285875 ] Ming Ma commented on HDFS-10208: Thank you [~sjlee0] and [~brahmareddy]! > Addendum for H

[jira] [Commented] (HDFS-9924) [umbrella] Asynchronous HDFS Access

2016-05-16 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15285597#comment-15285597 ] Ming Ma commented on HDFS-9924: --- Some general comments: When MR ran into similar performance

[jira] [Commented] (HDFS-8872) Reporting of missing blocks is different in fsck and namenode ui/metasave

2016-05-13 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283384#comment-15283384 ] Ming Ma commented on HDFS-8872: --- Agree that we should try to make fsck and webUI consistent N

[jira] [Commented] (HDFS-9389) Add maintenance states to AdminStates

2016-05-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15282212#comment-15282212 ] Ming Ma commented on HDFS-9389: --- [~eddyxu] thank you! > Add maintenance states to AdminState

[jira] [Updated] (HDFS-10320) Rack failures may result in NN terminate

2016-05-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-10320: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) [~xiaochen]

[jira] [Commented] (HDFS-10320) Rack failures may result in NN terminate

2016-05-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271651#comment-15271651 ] Ming Ma commented on HDFS-10320: [~xiaochen] thanks for the explanation! +1 for the latest

[jira] [Commented] (HDFS-10320) Rack failures may result in NN terminate

2016-05-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271102#comment-15271102 ] Ming Ma commented on HDFS-10320: bq. for subclasses Good catch. Maybe rename the method or

[jira] [Commented] (HDFS-10320) Rack failures may result in NN terminate

2016-05-03 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15269566#comment-15269566 ] Ming Ma commented on HDFS-10320: Thanks [~xiaochen]! The patch looks good overall. Couple

[jira] [Commented] (HDFS-7269) NN and DN don't check whether corrupted blocks reported by clients are actually corrupted

2016-04-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263477#comment-15263477 ] Ming Ma commented on HDFS-7269: --- We might not need another datanode command, instead we can u

[jira] [Updated] (HDFS-9389) Add maintenance states to AdminStates

2016-04-27 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9389: -- Assignee: Ming Ma Status: Patch Available (was: Open) > Add maintenance states to AdminStates > --

[jira] [Updated] (HDFS-9389) Add maintenance states to AdminStates

2016-04-27 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9389: -- Attachment: HDFS-9389.patch Here is the draft patch. The rest of maintenance functionalities are covered by othe

[jira] [Commented] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2016-04-26 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15258948#comment-15258948 ] Ming Ma commented on HDFS-10326: Nevermind about the backward compatibility comment, HDFS-

[jira] [Commented] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2016-04-26 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15258771#comment-15258771 ] Ming Ma commented on HDFS-10326: I tend to agree it should be fine to change the default t

[jira] [Commented] (HDFS-10320) Rack failures may result in NN terminate

2016-04-26 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15258372#comment-15258372 ] Ming Ma commented on HDFS-10320: Thanks [~xiaochen]! Should we push the InvalidTopologyExc

[jira] [Commented] (HDFS-10320) Rack failures may result in NN terminate

2016-04-25 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257341#comment-15257341 ] Ming Ma commented on HDFS-10320: [~xiaochen], regarding the expected behavior, besides you

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-04-22 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15254197#comment-15254197 ] Ming Ma commented on HDFS-10175: This is a great idea. It also addresses an issue at the c

[jira] [Commented] (HDFS-9016) Display upgrade domain information in fsck

2016-04-22 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15254145#comment-15254145 ] Ming Ma commented on HDFS-9016: --- I can add a new config property or maybe a new fsck CLI opti

[jira] [Commented] (HDFS-9016) Display upgrade domain information in fsck

2016-04-18 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15247248#comment-15247248 ] Ming Ma commented on HDFS-9016: --- By default there is no format change. ||Scenarios||Prior to

[jira] [Commented] (HDFS-9016) Display upgrade domain information in fsck

2016-04-18 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15246308#comment-15246308 ] Ming Ma commented on HDFS-9016: --- Thanks, [~eddyxu]! It shouldn't change fsck's output format

[jira] [Commented] (HDFS-10289) Balancer configures DNs directly

2016-04-15 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15243740#comment-15243740 ] Ming Ma commented on HDFS-10289: There was some discussion about moving balancer into name

[jira] [Commented] (HDFS-10208) Addendum for HDFS-9579: to handle the case when client machine can't resolve network path

2016-04-15 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15243738#comment-15243738 ] Ming Ma commented on HDFS-10208: TestReadStripedFileWithDecoding and TestWriteReadStripedF

[jira] [Commented] (HDFS-9016) Display upgrade domain information in fsck

2016-04-15 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15243689#comment-15243689 ] Ming Ma commented on HDFS-9016: --- TestReadStripedFileWithDecoding and TestWriteReadStripedFile

[jira] [Updated] (HDFS-9016) Display upgrade domain information in fsck

2016-04-13 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9016: -- Description: This will make it easy for people to use fsck to check block placement when upgrade domain is enable

[jira] [Updated] (HDFS-9016) Display upgrade domain information in fsck

2016-04-13 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9016: -- Assignee: Ming Ma Status: Patch Available (was: Open) > Display upgrade domain information in fsck > -

[jira] [Updated] (HDFS-9016) Display upgrade domain information in fsck

2016-04-13 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9016: -- Attachment: HDFS-9016.patch Here is the draft patch. Given there is no backward compatibility issue, it seems un

[jira] [Updated] (HDFS-10208) Addendum for HDFS-9579: to handle the case when client machine can't resolve network path

2016-04-13 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-10208: --- Attachment: HDFS-10208-5.patch Here is the updated patch. Thank you [~sjlee0] and [~brahmareddy]. > Addendum

[jira] [Commented] (HDFS-10208) Addendum for HDFS-9579: to handle the case when client machine can't resolve network path

2016-04-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15238345#comment-15238345 ] Ming Ma commented on HDFS-10208: Thanks. Sure I can fix the checkstyle issue, although thi

[jira] [Commented] (HDFS-10208) Addendum for HDFS-9579: to handle the case when client machine can't resolve network path

2016-04-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15237683#comment-15237683 ] Ming Ma commented on HDFS-10208: Thanks [~sjlee0]! * By default {{ScriptBasedMapping}} is

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-04-08 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15232824#comment-15232824 ] Ming Ma commented on HDFS-10175: Interesting work. * Seems like a useful feature to provi

[jira] [Updated] (HDFS-10208) Addendum for HDFS-9579: to handle the case when client machine can't resolve network path

2016-04-08 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-10208: --- Description: If DFSClient runs on a machine that can't resolve network path, {{DNSToSwitchMapping}} will retu

[jira] [Updated] (HDFS-10208) Addendum for HDFS-9579: to handle the case when client machine can't resolve network path

2016-04-08 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-10208: --- Attachment: HDFS-10208-4.patch Updated patch to address checkstyle issue. Failed tests aren't related. > Adde

[jira] [Commented] (HDFS-10246) Standby NameNode dfshealth.jsp Response very slow

2016-04-02 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15222977#comment-15222977 ] Ming Ma commented on HDFS-10246: You want to the disable the feature on the active, as wel

[jira] [Commented] (HDFS-10246) HDFS Standby NameNode dfshealth.jsp Response very slow

2016-04-01 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15221980#comment-15221980 ] Ming Ma commented on HDFS-10246: [~piaoyu zhang] based on the thread dump you provided, it

[jira] [Updated] (HDFS-10208) Addendum for HDFS-9579: to handle the case when client machine can't resolve network path

2016-04-01 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-10208: --- Attachment: HDFS-10208-3.patch Thanks [~brahmareddy]. I have updated the property description in core-default

[jira] [Commented] (HDFS-10221) Add .json to the rat exclusions

2016-03-30 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15219118#comment-15219118 ] Ming Ma commented on HDFS-10221: Thanks all! > Add .json to the rat exclusions >

[jira] [Commented] (HDFS-10203) Excessive topology lookup for large number of client machines in namenode

2016-03-29 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15217458#comment-15217458 ] Ming Ma commented on HDFS-10203: Thanks [~arpitagarwal] for the good suggestions. Here are

[jira] [Commented] (HDFS-10208) Addendum for HDFS-9579: to handle the case when client machine can't resolve network path

2016-03-29 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15217331#comment-15217331 ] Ming Ma commented on HDFS-10208: checkstyle isn't an issue. TestHDFSCLI issue has been fix

[jira] [Updated] (HDFS-10208) Addendum for HDFS-9579: to handle the case when client machine can't resolve network path

2016-03-29 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-10208: --- Attachment: HDFS-10208-2.patch The new patch will take care of the case where {{DNSToSwitchMapping}} returns

[jira] [Updated] (HDFS-10221) Add test resource dfs.hosts.json to the rat exclusions

2016-03-29 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-10221: --- Attachment: HDFS-10221-2.patch Thanks all. Here is the new patch that uses wildcard. > Add test resource dfs.

[jira] [Updated] (HDFS-10206) getBlockLocations might not sort datanodes properly by distance

2016-03-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-10206: --- Description: If the DFSClient machine is not a datanode, but it shares its rack with some datanodes of the HD

[jira] [Commented] (HDFS-9579) Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level

2016-03-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15214518#comment-15214518 ] Ming Ma commented on HDFS-9579: --- [~brahmareddy], that is right for the case where ScriptBased

[jira] [Commented] (HDFS-10208) Addendum for HDFS-9579: to handle the case when client machine can't resolve network path

2016-03-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15214460#comment-15214460 ] Ming Ma commented on HDFS-10208: asf license will be taken care of by HDFS-10221. The unit

[jira] [Updated] (HDFS-10221) Add test resource dfs.hosts.json to the rat exclusions

2016-03-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-10221: --- Assignee: Ming Ma Status: Patch Available (was: Open) > Add test resource dfs.hosts.json to the rat exc

[jira] [Updated] (HDFS-10221) Add test resource dfs.hosts.json to the rat exclusions

2016-03-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-10221: --- Attachment: HDFS-10221.patch Here is the patch. > Add test resource dfs.hosts.json to the rat exclusions > --

[jira] [Commented] (HDFS-9005) Provide configuration support for upgrade domain

2016-03-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15214379#comment-15214379 ] Ming Ma commented on HDFS-9005: --- Thank you [~eddyxu] for the commit! Thank you [~aw] for the

<    1   2   3   4   5   6   7   8   >