[jira] [Updated] (HDFS-11573) Support rename between different NameNodes in federated HDFS

2018-07-27 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-11573: Flags: Patch > Support rename between different NameNodes in federated HDFS >

[jira] [Commented] (HDFS-10240) Race between close/recoverLease leads to missing block

2018-07-23 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16552368#comment-16552368 ] zhouyingchao commented on HDFS-10240: - Hi Wei-Chiu, [~LiJinglun] who figured out the issue together

[jira] [Commented] (HDFS-10240) Race between close/recoverLease leads to missing block

2018-07-22 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16552301#comment-16552301 ] zhouyingchao commented on HDFS-10240: - Thank you, Wei-Chiu. I'd like to work on this issue. I'll add

[jira] [Commented] (HDFS-13700) The process of loading image can be done in a pipeline model

2018-06-26 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523522#comment-16523522 ] zhouyingchao commented on HDFS-13700: - Test the patch against a fsimage of a 70PB 2.4 cluster

[jira] [Updated] (HDFS-13700) The process of loading image can be done in a pipeline model

2018-06-26 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-13700: Attachment: HDFS-13700-001.patch Status: Patch Available (was: Open) > The process of

[jira] [Commented] (HDFS-13700) The process of loading image can be done in a pipeline model

2018-06-26 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523520#comment-16523520 ] zhouyingchao commented on HDFS-13700: - [~brahmareddy], thank you for telling me about HDFS-7784.  I

[jira] [Created] (HDFS-13700) The process of loading image can be done in a pipeline model

2018-06-26 Thread zhouyingchao (JIRA)
zhouyingchao created HDFS-13700: --- Summary: The process of loading image can be done in a pipeline model Key: HDFS-13700 URL: https://issues.apache.org/jira/browse/HDFS-13700 Project: Hadoop HDFS

[jira] [Updated] (HDFS-13694) Making md5 computing being in parallel with image loading

2018-06-22 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-13694: Attachment: HDFS-13694-001.patch Status: Patch Available (was: Open) Test the patch

[jira] [Updated] (HDFS-13694) Making md5 computing being in parallel with image loading

2018-06-22 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-13694: Attachment: (was: HDFS-13694-001.patch) > Making md5 computing being in parallel with image

[jira] [Updated] (HDFS-13694) Making md5 computing being in parallel with image loading

2018-06-22 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-13694: Attachment: HDFS-13694-001.patch > Making md5 computing being in parallel with image loading >

[jira] [Created] (HDFS-13694) Making md5 computing being in parallel with image loading

2018-06-22 Thread zhouyingchao (JIRA)
zhouyingchao created HDFS-13694: --- Summary: Making md5 computing being in parallel with image loading Key: HDFS-13694 URL: https://issues.apache.org/jira/browse/HDFS-13694 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13693) Remove unnecessary search in INodeDirectory.addChild during image loading

2018-06-21 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519897#comment-16519897 ] zhouyingchao commented on HDFS-13693: - Test the patch against a fsimage of a 70PB 2.4 cluster

[jira] [Updated] (HDFS-13693) Remove unnecessary search in INodeDirectory.addChild during image loading

2018-06-21 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-13693: Attachment: HDFS-13693-001.patch Status: Patch Available (was: Open) Run all hdfs related

[jira] [Created] (HDFS-13693) Remove unnecessary search in INodeDirectory.addChild during image loading

2018-06-21 Thread zhouyingchao (JIRA)
zhouyingchao created HDFS-13693: --- Summary: Remove unnecessary search in INodeDirectory.addChild during image loading Key: HDFS-13693 URL: https://issues.apache.org/jira/browse/HDFS-13693 Project:

[jira] [Updated] (HDFS-11573) Support rename between different NameNodes in federated HDFS

2017-06-06 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-11573: Attachment: HDFS-11573-2.6.5-001.patch Since we implemented the feature on a 2.6 branch, it is easy

[jira] [Updated] (HDFS-11573) Support rename between different NameNodes in federated HDFS

2017-06-06 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-11573: Attachment: HDFS_federation_rename.pdf Upload a write-up regarding the feature. > Support rename

[jira] [Updated] (HDFS-11895) Committed block should be completed during block report if usable replicas are enough

2017-05-26 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-11895: Status: Patch Available (was: Open) > Committed block should be completed during block report if

[jira] [Updated] (HDFS-11895) Committed block should be completed during block report if usable replicas are enough

2017-05-26 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-11895: Attachment: HDFS-11895-001.patch A patch for the issue. > Committed block should be completed

[jira] [Created] (HDFS-11895) Committed block should be completed during block report if usable replicas are enough

2017-05-26 Thread zhouyingchao (JIRA)
zhouyingchao created HDFS-11895: --- Summary: Committed block should be completed during block report if usable replicas are enough Key: HDFS-11895 URL: https://issues.apache.org/jira/browse/HDFS-11895

[jira] [Updated] (HDFS-11573) Support rename between different NameNodes in federated HDFS

2017-03-24 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-11573: Description: Federated file system can improve overall scalability by dividing a single

[jira] [Created] (HDFS-11573) Support rename between different NameNodes in federated HDFS

2017-03-24 Thread zhouyingchao (JIRA)
zhouyingchao created HDFS-11573: --- Summary: Support rename between different NameNodes in federated HDFS Key: HDFS-11573 URL: https://issues.apache.org/jira/browse/HDFS-11573 Project: Hadoop HDFS

[jira] [Created] (HDFS-10989) Cannot get last block length after namenode failover

2016-10-09 Thread zhouyingchao (JIRA)
zhouyingchao created HDFS-10989: --- Summary: Cannot get last block length after namenode failover Key: HDFS-10989 URL: https://issues.apache.org/jira/browse/HDFS-10989 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-10240) Race between close/recoverLease leads to missing block

2016-03-31 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-10240: Attachment: HDFS-10240-001.patch If the patch is ok, I would add some unit tests. > Race between

[jira] [Updated] (HDFS-10240) Race between close/recoverLease leads to missing block

2016-03-31 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-10240: Status: Patch Available (was: Open) > Race between close/recoverLease leads to missing block >

[jira] [Created] (HDFS-10240) Race between close/recoverLease leads to missing block

2016-03-31 Thread zhouyingchao (JIRA)
zhouyingchao created HDFS-10240: --- Summary: Race between close/recoverLease leads to missing block Key: HDFS-10240 URL: https://issues.apache.org/jira/browse/HDFS-10240 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8496) Calling stopWriter() with FSDatasetImpl lock held may block other threads

2016-03-31 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219483#comment-15219483 ] zhouyingchao commented on HDFS-8496: Thank you, Colin! The patch looks good to me. > Calling

[jira] [Updated] (HDFS-10182) Hedged read might overwrite user's buf

2016-03-28 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-10182: Attachment: HDFS-10182-branch26.patch Patch of branch-2.6 > Hedged read might overwrite user's buf

[jira] [Commented] (HDFS-10182) Hedged read might overwrite user's buf

2016-03-28 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214159#comment-15214159 ] zhouyingchao commented on HDFS-10182: - Thank you for picking up the fix. I'll upload a patch against

[jira] [Updated] (HDFS-10182) Hedged read might overwrite user's buf

2016-03-20 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-10182: Status: Patch Available (was: Open) > Hedged read might overwrite user's buf >

[jira] [Updated] (HDFS-10182) Hedged read might overwrite user's buf

2016-03-19 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-10182: Description: In DFSInputStream::hedgedFetchBlockByteRange, during the first attempt, the passed-in

[jira] [Updated] (HDFS-10182) Hedged read might overwrite user's buf

2016-03-19 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-10182: Description: In DFSInputStream::hedgedFetchBlockByteRange, during the first attempt, the passed-in

[jira] [Created] (HDFS-10182) Hedged read might overwrite user's buf

2016-03-19 Thread zhouyingchao (JIRA)
zhouyingchao created HDFS-10182: --- Summary: Hedged read might overwrite user's buf Key: HDFS-10182 URL: https://issues.apache.org/jira/browse/HDFS-10182 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-10182) Hedged read might overwrite user's buf

2016-03-18 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-10182: Attachment: HDFS-10182-001.patch > Hedged read might overwrite user's buf >

[jira] [Created] (HDFS-8649) Default ACL is not inherited if directory is generated by FileSystem.create interface

2015-06-23 Thread zhouyingchao (JIRA)
zhouyingchao created HDFS-8649: -- Summary: Default ACL is not inherited if directory is generated by FileSystem.create interface Key: HDFS-8649 URL: https://issues.apache.org/jira/browse/HDFS-8649

[jira] [Commented] (HDFS-8649) Default ACL is not inherited if directory is generated by FileSystem.create interface

2015-06-23 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598752#comment-14598752 ] zhouyingchao commented on HDFS-8649: [~cnauroth] Any comments ? Default ACL is not

[jira] [Commented] (HDFS-8496) Calling stopWriter() with FSDatasetImpl lock held may block other threads

2015-06-23 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598757#comment-14598757 ] zhouyingchao commented on HDFS-8496: [~cmccabe], Any comments? Calling stopWriter()

[jira] [Updated] (HDFS-8496) Calling stopWriter() with FSDatasetImpl lock held may block other threads

2015-05-29 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-8496: --- Status: Patch Available (was: Open) Run all hdfs unit tests without introducing new failure.

[jira] [Updated] (HDFS-8496) Calling stopWriter() with FSDatasetImpl lock held may block other threads

2015-05-29 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-8496: --- Attachment: HDFS-8496-001.patch Calling stopWriter() with FSDatasetImpl lock held may block other

[jira] [Created] (HDFS-8496) Calling stopWriter() with FSDatasetImpl lock held may block other threads

2015-05-28 Thread zhouyingchao (JIRA)
zhouyingchao created HDFS-8496: -- Summary: Calling stopWriter() with FSDatasetImpl lock held may block other threads Key: HDFS-8496 URL: https://issues.apache.org/jira/browse/HDFS-8496 Project: Hadoop

[jira] [Commented] (HDFS-8429) The DomainSocketWatcher thread should not block other threads if it dies

2015-05-26 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560303#comment-14560303 ] zhouyingchao commented on HDFS-8429: Colin, thank you for pointing out this issue.

[jira] [Updated] (HDFS-8429) The DomainSocketWatcher thread should not block other threads if it dies

2015-05-26 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-8429: --- Attachment: HDFS-8429-003.patch Tested cases include TestParallelShortCircuitLegacyRead,

[jira] [Updated] (HDFS-8429) Death of watcherThread making other local read blocked

2015-05-21 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-8429: --- Attachment: HDFS-8429-002.patch Tested cases include TestParallelShortCircuitLegacyRead,

[jira] [Commented] (HDFS-8429) Death of watcherThread making other local read blocked

2015-05-21 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14553702#comment-14553702 ] zhouyingchao commented on HDFS-8429: Yes, the modification of DomainSocketWatcher#add

[jira] [Commented] (HDFS-8429) Death of watcherThread making other local read blocked

2015-05-20 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14552095#comment-14552095 ] zhouyingchao commented on HDFS-8429: Colin, thank you for the great comments. In this

[jira] [Updated] (HDFS-8429) Death of watcherThread making other local read blocked

2015-05-20 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-8429: --- Status: Patch Available (was: Open) Death of watcherThread making other local read blocked

[jira] [Updated] (HDFS-8429) Death of watcherThread making other local read blocked

2015-05-20 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-8429: --- Attachment: HDFS-8429-001.patch Test following cases :

[jira] [Created] (HDFS-8429) Death of watcherThread making other local read blocked

2015-05-19 Thread zhouyingchao (JIRA)
zhouyingchao created HDFS-8429: -- Summary: Death of watcherThread making other local read blocked Key: HDFS-8429 URL: https://issues.apache.org/jira/browse/HDFS-8429 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-8429) Death of watcherThread making other local read blocked

2015-05-19 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14550293#comment-14550293 ] zhouyingchao commented on HDFS-8429: [~cmccabe] Should we stop DN in this condition?

[jira] [Created] (HDFS-8419) chmod impact user's effective ACL

2015-05-18 Thread zhouyingchao (JIRA)
zhouyingchao created HDFS-8419: -- Summary: chmod impact user's effective ACL Key: HDFS-8419 URL: https://issues.apache.org/jira/browse/HDFS-8419 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-8419) chmod impact user's effective ACL

2015-05-18 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14547909#comment-14547909 ] zhouyingchao commented on HDFS-8419: @Chris Nauroth chmod impact user's effective ACL

[jira] [Updated] (HDFS-8419) chmod impact user's effective ACL

2015-05-18 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-8419: --- Description: I set a directory's ACL to assign rwx permission to a user h_user1. Later, I used chmod

[jira] [Updated] (HDFS-8419) chmod impact user's effective ACL

2015-05-18 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-8419: --- Description: I set a directory's ACL to assign rwx permission to a user h_user1. Later, I used chmod

[jira] [Updated] (HDFS-8419) chmod impact user's effective ACL

2015-05-18 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-8419: --- Description: I set a directory's ACL to assign rwx permission to user h_user1. Later, I used chmod to

[jira] [Updated] (HDFS-8419) chmod impact user's effective ACL

2015-05-18 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-8419: --- Description: I set a directory's ACL to assign rwx permission to user h_user1. Later, I used chmod to

[jira] [Commented] (HDFS-7897) Shutdown metrics when stopping JournalNode

2015-04-30 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521202#comment-14521202 ] zhouyingchao commented on HDFS-7897: Any updates regarding this simple patch?

[jira] [Updated] (HDFS-7999) FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time

2015-04-04 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-7999: --- Attachment: HDFS-7999-003.patch FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock

[jira] [Commented] (HDFS-7999) FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time

2015-04-04 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395791#comment-14395791 ] zhouyingchao commented on HDFS-7999: Thank you, Colin. I'll update the patch soon.

[jira] [Commented] (HDFS-7999) FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time

2015-04-02 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392426#comment-14392426 ] zhouyingchao commented on HDFS-7999: Thanks a lot for the comments, Colin. I would

[jira] [Updated] (HDFS-7999) FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time

2015-04-02 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-7999: --- Attachment: HDFS-7999-002.patch Test with

[jira] [Updated] (HDFS-8045) Incorrect calculation of NonDfsUsed and Remaining

2015-04-02 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-8045: --- Attachment: HDFS-8045-001.patch Test with

[jira] [Updated] (HDFS-8045) Incorrect calculation of NonDfsUsed and Remaining

2015-04-02 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-8045: --- Description: After reserve some space via the param dfs.datanode.du.reserved, we noticed that the

[jira] [Updated] (HDFS-8045) Incorrect calculation of NonDfsUsed and Remaining

2015-04-02 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-8045: --- Description: After reserve some space via the param dfs.datanode.du.reserved, we noticed that the

[jira] [Created] (HDFS-8045) Incorrect calculation of NonDfsUsed and Remaining

2015-04-02 Thread zhouyingchao (JIRA)
zhouyingchao created HDFS-8045: -- Summary: Incorrect calculation of NonDfsUsed and Remaining Key: HDFS-8045 URL: https://issues.apache.org/jira/browse/HDFS-8045 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-8045) Incorrect calculation of NonDfsUsed and Remaining

2015-04-02 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-8045: --- Component/s: datanode Incorrect calculation of NonDfsUsed and Remaining

[jira] [Updated] (HDFS-8045) Incorrect calculation of NonDfsUsed and Remaining

2015-04-02 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-8045: --- Affects Version/s: 2.6.0 Status: Patch Available (was: Open) Incorrect calculation of

[jira] [Updated] (HDFS-8045) Incorrect calculation of NonDfsUsed and Remaining

2015-04-02 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-8045: --- Description: After reserve some space via the param dfs.datanode.du.reserved, we noticed that the

[jira] [Commented] (HDFS-5215) dfs.datanode.du.reserved is not taking effect as it's not considered while getting the available space

2015-04-02 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392609#comment-14392609 ] zhouyingchao commented on HDFS-5215: Shouldn't we also subtract rbwReserved ?

[jira] [Commented] (HDFS-7999) FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time

2015-03-31 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388080#comment-14388080 ] zhouyingchao commented on HDFS-7999: Thank you for looking into the patch. Here is

[jira] [Commented] (HDFS-7999) DN Hearbeat is blocked by waiting FsDatasetImpl lock

2015-03-30 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386528#comment-14386528 ] zhouyingchao commented on HDFS-7999: Hi Xinwei Thank you for sharing the status

[jira] [Commented] (HDFS-7999) DN Hearbeat is blocked by waiting FsDatasetImpl lock

2015-03-30 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386536#comment-14386536 ] zhouyingchao commented on HDFS-7999: I tested TestBalancer with the patch on my rig, it

[jira] [Commented] (HDFS-7997) The first non-existing xattr should also throw IOException

2015-03-29 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386205#comment-14386205 ] zhouyingchao commented on HDFS-7997: Thank you for pointing it out. Actually we are

[jira] [Updated] (HDFS-7997) The first non-existing xattr should also throw IOException

2015-03-27 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-7997: --- Affects Version/s: 2.6.0 Status: Patch Available (was: Open) Test with

[jira] [Commented] (HDFS-7212) Huge number of BLOCKED threads rendering DataNodes useless

2015-03-27 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383655#comment-14383655 ] zhouyingchao commented on HDFS-7212: I'll create a JIRA for the issue I met and submit

[jira] [Created] (HDFS-7999) DN Hearbeat is blocked by waiting FsDatasetImpl lock

2015-03-27 Thread zhouyingchao (JIRA)
zhouyingchao created HDFS-7999: -- Summary: DN Hearbeat is blocked by waiting FsDatasetImpl lock Key: HDFS-7999 URL: https://issues.apache.org/jira/browse/HDFS-7999 Project: Hadoop HDFS Issue

[jira] [Assigned] (HDFS-7999) DN Hearbeat is blocked by waiting FsDatasetImpl lock

2015-03-27 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao reassigned HDFS-7999: -- Assignee: zhouyingchao DN Hearbeat is blocked by waiting FsDatasetImpl lock

[jira] [Commented] (HDFS-7212) Huge number of BLOCKED threads rendering DataNodes useless

2015-03-27 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383654#comment-14383654 ] zhouyingchao commented on HDFS-7212: I'll create a JIRA for the issue I met and submit

[jira] [Updated] (HDFS-7999) DN Hearbeat is blocked by waiting FsDatasetImpl lock

2015-03-27 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-7999: --- Attachment: HDFS-7999-001.patch Test with

[jira] [Updated] (HDFS-7999) DN Hearbeat is blocked by waiting FsDatasetImpl lock

2015-03-27 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-7999: --- Status: Patch Available (was: Open) The fix is to call stopWriter w/o the FsDatasetImpl lock.

[jira] [Created] (HDFS-7997) The first non-existing xattr should also throw IOException

2015-03-27 Thread zhouyingchao (JIRA)
zhouyingchao created HDFS-7997: -- Summary: The first non-existing xattr should also throw IOException Key: HDFS-7997 URL: https://issues.apache.org/jira/browse/HDFS-7997 Project: Hadoop HDFS

[jira] [Updated] (HDFS-7997) The first non-existing xattr should also throw IOException

2015-03-27 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-7997: --- Attachment: HDFS-7997-001.patch The first non-existing xattr should also throw IOException

[jira] [Commented] (HDFS-7997) The first non-existing xattr should also throw IOException

2015-03-27 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383708#comment-14383708 ] zhouyingchao commented on HDFS-7997: The failed test case is not related to the change.

[jira] [Commented] (HDFS-7868) Use proper blocksize to choose target for blocks

2015-03-05 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14349744#comment-14349744 ] zhouyingchao commented on HDFS-7868: Looks like there are some issues with the jekins

[jira] [Updated] (HDFS-7868) Use proper blocksize to choose target for blocks

2015-03-05 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-7868: --- Status: Open (was: Patch Available) Use proper blocksize to choose target for blocks

[jira] [Updated] (HDFS-7868) Use proper blocksize to choose target for blocks

2015-03-05 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-7868: --- Attachment: (was: HDFS-7868-004.patch) Use proper blocksize to choose target for blocks

[jira] [Updated] (HDFS-7868) Use proper blocksize to choose target for blocks

2015-03-05 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-7868: --- Attachment: (was: HDFS-7868-003.patch) Use proper blocksize to choose target for blocks

[jira] [Updated] (HDFS-7868) Use proper blocksize to choose target for blocks

2015-03-05 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-7868: --- Attachment: (was: HDFS-7868-002.patch) Use proper blocksize to choose target for blocks

[jira] [Updated] (HDFS-7868) Use proper blocksize to choose target for blocks

2015-03-05 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-7868: --- Attachment: (was: HDFS-7868-001.patch) Use proper blocksize to choose target for blocks

[jira] [Created] (HDFS-7897) Shutdown metrics when stopping JournalNode

2015-03-05 Thread zhouyingchao (JIRA)
zhouyingchao created HDFS-7897: -- Summary: Shutdown metrics when stopping JournalNode Key: HDFS-7897 URL: https://issues.apache.org/jira/browse/HDFS-7897 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-7868) Use proper blocksize to choose target for blocks

2015-03-05 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-7868: --- Attachment: HDFS-7868-004.patch Use proper blocksize to choose target for blocks

[jira] [Updated] (HDFS-7868) Use proper blocksize to choose target for blocks

2015-03-05 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-7868: --- Attachment: HDFS-7868-002.patch The new patch which can pass earlier failed cases on my computer.

[jira] [Updated] (HDFS-7868) Use proper blocksize to choose target for blocks

2015-03-05 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-7868: --- Attachment: HDFS-7868-003.patch Use proper blocksize to choose target for blocks

[jira] [Commented] (HDFS-7897) Shutdown metrics when stopping JournalNode

2015-03-05 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14350003#comment-14350003 ] zhouyingchao commented on HDFS-7897: I tried the patch on my computer with the two

[jira] [Updated] (HDFS-7868) Use proper blocksize to choose target for blocks

2015-03-05 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-7868: --- Attachment: HDFS-7868-001.patch Use proper blocksize to choose target for blocks

[jira] [Updated] (HDFS-7868) Use proper blocksize to choose target for blocks

2015-03-05 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-7868: --- Status: Patch Available (was: Open) Not sure what's wrong with the Jekins build system. I just cancel

[jira] [Updated] (HDFS-7897) Shutdown metrics when stopping JournalNode

2015-03-05 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-7897: --- Affects Version/s: 2.6.0 Status: Patch Available (was: Open) Shutdown metrics when

[jira] [Updated] (HDFS-7897) Shutdown metrics when stopping JournalNode

2015-03-05 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-7897: --- Attachment: HDFS-7897-001.patch Shutdown metrics when stopping JournalNode

[jira] [Assigned] (HDFS-7897) Shutdown metrics when stopping JournalNode

2015-03-05 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao reassigned HDFS-7897: -- Assignee: zhouyingchao Shutdown metrics when stopping JournalNode

[jira] [Commented] (HDFS-7868) Use proper blocksize to choose target for blocks

2015-03-02 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14344208#comment-14344208 ] zhouyingchao commented on HDFS-7868: I'll investigate the failure a few days after

[jira] [Updated] (HDFS-7868) Use proper blocksize to choose target for blocks

2015-03-02 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-7868: --- Attachment: HDFS-7868-001.patch Use proper blocksize to choose target for blocks

[jira] [Updated] (HDFS-7868) Use proper blocksize to choose target for blocks

2015-03-02 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-7868: --- Affects Version/s: 2.6.0 Status: Patch Available (was: Open) Use proper blocksize to

  1   2   >