[jira] [Issue Comment Deleted] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Yan updated HDFS-13115: - Comment: was deleted (was: Verified new patch in

[jira] [Comment Edited] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355091#comment-16355091 ] Haibo Yan edited comment on HDFS-13115 at 2/7/18 7:50 AM: -- Verified new patch in

[jira] [Commented] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355091#comment-16355091 ] Haibo Yan commented on HDFS-13115: -- Verified new patch in

[jira] [Commented] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355072#comment-16355072 ] genericqa commented on HDFS-13115: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12933) Improve logging when DFSStripedOutputStream failed to write some blocks

[ https://issues.apache.org/jira/browse/HDFS-12933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355068#comment-16355068 ] Hudson commented on HDFS-12933: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13626 (See

[jira] [Commented] (HDFS-13099) RBF: Refactor RBF relevant settings

[ https://issues.apache.org/jira/browse/HDFS-13099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355066#comment-16355066 ] genericqa commented on HDFS-13099: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12933) Improve logging when DFSStripedOutputStream failed to write some blocks

[ https://issues.apache.org/jira/browse/HDFS-12933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12933: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.2 3.1.0

[jira] [Commented] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355050#comment-16355050 ] Xiao Chen commented on HDFS-11187: -- Cherry-picked the trunk commit to branch-3.0, after resolving a minor

[jira] [Updated] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11187: - Fix Version/s: 3.0.2 > Optimize disk access for last partial chunk checksum of Finalized replica >

[jira] [Updated] (HDFS-12933) Improve logging when DFSStripedOutputStream failed to write some blocks

[ https://issues.apache.org/jira/browse/HDFS-12933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12933: - Summary: Improve logging when DFSStripedOutputStream failed to write some blocks (was: Improve logging

[jira] [Commented] (HDFS-12933) Improve logging when DFSStripedOutputStream failed to read some blocks

[ https://issues.apache.org/jira/browse/HDFS-12933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355046#comment-16355046 ] Xiao Chen commented on HDFS-12933: -- Thanks for the patch [~candychencan]. +1, committing this. > Improve

[jira] [Commented] (HDFS-11701) NPE from Unresolved Host causes permanent DFSInputStream failures

[ https://issues.apache.org/jira/browse/HDFS-11701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355033#comment-16355033 ] genericqa commented on HDFS-11701: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355031#comment-16355031 ] genericqa commented on HDFS-13115: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355019#comment-16355019 ] genericqa commented on HDFS-10453: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13116) Ozone: Refactor Pipeline to have transport and container specific information

[ https://issues.apache.org/jira/browse/HDFS-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-13116: - Attachment: HDFS-13116-HDFS-7240.003.patch > Ozone: Refactor Pipeline to have transport

[jira] [Commented] (HDFS-13116) Ozone: Refactor Pipeline to have transport and container specific information

[ https://issues.apache.org/jira/browse/HDFS-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354999#comment-16354999 ] genericqa commented on HDFS-13116: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13097) [SPS]: Fix the branch review comments(Part1)

[ https://issues.apache.org/jira/browse/HDFS-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354991#comment-16354991 ] Rakesh R commented on HDFS-13097: - Attached new patch fixing checkstyle warnings and few other minor

[jira] [Updated] (HDFS-13097) [SPS]: Fix the branch review comments(Part1)

[ https://issues.apache.org/jira/browse/HDFS-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13097: Attachment: HDFS-13097-HDFS-10285.04.patch > [SPS]: Fix the branch review comments(Part1) >

[jira] [Assigned] (HDFS-12953) XORRawDecoder.doDecode throws NullPointerException

[ https://issues.apache.org/jira/browse/HDFS-12953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reassigned HDFS-12953: Assignee: Xiao Chen (was: Manoj Govindassamy) > XORRawDecoder.doDecode throws

[jira] [Commented] (HDFS-12136) BlockSender performance regression due to volume scanner edge case

[ https://issues.apache.org/jira/browse/HDFS-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354973#comment-16354973 ] genericqa commented on HDFS-12136: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13103) HDFS Client write acknowledgement timeout should not depend on read timeout

[ https://issues.apache.org/jira/browse/HDFS-13103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354972#comment-16354972 ] Wei-Chiu Chuang commented on HDFS-13103: Yes we could use a bit more help in the doc. Current

[jira] [Updated] (HDFS-13116) Ozone: Refactor Pipeline to have transport and container specific information

[ https://issues.apache.org/jira/browse/HDFS-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-13116: - Attachment: HDFS-13116-HDFS-7240.002.patch > Ozone: Refactor Pipeline to have transport

[jira] [Commented] (HDFS-13114) CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path

[ https://issues.apache.org/jira/browse/HDFS-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354966#comment-16354966 ] Wei-Chiu Chuang commented on HDFS-13114: +[~xiaochen] > CryptoAdmin#ReencryptZoneCommand should

[jira] [Commented] (HDFS-13051) dead lock occurs when rolleditlog rpc call happen and editPendingQ is full

[ https://issues.apache.org/jira/browse/HDFS-13051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354965#comment-16354965 ] Daryn Sharp commented on HDFS-13051: The fix is much simpler. Top priority, posted other patches to

[jira] [Commented] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354963#comment-16354963 ] genericqa commented on HDFS-13115: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13103) HDFS Client write acknowledgement timeout should not depend on read timeout

[ https://issues.apache.org/jira/browse/HDFS-13103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13103: --- Description: HDFS-8311 added a timeout for client write acknowledgement for both #

[jira] [Commented] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354960#comment-16354960 ] Yongjun Zhang commented on HDFS-13115: -- HI [~billyean], Thanks for taking a look. About coding

[jira] [Updated] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13115: - Attachment: HDFS-13115.002.patch > In getNumUnderConstructionBlocks(), ignore the inodeIds for

[jira] [Comment Edited] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354950#comment-16354950 ] Haibo Yan edited comment on HDFS-13115 at 2/7/18 4:24 AM: -- Can we go this

[jira] [Commented] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354950#comment-16354950 ] Haibo Yan commented on HDFS-13115: -- Can we go this way?(Which could reply logic in getINodesWithLease,

[jira] [Comment Edited] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354927#comment-16354927 ] He Xiaoqiao edited comment on HDFS-10453 at 2/7/18 4:11 AM: {quote}However,

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-branch-2.7.008.patch > ReplicationMonitor thread could stuck for long time due

[jira] [Commented] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354938#comment-16354938 ] Yongjun Zhang commented on HDFS-13115: -- Uploaded new rev, found I was using HADOOP instead of HDFS in

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: (was: HDFS-10453-branch-2.7.008.patch) > ReplicationMonitor thread could stuck for

[jira] [Updated] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13115: - Attachment: HDFS-13115.001.patch > In getNumUnderConstructionBlocks(), ignore the inodeIds for

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354927#comment-16354927 ] He Xiaoqiao commented on HDFS-10453: {quote}However, going through this makes me realize, a more

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-branch-2.7.008.patch > ReplicationMonitor thread could stuck for long time due

[jira] [Updated] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13115: - Attachment: (was: HADOOP-13115.001.patch) > In getNumUnderConstructionBlocks(), ignore the

[jira] [Commented] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354921#comment-16354921 ] Yongjun Zhang commented on HDFS-13115: -- Thanks for the review [~billyean] and [~jojochuang]. I had

[jira] [Commented] (HDFS-11701) NPE from Unresolved Host causes permanent DFSInputStream failures

[ https://issues.apache.org/jira/browse/HDFS-11701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354909#comment-16354909 ] Lokesh Jain commented on HDFS-11701: v4 patch has some minor corrections. > NPE from Unresolved Host

[jira] [Updated] (HDFS-11701) NPE from Unresolved Host causes permanent DFSInputStream failures

[ https://issues.apache.org/jira/browse/HDFS-11701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-11701: --- Attachment: HDFS-11701.004.patch > NPE from Unresolved Host causes permanent DFSInputStream failures

[jira] [Comment Edited] (HDFS-13099) RBF: Refactor RBF relevant settings

[ https://issues.apache.org/jira/browse/HDFS-13099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354904#comment-16354904 ] Yiqun Lin edited comment on HDFS-13099 at 2/7/18 3:28 AM: -- Just found the default

[jira] [Updated] (HDFS-13099) RBF: Refactor RBF relevant settings

[ https://issues.apache.org/jira/browse/HDFS-13099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13099: - Attachment: HDFS-13099.003.patch > RBF: Refactor RBF relevant settings >

[jira] [Updated] (HDFS-13099) RBF: Refactor RBF relevant settings

[ https://issues.apache.org/jira/browse/HDFS-13099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13099: - Attachment: (was: HDFS-13099.003.patch) > RBF: Refactor RBF relevant settings >

[jira] [Commented] (HDFS-13099) RBF: Refactor RBF relevant settings

[ https://issues.apache.org/jira/browse/HDFS-13099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354904#comment-16354904 ] Yiqun Lin commented on HDFS-13099: -- Just found the default value missing to update in class

[jira] [Updated] (HDFS-13099) RBF: Refactor RBF relevant settings

[ https://issues.apache.org/jira/browse/HDFS-13099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13099: - Attachment: HDFS-13099.003.patch > RBF: Refactor RBF relevant settings >

[jira] [Commented] (HDFS-13116) Ozone: Refactor Pipeline to have transport and container specific information

[ https://issues.apache.org/jira/browse/HDFS-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354902#comment-16354902 ] genericqa commented on HDFS-13116: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7786) Handle slow writers for DFSStripedOutputStream

[ https://issues.apache.org/jira/browse/HDFS-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354898#comment-16354898 ] liaoyuxiangqin commented on HDFS-7786: -- [~libo-intel] I take a think on this issue, and want to

[jira] [Commented] (HDFS-13117) Proposal to support writing replications to HDFS asynchronously

[ https://issues.apache.org/jira/browse/HDFS-13117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354893#comment-16354893 ] Wei-Chiu Chuang commented on HDFS-13117: Hi [~xuchuanyin] thanks for filing the jira. May I

[jira] [Commented] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354884#comment-16354884 ] Wei-Chiu Chuang commented on HDFS-13115: Hi [~yzhangal] thanks for the patch. I think it makes

[jira] [Updated] (HDFS-13051) dead lock occurs when rolleditlog rpc call happen and editPendingQ is full

[ https://issues.apache.org/jira/browse/HDFS-13051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangwei updated HDFS-13051: Attachment: deadlock.patch > dead lock occurs when rolleditlog rpc call happen and editPendingQ is full >

[jira] [Commented] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354879#comment-16354879 ] Haibo Yan commented on HDFS-13115: -- [~yzhangal] Maybe you can add some debug info for null inode id that

[jira] [Updated] (HDFS-13051) dead lock occurs when rolleditlog rpc call happen and editPendingQ is full

[ https://issues.apache.org/jira/browse/HDFS-13051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangwei updated HDFS-13051: Attachment: (was: deadlock.patch) > dead lock occurs when rolleditlog rpc call happen and editPendingQ

[jira] [Updated] (HDFS-13051) dead lock occurs when rolleditlog rpc call happen and editPendingQ is full

[ https://issues.apache.org/jira/browse/HDFS-13051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangwei updated HDFS-13051: Attachment: deadlock.patch > dead lock occurs when rolleditlog rpc call happen and editPendingQ is full >

[jira] [Updated] (HDFS-13116) Ozone: Refactor Pipeline to have transport and container specific information

[ https://issues.apache.org/jira/browse/HDFS-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-13116: - Attachment: HDFS-13116-HDFS-7240.001.patch > Ozone: Refactor Pipeline to have transport

[jira] [Updated] (HDFS-13116) Ozone: Refactor Pipeline to have transport and container specific information

[ https://issues.apache.org/jira/browse/HDFS-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-13116: - Status: Patch Available (was: Open) > Ozone: Refactor Pipeline to have transport and

[jira] [Commented] (HDFS-13109) Support fully qualified hdfs path in "crypto" commands path argument

[ https://issues.apache.org/jira/browse/HDFS-13109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354866#comment-16354866 ] Rushabh S Shah commented on HDFS-13109: --- [~hanishakoneru]: Thanks for reporting this bug. Maybe a

[jira] [Commented] (HDFS-13022) Block Storage: Kubernetes dynamic persistent volume provisioner

[ https://issues.apache.org/jira/browse/HDFS-13022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354861#comment-16354861 ] genericqa commented on HDFS-13022: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13102) Implement SnapshotSkipList class to store Multi level DirectoryDiffs

[ https://issues.apache.org/jira/browse/HDFS-13102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354860#comment-16354860 ] genericqa commented on HDFS-13102: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13115: --- Target Version/s: 3.1.0, 2.10.0 > In getNumUnderConstructionBlocks(), ignore the inodeIds for

[jira] [Created] (HDFS-13117) Proposal to support writing replications to HDFS asynchronously

xuchuanyin created HDFS-13117: - Summary: Proposal to support writing replications to HDFS asynchronously Key: HDFS-13117 URL: https://issues.apache.org/jira/browse/HDFS-13117 Project: Hadoop HDFS

[jira] [Updated] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13115: - Status: Patch Available (was: Open) > In getNumUnderConstructionBlocks(), ignore the inodeIds

[jira] [Updated] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13115: - Attachment: HADOOP-13115.001.patch > In getNumUnderConstructionBlocks(), ignore the inodeIds for

[jira] [Commented] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354849#comment-16354849 ] Yongjun Zhang commented on HDFS-13115: -- Noticed the following two methods in LeaseManager.java: 1.

[jira] [Created] (HDFS-13116) Ozone: Refactor Pipeline to have transport and container specific information

Mukul Kumar Singh created HDFS-13116: Summary: Ozone: Refactor Pipeline to have transport and container specific information Key: HDFS-13116 URL: https://issues.apache.org/jira/browse/HDFS-13116

[jira] [Updated] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13115: - Summary: In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been

[jira] [Updated] (HDFS-13115) Handle deleted inode in getNumUnderConstructionBlocks()

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13115: - Summary: Handle deleted inode in getNumUnderConstructionBlocks() (was: Handle inode of a given

[jira] [Commented] (HDFS-13051) dead lock occurs when rolleditlog rpc call happen and editPendingQ is full

[ https://issues.apache.org/jira/browse/HDFS-13051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354838#comment-16354838 ] photogamerun commented on HDFS-13051: - sure we alread found expire token is default hourly put edit to

[jira] [Commented] (HDFS-13055) Aggregate usage statistics from datanodes

[ https://issues.apache.org/jira/browse/HDFS-13055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354833#comment-16354833 ] genericqa commented on HDFS-13055: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13107) Add Mover Cli Unit Tests for Federated cluster

[ https://issues.apache.org/jira/browse/HDFS-13107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354823#comment-16354823 ] Hudson commented on HDFS-13107: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13625 (See

[jira] [Assigned] (HDFS-13115) Handle inode of a given inodeId already deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reassigned HDFS-13115: Assignee: Yongjun Zhang > Handle inode of a given inodeId already deleted >

[jira] [Created] (HDFS-13115) Handle inode of a given inodeId already deleted

Yongjun Zhang created HDFS-13115: Summary: Handle inode of a given inodeId already deleted Key: HDFS-13115 URL: https://issues.apache.org/jira/browse/HDFS-13115 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-12947) Limit the number of Snapshots allowed to be created for a Snapshottable Directory

[ https://issues.apache.org/jira/browse/HDFS-12947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-12947: --- Fix Version/s: 3.1.0 > Limit the number of Snapshots allowed to be created for a

[jira] [Updated] (HDFS-13107) Add Mover Cli Unit Tests for Federated cluster

[ https://issues.apache.org/jira/browse/HDFS-13107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-13107: --- Component/s: test balancer & mover > Add Mover Cli Unit Tests for

[jira] [Updated] (HDFS-13107) Add Mover Cli Unit Tests for Federated cluster

[ https://issues.apache.org/jira/browse/HDFS-13107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-13107: --- Resolution: Fixed Fix Version/s: 3.1.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-13107) Add Mover Cli Unit Tests for Federated cluster

[ https://issues.apache.org/jira/browse/HDFS-13107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-13107: --- Hadoop Flags: Reviewed Summary: Add Mover Cli Unit Tests for Federated

[jira] [Created] (HDFS-13114) CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path

Hanisha Koneru created HDFS-13114: - Summary: CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path Key: HDFS-13114 URL: https://issues.apache.org/jira/browse/HDFS-13114 Project:

[jira] [Commented] (HDFS-13112) Token expiration edits may cause log corruption or deadlock

[ https://issues.apache.org/jira/browse/HDFS-13112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354790#comment-16354790 ] genericqa commented on HDFS-13112: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13109) Support fully qualified hdfs path in "crypto" commands path argument

[ https://issues.apache.org/jira/browse/HDFS-13109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354792#comment-16354792 ] genericqa commented on HDFS-13109: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13106) Need to exercise all HDFS APIs for EC

[ https://issues.apache.org/jira/browse/HDFS-13106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HDFS-13106: - Resolution: Fixed Status: Resolved (was: Patch Available) > Need to exercise all HDFS

[jira] [Commented] (HDFS-13106) Need to exercise all HDFS APIs for EC

[ https://issues.apache.org/jira/browse/HDFS-13106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354767#comment-16354767 ] Sean Mackrory commented on HDFS-13106: -- Committed to trunk. > Need to exercise all HDFS APIs for EC

[jira] [Commented] (HDFS-12990) Change default NameNode RPC port back to 8020

[ https://issues.apache.org/jira/browse/HDFS-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354761#comment-16354761 ] Xiao Chen commented on HDFS-12990: -- Thanks [~anu] for pushing this through the finish line, and all for

[jira] [Commented] (HDFS-13106) Need to exercise all HDFS APIs for EC

[ https://issues.apache.org/jira/browse/HDFS-13106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354754#comment-16354754 ] Hudson commented on HDFS-13106: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13624 (See

[jira] [Updated] (HDFS-12933) Improve logging when DFSStripedOutputStream failed to read some blocks

[ https://issues.apache.org/jira/browse/HDFS-12933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12933: - Target Version/s: 3.0.2 (was: 3.0.1) > Improve logging when DFSStripedOutputStream failed to

[jira] [Commented] (HDFS-13109) Support fully qualified hdfs path in "crypto" commands path argument

[ https://issues.apache.org/jira/browse/HDFS-13109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354732#comment-16354732 ] Hanisha Koneru commented on HDFS-13109: --- Uploaded patch v01. Changed {{provisionEZTrash()}} to

[jira] [Updated] (HDFS-13109) Support fully qualified hdfs path in "crypto" commands path argument

[ https://issues.apache.org/jira/browse/HDFS-13109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-13109: -- Status: Patch Available (was: Open) > Support fully qualified hdfs path in "crypto" commands

[jira] [Commented] (HDFS-13106) Need to exercise all HDFS APIs for EC

[ https://issues.apache.org/jira/browse/HDFS-13106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354728#comment-16354728 ] Sean Mackrory commented on HDFS-13106: -- +1 from me too. Unit test failures are unrelated, new tests

[jira] [Updated] (HDFS-13109) Support fully qualified hdfs path in "crypto" commands path argument

[ https://issues.apache.org/jira/browse/HDFS-13109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-13109: -- Attachment: HDFS-13109.001.patch > Support fully qualified hdfs path in "crypto" commands path

[jira] [Comment Edited] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354711#comment-16354711 ] Erik Krogen edited comment on HDFS-10453 at 2/6/18 11:33 PM: - Hey

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354717#comment-16354717 ] Arpit Agarwal commented on HDFS-10453: -- bq. However, going through this makes me realize, a more

[jira] [Commented] (HDFS-12990) Change default NameNode RPC port back to 8020

[ https://issues.apache.org/jira/browse/HDFS-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354715#comment-16354715 ] genericqa commented on HDFS-12990: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354711#comment-16354711 ] Erik Krogen commented on HDFS-10453: Hey [~arpitagarwal], IIUC it doesn't need to see the most recent

[jira] [Commented] (HDFS-12947) Limit the number of Snapshots allowed to be created for a Snapshottable Directory

[ https://issues.apache.org/jira/browse/HDFS-12947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354708#comment-16354708 ] Hudson commented on HDFS-12947: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13623 (See

[jira] [Commented] (HDFS-12051) Reimplement NameCache in NameNode: Intern duplicate byte[] arrays (mainly those denoting file/directory names) to save memory

[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354707#comment-16354707 ] Tsz Wo Nicholas Sze commented on HDFS-12051: Thanks, [~mi...@cloudera.com] for running

[jira] [Commented] (HDFS-13106) Need to exercise all HDFS APIs for EC

[ https://issues.apache.org/jira/browse/HDFS-13106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354704#comment-16354704 ] genericqa commented on HDFS-13106: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354677#comment-16354677 ] Arpit Agarwal commented on HDFS-10453: -- Hi [~hexiaoqiao], I assume this is the key part of the fix in

[jira] [Updated] (HDFS-13102) Implement SnapshotSkipList class to store Multi level DirectoryDiffs

[ https://issues.apache.org/jira/browse/HDFS-13102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-13102: --- Status: Patch Available (was: Open) > Implement SnapshotSkipList class to store

[jira] [Updated] (HDFS-12947) Limit the number of Snapshots allowed to be created for a Snapshottable Directory

[ https://issues.apache.org/jira/browse/HDFS-12947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-12947: --- Resolution: Fixed Status: Resolved (was: Patch Available) I have committed

[jira] [Updated] (HDFS-12947) Limit the number of Snapshots allowed to be created for a Snapshottable Directory

[ https://issues.apache.org/jira/browse/HDFS-12947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-12947: --- Hadoop Flags: Reviewed Component/s: snapshots +1 the 004 patch looks good. >

[jira] [Commented] (HDFS-13113) Use Log.*(Object, Throwable) overload to log exceptions

[ https://issues.apache.org/jira/browse/HDFS-13113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354641#comment-16354641 ] genericqa commented on HDFS-13113: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >