[jira] [Resolved] (HDFS-15777) Hadoop

[ https://issues.apache.org/jira/browse/HDFS-15777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-15777. Resolution: Invalid > Hadoop > -- > > Key: HDFS-15777 >

[jira] [Commented] (HDFS-15661) The DeadNodeDetector shouldn't be shared by different DFSClients.

[ https://issues.apache.org/jira/browse/HDFS-15661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265745#comment-17265745 ] Wei-Chiu Chuang commented on HDFS-15661: I'm not familiar with the dead node detector -- it's a

[jira] [Commented] (HDFS-15661) The DeadNodeDetector shouldn't be shared by different DFSClients.

[ https://issues.apache.org/jira/browse/HDFS-15661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264829#comment-17264829 ] Wei-Chiu Chuang commented on HDFS-15661: [~leosun08] do you have cycles to review this patch for

[jira] [Commented] (HDFS-15763) Provide NameNode Analytics as a NameNode plugin

[ https://issues.apache.org/jira/browse/HDFS-15763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261516#comment-17261516 ] Wei-Chiu Chuang commented on HDFS-15763: Great work. Let's make it a "New Feature". > Provide

[jira] [Updated] (HDFS-15763) Provide NameNode Analytics as a NameNode plugin

[ https://issues.apache.org/jira/browse/HDFS-15763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15763: --- Issue Type: New Feature (was: Improvement) > Provide NameNode Analytics as a NameNode

[jira] [Deleted] (HDFS-15752) A user can obtain the infomation of blocks belong to other users

[ https://issues.apache.org/jira/browse/HDFS-15752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang deleted HDFS-15752: --- > A user can obtain the infomation of blocks belong to other users >

[jira] [Resolved] (HDFS-15719) [Hadoop 3] Both NameNodes can crash simultaneously due to the short JN socket timeout

[ https://issues.apache.org/jira/browse/HDFS-15719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-15719. Fix Version/s: 3.2.3 3.1.5 3.4.0

[jira] [Work started] (HDFS-15719) [Hadoop 3] Both NameNodes can crash simultaneously due to the short JN socket timeout

[ https://issues.apache.org/jira/browse/HDFS-15719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15719 started by Wei-Chiu Chuang. -- > [Hadoop 3] Both NameNodes can crash simultaneously due to the short JN

[jira] [Assigned] (HDFS-15732) EC client will not retry get block token when block token expired in kerberized cluster

[ https://issues.apache.org/jira/browse/HDFS-15732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-15732: -- Assignee: gaozhan ding > EC client will not retry get block token when block token

[jira] [Commented] (HDFS-15732) EC client will not retry get block token when block token expired in kerberized cluster

[ https://issues.apache.org/jira/browse/HDFS-15732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258600#comment-17258600 ] Wei-Chiu Chuang commented on HDFS-15732: [~lalapala] would you like to submit a PR? I see that

[jira] [Commented] (HDFS-15732) EC client will not retry get block token when block token expired in kerberized cluster

[ https://issues.apache.org/jira/browse/HDFS-15732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258598#comment-17258598 ] Wei-Chiu Chuang commented on HDFS-15732: Probably similar to HDFS-10609 and HDFS-11741 where we

[jira] [Commented] (HDFS-15741) Vulnerability fixes needed for Jackson Hadoop dependency library

[ https://issues.apache.org/jira/browse/HDFS-15741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252955#comment-17252955 ] Wei-Chiu Chuang commented on HDFS-15741: According to

[jira] [Commented] (HDFS-15719) [Hadoop 3] Both NameNodes can crash simultaneously due to the short JN socket timeout

[ https://issues.apache.org/jira/browse/HDFS-15719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250455#comment-17250455 ] Wei-Chiu Chuang commented on HDFS-15719: Ah yes you're right. Hadoop web UI, webhdfs were Jetty6.

[jira] [Assigned] (HDFS-15719) [Hadoop 3] Both NameNodes can crash simultaneously due to the short JN socket timeout

[ https://issues.apache.org/jira/browse/HDFS-15719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-15719: -- Assignee: Wei-Chiu Chuang > [Hadoop 3] Both NameNodes can crash simultaneously due to

[jira] [Updated] (HDFS-15170) EC: Block gets marked as CORRUPT in case of failover and pipeline recovery

[ https://issues.apache.org/jira/browse/HDFS-15170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15170: --- Fix Version/s: 3.2.3 3.1.5 3.4.0

[jira] [Commented] (HDFS-15170) EC: Block gets marked as CORRUPT in case of failover and pipeline recovery

[ https://issues.apache.org/jira/browse/HDFS-15170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249354#comment-17249354 ] Wei-Chiu Chuang commented on HDFS-15170: I'll commit the patch. The 04 patch is essentially 03

[jira] [Updated] (HDFS-15170) EC: Block gets marked as CORRUPT in case of failover and pipeline recovery

[ https://issues.apache.org/jira/browse/HDFS-15170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15170: --- Attachment: HDFS-15170-04.patch > EC: Block gets marked as CORRUPT in case of failover and

[jira] [Commented] (HDFS-15170) EC: Block gets marked as CORRUPT in case of failover and pipeline recovery

[ https://issues.apache.org/jira/browse/HDFS-15170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249350#comment-17249350 ] Wei-Chiu Chuang commented on HDFS-15170: We should move forward with the fix... even though 

[jira] [Commented] (HDFS-15729) Show progress of Balancer in Namenode UI

[ https://issues.apache.org/jira/browse/HDFS-15729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249306#comment-17249306 ] Wei-Chiu Chuang commented on HDFS-15729: Balancer runs as a separate process, probably not a good

[jira] [Resolved] (HDFS-15720) namenode audit async logger should add some log4j config

[ https://issues.apache.org/jira/browse/HDFS-15720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-15720. Fix Version/s: 3.2.3 3.1.5 3.3.1 Resolution:

[jira] [Commented] (HDFS-15170) EC: Block gets marked as CORRUPT in case of failover and pipeline recovery

[ https://issues.apache.org/jira/browse/HDFS-15170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246939#comment-17246939 ] Wei-Chiu Chuang commented on HDFS-15170: Ok. Thanks for the clarification! > EC: Block gets

[jira] [Commented] (HDFS-15170) EC: Block gets marked as CORRUPT in case of failover and pipeline recovery

[ https://issues.apache.org/jira/browse/HDFS-15170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246935#comment-17246935 ] Wei-Chiu Chuang commented on HDFS-15170:     {code:java} +// If the block is an EC

[jira] [Commented] (HDFS-15170) EC: Block gets marked as CORRUPT in case of failover and pipeline recovery

[ https://issues.apache.org/jira/browse/HDFS-15170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246841#comment-17246841 ] Wei-Chiu Chuang commented on HDFS-15170: Dumb question. I am not sure what makes EC blocks

[jira] [Updated] (HDFS-15170) EC: Block gets marked as CORRUPT in case of failover and pipeline recovery

[ https://issues.apache.org/jira/browse/HDFS-15170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15170: --- Component/s: erasure-coding > EC: Block gets marked as CORRUPT in case of failover and

[jira] [Created] (HDFS-15719) [Hadoop 3] Both NameNodes can crash simultaneously due to the short JN socket timeout

Wei-Chiu Chuang created HDFS-15719: -- Summary: [Hadoop 3] Both NameNodes can crash simultaneously due to the short JN socket timeout Key: HDFS-15719 URL: https://issues.apache.org/jira/browse/HDFS-15719

[jira] [Commented] (HDFS-15402) Requesting http jmx metrics leads to too much CLOSE-WAIT on datanode

[ https://issues.apache.org/jira/browse/HDFS-15402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246266#comment-17246266 ] Wei-Chiu Chuang commented on HDFS-15402: This is perhaps resolved by HADOOP-16881. [~seanlook] if

[jira] [Resolved] (HDFS-15709) EC: Socket file descriptor leak in StripedBlockChecksumReconstructor

[ https://issues.apache.org/jira/browse/HDFS-15709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-15709. Fix Version/s: 3.2.3 3.1.5 3.4.0

[jira] [Assigned] (HDFS-15709) Socket file descriptor leak in StripedBlockChecksumReconstructor

[ https://issues.apache.org/jira/browse/HDFS-15709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-15709: -- Assignee: Yushi Hayasaka > Socket file descriptor leak in

[jira] [Commented] (HDFS-15709) Socket file descriptor leak in StripedBlockChecksumReconstructor

[ https://issues.apache.org/jira/browse/HDFS-15709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244237#comment-17244237 ] Wei-Chiu Chuang commented on HDFS-15709: Patch looks good to me. Just out of my curiosity, how

[jira] [Updated] (HDFS-15708) TestURLConnectionFactory fails by NoClassDefFoundError in branch-3.3 and branch-3.2

[ https://issues.apache.org/jira/browse/HDFS-15708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15708: --- Priority: Blocker (was: Major) > TestURLConnectionFactory fails by NoClassDefFoundError in

[jira] [Resolved] (HDFS-15706) HttpFS: Log more information on request failures

[ https://issues.apache.org/jira/browse/HDFS-15706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-15706. Fix Version/s: 3.2.3 3.1.5 3.4.0

[jira] [Commented] (HDFS-15704) Mitigate lease monitor's rapid infinite loop

[ https://issues.apache.org/jira/browse/HDFS-15704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243232#comment-17243232 ] Wei-Chiu Chuang commented on HDFS-15704: Does HDFS-14498 look familiar to you? CC [~sodonnell] >

[jira] [Updated] (HDFS-15705) Fix a typo in SecondaryNameNode.java

[ https://issues.apache.org/jira/browse/HDFS-15705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15705: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-15705) Fix a typo in SecondaryNameNode.java

[ https://issues.apache.org/jira/browse/HDFS-15705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17242795#comment-17242795 ] Wei-Chiu Chuang commented on HDFS-15705: +1. I added you to the contributor list and you'll be

[jira] [Assigned] (HDFS-15705) Fix a typo in SecondaryNameNode.java

[ https://issues.apache.org/jira/browse/HDFS-15705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-15705: -- Assignee: Sixiang Ma > Fix a typo in SecondaryNameNode.java >

[jira] [Updated] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15039: --- Fix Version/s: (was: 3.4.0) 3.3.0 > Cache meta file length of

[jira] [Updated] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15039: --- Fix Version/s: 3.4.0 > Cache meta file length of FinalizedReplica to reduce call

[jira] [Updated] (HDFS-15545) (S)Webhdfs will not use updated delegation tokens available in the ugi after the old ones expire

[ https://issues.apache.org/jira/browse/HDFS-15545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15545: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Updated] (HDFS-15608) Rename variable DistCp#CLEANUP

[ https://issues.apache.org/jira/browse/HDFS-15608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15608: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Updated] (HDFS-15608) Rename variable DistCp#CLEANUP

[ https://issues.apache.org/jira/browse/HDFS-15608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15608: --- Summary: Rename variable DistCp#CLEANUP (was: Reset the DistCp#CLEANUP variable

[jira] [Resolved] (HDFS-15485) Fix outdated properties of JournalNode when performing rollback

[ https://issues.apache.org/jira/browse/HDFS-15485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-15485. Fix Version/s: 3.2.3 3.1.5 3.3.1 Resolution:

[jira] [Updated] (HDFS-15485) Fix outdated properties of JournalNode when performing rollback

[ https://issues.apache.org/jira/browse/HDFS-15485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15485: --- Fix Version/s: 3.4.0 > Fix outdated properties of JournalNode when performing rollback >

[jira] [Commented] (HDFS-15569) Speed up the Storage#doRecover during datanode rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-15569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226918#comment-17226918 ] Wei-Chiu Chuang commented on HDFS-15569: This is not directly related to Hadoop, but Cloudera

[jira] [Commented] (HDFS-15562) StandbyCheckpointer will do checkpoint repeatedly while connecting observer/active namenode failed

[ https://issues.apache.org/jira/browse/HDFS-15562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226420#comment-17226420 ] Wei-Chiu Chuang commented on HDFS-15562: [~cliang] [~shv] do you think you can help Aihua with

[jira] [Commented] (HDFS-15545) (S)Webhdfs will not use updated delegation tokens available in the ugi after the old ones expire

[ https://issues.apache.org/jira/browse/HDFS-15545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17225112#comment-17225112 ] Wei-Chiu Chuang commented on HDFS-15545: +1.   We have quite poor support and test coverage for

[jira] [Assigned] (HDFS-15485) Fix outdated properties of JournalNode when performing rollback

[ https://issues.apache.org/jira/browse/HDFS-15485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-15485: -- Assignee: Deegue > Fix outdated properties of JournalNode when performing rollback >

[jira] [Assigned] (HDFS-15485) Fix outdated properties of JournalNode when performing rollback

[ https://issues.apache.org/jira/browse/HDFS-15485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-15485: -- Assignee: (was: Wei-Chiu Chuang) > Fix outdated properties of JournalNode when

[jira] [Assigned] (HDFS-15485) Fix outdated properties of JournalNode when performing rollback

[ https://issues.apache.org/jira/browse/HDFS-15485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-15485: -- Assignee: Wei-Chiu Chuang > Fix outdated properties of JournalNode when performing

[jira] [Assigned] (HDFS-15623) Respect configured values of rpc.engine

[ https://issues.apache.org/jira/browse/HDFS-15623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-15623: -- Assignee: Hector Sandoval Chaverri > Respect configured values of rpc.engine >

[jira] [Updated] (HDFS-15608) Reset the DistCp#CLEANUP variable definition.

[ https://issues.apache.org/jira/browse/HDFS-15608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15608: --- Priority: Trivial (was: Major) > Reset the DistCp#CLEANUP variable definition. >

[jira] [Commented] (HDFS-15650) Make the socket timeout for computing checksum of striped blocks configurable

[ https://issues.apache.org/jira/browse/HDFS-15650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224911#comment-17224911 ] Wei-Chiu Chuang commented on HDFS-15650: Sounds like a possible scenario... thanks for sharing

[jira] [Commented] (HDFS-15650) Make the socket timeout for computing checksum of striped blocks configurable

[ https://issues.apache.org/jira/browse/HDFS-15650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224862#comment-17224862 ] Wei-Chiu Chuang commented on HDFS-15650: In that case, you can use

[jira] [Commented] (HDFS-15663) NetworkBinding has a runtime class dependency on a third-party shaded class

[ https://issues.apache.org/jira/browse/HDFS-15663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223889#comment-17223889 ] Wei-Chiu Chuang commented on HDFS-15663: [~ste...@apache.org] any ideas? > NetworkBinding has a

[jira] [Updated] (HDFS-15644) Failed volumes can cause DNs to stop block reporting

[ https://issues.apache.org/jira/browse/HDFS-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15644: --- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks! > Failed volumes

[jira] [Updated] (HDFS-15644) Failed volumes can cause DNs to stop block reporting

[ https://issues.apache.org/jira/browse/HDFS-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15644: --- Fix Version/s: 2.10.2 > Failed volumes can cause DNs to stop block reporting >

[jira] [Commented] (HDFS-15644) Failed volumes can cause DNs to stop block reporting

[ https://issues.apache.org/jira/browse/HDFS-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1754#comment-1754 ] Wei-Chiu Chuang commented on HDFS-15644: I tried to verify the tests are good but

[jira] [Updated] (HDFS-15644) Failed volumes can cause DNs to stop block reporting

[ https://issues.apache.org/jira/browse/HDFS-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15644: --- Fix Version/s: (was: 3.2.2) 3.2.3 > Failed volumes can cause DNs to

[jira] [Updated] (HDFS-15644) Failed volumes can cause DNs to stop block reporting

[ https://issues.apache.org/jira/browse/HDFS-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15644: --- Fix Version/s: 3.1.5 3.4.0 3.3.1

[jira] [Commented] (HDFS-15644) Failed volumes can cause DNs to stop block reporting

[ https://issues.apache.org/jira/browse/HDFS-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219887#comment-17219887 ] Wei-Chiu Chuang commented on HDFS-15644: The cherrypick is clean from trunk all the way to

[jira] [Commented] (HDFS-15644) Failed volumes can cause DNs to stop block reporting

[ https://issues.apache.org/jira/browse/HDFS-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219880#comment-17219880 ] Wei-Chiu Chuang commented on HDFS-15644: +1 the failed test are flaky. will file jiras to track

[jira] [Commented] (HDFS-15644) Failed volumes can cause DNs to stop block reporting

[ https://issues.apache.org/jira/browse/HDFS-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219274#comment-17219274 ] Wei-Chiu Chuang commented on HDFS-15644: BTW, [~ahussein] let's move to github PR in the future,

[jira] [Commented] (HDFS-15644) Failed volumes can cause DNs to stop block reporting

[ https://issues.apache.org/jira/browse/HDFS-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219245#comment-17219245 ] Wei-Chiu Chuang commented on HDFS-15644: +1 test failures looks unrelated. i'm triggrering the

[jira] [Commented] (HDFS-15642) EC：radmon error when enable ec policy on hbase data

[ https://issues.apache.org/jira/browse/HDFS-15642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217036#comment-17217036 ] Wei-Chiu Chuang commented on HDFS-15642: There were a number of EC corruption bugs fixed in more

[jira] [Comment Edited] (HDFS-15597) ContentSummary.getSpaceConsumed does not consider replication

[ https://issues.apache.org/jira/browse/HDFS-15597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216969#comment-17216969 ] Wei-Chiu Chuang edited comment on HDFS-15597 at 10/19/20, 5:49 PM: ---

[jira] [Commented] (HDFS-15597) ContentSummary.getSpaceConsumed does not consider replication

[ https://issues.apache.org/jira/browse/HDFS-15597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216969#comment-17216969 ] Wei-Chiu Chuang commented on HDFS-15597: {quote}replication 0 or 1? IIRC its 1. {quote} My bad. A

[jira] [Commented] (HDFS-15621) Datanode DirectoryScanner uses excessive memory

[ https://issues.apache.org/jira/browse/HDFS-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212442#comment-17212442 ] Wei-Chiu Chuang commented on HDFS-15621: Found an old jira reporting the same: HDFS-14531 >

[jira] [Commented] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209917#comment-17209917 ] Wei-Chiu Chuang commented on HDFS-15240: [~ferhui] could you review this patch? Looks like a

[jira] [Commented] (HDFS-15597) ContentSummary.getSpaceConsumed does not consider replication

[ https://issues.apache.org/jira/browse/HDFS-15597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209910#comment-17209910 ] Wei-Chiu Chuang commented on HDFS-15597: Thanks for the patch. Spent some time to understand

[jira] [Commented] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17204000#comment-17204000 ] Wei-Chiu Chuang commented on HDFS-15415: +1 > Reduce locking in Datanode DirectoryScanner >

[jira] [Commented] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203483#comment-17203483 ] Wei-Chiu Chuang commented on HDFS-15415: Ok +1. Committed the patch into branch-3.2 > Reduce

[jira] [Commented] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201272#comment-17201272 ] Wei-Chiu Chuang commented on HDFS-15415: The code looks good. I wanted to verify that test

[jira] [Commented] (HDFS-15583) Backport DirectoryScanner improvements HDFS-14476, HDFS-14751 and HDFS-15048 to branch 3.2 and 3.1

[ https://issues.apache.org/jira/browse/HDFS-15583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199694#comment-17199694 ] Wei-Chiu Chuang commented on HDFS-15583: +1 > Backport DirectoryScanner improvements HDFS-14476,

[jira] [Commented] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199693#comment-17199693 ] Wei-Chiu Chuang commented on HDFS-15415: +1. Sorry I reviewed but forgot to comment here. >

[jira] [Commented] (HDFS-15569) Speed up the Storage#doRecover during datanode rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-15569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198849#comment-17198849 ] Wei-Chiu Chuang commented on HDFS-15569: Nit: {code} LOG.info("Deleting storage directory {}

[jira] [Commented] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17197248#comment-17197248 ] Wei-Chiu Chuang commented on HDFS-15415: LGTM can you verify the failed tests are unrelated?

[jira] [Commented] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196185#comment-17196185 ] Wei-Chiu Chuang commented on HDFS-15415: {code} try (AutoCloseableLock lock =

[jira] [Commented] (HDFS-15566) NN restart fails after RollingUpgrade from 3.1.3/3.2.1 to 3.3.0

[ https://issues.apache.org/jira/browse/HDFS-15566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194475#comment-17194475 ] Wei-Chiu Chuang commented on HDFS-15566: Oh yeah you're right. Sorry about that. LGTM +1 > NN

[jira] [Comment Edited] (HDFS-15566) NN restart fails after RollingUpgrade from 3.1.3/3.2.1 to 3.3.0

[ https://issues.apache.org/jira/browse/HDFS-15566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193191#comment-17193191 ] Wei-Chiu Chuang edited comment on HDFS-15566 at 9/9/20, 9:44 PM: - Should

[jira] [Commented] (HDFS-15566) NN restart fails after RollingUpgrade from 3.1.3/3.2.1 to 3.3.0

[ https://issues.apache.org/jira/browse/HDFS-15566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193191#comment-17193191 ] Wei-Chiu Chuang commented on HDFS-15566: Should we add a doc to tell users not to rolling upgrade

[jira] [Updated] (HDFS-15540) Directories protected from delete can still be moved to the trash

[ https://issues.apache.org/jira/browse/HDFS-15540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15540: --- Fix Version/s: 3.4.0 3.3.1 Resolution: Fixed Status:

[jira] [Commented] (HDFS-15540) Directories protected from delete can still be moved to the trash

[ https://issues.apache.org/jira/browse/HDFS-15540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17185627#comment-17185627 ] Wei-Chiu Chuang commented on HDFS-15540: Committed to trunk and branch-3.3. For branch-3.2 and

[jira] [Commented] (HDFS-15540) Directories protected from delete can still be moved to the trash

[ https://issues.apache.org/jira/browse/HDFS-15540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17185620#comment-17185620 ] Wei-Chiu Chuang commented on HDFS-15540: +1 nice catch. Committing the 001 patch. > Directories

[jira] [Comment Edited] (HDFS-15473) Add listSnapshots command to list all snapshots

[ https://issues.apache.org/jira/browse/HDFS-15473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163753#comment-17163753 ] Wei-Chiu Chuang edited comment on HDFS-15473 at 7/23/20, 4:41 PM: -- bq.

[jira] [Commented] (HDFS-15473) Add listSnapshots command to list all snapshots

[ https://issues.apache.org/jira/browse/HDFS-15473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163753#comment-17163753 ] Wei-Chiu Chuang commented on HDFS-15473: bq. Also, can you add a metrics for the number of total

[jira] [Commented] (HDFS-15473) Add listSnapshots command to list all snapshots

[ https://issues.apache.org/jira/browse/HDFS-15473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163723#comment-17163723 ] Wei-Chiu Chuang commented on HDFS-15473: Ideally, you want to use an iterator to return partial

[jira] [Updated] (HDFS-15468) Active namenode crashed when no edit recover

[ https://issues.apache.org/jira/browse/HDFS-15468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15468: --- Component/s: journal-node ha > Active namenode crashed when no edit recover

[jira] [Commented] (HDFS-15472) Erasure Coding: Support fallback read when zero copy is not supported

[ https://issues.apache.org/jira/browse/HDFS-15472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159403#comment-17159403 ] Wei-Chiu Chuang commented on HDFS-15472: thanks for the patch. I think the patch is fine. We

[jira] [Commented] (HDFS-15473) Add listSnapshots command to list all snapshots

[ https://issues.apache.org/jira/browse/HDFS-15473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159399#comment-17159399 ] Wei-Chiu Chuang commented on HDFS-15473: [~hemanthboyina] can you make an example? Say the

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154657#comment-17154657 ] Wei-Chiu Chuang commented on HDFS-14498: It looks very similar to HDFS-8406 / HDFS-11817. I

[jira] [Updated] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15160: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-15105) Standby NN exits and fails to restart due to edit log corruption

[ https://issues.apache.org/jira/browse/HDFS-15105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17145941#comment-17145941 ] Wei-Chiu Chuang commented on HDFS-15105: [~Tao Yang] The truncate feature is seldom used so i am

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17145928#comment-17145928 ] Wei-Chiu Chuang commented on HDFS-15160: +1 let's commit this latest version now. We can

[jira] [Commented] (HDFS-15407) Hedged read will not work if a datanode slow for a long time

[ https://issues.apache.org/jira/browse/HDFS-15407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17144356#comment-17144356 ] Wei-Chiu Chuang commented on HDFS-15407: I am aware of a HBaseCon talk two years ago that talked

[jira] [Commented] (HDFS-15372) Files in snapshots no longer see attribute provider permissions

[ https://issues.apache.org/jira/browse/HDFS-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139432#comment-17139432 ] Wei-Chiu Chuang commented on HDFS-15372: Accidentally committed version 004 instead of the last,

[jira] [Assigned] (HDFS-15416) The addStorageLocations() method in the DataStorage class is not perfect.

[ https://issues.apache.org/jira/browse/HDFS-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-15416: -- Assignee: jianghua zhu > The addStorageLocations() method in the DataStorage class is

[jira] [Updated] (HDFS-15372) Files in snapshots no longer see attribute provider permissions

[ https://issues.apache.org/jira/browse/HDFS-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15372: --- Fix Version/s: 3.4.0 3.3.1 Resolution: Fixed Status:

[jira] [Commented] (HDFS-15372) Files in snapshots no longer see attribute provider permissions

[ https://issues.apache.org/jira/browse/HDFS-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17137975#comment-17137975 ] Wei-Chiu Chuang commented on HDFS-15372: Committed the change to trunk and branch-3.3. There are

[jira] [Commented] (HDFS-15372) Files in snapshots no longer see attribute provider permissions

[ https://issues.apache.org/jira/browse/HDFS-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17137971#comment-17137971 ] Wei-Chiu Chuang commented on HDFS-15372: +1 from me. Will commit later. > Files in snapshots no

[jira] [Commented] (HDFS-15402) Requesting http jmx metrics leads to too much CLOSE-WAIT on datanode

[ https://issues.apache.org/jira/browse/HDFS-15402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129509#comment-17129509 ] Wei-Chiu Chuang commented on HDFS-15402: Initially I thought it was broken by HADOOP-15696 (KMS,

[jira] [Commented] (HDFS-15392) DistrbutedFileSystem#concat api can create large number of small blocks

[ https://issues.apache.org/jira/browse/HDFS-15392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17128732#comment-17128732 ] Wei-Chiu Chuang commented on HDFS-15392: A file with lots of blocks is known to slow down. Hadoop

<    1   2   3   4   5   6   7   8   9   10   >