[jira] [Commented] (HDFS-13522) Support observer node from Router-Based Federation

2020-09-03 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17190483#comment-17190483 ] Chao Sun commented on HDFS-13522: - [~hemanthboyina] feel free to take over this. I haven'

[jira] [Commented] (HDFS-15516) Add info for create flags in NameNode audit logs

2020-09-15 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196410#comment-17196410 ] Chao Sun commented on HDFS-15516: - I think this makes sense given that we already record

[jira] [Created] (HDFS-15601) Batch listing: gracefully fallback to use non-batched listing when NameNode doesn't support the feature

2020-09-25 Thread Chao Sun (Jira)
Chao Sun created HDFS-15601: --- Summary: Batch listing: gracefully fallback to use non-batched listing when NameNode doesn't support the feature Key: HDFS-15601 URL: https://issues.apache.org/jira/browse/HDFS-15601

[jira] [Commented] (HDFS-14528) [SBN Read]Failover from Active to Standby Failed

2019-06-04 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855939#comment-16855939 ] Chao Sun commented on HDFS-14528: - Thanks [~Sushma_28]. This is a good catch. I'm curious

[jira] [Assigned] (HDFS-14528) [SBN Read]Failover from Active to Standby Failed

2019-06-04 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned HDFS-14528: --- Assignee: Chao Sun (was: Ravuri Sushma sree) > [SBN Read]Failover from Active to Standby Failed >

[jira] [Assigned] (HDFS-14528) [SBN Read]Failover from Active to Standby Failed

2019-06-04 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned HDFS-14528: --- Assignee: Ayush Saxena (was: Chao Sun) > [SBN Read]Failover from Active to Standby Failed > -

[jira] [Commented] (HDFS-14528) [SBN Read]Failover from Active to Standby Failed

2019-06-04 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16856071#comment-16856071 ] Chao Sun commented on HDFS-14528: - I think the connection refused failure has nothing to

[jira] [Commented] (HDFS-14528) [SBN Read]Failover from Active to Standby Failed

2019-06-04 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16856080#comment-16856080 ] Chao Sun commented on HDFS-14528: - I think the current fix is on the right track. Just tw

[jira] [Commented] (HDFS-14579) In refreshNodes, avoid performing a DNS lookup while holding the write lock

2019-06-19 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16867877#comment-16867877 ] Chao Sun commented on HDFS-14579: - One (not quite related) issue we've seen is that when

[jira] [Commented] (HDFS-14403) Cost-Based RPC FairCallQueue

2019-06-19 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16867976#comment-16867976 ] Chao Sun commented on HDFS-14403: - Thanks [~xkrogen] for updating the patch. Overall I th

[jira] [Commented] (HDFS-14563) Enhance interface about recommissioning/decommissioning

2019-06-19 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16867996#comment-16867996 ] Chao Sun commented on HDFS-14563: - +1 on storing the DN state in a centralized place. How

[jira] [Commented] (HDFS-14563) Enhance interface about recommissioning/decommissioning

2019-06-19 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16868006#comment-16868006 ] Chao Sun commented on HDFS-14563: - If every NN reads the file and does the loading, will

[jira] [Commented] (HDFS-14403) Cost-Based RPC FairCallQueue

2019-06-20 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16868816#comment-16868816 ] Chao Sun commented on HDFS-14403: - The latest patch v11 LGTM. +1. Although keep in mind t

[jira] [Commented] (HDFS-14034) Support getQuotaUsage API in WebHDFS

2019-06-21 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16869709#comment-16869709 ] Chao Sun commented on HDFS-14034: - [~xkrogen]: are you still working on this? do you mind

[jira] [Commented] (HDFS-14034) Support getQuotaUsage API in WebHDFS

2019-06-21 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16869731#comment-16869731 ] Chao Sun commented on HDFS-14034: - Cool! I'll start work on this early next week. Hope th

[jira] [Assigned] (HDFS-14034) Support getQuotaUsage API in WebHDFS

2019-06-21 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned HDFS-14034: --- Assignee: Chao Sun (was: Erik Krogen) > Support getQuotaUsage API in WebHDFS >

[jira] [Updated] (HDFS-14034) Support getQuotaUsage API in WebHDFS

2019-06-24 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-14034: Issue Type: Sub-task (was: Improvement) Parent: HDFS-8629 > Support getQuotaUsage API in WebHDFS >

[jira] [Commented] (HDFS-14034) Support getQuotaUsage API in WebHDFS

2019-06-24 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16871519#comment-16871519 ] Chao Sun commented on HDFS-14034: - Sure. Converted. Didn't notice there's already HDFS-86

[jira] [Commented] (HDFS-8631) WebHDFS : Support get/setQuota

2019-06-24 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16871520#comment-16871520 ] Chao Sun commented on HDFS-8631: [~xuel1] are you still working on this? I just noticed th

[jira] [Commented] (HDFS-10702) Add a Client API and Proxy Provider to enable stale read from Standby

2017-09-05 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154494#comment-16154494 ] Chao Sun commented on HDFS-10702: - Thanks [~clouderajiayi] and [~mackrorysd] for this grea

[jira] [Created] (HDFS-12669) Implement toString() for EditLogInputStream

2017-10-16 Thread Chao Sun (JIRA)
Chao Sun created HDFS-12669: --- Summary: Implement toString() for EditLogInputStream Key: HDFS-12669 URL: https://issues.apache.org/jira/browse/HDFS-12669 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-12669) Implement toString() for EditLogInputStream

2017-10-16 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16206604#comment-16206604 ] Chao Sun commented on HDFS-12669: - I want to assign this to myself and start contributing

[jira] [Assigned] (HDFS-12669) Implement toString() for EditLogInputStream

2017-10-17 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned HDFS-12669: --- Assignee: Chao Sun > Implement toString() for EditLogInputStream > --

[jira] [Commented] (HDFS-12669) Implement toString() for EditLogInputStream

2017-10-17 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16208250#comment-16208250 ] Chao Sun commented on HDFS-12669: - Thanks [~andrew.wang]! > Implement toString() for Edit

[jira] [Created] (HDFS-12836) startTxId could be greater than endTxId when tailing in-progress edit log

2017-11-17 Thread Chao Sun (JIRA)
Chao Sun created HDFS-12836: --- Summary: startTxId could be greater than endTxId when tailing in-progress edit log Key: HDFS-12836 URL: https://issues.apache.org/jira/browse/HDFS-12836 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12836) startTxId could be greater than endTxId when tailing in-progress edit log

2017-11-20 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16259891#comment-16259891 ] Chao Sun commented on HDFS-12836: - This issue happens when not all NNs in the cluster enab

[jira] [Updated] (HDFS-12836) startTxId could be greater than endTxId when tailing in-progress edit log

2017-11-21 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12836: Attachment: HDFS-12836.1.patch Thanks [~jojochuang]. I attached a patch with a test case. It would be great

[jira] [Updated] (HDFS-12836) startTxId could be greater than endTxId when tailing in-progress edit log

2017-11-22 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12836: Attachment: HDFS-12836.2.patch Thanks [~jojochuang]. Yes I think this is a good suggestion. Uploaded patch v

[jira] [Updated] (HDFS-12836) startTxId could be greater than endTxId when tailing in-progress edit log

2017-11-22 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12836: Status: Patch Available (was: Open) > startTxId could be greater than endTxId when tailing in-progress edit

[jira] [Commented] (HDFS-12836) startTxId could be greater than endTxId when tailing in-progress edit log

2017-11-27 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16267719#comment-16267719 ] Chao Sun commented on HDFS-12836: - Doesn't look like the test failures are related. [~jojo

[jira] [Updated] (HDFS-12836) startTxId could be greater than endTxId when tailing in-progress edit log

2017-11-29 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12836: Attachment: HDFS-12836.3.patch Thanks [~jojochuang]. Attaching patch v3 to address the checkstyle issue. >

[jira] [Commented] (HDFS-12836) startTxId could be greater than endTxId when tailing in-progress edit log

2017-11-29 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16271923#comment-16271923 ] Chao Sun commented on HDFS-12836: - [~jojochuang] The checkstyle passed but there are some

[jira] [Commented] (HDFS-12836) startTxId could be greater than endTxId when tailing in-progress edit log

2017-12-01 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16274879#comment-16274879 ] Chao Sun commented on HDFS-12836: - Thanks [~jojochuang] for the review! > startTxId could

[jira] [Created] (HDFS-12932) Confusing LOG message for block replication

2017-12-15 Thread Chao Sun (JIRA)
Chao Sun created HDFS-12932: --- Summary: Confusing LOG message for block replication Key: HDFS-12932 URL: https://issues.apache.org/jira/browse/HDFS-12932 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-12932) Confusing LOG message for block replication

2017-12-18 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12932: Attachment: HDFS-12932.0.patch Attaching patch v0 to address the issue. > Confusing LOG message for block r

[jira] [Updated] (HDFS-12932) Confusing LOG message for block replication

2017-12-18 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12932: Status: Patch Available (was: Open) > Confusing LOG message for block replication > ---

[jira] [Updated] (HDFS-12932) Confusing LOG message for block replication

2017-12-18 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12932: Attachment: HDFS-12932.1.patch Thanks [~vagarychen] for taking a look! Yes I agree it's probably better to

[jira] [Updated] (HDFS-12932) Confusing LOG message for block replication

2017-12-18 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12932: Attachment: (was: HDFS-12932.1.patch) > Confusing LOG message for block replication > --

[jira] [Updated] (HDFS-12932) Confusing LOG message for block replication

2017-12-18 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12932: Attachment: HDFS-12932.1.patch Re-attaching patch v1 to trigger jenkins. > Confusing LOG message for block

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

2017-12-19 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16297979#comment-16297979 ] Chao Sun commented on HDFS-12943: - [~chris.douglas] I did some experiment with the POC pat

[jira] [Commented] (HDFS-12932) Fix confusing LOG message for block replication

2017-12-20 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298819#comment-16298819 ] Chao Sun commented on HDFS-12932: - Thanks [~vagarychen] and [~ywskycn] for reviewing the p

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

2017-12-20 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298876#comment-16298876 ] Chao Sun commented on HDFS-12943: - bq. Thanks Chao Sun, interesting results! You used only

[jira] [Commented] (HDFS-15664) Prevent Observer NameNode from becoming StandBy NameNode

2020-11-02 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17224933#comment-17224933 ] Chao Sun commented on HDFS-15664: - [~aihuaxu] seems this is already fixed by HDFS-14961?

[jira] [Commented] (HDFS-15467) ObserverReadProxyProvider should skip logging first failover from each proxy

2020-11-10 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17229596#comment-17229596 ] Chao Sun commented on HDFS-15467: - [~aihuaxu] yes {{msync}} relies on the upper-level ret

[jira] [Updated] (HDFS-15469) Dynamically configure the size of PacketReceiver#MAX_PACKET_SIZE

2020-11-10 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-15469: Fix Version/s: 3.4.0 > Dynamically configure the size of PacketReceiver#MAX_PACKET_SIZE > -

[jira] [Updated] (HDFS-15469) Dynamically configure the size of PacketReceiver#MAX_PACKET_SIZE

2020-11-10 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-15469: Resolution: Fixed Status: Resolved (was: Patch Available) > Dynamically configure the size of Pack

[jira] [Commented] (HDFS-15467) ObserverReadProxyProvider should skip logging first failover from each proxy

2020-11-13 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17231721#comment-17231721 ] Chao Sun commented on HDFS-15467: - [~aihuaxu] Yes. ObserverReadProxyProvider does have it

[jira] [Resolved] (HDFS-15690) Add lz4-java as hadoop-hdfs test dependency

2020-11-21 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved HDFS-15690. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk. I'll backpo

[jira] [Commented] (HDFS-15690) Add lz4-java as hadoop-hdfs test dependency

2020-11-21 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17236836#comment-17236836 ] Chao Sun commented on HDFS-15690: - [~ayushtkn], [~ste...@apache.org] can you help to add

[jira] [Assigned] (HDFS-15708) TestURLConnectionFactory fails by NoClassDefFoundError in branch-3.3 and branch-3.2

2020-12-03 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned HDFS-15708: --- Assignee: Chao Sun > TestURLConnectionFactory fails by NoClassDefFoundError in branch-3.3 and > bra

[jira] [Resolved] (HDFS-15708) TestURLConnectionFactory fails by NoClassDefFoundError in branch-3.3 and branch-3.2

2020-12-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved HDFS-15708. - Fix Version/s: 3.3.1 3.2.2 Hadoop Flags: Reviewed Resolution: Fixed > Test

[jira] [Updated] (HDFS-15690) Add lz4-java as hadoop-hdfs test dependency

2020-12-29 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-15690: Fix Version/s: 3.3.1 > Add lz4-java as hadoop-hdfs test dependency > --

[jira] [Commented] (HDFS-15751) Add documentation for msync() API to filesystem.md

2020-12-30 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17256656#comment-17256656 ] Chao Sun commented on HDFS-15751: - I agree with [~hexiaoqiao] and think we can mention th

[jira] [Updated] (HDFS-15756) [RBF] Cannot get updated delegation token from zookeeper

2020-12-30 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-15756: Summary: [RBF] Cannot get updated delegation token from zookeeper (was: [RBF]Cannot get updated delegation

[jira] [Commented] (HDFS-15756) RBF: Cannot get updated delegation token from zookeeper

2020-12-31 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17257097#comment-17257097 ] Chao Sun commented on HDFS-15756: - cc [~fengnanli] > RBF: Cannot get updated delegation

[jira] [Commented] (HDFS-15751) Add documentation for msync() API to filesystem.md

2021-01-02 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17257335#comment-17257335 ] Chao Sun commented on HDFS-15751: - Thanks [~hexiaoqiao]! IMO the preconditions section sh

[jira] [Commented] (HDFS-15751) Add documentation for msync() API to filesystem.md

2021-01-02 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17257429#comment-17257429 ] Chao Sun commented on HDFS-15751: - +1 on patch v3. Thanks again [~hexiaoqiao] and [~shv]!

[jira] [Resolved] (HDFS-15754) Create packet metrics for DataNode

2021-01-07 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved HDFS-15754. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Create packet metrics for Dat

[jira] [Assigned] (HDFS-13522) RBF: Support observer node from Router-Based Federation

2021-06-18 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned HDFS-13522: --- Assignee: (was: Chao Sun) > RBF: Support observer node from Router-Based Federation > --

[jira] [Updated] (HDFS-16315) Add metrics related to Transfer and NativeCopy for DataNode

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16315: Fix Version/s: 3.3.2 (was: 3.3.3) > Add metrics related to Transfer and NativeCopy f

[jira] [Updated] (HDFS-16323) DatanodeHttpServer doesn't require handler state map while retrieving filter handlers

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16323: Fix Version/s: 3.3.2 (was: 3.3.3) > DatanodeHttpServer doesn't require handler state

[jira] [Updated] (HDFS-16329) Fix log format for BlockManager

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16329: Fix Version/s: 3.3.2 (was: 3.3.3) > Fix log format for BlockManager > --

[jira] [Updated] (HDFS-16326) Simplify the code for DiskBalancer

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16326: Fix Version/s: 3.3.2 (was: 3.3.3) > Simplify the code for DiskBalancer > ---

[jira] [Updated] (HDFS-16330) Fix incorrect placeholder for Exception logs in DiskBalancer

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16330: Fix Version/s: 3.3.2 (was: 3.3.3) > Fix incorrect placeholder for Exception logs in

[jira] [Updated] (HDFS-16328) Correct disk balancer param desc

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16328: Fix Version/s: 3.3.2 (was: 3.3.3) > Correct disk balancer param desc > -

[jira] [Updated] (HDFS-16334) Correct NameNode ACL description

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16334: Fix Version/s: 3.3.2 (was: 3.3.3) > Correct NameNode ACL description > -

[jira] [Updated] (HDFS-16335) Fix HDFSCommands.md

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16335: Fix Version/s: 3.3.2 (was: 3.3.3) > Fix HDFSCommands.md > --- > >

[jira] [Updated] (HDFS-16337) Show start time of Datanode on Web

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16337: Fix Version/s: 3.3.2 (was: 3.3.3) > Show start time of Datanode on Web > ---

[jira] [Updated] (HDFS-16343) Add some debug logs when the dfsUsed are not used during Datanode startup

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16343: Fix Version/s: 3.3.2 (was: 3.3.3) > Add some debug logs when the dfsUsed are not use

[jira] [Updated] (HDFS-16409) Fix typo: testHasExeceptionsReturnsCorrectValue -> testHasExceptionsReturnsCorrectValue

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16409: Fix Version/s: 3.3.2 (was: 3.3.3) > Fix typo: testHasExeceptionsReturnsCorrectValue

[jira] [Updated] (HDFS-14099) Unknown frame descriptor when decompressing multiple frames in ZStandardDecompressor

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-14099: Fix Version/s: 3.3.2 (was: 3.3.3) > Unknown frame descriptor when decompressing mult

[jira] [Updated] (HDFS-16395) Remove useless NNThroughputBenchmark#dummyActionNoSynch()

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16395: Fix Version/s: 3.3.2 (was: 3.3.3) > Remove useless NNThroughputBenchmark#dummyAction

[jira] [Updated] (HDFS-16386) Reduce DataNode load when FsDatasetAsyncDiskService is working

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16386: Fix Version/s: 3.3.2 (was: 3.3.3) > Reduce DataNode load when FsDatasetAsyncDiskServ

[jira] [Updated] (HDFS-16391) Avoid evaluation of LOG.debug statement in NameNodeHeartbeatService

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16391: Fix Version/s: 3.3.2 (was: 3.3.3) > Avoid evaluation of LOG.debug statement in NameN

[jira] [Updated] (HDFS-16327) Make dfs.namenode.max.slowpeer.collect.nodes reconfigurable

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16327: Fix Version/s: 3.3.2 (was: 3.3.3) > Make dfs.namenode.max.slowpeer.collect.nodes rec

[jira] [Updated] (HDFS-16377) Should CheckNotNull before access FsDatasetSpi

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16377: Fix Version/s: 3.3.2 (was: 3.3.3) > Should CheckNotNull before access FsDatasetSpi >

[jira] [Updated] (HDFS-16373) Fix MiniDFSCluster restart in case of multiple namenodes

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16373: Fix Version/s: 3.3.2 (was: 3.3.3) > Fix MiniDFSCluster restart in case of multiple n

[jira] [Updated] (HDFS-16375) The FBR lease ID should be exposed to the log

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16375: Fix Version/s: 3.3.2 (was: 3.3.3) > The FBR lease ID should be exposed to the log >

[jira] [Updated] (HDFS-16333) fix balancer bug when transfer an EC block

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16333: Fix Version/s: 3.3.2 (was: 3.3.3) > fix balancer bug when transfer an EC block > ---

[jira] [Updated] (HDFS-16345) Fix test cases fail in TestBlockStoragePolicy

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16345: Fix Version/s: 3.3.2 (was: 3.3.3) > Fix test cases fail in TestBlockStoragePolicy >

[jira] [Updated] (HDFS-15862) Make TestViewfsWithNfs3.testNfsRenameSingleNN() idempotent

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-15862: Fix Version/s: 3.3.2 (was: 3.3.3) > Make TestViewfsWithNfs3.testNfsRenameSingleNN()

[jira] [Updated] (HDFS-16293) Client sleeps and holds 'dataQueue' when DataNodes are congested

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16293: Fix Version/s: 3.3.2 (was: 3.3.3) > Client sleeps and holds 'dataQueue' when DataNod

[jira] [Updated] (HDFS-16268) Balancer stuck when moving striped blocks due to NPE

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16268: Fix Version/s: 3.3.2 (was: 3.3.3) > Balancer stuck when moving striped blocks due to

[jira] [Updated] (HDFS-16287) Support to make dfs.namenode.avoid.read.slow.datanode reconfigurable

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16287: Fix Version/s: 3.3.2 (was: 3.3.3) > Support to make dfs.namenode.avoid.read.slow.dat

[jira] [Updated] (HDFS-16314) Support to make dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable

2022-01-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16314: Fix Version/s: 3.3.2 (was: 3.3.3) > Support to make > dfs.namenode.block-placement-

[jira] [Updated] (HDFS-16408) Ensure LeaseRecheckIntervalMs is greater than zero

2022-01-05 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16408: Fix Version/s: 3.3.2 (was: 3.3.3) > Ensure LeaseRecheckIntervalMs is greater than ze

[jira] [Resolved] (HDFS-16410) Insecure Xml parsing in OfflineEditsXmlLoader

2022-01-05 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved HDFS-16410. - Fix Version/s: 3.4.0 3.3.2 Resolution: Fixed > Insecure Xml parsing in OfflineE

[jira] [Updated] (HDFS-16420) Avoid deleting unique data blocks when deleting redundancy striped blocks

2022-01-14 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16420: Fix Version/s: 3.3.2 (was: 3.3.3) > Avoid deleting unique data blocks when deleting

[jira] [Commented] (HDFS-16420) Avoid deleting unique data blocks when deleting redundancy striped blocks

2022-01-14 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476281#comment-17476281 ] Chao Sun commented on HDFS-16420: - [~tasanuma] done > Avoid deleting unique data blocks

[jira] [Updated] (HDFS-16339) Show the threshold when mover threads quota is exceeded

2022-02-14 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16339: Fix Version/s: 3.3.2 (was: 3.3.3) > Show the threshold when mover threads quota is e

[jira] [Updated] (HDFS-16171) De-flake testDecommissionStatus

2022-02-14 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16171: Fix Version/s: 3.3.2 (was: 3.3.3) > De-flake testDecommissionStatus > --

[jira] [Updated] (HDFS-16350) Datanode start time should be set after RPC server starts successfully

2022-02-14 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16350: Fix Version/s: 3.3.2 (was: 3.3.3) > Datanode start time should be set after RPC serv

[jira] [Updated] (HDFS-16336) De-flake TestRollingUpgrade#testRollback

2022-02-14 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16336: Fix Version/s: 3.3.2 (was: 3.3.3) > De-flake TestRollingUpgrade#testRollback > -

[jira] [Updated] (HDFS-16332) Expired block token causes slow read due to missing handling in sasl handshake

2022-02-14 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16332: Fix Version/s: 3.3.2 (was: 3.3.3) > Expired block token causes slow read due to miss

[jira] [Updated] (HDFS-16344) Improve DirectoryScanner.Stats#toString

2022-02-14 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16344: Fix Version/s: 3.3.2 (was: 3.3.3) > Improve DirectoryScanner.Stats#toString > --

[jira] [Updated] (HDFS-16271) RBF: NullPointerException when setQuota through routers with quota disabled

2022-02-14 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16271: Fix Version/s: 3.3.2 (was: 3.3.1) > RBF: NullPointerException when setQuota through

[jira] [Resolved] (HDFS-16507) [SBN read] Avoid purging edit log which is in progress

2022-03-30 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved HDFS-16507. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > [SBN read] Avoid purging edit

[jira] [Updated] (HDFS-16507) [SBN read] Avoid purging edit log which is in progress

2022-03-30 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16507: Fix Version/s: 3.3.3 > [SBN read] Avoid purging edit log which is in progress > ---

[jira] [Updated] (HDFS-16507) [SBN read] Avoid purging edit log which is in progress

2022-03-30 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-16507: Fix Version/s: 3.2.4 > [SBN read] Avoid purging edit log which is in progress > ---

[jira] [Updated] (HDFS-15965) Please upgrade the log4j dependency to log4j2

2021-11-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-15965: Target Version/s: 3.4.0, 3.3.3 (was: 3.4.0, 3.3.2) > Please upgrade the log4j dependency to log4j2 > -

<    1   2   3   4   5   6   7   8   9   10   >