[
https://issues.apache.org/jira/browse/HDFS-14660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14660:
Attachment: (was: HDFS-14660.002.patch)
> [SBN Read] ObserverNameNode should throw StandbyException
Chao Sun created HDFS-14671:
---
Summary: WebHDFS: Add erasureCodingPolicy to ContentSummary
Key: HDFS-14671
URL: https://issues.apache.org/jira/browse/HDFS-14671
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893196#comment-16893196
]
Chao Sun commented on HDFS-14034:
-
Thanks [~xkrogen] for the comments! attached patch v4 to address them.
[
https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14034:
Attachment: HDFS-14034.004.patch
> Support getQuotaUsage API in WebHDFS
>
[
https://issues.apache.org/jira/browse/HDFS-14660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890699#comment-16890699
]
Chao Sun commented on HDFS-14660:
-
Thanks [~ayushtkn] and [~Harsha1206] for the feedback!
[
https://issues.apache.org/jira/browse/HDFS-14660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890315#comment-16890315
]
Chao Sun commented on HDFS-14660:
-
{quote}Now what I think, even if ObserverProxyProvider is set, and the
[
https://issues.apache.org/jira/browse/HDFS-14660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14660:
Attachment: HDFS-14660.001.patch
> [SBN Read] ObserverNameNode should throw StandbyException for requests
[
https://issues.apache.org/jira/browse/HDFS-14660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889832#comment-16889832
]
Chao Sun edited comment on HDFS-14660 at 7/21/19 10:08 PM:
---
{quote}For the
[
https://issues.apache.org/jira/browse/HDFS-14660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889832#comment-16889832
]
Chao Sun commented on HDFS-14660:
-
{quote}*For the special value we may raise separate JIRA.(Just we
[
https://issues.apache.org/jira/browse/HDFS-14660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14660:
Status: Patch Available (was: Open)
Thanks everyone for the discussion! submitted patch v0. Appreciated
[
https://issues.apache.org/jira/browse/HDFS-14660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14660:
Attachment: HDFS-14660.000.patch
> [SBN Read] ObserverNameNode should throw StandbyException for requests
[
https://issues.apache.org/jira/browse/HDFS-14110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved HDFS-14110.
-
Resolution: Duplicate
> NPE when serving http requests while NameNode is starting up
>
[
https://issues.apache.org/jira/browse/HDFS-14647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888361#comment-16888361
]
Chao Sun commented on HDFS-14647:
-
Thanks [~fengnanli]. Resolved mine as duplicate.
> NPE during secure
[
https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888174#comment-16888174
]
Chao Sun commented on HDFS-14034:
-
Test failures are not related. [~jojochuang], [~xkrogen]: can you take
[
https://issues.apache.org/jira/browse/HDFS-14660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888142#comment-16888142
]
Chao Sun commented on HDFS-14660:
-
I think the special value can be handled separately. In this case we
[
https://issues.apache.org/jira/browse/HDFS-14660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887644#comment-16887644
]
Chao Sun commented on HDFS-14660:
-
Oops didn't see the existing JIRA. [~RANith] let me know if you intend
Chao Sun created HDFS-14660:
---
Summary: [SBN Read] ObserverNameNode should throw StandbyException
for requests not from ObserverProxyProvider
Key: HDFS-14660
URL: https://issues.apache.org/jira/browse/HDFS-14660
[
https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14034:
Attachment: HDFS-14034.002.patch
> Support getQuotaUsage API in WebHDFS
>
[
https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887632#comment-16887632
]
Chao Sun commented on HDFS-14034:
-
Attach patch v2 to fix style issue and test failure.
> Support
[
https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14034:
Attachment: HDFS-14034.001.patch
> Support getQuotaUsage API in WebHDFS
>
[
https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880464#comment-16880464
]
Chao Sun commented on HDFS-14034:
-
Thanks [~jojochuang] for taking a look! I think we can incorporate the
[
https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14034:
Status: Patch Available (was: Open)
> Support getQuotaUsage API in WebHDFS
>
[
https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879892#comment-16879892
]
Chao Sun commented on HDFS-14034:
-
Sorry for the delay. Submitted patch v0.
> Support getQuotaUsage API
[
https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14034:
Attachment: HDFS-14034.000.patch
> Support getQuotaUsage API in WebHDFS
>
[
https://issues.apache.org/jira/browse/HDFS-8631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16871520#comment-16871520
]
Chao Sun commented on HDFS-8631:
[~xuel1] are you still working on this? I just noticed this while taking
[
https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16871519#comment-16871519
]
Chao Sun commented on HDFS-14034:
-
Sure. Converted. Didn't notice there's already HDFS-8631. Let me ping
[
https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14034:
Issue Type: Sub-task (was: Improvement)
Parent: HDFS-8629
> Support getQuotaUsage API in WebHDFS
[
https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun reassigned HDFS-14034:
---
Assignee: Chao Sun (was: Erik Krogen)
> Support getQuotaUsage API in WebHDFS
>
[
https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16869731#comment-16869731
]
Chao Sun commented on HDFS-14034:
-
Cool! I'll start work on this early next week. Hope the timeline is
[
https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16869709#comment-16869709
]
Chao Sun commented on HDFS-14034:
-
[~xkrogen]: are you still working on this? do you mind if I take it?
[
https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868816#comment-16868816
]
Chao Sun commented on HDFS-14403:
-
The latest patch v11 LGTM. +1. Although keep in mind that I'm not a
[
https://issues.apache.org/jira/browse/HDFS-14563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868006#comment-16868006
]
Chao Sun commented on HDFS-14563:
-
If every NN reads the file and does the loading, will this still run
[
https://issues.apache.org/jira/browse/HDFS-14563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867996#comment-16867996
]
Chao Sun commented on HDFS-14563:
-
+1 on storing the DN state in a centralized place. However, seems this
[
https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867976#comment-16867976
]
Chao Sun commented on HDFS-14403:
-
Thanks [~xkrogen] for updating the patch. Overall I think it looks
[
https://issues.apache.org/jira/browse/HDFS-14579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867877#comment-16867877
]
Chao Sun commented on HDFS-14579:
-
One (not quite related) issue we've seen is that when refreshing
[
https://issues.apache.org/jira/browse/HDFS-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856080#comment-16856080
]
Chao Sun commented on HDFS-14528:
-
I think the current fix is on the right track. Just two comments as
[
https://issues.apache.org/jira/browse/HDFS-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856071#comment-16856071
]
Chao Sun commented on HDFS-14528:
-
I think the connection refused failure has nothing to do with the
[
https://issues.apache.org/jira/browse/HDFS-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun reassigned HDFS-14528:
---
Assignee: Chao Sun (was: Ravuri Sushma sree)
> [SBN Read]Failover from Active to Standby Failed
[
https://issues.apache.org/jira/browse/HDFS-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun reassigned HDFS-14528:
---
Assignee: Ayush Saxena (was: Chao Sun)
> [SBN Read]Failover from Active to Standby Failed
>
[
https://issues.apache.org/jira/browse/HDFS-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16855939#comment-16855939
]
Chao Sun commented on HDFS-14528:
-
Thanks [~Sushma_28]. This is a good catch. I'm curious why we get the
[
https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16851092#comment-16851092
]
Chao Sun commented on HDFS-14403:
-
Thanks [~xkrogen]. Overall this looks good to me. A few comments:
1.
[
https://issues.apache.org/jira/browse/HDFS-13189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831706#comment-16831706
]
Chao Sun commented on HDFS-13189:
-
[~starphin]. Cool - somehow didn't notice HDFS-14378. Will take a
[
https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831447#comment-16831447
]
Chao Sun commented on HDFS-13522:
-
Thanks [~surendrasingh] for the patch, and [~ayushtkn] for the
[
https://issues.apache.org/jira/browse/HDFS-13189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved HDFS-13189.
-
Resolution: Duplicate
> Standby NameNode should roll active edit log when checkpointing
>
[
https://issues.apache.org/jira/browse/HDFS-13189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831131#comment-16831131
]
Chao Sun commented on HDFS-13189:
-
[~xuzq_zander] this JIRA is duplicated by HDFS-14349. You are welcome
[
https://issues.apache.org/jira/browse/HDFS-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823381#comment-16823381
]
Chao Sun commented on HDFS-14435:
-
+1 from me as well!
> ObserverReadProxyProvider is unable to properly
[
https://issues.apache.org/jira/browse/HDFS-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823227#comment-16823227
]
Chao Sun commented on HDFS-14406:
-
[~xuel1]: I'm still in favor of reusing the existing
[
https://issues.apache.org/jira/browse/HDFS-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822258#comment-16822258
]
Chao Sun commented on HDFS-14406:
-
Thanks [~xuel1] for the update. Instead of adding a new class
[
https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822129#comment-16822129
]
Chao Sun commented on HDFS-14403:
-
Thanks [~cgregori]. I like the way how these two patches getting
[
https://issues.apache.org/jira/browse/HDFS-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16821387#comment-16821387
]
Chao Sun commented on HDFS-14435:
-
Thanks [~xkrogen]! LGTM to me as well except the white space in
[
https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16821375#comment-16821375
]
Chao Sun edited comment on HDFS-14403 at 4/18/19 6:15 PM:
--
Very much looking
[
https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16821375#comment-16821375
]
Chao Sun commented on HDFS-14403:
-
Very much looking forward to this feature as it could help a lot to
[
https://issues.apache.org/jira/browse/HDFS-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16821319#comment-16821319
]
Chao Sun commented on HDFS-14406:
-
Thanks [~xuel1]. A few comments beside the above mentioned:
1. Why
[
https://issues.apache.org/jira/browse/HDFS-14406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16821319#comment-16821319
]
Chao Sun edited comment on HDFS-14406 at 4/18/19 5:15 PM:
--
Thanks [~xuel1]. A
[
https://issues.apache.org/jira/browse/HDFS-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16821280#comment-16821280
]
Chao Sun commented on HDFS-14435:
-
Looks good [~xkrogen]! Just two nits:
1. there's an extra space in
[
https://issues.apache.org/jira/browse/HDFS-14415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811069#comment-16811069
]
Chao Sun commented on HDFS-14415:
-
Another simple backport. [~vagarychen]: can you review this? I cannot
[
https://issues.apache.org/jira/browse/HDFS-14415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14415:
Attachment: HDFS-14415-branch-2.000.patch
> Backport HDFS-13799 to branch-2
>
[
https://issues.apache.org/jira/browse/HDFS-14415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14415:
Status: Patch Available (was: Open)
> Backport HDFS-13799 to branch-2
> ---
>
Chao Sun created HDFS-14415:
---
Summary: Backport HDFS-13799 to branch-2
Key: HDFS-14415
URL: https://issues.apache.org/jira/browse/HDFS-14415
Project: Hadoop HDFS
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/HDFS-14397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808931#comment-16808931
]
Chao Sun commented on HDFS-14397:
-
[~vagarychen] can you take a look at this? All the failed tests are
[
https://issues.apache.org/jira/browse/HDFS-14397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14397:
Attachment: HDFS-14397-branch-2.001.patch
> Backport HADOOP-15684 to branch-2
>
[
https://issues.apache.org/jira/browse/HDFS-14399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16805454#comment-16805454
]
Chao Sun commented on HDFS-14399:
-
Failed tests are passing on my laptop. [~vagarychen]: can you take a
[
https://issues.apache.org/jira/browse/HDFS-14397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16805244#comment-16805244
]
Chao Sun commented on HDFS-14397:
-
Test fails because this needs HDFS-10536. Filed HDFS-14399 and will
[
https://issues.apache.org/jira/browse/HDFS-14399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14399:
Status: Patch Available (was: Open)
> Backport HDFS-10536 to branch-2
> ---
>
[
https://issues.apache.org/jira/browse/HDFS-14399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14399:
Description:
As multi-SBN feature is already backported to branch-2, this is a follow-up to
backport
[
https://issues.apache.org/jira/browse/HDFS-14399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14399:
Attachment: HDFS-14399-branch-2.000.patch
> Backport HDFS-10536 to branch-2
>
Chao Sun created HDFS-14399:
---
Summary: Backport HDFS-10536 to branch-2
Key: HDFS-14399
URL: https://issues.apache.org/jira/browse/HDFS-14399
Project: Hadoop HDFS
Issue Type: Bug
[
https://issues.apache.org/jira/browse/HDFS-14397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14397:
Status: Patch Available (was: Open)
> Backport HADOOP-15684 to branch-2
>
[
https://issues.apache.org/jira/browse/HDFS-14397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14397:
Attachment: HDFS-14397-branch-2.000.patch
> Backport HADOOP-15684 to branch-2
>
Chao Sun created HDFS-14397:
---
Summary: Backport HADOOP-15684 to branch-2
Key: HDFS-14397
URL: https://issues.apache.org/jira/browse/HDFS-14397
Project: Hadoop HDFS
Issue Type: Bug
[
https://issues.apache.org/jira/browse/HDFS-14392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16804141#comment-16804141
]
Chao Sun commented on HDFS-14392:
-
cc [~vagarychen]: the test failures for this also do not seem to be
[
https://issues.apache.org/jira/browse/HDFS-14392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14392:
Attachment: HDFS-14392-branch-2.000.patch
> Backport HDFS-9787 to branch-2
>
[
https://issues.apache.org/jira/browse/HDFS-14392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14392:
Status: Patch Available (was: Open)
> Backport HDFS-9787 to branch-2
> --
>
>
[
https://issues.apache.org/jira/browse/HDFS-14391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803350#comment-16803350
]
Chao Sun commented on HDFS-14391:
-
The failed tests (except {{TestWebHdfsTimeouts}}, which is a known
Chao Sun created HDFS-14392:
---
Summary: Backport HDFS-9787 to branch-2
Key: HDFS-14392
URL: https://issues.apache.org/jira/browse/HDFS-14392
Project: Hadoop HDFS
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/HDFS-14391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14391:
Status: Patch Available (was: Open)
> Backport HDFS-9659 to branch-2
> --
>
>
[
https://issues.apache.org/jira/browse/HDFS-14391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14391:
Attachment: HDFS-14391-branch-2.000.patch
> Backport HDFS-9659 to branch-2
>
Chao Sun created HDFS-14391:
---
Summary: Backport HDFS-9659 to branch-2
Key: HDFS-14391
URL: https://issues.apache.org/jira/browse/HDFS-14391
Project: Hadoop HDFS
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/HDFS-14205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802098#comment-16802098
]
Chao Sun commented on HDFS-14205:
-
Thanks [~vagarychen]! I'll backport the follow-up JIRAs soon.
>
[
https://issues.apache.org/jira/browse/HDFS-14205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795417#comment-16795417
]
Chao Sun commented on HDFS-14205:
-
Thanks [~vagarychen]. I think we need to include the change for #2 and
[
https://issues.apache.org/jira/browse/HDFS-14366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793906#comment-16793906
]
Chao Sun commented on HDFS-14366:
-
Thanks [~elgoiri]! do you think we should backport this to other
[
https://issues.apache.org/jira/browse/HDFS-14366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793785#comment-16793785
]
Chao Sun edited comment on HDFS-14366 at 3/15/19 5:16 PM:
--
[~elgoiri],
[
https://issues.apache.org/jira/browse/HDFS-14366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793785#comment-16793785
]
Chao Sun commented on HDFS-14366:
-
[~elgoiri], [~jojochuang]: can you help to get committed? Thanks.
>
[
https://issues.apache.org/jira/browse/HDFS-14205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16792095#comment-16792095
]
Chao Sun commented on HDFS-14205:
-
[~vagarychen] there are a few things I fixed in the latest patch:
1.
[
https://issues.apache.org/jira/browse/HDFS-14346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14346:
Attachment: HDFS-14346.002.patch
> Better time precision in getTimeDuration
>
[
https://issues.apache.org/jira/browse/HDFS-14346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791842#comment-16791842
]
Chao Sun commented on HDFS-14346:
-
Thanks [~xkrogen]. Attached patch v2 to address the checkstyle issues.
[
https://issues.apache.org/jira/browse/HDFS-14366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791104#comment-16791104
]
Chao Sun commented on HDFS-14366:
-
Thanks [~elgoiri]. Attached patch v1 according to your comments.
>
[
https://issues.apache.org/jira/browse/HDFS-14366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791104#comment-16791104
]
Chao Sun edited comment on HDFS-14366 at 3/12/19 11:57 PM:
---
Thanks [~elgoiri].
[
https://issues.apache.org/jira/browse/HDFS-14366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14366:
Attachment: HDFS-14366.001.patch
> Improve HDFS append performance
> ---
>
>
[
https://issues.apache.org/jira/browse/HDFS-14366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791089#comment-16791089
]
Chao Sun commented on HDFS-14366:
-
Ah I see. I guess maybe not so many people are using {{append}} in
[
https://issues.apache.org/jira/browse/HDFS-14366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791077#comment-16791077
]
Chao Sun commented on HDFS-14366:
-
Thanks [~jojochuang]! Yes similar to HDFS-14171, the issue is again
[
https://issues.apache.org/jira/browse/HDFS-14346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791066#comment-16791066
]
Chao Sun commented on HDFS-14346:
-
Good spot [~xkrogen]. It should be private. I also want to make the
[
https://issues.apache.org/jira/browse/HDFS-14346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14346:
Attachment: HDFS-14346.001.patch
> Better time precision in getTimeDuration
>
[
https://issues.apache.org/jira/browse/HDFS-14366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14366:
Attachment: HDFS-14366.000.patch
> Improve HDFS append performance
> ---
>
>
[
https://issues.apache.org/jira/browse/HDFS-14366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14366:
Attachment: (was: HDFS-14366.000.patch)
> Improve HDFS append performance
>
[
https://issues.apache.org/jira/browse/HDFS-14366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14366:
Affects Version/s: 2.8.2
> Improve HDFS append performance
> ---
>
>
[
https://issues.apache.org/jira/browse/HDFS-14366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791054#comment-16791054
]
Chao Sun commented on HDFS-14366:
-
Attach patch v0 which only calls {{getNumLiveDataNodes}} if the # of
[
https://issues.apache.org/jira/browse/HDFS-14366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14366:
Status: Patch Available (was: Open)
> Improve HDFS append performance
> ---
>
[
https://issues.apache.org/jira/browse/HDFS-14366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14366:
Attachment: HDFS-14366.000.patch
> Improve HDFS append performance
> ---
>
>
[
https://issues.apache.org/jira/browse/HDFS-14366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated HDFS-14366:
Description:
In our HDFS cluster we observed that {{append}} operation can take as much as
10X write lock
201 - 300 of 900 matches
Mail list logo
