[jira] [Updated] (HDFS-16000) HDFS : Rename performance optimization

sues.apache.org/jira/browse/HDFS-16000 > Project: Hadoop HDFS > Issue Type: Improvement > Components: hdfs, namenode >Affects Versions: 3.1.4, 3.3.1 >Reporter: zhu >Assignee: zhu >Priority: Major >

[jira] [Updated] (HDFS-16000) HDFS : Rename performance optimization

sues.apache.org/jira/browse/HDFS-16000 > Project: Hadoop HDFS > Issue Type: Improvement > Components: hdfs, namenode >Affects Versions: 3.1.4, 3.3.1 >Reporter: zhu >Assignee: zhu >Priority: Major > Att

[jira] [Updated] (HDFS-16000) HDFS : Rename performance optimization

zhu >Assignee: zhu >Priority: Major > Attachments: 20210428-143238.svg, 20210428-171635-lambda.svg, > HDFS-16000 > > > It takes a long time to move a large directory with rename. For example, it > takes about 40 seconds to move a 1000W directory.

[jira] [Updated] (HDFS-16000) HDFS : Rename performance optimization

oject: Hadoop HDFS > Issue Type: Improvement > Components: hdfs, namenode >Affects Versions: 3.1.4, 3.3.1 >Reporter: zhu >Assignee: zhu >Priority: Major > Attachments: 20210428-143238.svg, 20210428-171635-lambda.svg, &

[jira] [Updated] (HDFS-16000) HDFS : Rename performance optimization

oject: Hadoop HDFS > Issue Type: Improvement > Components: hdfs, namenode >Affects Versions: 3.1.4, 3.3.1 >Reporter: zhu >Assignee: zhu >Priority: Major > Attachments: 20210428-143238.svg, 20210428-171635-lambda.svg, &

[jira] [Updated] (HDFS-16000) HDFS : Rename performance optimization

Project: Hadoop HDFS > Issue Type: Improvement > Components: hdfs, namenode >Affects Versions: 3.1.4, 3.3.1 >Reporter: zhu >Assignee: zhu >Priority: Major > Attachments: 20210428-143238.svg, 20210428-171635-lambda.

[jira] [Updated] (HDFS-16000) HDFS : Rename performance optimization

s, namenode >Affects Versions: 3.1.4, 3.3.1 >Reporter: zhu >Assignee: zhu >Priority: Major > Attachments: 20210428-143238.svg, 20210428-171635-lambda.svg, > HDFS-16000.patch > > > It takes a long time to move a large direc

[jira] [Commented] (HDFS-15247) RBF: Provide Non DFS Used per DataNode in DataNode UI

[ https://issues.apache.org/jira/browse/HDFS-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17334621#comment-17334621 ] Takanobu Asanuma commented on HDFS-15247: - Cherry-picked to branch-3.3. > RBF: Provide Non DFS

[jira] [Commented] (HDFS-15358) RBF: Unify router datanode UI with namenode datanode UI

[ https://issues.apache.org/jira/browse/HDFS-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17334622#comment-17334622 ] Takanobu Asanuma commented on HDFS-15358: - Cherry-picked to branch-3.3. > RBF: Unify router

[jira] [Updated] (HDFS-15247) RBF: Provide Non DFS Used per DataNode in DataNode UI

[ https://issues.apache.org/jira/browse/HDFS-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15247: Fix Version/s: 3.3.1 > RBF: Provide Non DFS Used per DataNode in DataNode UI >

[jira] [Commented] (HDFS-15698) Fix the typo of dfshealth.html after HDFS-15358

[ https://issues.apache.org/jira/browse/HDFS-15698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17334623#comment-17334623 ] Takanobu Asanuma commented on HDFS-15698: - Cherry-picked to branch-3.3. > Fix the typo of

[jira] [Updated] (HDFS-15358) RBF: Unify router datanode UI with namenode datanode UI

[ https://issues.apache.org/jira/browse/HDFS-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15358: Fix Version/s: 3.3.1 > RBF: Unify router datanode UI with namenode datanode UI >

[jira] [Updated] (HDFS-15698) Fix the typo of dfshealth.html after HDFS-15358

[ https://issues.apache.org/jira/browse/HDFS-15698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15698: Fix Version/s: 3.3.1 > Fix the typo of dfshealth.html after HDFS-15358 >

[jira] [Updated] (HDFS-16000) HDFS : Rename performance optimization

oject: Hadoop HDFS > Issue Type: Improvement > Components: hdfs, namenode >Affects Versions: 3.1.4, 3.3.1 >Reporter: zhu >Assignee: zhu >Priority: Major > Attachments: 20210428-143238.svg, 20210428-171635-lambda.svg, &

[jira] [Updated] (HDFS-16000) HDFS : Rename performance optimization

oject: Hadoop HDFS > Issue Type: Improvement > Components: hdfs, namenode >Affects Versions: 3.1.4, 3.3.1 >Reporter: zhu >Assignee: zhu >Priority: Major > Attachments: 20210428-143238.svg, 20210428-171635-lambda.

[jira] [Updated] (HDFS-16000) HDFS : Rename performance optimization

ira/browse/HDFS-16000 > Project: Hadoop HDFS > Issue Type: Improvement > Components: hdfs, namenode >Affects Versions: 3.1.4, 3.3.1 >Reporter: zhu >Assignee: zhu >Priority: Major > Attachments: 20210428

[jira] [Commented] (HDFS-15968) Improve the log for The DecayRpcScheduler

[ https://issues.apache.org/jira/browse/HDFS-15968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17334533#comment-17334533 ] Akira Ajisaka commented on HDFS-15968: -- Umm, it is weird. Kicked

[jira] [Updated] (HDFS-15991) Add location into datanode info for NameNodeMXBean

[ https://issues.apache.org/jira/browse/HDFS-15991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15991: Fix Version/s: 3.3.1 > Add location into datanode info for NameNodeMXBean >

[jira] [Commented] (HDFS-15991) Add location into datanode info for NameNodeMXBean

[ https://issues.apache.org/jira/browse/HDFS-15991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17334625#comment-17334625 ] Takanobu Asanuma commented on HDFS-15991: - Cherry-picked to branch-3.3. > Add location into

[jira] [Created] (HDFS-16000) HDFS : Rename performance optimization

once. Reporter: zhu Assignee: zhu Attachments: 20210428-143238.svg, 20210428-171635-lambda.svg -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues

[jira] [Updated] (HDFS-16000) HDFS : Rename performance optimization

ter: zhu >Assignee: zhu >Priority: Major > Attachments: 20210428-143238.svg, 20210428-171635-lambda.svg, > HDFS-16000.patch > > > It takes a long time to move a large directory with rename. For example, it > takes about 40 seconds

[jira] [Updated] (HDFS-16000) HDFS : Rename performance optimization

zhu >Assignee: zhu >Priority: Major > Attachments: 20210428-143238.svg, 20210428-171635-lambda.svg, > HDFS-16000.patch > > > It takes a long time to move a large directory with rename. For example, it > takes about 40 seconds to move a 1000

[jira] [Work logged] (HDFS-15982) Deleted data using HTTP API should be saved to the trash

[ https://issues.apache.org/jira/browse/HDFS-15982?focusedWorklogId=590266=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-590266 ] ASF GitHub Bot logged work on HDFS-15982: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15982) Deleted data using HTTP API should be saved to the trash

[ https://issues.apache.org/jira/browse/HDFS-15982?focusedWorklogId=590267=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-590267 ] ASF GitHub Bot logged work on HDFS-15982: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16000) HDFS : Rename performance optimization

oject: Hadoop HDFS > Issue Type: Improvement > Components: hdfs, namenode >Affects Versions: 3.1.4, 3.3.1 >Reporter: zhu >Assignee: zhu >Priority: Major > Attachments: 20210428-143238.svg, 20210428-171635-lambda.

[jira] [Updated] (HDFS-16000) HDFS : Rename performance optimization

Project: Hadoop HDFS > Issue Type: Improvement > Components: hdfs, namenode >Affects Versions: 3.1.4, 3.3.1 >Reporter: zhu >Assignee: zhu >Priority: Major > Attachments: 20210428-143238.svg, 20210428-171635-lambda.

[jira] [Updated] (HDFS-16000) HDFS : Rename performance optimization

Project: Hadoop HDFS > Issue Type: Improvement > Components: hdfs, namenode >Affects Versions: 3.1.4, 3.3.1 >Reporter: zhu >Assignee: zhu >Priority: Major > Attachments: 20210428-143238.svg, 20210428

[jira] [Updated] (HDFS-16000) HDFS : Rename performance optimization

Project: Hadoop HDFS > Issue Type: Improvement > Components: hdfs, namenode >Affects Versions: 3.1.4, 3.3.1 >Reporter: zhu >Assignee: zhu >Priority: Major > Attachments: 20210428-143238.svg, 20210428

[jira] [Updated] (HDFS-16000) HDFS : Rename performance optimization

oject: Hadoop HDFS > Issue Type: Improvement > Components: hdfs, namenode >Affects Versions: 3.1.4, 3.3.1 >Reporter: zhu >Assignee: zhu >Priority: Major > Attachments: 20210428-143238.svg, 20210428-171635-lambda.svg, &

[jira] [Updated] (HDFS-16000) HDFS : Rename performance optimization

apache.org/jira/browse/HDFS-16000 > Project: Hadoop HDFS > Issue Type: Improvement > Components: hdfs, namenode >Affects Versions: 3.1.4, 3.3.1 >Reporter: zhu >Assignee: zhu >Priority: Major > Att

[jira] [Work logged] (HDFS-15982) Deleted data using HTTP API should be saved to the trash

[ https://issues.apache.org/jira/browse/HDFS-15982?focusedWorklogId=590706=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-590706 ] ASF GitHub Bot logged work on HDFS-15982: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-7612) TestOfflineEditsViewer.testStored() uses incorrect default value for cacheDir

[ https://issues.apache.org/jira/browse/HDFS-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7612: -- Labels: newbie (was: ) > TestOfflineEditsViewer.testStored() uses incorrect default

[jira] [Commented] (HDFS-7612) TestOfflineEditsViewer.testStored() uses incorrect default value for cacheDir

[ https://issues.apache.org/jira/browse/HDFS-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17335043#comment-17335043 ] Konstantin Shvachko commented on HDFS-7612: --- Came across this again. Still not fixed. We just

[jira] [Updated] (HDFS-16001) TestOfflineEditsViewer.testStored() fails reading negative value of FSEditLogOpCodes

[ https://issues.apache.org/jira/browse/HDFS-16001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-16001: --- Docs Text: (was: {{TestOfflineEditsViewer.testStored()}} fails consistently with

[jira] [Created] (HDFS-16001) TestOfflineEditsViewer.testStored() fails reading negative value of FSEditLogOpCodes

Konstantin Shvachko created HDFS-16001: -- Summary: TestOfflineEditsViewer.testStored() fails reading negative value of FSEditLogOpCodes Key: HDFS-16001 URL: https://issues.apache.org/jira/browse/HDFS-16001

[jira] [Commented] (HDFS-16001) TestOfflineEditsViewer.testStored() fails reading negative value of FSEditLogOpCodes

[ https://issues.apache.org/jira/browse/HDFS-16001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17335051#comment-17335051 ] Konstantin Shvachko commented on HDFS-16001: This fails consistently on trunk but not in

[jira] [Updated] (HDFS-15915) Race condition with async edits logging due to updating txId outside of the namesystem log

[ https://issues.apache.org/jira/browse/HDFS-15915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-15915: --- Attachment: HDFS-15915-02.patch > Race condition with async edits logging due to

[jira] [Commented] (HDFS-15915) Race condition with async edits logging due to updating txId outside of the namesystem log

[ https://issues.apache.org/jira/browse/HDFS-15915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17335052#comment-17335052 ] Konstantin Shvachko commented on HDFS-15915: Patch v.02 fixes findbugs and white space

[jira] [Work logged] (HDFS-16000) HDFS : Rename performance optimization

sue Type: Improvement > Components: hdfs, namenode >Affects Versions: 3.1.4, 3.3.1 >Reporter: zhu >Assignee: zhu >Priority: Major > Attachments: 20210428-143238.svg, 20210428-171635-lambda.svg, > HDFS-16000.patch > >

[jira] [Updated] (HDFS-16000) HDFS : Rename performance optimization

ects Versions: 3.1.4, 3.3.1 >Reporter: zhu >Assignee: zhu >Priority: Major > Labels: pull-request-available > Attachments: 20210428-143238.svg, 20210428-171635-lambda.svg, > HDFS-16000.patch > > Time Spent: 10m > Remaining

[jira] [Updated] (HDFS-15915) Race condition with async edits logging due to updating txId outside of the namesystem log

[ https://issues.apache.org/jira/browse/HDFS-15915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-15915: --- Status: Patch Available (was: Open) > Race condition with async edits logging due

[jira] [Updated] (HDFS-15915) Race condition with async edits logging due to updating txId outside of the namesystem log

[ https://issues.apache.org/jira/browse/HDFS-15915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-15915: --- Attachment: HDFS-15915-01.patch > Race condition with async edits logging due to

[jira] [Assigned] (HDFS-15915) Race condition with async edits logging due to updating txId outside of the namesystem log

[ https://issues.apache.org/jira/browse/HDFS-15915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko reassigned HDFS-15915: -- Assignee: Konstantin Shvachko > Race condition with async edits logging due

[jira] [Work logged] (HDFS-15982) Deleted data using HTTP API should be saved to the trash

[ https://issues.apache.org/jira/browse/HDFS-15982?focusedWorklogId=590186=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-590186 ] ASF GitHub Bot logged work on HDFS-15982: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15915) Race condition with async edits logging due to updating txId outside of the namesystem log

[ https://issues.apache.org/jira/browse/HDFS-15915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17334483#comment-17334483 ] Konstantin Shvachko commented on HDFS-15915: Attaching a patch to fix the problem. The is a

[jira] [Commented] (HDFS-15968) Improve the log for The DecayRpcScheduler

[ https://issues.apache.org/jira/browse/HDFS-15968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17334658#comment-17334658 ] Hadoop QA commented on HDFS-15968: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-16000) HDFS : Rename performance optimization

ects Versions: 3.1.4, 3.3.1 >Reporter: zhu >Assignee: zhu >Priority: Major > Attachments: 20210428-143238.svg, 20210428-171635-lambda.svg, > HDFS-16000.patch > > > It takes a long time to move a large directory with rename. For example, it

[jira] [Commented] (HDFS-15915) Race condition with async edits logging due to updating txId outside of the namesystem log

[ https://issues.apache.org/jira/browse/HDFS-15915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17334679#comment-17334679 ] Hadoop QA commented on HDFS-15915: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15652) Make block size from NNThroughputBenchmark configurable

[ https://issues.apache.org/jira/browse/HDFS-15652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17335066#comment-17335066 ] Konstantin Shvachko commented on HDFS-15652: I would like to backport this to earlier

[jira] [Work logged] (HDFS-15561) RBF: Fix NullPointException when start dfsrouter

[ https://issues.apache.org/jira/browse/HDFS-15561?focusedWorklogId=590839=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-590839 ] ASF GitHub Bot logged work on HDFS-15561: - Author: ASF GitHub Bot