[jira] [Updated] (HDFS-15498) Show snapshots deletion status in snapList cmd

[ https://issues.apache.org/jira/browse/HDFS-15498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15498: --- Description: HDFS-15488 adds a cmd to list all snapshots for a given snapshottable

[jira] [Updated] (HDFS-15498) Show snapshots deletion status in snapList cmd

[ https://issues.apache.org/jira/browse/HDFS-15498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15498: --- Attachment: HDFS-15498.000.patch > Show snapshots deletion status in snapList cmd >

[jira] [Updated] (HDFS-15498) Show snapshots deletion status in snapList cmd

[ https://issues.apache.org/jira/browse/HDFS-15498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15498: --- Description: HDFS-15488 adds a cmd to list all snapshots for a given snapshottable

[jira] [Updated] (HDFS-15498) Show snapshots deletion status in snapList cmd

[ https://issues.apache.org/jira/browse/HDFS-15498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15498: --- Summary: Show snapshots deletion status in snapList cmd (was: Add an option in

[jira] [Updated] (HDFS-15498) Add an option in snapList cmd to show snapshots deletion status

[ https://issues.apache.org/jira/browse/HDFS-15498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15498: --- Summary: Add an option in snapList cmd to show snapshots deletion status (was: Add

[jira] [Assigned] (HDFS-15496) Add UI for deleted snapshots

[ https://issues.apache.org/jira/browse/HDFS-15496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDFS-15496: Assignee: Vivek Ratnavel Subramanian > Add UI for deleted snapshots >

[jira] [Created] (HDFS-15501) Update Apache documentation for new ordered snapshot deletion feature

Mukul Kumar Singh created HDFS-15501: Summary: Update Apache documentation for new ordered snapshot deletion feature Key: HDFS-15501 URL: https://issues.apache.org/jira/browse/HDFS-15501 Project:

[jira] [Created] (HDFS-15500) Add more assertions about ordered deletion of snapshot

Mukul Kumar Singh created HDFS-15500: Summary: Add more assertions about ordered deletion of snapshot Key: HDFS-15500 URL: https://issues.apache.org/jira/browse/HDFS-15500 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15492) Make trash root inside each snapshottable directory

[ https://issues.apache.org/jira/browse/HDFS-15492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-15492: - Parent: HDFS-15477 Issue Type: Sub-task (was: Improvement) > Make trash root

[jira] [Comment Edited] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167604#comment-17167604 ] Chengwei Wang edited comment on HDFS-15493 at 7/30/20, 3:01 AM: Hi

[jira] [Commented] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167604#comment-17167604 ] Chengwei Wang commented on HDFS-15493: -- Hi [~sodonnell]，sorry for missing some messages. {quote}I

[jira] [Updated] (HDFS-15499) Exclude aws-java-sdk-bundle from httpfs pom.xml

[ https://issues.apache.org/jira/browse/HDFS-15499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-15499: - Summary: Exclude aws-java-sdk-bundle from httpfs pom.xml (was: Exclude aws-java-sdk-bundle from

[jira] [Updated] (HDFS-15499) Exclude aws-java-sdk-bundle from httpfs

[ https://issues.apache.org/jira/browse/HDFS-15499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-15499: - Description: In [HADOOP-14040] we use shaded aws-sdk uber-JAR for instead of s3 jar in

[jira] [Created] (HDFS-15499) Exclude aws-java-sdk-bundle from httpfs

Mingliang Liu created HDFS-15499: Summary: Exclude aws-java-sdk-bundle from httpfs Key: HDFS-15499 URL: https://issues.apache.org/jira/browse/HDFS-15499 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-15492) Make trash root inside each snapshottable directory

[ https://issues.apache.org/jira/browse/HDFS-15492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15492: -- Description: We have seen FSImage corruption cases (e.g. HDFS-13101) where files inside one

[jira] [Comment Edited] (HDFS-15495) Decommissioning a DataNode with corrupted EC files should not be blocked indefinitely

[ https://issues.apache.org/jira/browse/HDFS-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167526#comment-17167526 ] Siyao Meng edited comment on HDFS-15495 at 7/29/20, 10:20 PM: -- Awesome!

[jira] [Updated] (HDFS-15495) Decommissioning a DataNode with corrupted EC files should not be blocked indefinitely

[ https://issues.apache.org/jira/browse/HDFS-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15495: -- Description: Originally discovered in patched CDH 6.2.1 (with a bunch of EC fixes: HDFS-14699,

[jira] [Commented] (HDFS-15495) Decommissioning a DataNode with corrupted EC files should not be blocked indefinitely

[ https://issues.apache.org/jira/browse/HDFS-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167526#comment-17167526 ] Siyao Meng commented on HDFS-15495: --- Awesome! Thanks [~sodonnell] for the writeup and unit test. I

[jira] [Commented] (HDFS-15329) Provide FileContext based ViewFSOverloadScheme implementation

[ https://issues.apache.org/jira/browse/HDFS-15329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167508#comment-17167508 ] Uma Maheswara Rao G commented on HDFS-15329: HI [~abhishekd], sorry for late reply. I missed

[jira] [Commented] (HDFS-15444) mkdir should not create dir in fallback if the dir already in mount Path

[ https://issues.apache.org/jira/browse/HDFS-15444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167506#comment-17167506 ] Uma Maheswara Rao G commented on HDFS-15444: [~jianghuazhu], thanks you for the question.

[jira] [Updated] (HDFS-15498) Add an option in snapList cmd to show snapshots which are marked deleted

[ https://issues.apache.org/jira/browse/HDFS-15498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15498: --- Description: HDFS-15488 adds a cmd to list all snapshots for a given snapshottable

[jira] [Created] (HDFS-15498) Add an option in snapList cmd to show snapshots which are marked deleted

Shashikant Banerjee created HDFS-15498: -- Summary: Add an option in snapList cmd to show snapshots which are marked deleted Key: HDFS-15498 URL: https://issues.apache.org/jira/browse/HDFS-15498

[jira] [Commented] (HDFS-15014) RBF: WebHdfs chooseDatanode shouldn't call getDatanodeReport

[ https://issues.apache.org/jira/browse/HDFS-15014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167374#comment-17167374 ] Chao Sun commented on HDFS-15014: - Thanks [~fengnanli]. Closing this as duplicate. > RBF: WebHdfs

[jira] [Resolved] (HDFS-15014) RBF: WebHdfs chooseDatanode shouldn't call getDatanodeReport

[ https://issues.apache.org/jira/browse/HDFS-15014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved HDFS-15014. - Resolution: Duplicate > RBF: WebHdfs chooseDatanode shouldn't call getDatanodeReport >

[jira] [Commented] (HDFS-15488) Add a command to list all snapshots for a snaphottable root with snapshot Ids

[ https://issues.apache.org/jira/browse/HDFS-15488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167343#comment-17167343 ] Hudson commented on HDFS-15488: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18478 (See

[jira] [Commented] (HDFS-15495) Decommissioning a DataNode with corrupted EC files should not be blocked indefinitely

[ https://issues.apache.org/jira/browse/HDFS-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167341#comment-17167341 ] Stephen O'Donnell commented on HDFS-15495: -- Here is a unit test which can be added to

[jira] [Comment Edited] (HDFS-15495) Decommissioning a DataNode with corrupted EC files should not be blocked indefinitely

[ https://issues.apache.org/jira/browse/HDFS-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167200#comment-17167200 ] Stephen O'Donnell edited comment on HDFS-15495 at 7/29/20, 4:12 PM:

[jira] [Comment Edited] (HDFS-15495) Decommissioning a DataNode with corrupted EC files should not be blocked indefinitely

[ https://issues.apache.org/jira/browse/HDFS-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167200#comment-17167200 ] Stephen O'Donnell edited comment on HDFS-15495 at 7/29/20, 4:12 PM:

[jira] [Updated] (HDFS-15488) Add a command to list all snapshots for a snaphottable root with snapshot Ids

[ https://issues.apache.org/jira/browse/HDFS-15488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15488: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was:

[jira] [Reopened] (HDFS-13934) Multipart uploaders to be created through API call to FileSystem/FileContext, not service loader

[ https://issues.apache.org/jira/browse/HDFS-13934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reopened HDFS-13934: - > Multipart uploaders to be created through API call to FileSystem/FileContext, > not service

[jira] [Commented] (HDFS-15484) Add option in enum Rename to suport batch rename

[ https://issues.apache.org/jira/browse/HDFS-15484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167208#comment-17167208 ] Steve Loughran commented on HDFS-15484: --- # make the new interface one in hadoop-common, so other

[jira] [Commented] (HDFS-15495) Decommissioning a DataNode with corrupted EC files should not be blocked indefinitely

[ https://issues.apache.org/jira/browse/HDFS-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167200#comment-17167200 ] Stephen O'Donnell commented on HDFS-15495: -- There are a few things to think about here. For non

[jira] [Commented] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167143#comment-17167143 ] Stephen O'Donnell commented on HDFS-15493: -- {quote} I had tested loading the caches and blocks

[jira] [Updated] (HDFS-15483) Ordered snapshot deletion: Disallow rename between two snapshottable directories

[ https://issues.apache.org/jira/browse/HDFS-15483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-15483: - Status: Patch Available (was: Open) > Ordered snapshot deletion: Disallow rename

[jira] [Commented] (HDFS-13934) Multipart uploaders to be created through API call to FileSystem/FileContext, not service loader

[ https://issues.apache.org/jira/browse/HDFS-13934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167094#comment-17167094 ] Ayush Saxena commented on HDFS-13934: - Hi [~ste...@apache.org], [~fabbri] This tends to break

[jira] [Updated] (HDFS-15497) Make snapshot limit on global as well per snapshot root directory configurable

[ https://issues.apache.org/jira/browse/HDFS-15497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15497: --- Attachment: HDFS-15497.000.patch > Make snapshot limit on global as well per

[jira] [Commented] (HDFS-15438) Setting dfs.disk.balancer.max.disk.errors = 0 will fail the block copy

[ https://issues.apache.org/jira/browse/HDFS-15438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167085#comment-17167085 ] Ayush Saxena commented on HDFS-15438: - Can you check the test failures, Couple of them seems related

[jira] [Commented] (HDFS-15229) Truncate info should be logged at INFO level

[ https://issues.apache.org/jira/browse/HDFS-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167044#comment-17167044 ] Hadoop QA commented on HDFS-15229: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-15497) Make snapshot limit on global as well per snapshot root directory configurable

Shashikant Banerjee created HDFS-15497: -- Summary: Make snapshot limit on global as well per snapshot root directory configurable Key: HDFS-15497 URL: https://issues.apache.org/jira/browse/HDFS-15497

[jira] [Commented] (HDFS-15423) RBF: WebHDFS create shouldn't choose DN from all sub-clusters

[ https://issues.apache.org/jira/browse/HDFS-15423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17166921#comment-17166921 ] Fengnan Li commented on HDFS-15423: --- [~csun] I will work on this one. > RBF: WebHDFS create shouldn't

[jira] [Assigned] (HDFS-15423) RBF: WebHDFS create shouldn't choose DN from all sub-clusters

[ https://issues.apache.org/jira/browse/HDFS-15423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li reassigned HDFS-15423: - Assignee: Fengnan Li > RBF: WebHDFS create shouldn't choose DN from all sub-clusters >

[jira] [Commented] (HDFS-15014) RBF: WebHdfs chooseDatanode shouldn't call getDatanodeReport

[ https://issues.apache.org/jira/browse/HDFS-15014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17166918#comment-17166918 ] Fengnan Li commented on HDFS-15014: --- [~csun] We can close this one since HDFS-15417 is closed? > RBF: