[jira] [Updated] (HDFS-15480) Ordered snapshot deletion: record snapshot deletion in XAttr

2020-07-20 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15480: --- Attachment: HDFS-15480.000.patch > Ordered snapshot deletion: record snapshot

[jira] [Assigned] (HDFS-15480) Ordered snapshot deletion: record snapshot deletion in XAttr

2020-07-20 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee reassigned HDFS-15480: -- Assignee: Shashikant Banerjee > Ordered snapshot deletion: record snapshot

[jira] [Commented] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-07-20 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161036#comment-17161036 ] Shashikant Banerjee commented on HDFS-15313: [^HDFS-15313.branch-2.10.001.patch] -> Patch for

[jira] [Updated] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-07-20 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15313: --- Attachment: HDFS-15313.branch-2.10.001.patch > Ensure inodes in active filesytem are

[jira] [Resolved] (HDFS-15463) Add a tool to validate FsImage

2020-07-20 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee resolved HDFS-15463. Fix Version/s: 3.4.0 Resolution: Fixed > Add a tool to validate FsImage >

[jira] [Updated] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-07-15 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15313: --- Attachment: HDFS-15313.branch-2.10.patch > Ensure inodes in active filesytem are not

[jira] [Updated] (HDFS-15470) Added more unit tests to validate rename behaviour across snapshots

2020-07-15 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15470: --- Attachment: HDFS-15470.002.patch > Added more unit tests to validate rename

[jira] [Commented] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-07-15 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158176#comment-17158176 ] Shashikant Banerjee commented on HDFS-15313: Thanks [~sodonnell], i have uploaded patches for

[jira] [Updated] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-07-15 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15313: --- Attachment: HDFS-15313.branch-3.1.patch > Ensure inodes in active filesytem are not

[jira] [Updated] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-07-15 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15313: --- Attachment: HDFS-15313.branch-2.8.patch > Ensure inodes in active filesytem are not

[jira] [Commented] (HDFS-15463) Add a tool to validate FsImage

2020-07-15 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158030#comment-17158030 ] Shashikant Banerjee commented on HDFS-15463: Thanks [~szetszwo] for working on this. 

[jira] [Updated] (HDFS-15463) Add a tool to validate FsImage

2020-07-15 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15463: --- Attachment: HDFS-15463.000.patch > Add a tool to validate FsImage >

[jira] [Updated] (HDFS-15463) Add a tool to validate FsImage

2020-07-15 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15463: --- Status: Patch Available (was: Open) > Add a tool to validate FsImage >

[jira] [Commented] (HDFS-14504) Rename with Snapshots does not honor quota limit

2020-07-14 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157903#comment-17157903 ] Shashikant Banerjee commented on HDFS-14504: [~hemanthboyina], sorry for coming back to it

[jira] [Updated] (HDFS-15470) Added more unit tests to validate rename behaviour across snapshots

2020-07-14 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15470: --- Attachment: HDFS-15470.001.patch > Added more unit tests to validate rename

[jira] [Updated] (HDFS-15319) Fix INode#isInLatestSnapshot() API

2020-07-14 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15319: --- Fix Version/s: 3.0.4 Resolution: Fixed Status: Resolved (was:

[jira] [Updated] (HDFS-15470) Added more unit tests to validate rename behaviour across snapshots

2020-07-14 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15470: --- Status: Patch Available (was: Open) > Added more unit tests to validate rename

[jira] [Updated] (HDFS-15470) Added more unit tests to validate rename behaviour across snapshots

2020-07-14 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15470: --- Attachment: HDFS-15470.000.patch > Added more unit tests to validate rename

[jira] [Created] (HDFS-15470) Added more unit tests to validate rename behaviour across snapshots

2020-07-14 Thread Shashikant Banerjee (Jira)
Shashikant Banerjee created HDFS-15470: -- Summary: Added more unit tests to validate rename behaviour across snapshots Key: HDFS-15470 URL: https://issues.apache.org/jira/browse/HDFS-15470

[jira] [Updated] (HDFS-15319) Fix INode#isInLatestSnapshot() API

2020-07-14 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15319: --- Attachment: HDFS-15319.001.patch > Fix INode#isInLatestSnapshot() API >

[jira] [Commented] (HDFS-15319) Fix INode#isInLatestSnapshot() API

2020-07-14 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157498#comment-17157498 ] Shashikant Banerjee commented on HDFS-15319: patch v1 removes the TODO added as a part of fix

[jira] [Updated] (HDFS-15319) Fix INode#isInLatestSnapshot() API

2020-05-01 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15319: --- Status: Patch Available (was: Open) > Fix INode#isInLatestSnapshot() API >

[jira] [Updated] (HDFS-15319) Fix INode#isInLatestSnapshot() API

2020-05-01 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15319: --- Attachment: HDFS-15319.000.patch > Fix INode#isInLatestSnapshot() API >

[jira] [Commented] (HDFS-15319) Fix INode#isInLatestSnapshot() API

2020-05-01 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17097210#comment-17097210 ] Shashikant Banerjee commented on HDFS-15319: [~szetszwo], can you please have a look? > Fix

[jira] [Updated] (HDFS-15319) Fix INode#isInLatestSnapshot() API

2020-05-01 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15319: --- Component/s: snapshots > Fix INode#isInLatestSnapshot() API >

[jira] [Commented] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-05-01 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17097200#comment-17097200 ] Shashikant Banerjee commented on HDFS-15313: Filed HDFS-15319 to address the issues in

[jira] [Assigned] (HDFS-15319) Fix INode#isInLatestSnapshot() API

2020-05-01 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee reassigned HDFS-15319: -- Assignee: Shashikant Banerjee > Fix INode#isInLatestSnapshot() API >

[jira] [Updated] (HDFS-15319) Fix INode#isInLatestSnapshot() API

2020-05-01 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15319: --- Description: isInLatestSnapshot() may return true in cases where an inode's

[jira] [Updated] (HDFS-15319) Fix INode#isInLatestSnapshot() API

2020-05-01 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15319: --- Description: {code:java} // if parent is a reference node, parent must be a renamed

[jira] [Updated] (HDFS-15319) Fix INode#isInLatestSnapshot() API

2020-05-01 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15319: --- Description: The  > Fix INode#isInLatestSnapshot() API >

[jira] [Created] (HDFS-15319) Fix INode#isInLatestSnapshot

2020-05-01 Thread Shashikant Banerjee (Jira)
Shashikant Banerjee created HDFS-15319: -- Summary: Fix INode#isInLatestSnapshot Key: HDFS-15319 URL: https://issues.apache.org/jira/browse/HDFS-15319 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-15319) Fix INode#isInLatestSnapshot() API

2020-05-01 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15319: --- Summary: Fix INode#isInLatestSnapshot() API (was: Fix INode#isInLatestSnapshot) >

[jira] [Updated] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-05-01 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15313: --- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks

[jira] [Commented] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-04-30 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096576#comment-17096576 ] Shashikant Banerjee commented on HDFS-15313: Patch v1 addresses checkstyle issues. > Ensure

[jira] [Updated] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-04-30 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15313: --- Attachment: HDFS-15313.001.patch > Ensure inodes in active filesytem are not deleted

[jira] [Updated] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-04-30 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15313: --- Description: After HDFS-13101, it was observed in one of our customer deployments

[jira] [Commented] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-04-30 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096271#comment-17096271 ] Shashikant Banerjee commented on HDFS-15313: [~szetszwo], [~weichiu] , can you please have a

[jira] [Updated] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-04-30 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15313: --- Description: After HDFS-13101, it was observed that delete snapshot end up cleaning

[jira] [Updated] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-04-30 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15313: --- Status: Patch Available (was: Open) > Ensure inodes in active filesytem are not

[jira] [Updated] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-04-30 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15313: --- Attachment: HDFS-15313.000.patch > Ensure inodes in active filesytem are not deleted

[jira] [Updated] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-04-30 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15313: --- Description: After HDFS-13101, it was observed that delete snapshot end up cleaning

[jira] [Created] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-04-30 Thread Shashikant Banerjee (Jira)
Shashikant Banerjee created HDFS-15313: -- Summary: Ensure inodes in active filesytem are not deleted during snapshot delete Key: HDFS-15313 URL: https://issues.apache.org/jira/browse/HDFS-15313

[jira] [Commented] (HDFS-14504) Rename with Snapshots does not honor quota limit

2020-04-24 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17092046#comment-17092046 ] Shashikant Banerjee commented on HDFS-14504: Thanks [~hemanthboyina] for the explanation.

[jira] [Comment Edited] (HDFS-14504) Rename with Snapshots does not honor quota limit

2020-04-20 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087899#comment-17087899 ] Shashikant Banerjee edited comment on HDFS-14504 at 4/20/20, 4:25 PM:

[jira] [Comment Edited] (HDFS-14504) Rename with Snapshots does not honor quota limit

2020-04-20 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087899#comment-17087899 ] Shashikant Banerjee edited comment on HDFS-14504 at 4/20/20, 4:17 PM:

[jira] [Commented] (HDFS-14504) Rename with Snapshots does not honor quota limit

2020-04-20 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087899#comment-17087899 ] Shashikant Banerjee commented on HDFS-14504: Thanks [~hemanthboyina] for updating the patch. 

[jira] [Comment Edited] (HDFS-14504) Rename with Snapshots does not honor quota limit

2020-04-08 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17077306#comment-17077306 ] Shashikant Banerjee edited comment on HDFS-14504 at 4/8/20, 5:52 PM: -

[jira] [Commented] (HDFS-14504) Rename with Snapshots does not honor quota limit

2020-04-07 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17077306#comment-17077306 ] Shashikant Banerjee commented on HDFS-14504: Thanks [~hemanthboyina] for working on this.

[jira] [Comment Edited] (HDFS-15012) NN fails to parse Edit logs after applying HDFS-13101

2019-12-18 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16999407#comment-16999407 ] Shashikant Banerjee edited comment on HDFS-15012 at 12/18/19 6:12 PM:

[jira] [Updated] (HDFS-15012) NN fails to parse Edit logs after applying HDFS-13101

2019-12-18 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15012: --- Fix Version/s: 2.8.0 2.9.0 3.1.0

[jira] [Commented] (HDFS-15012) NN fails to parse Edit logs after applying HDFS-13101

2019-12-11 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994244#comment-16994244 ] Shashikant Banerjee commented on HDFS-15012: Thanks [~szetszwo] . Patch v1 addresses the

[jira] [Updated] (HDFS-15012) NN fails to parse Edit logs after applying HDFS-13101

2019-12-11 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15012: --- Attachment: HDFS-15012.001.patch > NN fails to parse Edit logs after applying

[jira] [Updated] (HDFS-15012) NN fails to parse Edit logs after applying HDFS-13101

2019-12-06 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15012: --- Status: Patch Available (was: Open) Patch v0 adds a unit test and fix to address

[jira] [Updated] (HDFS-15012) NN fails to parse Edit logs after applying HDFS-13101

2019-12-06 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15012: --- Attachment: HDFS-15012.000.patch > NN fails to parse Edit logs after applying

[jira] [Resolved] (HDFS-14869) Data loss in case of distcp using snapshot diff. Replication should include rename records if file was skipped in the previous iteration

2019-12-06 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee resolved HDFS-14869. Fix Version/s: 3.1.4 Resolution: Fixed Thanks [~aasha] for the contribution

[jira] [Assigned] (HDFS-15012) NN fails to parse Edit logs after applying HDFS-13101

2019-11-27 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee reassigned HDFS-15012: -- Assignee: Shashikant Banerjee > NN fails to parse Edit logs after applying

[jira] [Assigned] (HDDS-2542) Race condition between read and write stateMachineData

2019-11-19 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee reassigned HDDS-2542: - Assignee: Shashikant Banerjee > Race condition between read and write

[jira] [Updated] (HDDS-2509) Code cleanup in replication package

2019-11-19 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-2509: -- Fix Version/s: 0.5.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Assigned] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

2019-11-14 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee reassigned HDDS-2372: - Assignee: Marton Elek (was: Shashikant Banerjee) > Datanode pipeline is failing

[jira] [Commented] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

2019-11-07 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969379#comment-16969379 ] Shashikant Banerjee commented on HDDS-2372: --- In ratis, raft log entries can get truncated after

[jira] [Commented] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

2019-11-06 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968960#comment-16968960 ] Shashikant Banerjee commented on HDDS-2372: --- Thanks [~aengineer] for the suggestion. Writing to

[jira] [Updated] (HDDS-2270) Avoid buffer copying in ContainerStateMachine.loadSnapshot/persistContainerSet

2019-11-06 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-2270: -- Fix Version/s: 0.5.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Updated] (HDDS-2407) Reduce log level of per-node failure in XceiverClientGrpc

2019-11-06 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-2407: -- Fix Version/s: 0.5.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDDS-2388) Teragen test failure due to OM exception

2019-11-04 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966770#comment-16966770 ] Shashikant Banerjee commented on HDDS-2388: --- [~avijayan], OM was not crashing because of this

[jira] [Assigned] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

2019-10-31 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee reassigned HDDS-2372: - Assignee: Shashikant Banerjee > Datanode pipeline is failing with

[jira] [Commented] (HDDS-2388) Teragen test failure due to OM exception

2019-10-31 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963831#comment-16963831 ] Shashikant Banerjee commented on HDDS-2388: --- cc - [~bharat] > Teragen test failure due to OM

[jira] [Created] (HDDS-2388) Teragen test failure due to OM exception

2019-10-31 Thread Shashikant Banerjee (Jira)
Shashikant Banerjee created HDDS-2388: - Summary: Teragen test failure due to OM exception Key: HDDS-2388 URL: https://issues.apache.org/jira/browse/HDDS-2388 Project: Hadoop Distributed Data Store

[jira] [Comment Edited] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

2019-10-31 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963813#comment-16963813 ] Shashikant Banerjee edited comment on HDDS-2372 at 10/31/19 9:52 AM: -

[jira] [Commented] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

2019-10-31 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963815#comment-16963815 ] Shashikant Banerjee commented on HDDS-2372: --- [~szetszwo], to answer your question precisely,

[jira] [Commented] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

2019-10-31 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963813#comment-16963813 ] Shashikant Banerjee commented on HDDS-2372: --- Thanks [~elek] . I do agree that, there is no

[jira] [Commented] (HDDS-2331) Client OOME due to buffer retention

2019-10-21 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955856#comment-16955856 ] Shashikant Banerjee commented on HDDS-2331: --- One more point to add here is, as per the cmd,

[jira] [Deleted] (HDDS-2338) Avoid buffer copy while submitting write chunk request in Ozone Client

2019-10-21 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee deleted HDDS-2338: -- > Avoid buffer copy while submitting write chunk request in Ozone Client >

[jira] [Assigned] (HDDS-2338) Avoid buffer copy while submitting write chunk request in Ozone Client

2019-10-21 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee reassigned HDDS-2338: - Assignee: Shashikant Banerjee > Avoid buffer copy while submitting write chunk

[jira] [Created] (HDDS-2338) Avoid buffer copy while submitting write chunk request in Ozone Client

2019-10-21 Thread Shashikant Banerjee (Jira)
Shashikant Banerjee created HDDS-2338: - Summary: Avoid buffer copy while submitting write chunk request in Ozone Client Key: HDDS-2338 URL: https://issues.apache.org/jira/browse/HDDS-2338

[jira] [Comment Edited] (HDDS-2331) Client OOME due to buffer retention

2019-10-21 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955814#comment-16955814 ] Shashikant Banerjee edited comment on HDDS-2331 at 10/21/19 7:04 AM: -

[jira] [Commented] (HDDS-2331) Client OOME due to buffer retention

2019-10-21 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955814#comment-16955814 ] Shashikant Banerjee commented on HDDS-2331: --- In Ozone, by default the buffer size is equal to

[jira] [Assigned] (HDDS-2331) Client OOME due to buffer retention

2019-10-21 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee reassigned HDDS-2331: - Assignee: Shashikant Banerjee > Client OOME due to buffer retention >

[jira] [Commented] (HDDS-2280) HddsUtils#CheckForException should not return null in case the ratis exception cause is not set

2019-10-18 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954702#comment-16954702 ] Shashikant Banerjee commented on HDDS-2280: --- st > HddsUtils#CheckForException should not return

[jira] [Commented] (HDDS-2332) BlockOutputStream#waitOnFlushFutures blocks on putBlock combined future

2019-10-18 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954697#comment-16954697 ] Shashikant Banerjee commented on HDDS-2332: --- [~ljain], i think we should timeout all requests in

[jira] [Created] (HDDS-2286) Add a log info in ozone client and scm to print the exclusion list during allocate block

2019-10-11 Thread Shashikant Banerjee (Jira)
Shashikant Banerjee created HDDS-2286: - Summary: Add a log info in ozone client and scm to print the exclusion list during allocate block Key: HDDS-2286 URL: https://issues.apache.org/jira/browse/HDDS-2286

[jira] [Created] (HDDS-2281) ContainerStateMachine#handleWriteChunk should ignore close container exception

2019-10-10 Thread Shashikant Banerjee (Jira)
Shashikant Banerjee created HDDS-2281: - Summary: ContainerStateMachine#handleWriteChunk should ignore close container exception Key: HDDS-2281 URL: https://issues.apache.org/jira/browse/HDDS-2281

[jira] [Updated] (HDDS-2280) HddsUtils#CheckForException should not return null in case the ratis exception cause is not set

2019-10-10 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-2280: -- Summary: HddsUtils#CheckForException should not return null in case the ratis exception

[jira] [Created] (HDDS-2280) HddsUtils#CheckForException may return null in case the ratis exception cause is not set

2019-10-10 Thread Shashikant Banerjee (Jira)
Shashikant Banerjee created HDDS-2280: - Summary: HddsUtils#CheckForException may return null in case the ratis exception cause is not set Key: HDDS-2280 URL: https://issues.apache.org/jira/browse/HDDS-2280

[jira] [Resolved] (HDDS-2266) Avoid evaluation of LOG.trace and LOG.debug statement in the read/write path (Ozone)

2019-10-10 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee resolved HDDS-2266. --- Resolution: Fixed Thanks [~swagle] for the contribution. I have committed this. >

[jira] [Commented] (HDFS-14869) Data loss in case of distcp using snapshot diff. Replication should include rename records if file was skipped in the previous iteration

2019-10-10 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948318#comment-16948318 ] Shashikant Banerjee commented on HDFS-14869: [~ste...@apache.org], can you please have a look

[jira] [Resolved] (HDDS-2261) Change readChunk methods to return ByteBuffer

2019-10-09 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee resolved HDDS-2261. --- Resolution: Fixed > Change readChunk methods to return ByteBuffer >

[jira] [Resolved] (HDDS-2233) Remove ByteStringHelper and refactor the code to the place where it used

2019-10-09 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee resolved HDDS-2233. --- Fix Version/s: 0.5.0 Resolution: Fixed > Remove ByteStringHelper and refactor

[jira] [Updated] (HDDS-2169) Avoid buffer copies while submitting client requests in Ratis

2019-10-06 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-2169: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Avoid buffer

[jira] [Updated] (HDDS-2210) ContainerStateMachine should not be marked unhealthy if applyTransaction fails with closed container exception

2019-10-01 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-2210: -- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks [~msingh] for

[jira] [Resolved] (HDFS-14492) Snapshot memory leak

2019-10-01 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee resolved HDFS-14492. Fix Version/s: 3.1.4 Resolution: Fixed Thanks [~jojochuang] for the

[jira] [Updated] (HDDS-2210) ContainerStateMachine should not be marked unhealthy if applyTransaction fails with closed container exception

2019-09-30 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-2210: -- Status: Patch Available (was: Open) > ContainerStateMachine should not be marked

[jira] [Created] (HDDS-2210) ContainerStateMachine should not be marked unhealthy if applyTransaction fails with closed container exception

2019-09-30 Thread Shashikant Banerjee (Jira)
Shashikant Banerjee created HDDS-2210: - Summary: ContainerStateMachine should not be marked unhealthy if applyTransaction fails with closed container exception Key: HDDS-2210 URL:

[jira] [Assigned] (HDDS-2152) Ozone client fails with OOM while writing a large (~300MB) key.

2019-09-30 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee reassigned HDDS-2152: - Assignee: Shashikant Banerjee > Ozone client fails with OOM while writing a

[jira] [Created] (HDDS-2207) Update Ratis to latest snnapshot

2019-09-30 Thread Shashikant Banerjee (Jira)
Shashikant Banerjee created HDDS-2207: - Summary: Update Ratis to latest snnapshot Key: HDDS-2207 URL: https://issues.apache.org/jira/browse/HDDS-2207 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDDS-2152) Ozone client fails with OOM while writing a large (~300MB) key.

2019-09-23 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935959#comment-16935959 ] Shashikant Banerjee commented on HDDS-2152: --- [~jnp], this requires changes in Ratis as tracked

[jira] [Commented] (HDDS-2152) Ozone client fails with OOM while writing a large (~300MB) key.

2019-09-23 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935663#comment-16935663 ] Shashikant Banerjee commented on HDDS-2152: --- The issue gets recreated when u try to create/write

[jira] [Commented] (HDDS-2152) Ozone client fails with OOM while writing a large (~300MB) key.

2019-09-19 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933588#comment-16933588 ] Shashikant Banerjee commented on HDDS-2152: --- [~cxorm], do you have a solution/fix to address

[jira] [Updated] (HDDS-2153) Add a config to tune max pending requests in Ratis leader

2019-09-19 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-2153: -- Status: Patch Available (was: Open) > Add a config to tune max pending requests in

[jira] [Created] (HDDS-2153) Add a config to tune max pending requests in Ratis leader

2019-09-19 Thread Shashikant Banerjee (Jira)
Shashikant Banerjee created HDDS-2153: - Summary: Add a config to tune max pending requests in Ratis leader Key: HDDS-2153 URL: https://issues.apache.org/jira/browse/HDDS-2153 Project: Hadoop

[jira] [Updated] (HDDS-2032) Ozone client should retry writes in case of any ratis/stateMachine exceptions

2019-09-18 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-2032: -- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks [~msingh] for

<    1   2   3   4   5   6   7   8   9   10   >