[jira] [Commented] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-29 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048438#comment-17048438 ] Yang Yun commented on HDFS-13377: - Thanks [~ayushtkn] for review. The original intention is only the

[jira] [Commented] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-29 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048329#comment-17048329 ] Yang Yun commented on HDFS-13377: - Thanks [~ayushtkn] for the good catch. Updated. > The owner of

[jira] [Updated] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-29 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-13377: Attachment: HDFS-13377.patch Status: Patch Available (was: Open) > The owner of folder can set

[jira] [Updated] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-29 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-13377: Status: Open (was: Patch Available) > The owner of folder can set quota for his sub folder >

[jira] [Commented] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-28 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047326#comment-17047326 ] Yang Yun commented on HDFS-13377: - Thanks [~ayushtkn] for the review. Failed UT 

[jira] [Updated] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-28 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-13377: Attachment: HDFS-13377.patch Status: Patch Available (was: Open) > The owner of folder can set

[jira] [Updated] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-28 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-13377: Status: Open (was: Patch Available) > The owner of folder can set quota for his sub folder >

[jira] [Updated] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15188: Attachment: HDFS-15188.patch Status: Patch Available (was: Open) > Add option to set Write/Read

[jira] [Updated] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15188: Status: Open (was: Patch Available) > Add option to set Write/Read timeout extension for different

[jira] [Commented] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047195#comment-17047195 ] Yang Yun commented on HDFS-15033: - Thanks [~ayushtkn] for the review. Got the time usage and removed 

[jira] [Updated] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15033: Attachment: HDFS-15033.patch Status: Patch Available (was: Open) > Support to save replica cached

[jira] [Updated] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15033: Status: Open (was: Patch Available) > Support to save replica cached files to other place and make

[jira] [Commented] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047173#comment-17047173 ] Yang Yun commented on HDFS-15033: - Thanks [~elgoiri] for the review. Added the time suffix  in  

[jira] [Updated] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15033: Attachment: (was: HDFS-15033.patch) > Support to save replica cached files to other place and make

[jira] [Updated] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15033: Attachment: (was: HDFS-15033.patch) > Support to save replica cached files to other place and make

[jira] [Updated] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15033: Attachment: (was: HDFS-15033.patch) > Support to save replica cached files to other place and make

[jira] [Updated] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15033: Status: Open (was: Patch Available) > Support to save replica cached files to other place and make

[jira] [Updated] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15033: Attachment: HDFS-15033.patch Status: Patch Available (was: Open) > Support to save replica cached

[jira] [Commented] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17047159#comment-17047159 ] Yang Yun commented on HDFS-15188: - Thanks [~elgoiri] for the review. Fixed the checkstyle warnings. Yes, 

[jira] [Updated] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15188: Attachment: HDFS-15188.patch Status: Patch Available (was: Open) > Add option to set Write/Read

[jira] [Updated] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15188: Status: Open (was: Patch Available) > Add option to set Write/Read timeout extension for different

[jira] [Updated] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-13377: Attachment: HDFS-13377.patch Status: Patch Available (was: Open) > The owner of folder can set

[jira] [Updated] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-13377: Status: Open (was: Patch Available) > The owner of folder can set quota for his sub folder >

[jira] [Updated] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-27 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-13377: Attachment: (was: HADOOP-13377.patch) > The owner of folder can set quota for his sub folder >

[jira] [Commented] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-26 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046148#comment-17046148 ] Yang Yun commented on HDFS-13377: - Thanx Ayush Saxena for the review. Refactored the patch only with

[jira] [Updated] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-26 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-13377: Attachment: HDFS-13377.patch Status: Patch Available (was: Open) > The owner of folder can set

[jira] [Updated] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-26 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-13377: Status: Open (was: Patch Available) > The owner of folder can set quota for his sub folder >

[jira] [Comment Edited] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-26 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046063#comment-17046063 ] Yang Yun edited comment on HDFS-13377 at 2/27/20 2:10 AM: -- Thanx Ayush Saxena

[jira] [Commented] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-26 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046063#comment-17046063 ] Yang Yun commented on HDFS-13377: - Thanx Ayush Saxena for the review. The reason to check the parent's

[jira] [Commented] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-26 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045617#comment-17045617 ] Yang Yun commented on HDFS-13377: - Thanks [~ayushtkn] for the review. I added a configuration option and

[jira] [Updated] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-26 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-13377: Attachment: HDFS-13377.patch Status: Patch Available (was: Open) > The owner of folder can set

[jira] [Updated] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-26 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-13377: Status: Open (was: Patch Available) > The owner of folder can set quota for his sub folder >

[jira] [Commented] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-26 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045514#comment-17045514 ] Yang Yun commented on HDFS-13377: - In our setup, an user(we call User A) is the owner of a huge

[jira] [Updated] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-26 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-13377: Attachment: HDFS-13377.patch Status: Patch Available (was: Open) > The owner of folder can set

[jira] [Commented] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-26 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045368#comment-17045368 ] Yang Yun commented on HDFS-13377: - Update patch with newest code. > The owner of folder can set quota

[jira] [Assigned] (HDFS-13377) The owner of folder can set quota for his sub folder

2020-02-26 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun reassigned HDFS-13377: --- Assignee: Yang Yun > The owner of folder can set quota for his sub folder >

[jira] [Commented] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

2020-02-25 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045074#comment-17045074 ] Yang Yun commented on HDFS-15039: - Thanks [~weichiu] for the review. Yes,  I make metaLength an int

[jira] [Commented] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

2020-02-25 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044388#comment-17044388 ] Yang Yun commented on HDFS-15039: - Updated patch for style warning. > Cache meta file length of

[jira] [Updated] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

2020-02-25 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15039: Attachment: HDFS-15039.patch Status: Patch Available (was: Open) > Cache meta file length of

[jira] [Updated] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

2020-02-25 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15039: Status: Open (was: Patch Available) > Cache meta file length of FinalizedReplica to reduce call

[jira] [Commented] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

2020-02-24 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044114#comment-17044114 ] Yang Yun commented on HDFS-15039: - Done, Thanks for review! > Cache meta file length of FinalizedReplica

[jira] [Updated] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

2020-02-24 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15039: Attachment: HDFS-15039.patch Status: Patch Available (was: Open) > Cache meta file length of

[jira] [Updated] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

2020-02-24 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15039: Status: Open (was: Patch Available) > Cache meta file length of FinalizedReplica to reduce call

[jira] [Updated] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

2020-02-24 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15039: Attachment: HDFS-15039.patch Status: Patch Available (was: Open) > Cache meta file length of

[jira] [Updated] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

2020-02-24 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15039: Attachment: HDFS-15039.patch > Cache meta file length of FinalizedReplica to reduce call File.length() >

[jira] [Updated] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

2020-02-24 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15039: Status: Open (was: Patch Available) > Cache meta file length of FinalizedReplica to reduce call

[jira] [Updated] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

2020-02-24 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15188: Priority: Minor (was: Major) > Add option to set Write/Read timeout extension for different StorageType >

[jira] [Updated] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

2020-02-23 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15188: Attachment: HDFS-15188.patch Status: Patch Available (was: Open) > Add option to set Write/Read

[jira] [Created] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

2020-02-23 Thread Yang Yun (Jira)
Yang Yun created HDFS-15188: --- Summary: Add option to set Write/Read timeout extension for different StorageType Key: HDFS-15188 URL: https://issues.apache.org/jira/browse/HDFS-15188 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15104) If block is not reported by any Datanode, the flag corrupt of BlockLocation should be marked as true.

2020-02-17 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038421#comment-17038421 ] Yang Yun commented on HDFS-15104: - For the block, it's missing. But for the file, it's corrupt as fsck

[jira] [Commented] (HDFS-15158) The number of failed volumes mismatch with volumeFailures of Datanode metrics

2020-02-09 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033216#comment-17033216 ] Yang Yun commented on HDFS-15158: - Thanks Ayush Saxena for the review. Changed according to your

[jira] [Updated] (HDFS-15158) The number of failed volumes mismatch with volumeFailures of Datanode metrics

2020-02-09 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15158: Attachment: HDFS-15158.patch Status: Patch Available (was: Open) > The number of failed volumes

[jira] [Updated] (HDFS-15158) The number of failed volumes mismatch with volumeFailures of Datanode metrics

2020-02-09 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15158: Status: Open (was: Patch Available) > The number of failed volumes mismatch with volumeFailures of

[jira] [Commented] (HDFS-15158) The number of failed volumes mismatch with volumeFailures of Datanode metrics

2020-02-09 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033190#comment-17033190 ] Yang Yun commented on HDFS-15158: - Thanks Ayush Saxena for the review. I have added a UT for the issue.

[jira] [Updated] (HDFS-15158) The number of failed volumes mismatch with volumeFailures of Datanode metrics

2020-02-09 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15158: Attachment: HDFS-15158.patch Status: Patch Available (was: Open) > The number of failed volumes

[jira] [Updated] (HDFS-15158) The number of failed volumes mismatch with volumeFailures of Datanode metrics

2020-02-09 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15158: Status: Open (was: Patch Available) > The number of failed volumes mismatch with volumeFailures of

[jira] [Updated] (HDFS-15158) The number of failed volumes mismatch with volumeFailures of Datanode metrics

2020-02-08 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15158: Summary: The number of failed volumes mismatch with volumeFailures of Datanode metrics (was: The number

[jira] [Updated] (HDFS-15158) The number of failed volumes is mismatch with Datanode metrics

2020-02-08 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15158: Attachment: HDFS-15158.patch Status: Patch Available (was: Open) > The number of failed volumes

[jira] [Created] (HDFS-15158) The number of failed volumes is mismatch with Datanode metrics

2020-02-08 Thread Yang Yun (Jira)
Yang Yun created HDFS-15158: --- Summary: The number of failed volumes is mismatch with Datanode metrics Key: HDFS-15158 URL: https://issues.apache.org/jira/browse/HDFS-15158 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15104) If block is not reported by any Datanode, the flag corrupt of BlockLocation should be marked as true.

2020-01-09 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15104: Issue Type: Bug (was: Improvement) > If block is not reported by any Datanode, the flag corrupt of

[jira] [Updated] (HDFS-15104) If block is not reported by any Datanode, the flag corrupt of BlockLocation should be marked as true.

2020-01-09 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15104: Attachment: HDFS-15104.patch Assignee: Yang Yun Status: Patch Available (was: Open) > If

[jira] [Created] (HDFS-15104) If block is not reported by any Datanode, the flag corrupt of BlockLocation should be marked as true.

2020-01-09 Thread Yang Yun (Jira)
Yang Yun created HDFS-15104: --- Summary: If block is not reported by any Datanode, the flag corrupt of BlockLocation should be marked as true. Key: HDFS-15104 URL: https://issues.apache.org/jira/browse/HDFS-15104

[jira] [Commented] (HDFS-15059) Cache finalized replica info during datanode shutdown for fast restarting

2019-12-14 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16996429#comment-16996429 ] Yang Yun commented on HDFS-15059: - Thanks  [~kihwal] for the review. For finalized replica, it looks the

[jira] [Updated] (HDFS-15059) Cache finalized replica info during datanode shutdown for fast restarting

2019-12-13 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15059: Attachment: HDFS-15059.patch Status: Patch Available (was: Open) > Cache finalized replica info

[jira] [Created] (HDFS-15059) Cache finalized replica info during datanode shutdown for fast restarting

2019-12-13 Thread Yang Yun (Jira)
Yang Yun created HDFS-15059: --- Summary: Cache finalized replica info during datanode shutdown for fast restarting Key: HDFS-15059 URL: https://issues.apache.org/jira/browse/HDFS-15059 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2019-12-08 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15033: Description: For slow volume with many replicas,  add an option to save the replica files to high-speed

[jira] [Updated] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

2019-12-08 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15039: Attachment: HDFS-15039.patch Status: Patch Available (was: Open) > Cache meta file length of

[jira] [Created] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

2019-12-08 Thread Yang Yun (Jira)
Yang Yun created HDFS-15039: --- Summary: Cache meta file length of FinalizedReplica to reduce call File.length() Key: HDFS-15039 URL: https://issues.apache.org/jira/browse/HDFS-15039 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15022) Add new RPC to transfer data block with external shell script across Datanode

2019-12-07 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990703#comment-16990703 ] Yang Yun commented on HDFS-15022: - Thanks [Wei-Chiu

[jira] [Updated] (HDFS-15022) Add new RPC to transfer data block with external shell script across Datanode

2019-12-07 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15022: Attachment: link_block_across_datanode.pdf > Add new RPC to transfer data block with external shell script

[jira] [Commented] (HDFS-14993) checkDiskError doesn't work during datanode startup

2019-12-06 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990370#comment-16990370 ] Yang Yun commented on HDFS-14993: - Thanks [~ayushtkn]  and [~weichiu]  for the review. changed according

[jira] [Updated] (HDFS-14993) checkDiskError doesn't work during datanode startup

2019-12-06 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-14993: Attachment: HDFS-14993.patch Status: Patch Available (was: Open) > checkDiskError doesn't work

[jira] [Updated] (HDFS-14993) checkDiskError doesn't work during datanode startup

2019-12-06 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-14993: Status: Open (was: Patch Available) > checkDiskError doesn't work during datanode startup >

[jira] [Updated] (HDFS-15028) Keep the capacity of volume and reduce a system call

2019-12-05 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15028: Status: Open (was: Patch Available) > Keep the capacity of volume and reduce a system call >

[jira] [Updated] (HDFS-15028) Keep the capacity of volume and reduce a system call

2019-12-05 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15028: Attachment: HDFS-15028.patch Status: Patch Available (was: Open) > Keep the capacity of volume

[jira] [Updated] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2019-12-05 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15033: Attachment: HDFS-15033.patch Status: Patch Available (was: Open) > Support to save replica cached

[jira] [Updated] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2019-12-05 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15033: Status: Open (was: Patch Available) > Support to save replica cached files to other place and make

[jira] [Updated] (HDFS-15033) Support to save replica cached files to other place and make expired time configurable

2019-12-05 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15033: Summary: Support to save replica cached files to other place and make expired time configurable (was:

[jira] [Updated] (HDFS-15033) Support save replica cache file to other place and make expired time configurable

2019-12-05 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15033: Attachment: HDFS-15033.patch Status: Patch Available (was: Open) > Support save replica cache

[jira] [Updated] (HDFS-15033) Support save replica cache file to other place and make expired time configurable

2019-12-05 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15033: Status: Open (was: Patch Available) > Support save replica cache file to other place and make expired

[jira] [Commented] (HDFS-15028) Keep the capacity of volume and reduce a system call

2019-12-05 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989318#comment-16989318 ] Yang Yun commented on HDFS-15028: - Thanks for the review, Masatake Iwasaki. I changed the code accoring

[jira] [Updated] (HDFS-15028) Keep the capacity of volume and reduce a system call

2019-12-05 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15028: Status: Open (was: Patch Available) > Keep the capacity of volume and reduce a system call >

[jira] [Updated] (HDFS-15028) Keep the capacity of volume and reduce a system call

2019-12-05 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15028: Attachment: HDFS-15028.patch Status: Patch Available (was: Open) > Keep the capacity of volume

[jira] [Updated] (HDFS-15033) Support save replica cache file to other place and make expired time configurable

2019-12-05 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15033: Attachment: HDFS-15033.patch Status: Patch Available (was: Open) > Support save replica cache

[jira] [Created] (HDFS-15033) Support save replica cache file to other place and make expired time configurable

2019-12-05 Thread Yang Yun (Jira)
Yang Yun created HDFS-15033: --- Summary: Support save replica cache file to other place and make expired time configurable Key: HDFS-15033 URL: https://issues.apache.org/jira/browse/HDFS-15033 Project:

[jira] [Updated] (HDFS-15028) Keep the capacity of volume and reduce a system call

2019-12-05 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15028: Attachment: HDFS-15028.patch Status: Patch Available (was: Open) > Keep the capacity of volume

[jira] [Updated] (HDFS-15028) Keep the capacity of volume and reduce a system call

2019-12-05 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15028: Status: Open (was: Patch Available) > Keep the capacity of volume and reduce a system call >

[jira] [Updated] (HDFS-15028) Keep the capacity of volume and reduce a system call

2019-12-04 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15028: Attachment: HDFS-15028.patch Status: Patch Available (was: Open) > Keep the capacity of volume

[jira] [Updated] (HDFS-15028) Keep the capacity of volume and reduce a system call

2019-12-04 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15028: Status: Open (was: Patch Available) > Keep the capacity of volume and reduce a system call >

[jira] [Commented] (HDFS-15028) Keep the capacity of volume and reduce a system call

2019-12-03 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986774#comment-16986774 ] Yang Yun commented on HDFS-15028: - I have no number how much the overhead is reduced by the change for

[jira] [Updated] (HDFS-15028) Keep the capacity of volume and reduce a system call

2019-12-02 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15028: Attachment: HDFS-15028.patch Status: Patch Available (was: Open) > Keep the capacity of volume

[jira] [Created] (HDFS-15028) Keep the capacity of volume and reduce a system call

2019-12-02 Thread Yang Yun (Jira)
Yang Yun created HDFS-15028: --- Summary: Keep the capacity of volume and reduce a system call Key: HDFS-15028 URL: https://issues.apache.org/jira/browse/HDFS-15028 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-15022) Add new RPC to transfer data block with external shell script across Datanode

2019-11-29 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15022: Attachment: HDFS-15022.patch Status: Patch Available (was: Open) > Add new RPC to transfer data

[jira] [Updated] (HDFS-15022) Add new RPC to transfer data block with external shell script across Datanode

2019-11-29 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15022: Status: Open (was: Patch Available) > Add new RPC to transfer data block with external shell script

[jira] [Updated] (HDFS-15022) Add new RPC to transfer data block with external shell script across Datanode

2019-11-28 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15022: Attachment: HDFS-15022.patch Status: Patch Available (was: Open) > Add new RPC to transfer data

[jira] [Created] (HDFS-15022) Add new RPC to transfer data block with external shell script across Datanode

2019-11-28 Thread Yang Yun (Jira)
Yang Yun created HDFS-15022: --- Summary: Add new RPC to transfer data block with external shell script across Datanode Key: HDFS-15022 URL: https://issues.apache.org/jira/browse/HDFS-15022 Project: Hadoop

[jira] [Commented] (HDFS-14993) checkDiskError doesn't work during datanode startup

2019-11-21 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979771#comment-16979771 ] Yang Yun commented on HDFS-14993: - The check in makeInstance is for StorageLocation not for volume, it

[jira] [Updated] (HDFS-15001) Automatically add back the failed volume if it gets better again

2019-11-21 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15001: Attachment: HDFS-15001.patch Status: Patch Available (was: Open) > Automatically add back the

[jira] [Created] (HDFS-15001) Automatically add back the failed volume if it gets better again

2019-11-21 Thread Yang Yun (Jira)
Yang Yun created HDFS-15001: --- Summary: Automatically add back the failed volume if it gets better again Key: HDFS-15001 URL: https://issues.apache.org/jira/browse/HDFS-15001 Project: Hadoop HDFS

[jira] [Commented] (HDFS-14993) checkDiskError doesn't work during datanode startup

2019-11-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16978020#comment-16978020 ] Yang Yun commented on HDFS-14993: - It looks don't work from start.  >From current code it doesn't bother

<    1   2   3   4   5   6   7   >