[jira] [Commented] (HDFS-13225) StripeReader#checkMissingBlocks() 's IOException info is incomplete

2018-03-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385757#comment-16385757 ] genericqa commented on HDFS-13225: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13223) Reduce DiffListBySkipList memory usage

2018-03-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385938#comment-16385938 ] genericqa commented on HDFS-13223: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13223) Reduce DiffListBySkipList memory usage

2018-03-05 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-13223: --- Attachment: HDFS-13223.002.patch > Reduce DiffListBySkipList memory usage >

[jira] [Commented] (HDFS-13223) Reduce DiffListBySkipList memory usage

2018-03-05 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385998#comment-16385998 ] Shashikant Banerjee commented on HDFS-13223: patch v2 fixes the checkstyle issues. > Reduce

[jira] [Created] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-05 Thread maobaolong (JIRA)
maobaolong created HDFS-13226: - Summary: RBF: We should throw the failure validate and refuse this mount entry Key: HDFS-13226 URL: https://issues.apache.org/jira/browse/HDFS-13226 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-05 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong reassigned HDFS-13226: - Assignee: maobaolong > RBF: We should throw the failure validate and refuse this mount entry >

[jira] [Updated] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-05 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong updated HDFS-13226: -- Labels: RBF (was: ) Fix Version/s: 3.2.0 Target Version/s: 3.2.0

[jira] [Commented] (HDFS-13227) Add a method to calculate cumulative diff over multiple snapshots in DirectoryDiffList

2018-03-05 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385992#comment-16385992 ] Shashikant Banerjee commented on HDFS-13227: Patch v1 introduces an method called

[jira] [Updated] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-05 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong updated HDFS-13226: -- Attachment: HDFS-13226.001.patch > RBF: We should throw the failure validate and refuse this mount

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-05 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385870#comment-16385870 ] maobaolong commented on HDFS-13215: --- Any update here? expecting. > RBF: Move Router to its own module >

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-05 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385915#comment-16385915 ] maobaolong commented on HDFS-13226: --- [~elgoiri] Do you think this is a bug? Please take a look > RBF:

[jira] [Updated] (HDFS-13227) Add a method to calculate cumulative diff over multiple snapshots in DirectoryDiffList

2018-03-05 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-13227: --- Description: This Jira proposes to add an API in DirectoryWithSnapshotFeature#f

[jira] [Created] (HDFS-13227) Add a method to calculate cumulative diff over multiple snapshots in DirectoryDiffList

2018-03-05 Thread Shashikant Banerjee (JIRA)
Shashikant Banerjee created HDFS-13227: -- Summary: Add a method to calculate cumulative diff over multiple snapshots in DirectoryDiffList Key: HDFS-13227 URL: https://issues.apache.org/jira/browse/HDFS-13227

[jira] [Commented] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-03-05 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385946#comment-16385946 ] Wei-Chiu Chuang commented on HDFS-13040: +1 branch-2 patch. Thanks! > Kerberized inotify client

[jira] [Updated] (HDFS-13227) Add a method to calculate cumulative diff over multiple snapshots in DirectoryDiffList

2018-03-05 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-13227: --- Attachment: HDFS-13227.001.patch > Add a method to calculate cumulative diff over

[jira] [Updated] (HDFS-13228) Ozone: Add support for rename key within a bucket for rpc client

2018-03-05 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-13228: --- Parent Issue: HDFS-13074 (was: HDFS-7240) > Ozone: Add support for rename key within a bucket for

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386054#comment-16386054 ] genericqa commented on HDFS-13226: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13228) Ozone: Add support for rename key within a bucket for rpc client

2018-03-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386107#comment-16386107 ] genericqa commented on HDFS-13228: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13223) Reduce DiffListBySkipList memory usage

2018-03-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386175#comment-16386175 ] genericqa commented on HDFS-13223: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13109) Support fully qualified hdfs path in EZ commands

2018-03-05 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386176#comment-16386176 ] Rushabh S Shah commented on HDFS-13109: --- Taking a look now. > Support fully qualified hdfs path in

[jira] [Updated] (HDFS-13228) Ozone: Add support for rename key within a bucket for rpc client

2018-03-05 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-13228: --- Attachment: HDFS-13228.001.patch > Ozone: Add support for rename key within a bucket for rpc client >

[jira] [Updated] (HDFS-13228) Ozone: Add support for rename key within a bucket for rpc client

2018-03-05 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-13228: --- Attachment: HDFS-13228-HDFS-7240.001.patch > Ozone: Add support for rename key within a bucket for

[jira] [Updated] (HDFS-13228) Ozone: Add support for rename key within a bucket for rpc client

2018-03-05 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-13228: --- Status: Patch Available (was: Open) > Ozone: Add support for rename key within a bucket for rpc

[jira] [Commented] (HDFS-13228) Ozone: Add support for rename key within a bucket for rpc client

2018-03-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386117#comment-16386117 ] genericqa commented on HDFS-13228: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-13228) Ozone: Add support for rename key within a bucket for rpc client

2018-03-05 Thread Lokesh Jain (JIRA)
Lokesh Jain created HDFS-13228: -- Summary: Ozone: Add support for rename key within a bucket for rpc client Key: HDFS-13228 URL: https://issues.apache.org/jira/browse/HDFS-13228 Project: Hadoop HDFS

[jira] [Updated] (HDFS-13228) Ozone: Add support for rename key within a bucket for rpc client

2018-03-05 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-13228: --- Attachment: HDFS-13228-HDFS-13074.001.patch > Ozone: Add support for rename key within a bucket for

[jira] [Updated] (HDFS-13228) Ozone: Add support for rename key within a bucket for rpc client

2018-03-05 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-13228: --- Attachment: (was: HDFS-13228.001.patch) > Ozone: Add support for rename key within a bucket for

[jira] [Updated] (HDFS-13228) Ozone: Add support for rename key within a bucket for rpc client

2018-03-05 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-13228: --- Attachment: (was: HDFS-13228-HDFS-13074.001.patch) > Ozone: Add support for rename key within a

[jira] [Updated] (HDFS-13227) Add a method to calculate cumulative diff over multiple snapshots in DirectoryDiffList

2018-03-05 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-13227: --- Status: Patch Available (was: Open) > Add a method to calculate cumulative diff

[jira] [Created] (HDFS-13229) Ozone: Add support for rename key within a bucket for rest client

2018-03-05 Thread Lokesh Jain (JIRA)
Lokesh Jain created HDFS-13229: -- Summary: Ozone: Add support for rename key within a bucket for rest client Key: HDFS-13229 URL: https://issues.apache.org/jira/browse/HDFS-13229 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13178) Disk Balancer: Add a force option to DiskBalancer Execute command

2018-03-05 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386238#comment-16386238 ] Bharat Viswanadham commented on HDFS-13178: --- Thank You [~anu] for review and [~arpitagarwal] for

[jira] [Updated] (HDFS-13229) Ozone: Add support for rename key within a bucket for rest client

2018-03-05 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-13229: --- Attachment: HDFS-13229-HDFS-7240.001.patch > Ozone: Add support for rename key within a bucket for

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-05 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386368#comment-16386368 ] Íñigo Goiri commented on HDFS-13226: I think this is a valid check. I would add a unit test and maybe

[jira] [Commented] (HDFS-13204) RBF: Optimize name service safe mode icon

2018-03-05 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386370#comment-16386370 ] Íñigo Goiri commented on HDFS-13204: bq. Yeah i mean to add federationdfshealth-router-* to

[jira] [Comment Edited] (HDFS-13204) RBF: Optimize name service safe mode icon

2018-03-05 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386370#comment-16386370 ] Íñigo Goiri edited comment on HDFS-13204 at 3/5/18 5:03 PM: bq. Yeah i mean to

[jira] [Commented] (HDFS-13109) Support fully qualified hdfs path in EZ commands

2018-03-05 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386353#comment-16386353 ] Rushabh S Shah commented on HDFS-13109: --- +HdfsAdmin.java+ If I understand the jira correctly, this

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-05 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386372#comment-16386372 ] Íñigo Goiri commented on HDFS-13215: It looks like people is mostly positive about this change. I'd go

[jira] [Assigned] (HDFS-13215) RBF: Move Router to its own module

2018-03-05 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan reassigned HDFS-13215: -- Assignee: Wei Yan > RBF: Move Router to its own module > -- > >

[jira] [Commented] (HDFS-13191) Internal buffer-sizing details are inadvertently baked into FileChecksum and BlockGroupChecksum

2018-03-05 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386395#comment-16386395 ] Ajay Kumar commented on HDFS-13191: --- Ya, it seems there is no good solution to this. {quote} If

[jira] [Created] (HDFS-13231) Extend visualization for Maintenance Mode under Datanode tab in the NameNode UI

2018-03-05 Thread Haibo Yan (JIRA)
Haibo Yan created HDFS-13231: Summary: Extend visualization for Maintenance Mode under Datanode tab in the NameNode UI Key: HDFS-13231 URL: https://issues.apache.org/jira/browse/HDFS-13231 Project:

[jira] [Updated] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-03-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13040: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.10.0 Status: Resolved

[jira] [Resolved] (HDFS-10992) file is under construction but no leases found

2018-03-05 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-10992. Resolution: Duplicate > file is under construction but no leases found >

[jira] [Updated] (HDFS-13222) Update getBlocks method to take minBlockSize in RPC calls

2018-03-05 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13222: -- Status: Patch Available (was: In Progress) > Update getBlocks method to take

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-05 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386387#comment-16386387 ] Wei Yan commented on HDFS-13215: [~elgoiri] let me take this one. > RBF: Move Router to its own module >

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-03-05 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386430#comment-16386430 ] He Xiaoqiao commented on HDFS-12749: [~kihwal] could you help to review or give some suggestions? >

[jira] [Created] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-05 Thread Wei Yan (JIRA)
Wei Yan created HDFS-13230: -- Summary: RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns Key: HDFS-13230 URL: https://issues.apache.org/jira/browse/HDFS-13230

[jira] [Commented] (HDFS-10992) file is under construction but no leases found

2018-03-05 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386458#comment-16386458 ] Wei-Chiu Chuang commented on HDFS-10992: I am wondering if a different bug caused the same error

[jira] [Commented] (HDFS-13214) RBF: Configuration on Router conflicts with client side configuration

2018-03-05 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386384#comment-16386384 ] Íñigo Goiri commented on HDFS-13214: Thanks [~linyiqun] for catching the typo in

[jira] [Commented] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-03-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386425#comment-16386425 ] Xiao Chen commented on HDFS-13040: -- I have triggered a few pre-commits but none can complete within

[jira] [Commented] (HDFS-13089) Add test to validate dfs used and no of blocks when blocks are moved across volumes

2018-03-05 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386523#comment-16386523 ] Ajay Kumar commented on HDFS-13089: --- test failure due to OOM is unrelated to patch. > Add test to

[jira] [Updated] (HDFS-13224) RBF: Mount points across multiple subclusters

2018-03-05 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13224: --- Status: Patch Available (was: Open) > RBF: Mount points across multiple subclusters >

[jira] [Commented] (HDFS-12621) Inconsistency/confusion around ViewFileSystem.getDelagation

2018-03-05 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386556#comment-16386556 ] Ajay Kumar commented on HDFS-12621: --- Currently Yarn, MapReduce jobs runs on ViewFs with existing

[jira] [Commented] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-05 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386571#comment-16386571 ] Íñigo Goiri commented on HDFS-13230: Probably right... the unit tests didn't catch this. We need to

[jira] [Commented] (HDFS-13109) Support fully qualified hdfs path in EZ commands

2018-03-05 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386577#comment-16386577 ] Xiaoyu Yao commented on HDFS-13109: --- Thanks [~shahrs87] for the review. Agree with the suggestions on

[jira] [Commented] (HDFS-13055) Aggregate usage statistics from datanodes

2018-03-05 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386595#comment-16386595 ] Ajay Kumar commented on HDFS-13055: --- Failed tests pass locally. Added javdoc comment in patch v6 to new

[jira] [Updated] (HDFS-13224) RBF: Mount points across multiple subclusters

2018-03-05 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13224: --- Attachment: HDFS-13224.000.patch > RBF: Mount points across multiple subclusters >

[jira] [Updated] (HDFS-13055) Aggregate usage statistics from datanodes

2018-03-05 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13055: -- Attachment: HDFS-13055.006.patch > Aggregate usage statistics from datanodes >

[jira] [Commented] (HDFS-13228) Ozone: Add support for rename key within a bucket for rpc client

2018-03-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386609#comment-16386609 ] genericqa commented on HDFS-13228: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13224) RBF: Mount points across multiple subclusters

2018-03-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386638#comment-16386638 ] genericqa commented on HDFS-13224: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-05 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned HDFS-13230: --- Assignee: Chao Sun > RBF: ConnectionManager's cleanup task will compare each pool's own active >

[jira] [Updated] (HDFS-13176) WebHdfs file path gets truncated when having semicolon (;) inside

2018-03-05 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zsolt Venczel updated HDFS-13176: - Status: Patch Available (was: Open) > WebHdfs file path gets truncated when having semicolon (;)

[jira] [Commented] (HDFS-13224) RBF: Mount points across multiple subclusters

2018-03-05 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386553#comment-16386553 ] Íñigo Goiri commented on HDFS-13224: I should add some documentation at some point (maybe a separate

[jira] [Updated] (HDFS-13176) WebHdfs file path gets truncated when having semicolon (;) inside

2018-03-05 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zsolt Venczel updated HDFS-13176: - Attachment: HDFS-13176.01.patch > WebHdfs file path gets truncated when having semicolon (;)

[jira] [Commented] (HDFS-13227) Add a method to calculate cumulative diff over multiple snapshots in DirectoryDiffList

2018-03-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386663#comment-16386663 ] genericqa commented on HDFS-13227: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13222) Update getBlocks method to take minBlockSize in RPC calls

2018-03-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386821#comment-16386821 ] genericqa commented on HDFS-13222: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13224) RBF: Mount points across multiple subclusters

2018-03-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386831#comment-16386831 ] genericqa commented on HDFS-13224: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-13191) Internal buffer-sizing details are inadvertently baked into FileChecksum and BlockGroupChecksum

2018-03-05 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386395#comment-16386395 ] Ajay Kumar edited comment on HDFS-13191 at 3/5/18 10:11 PM: Ya, it seems

[jira] [Commented] (HDFS-13170) Port webhdfs unmaskedpermission parameter to HTTPFS

2018-03-05 Thread Stephen O'Donnell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386867#comment-16386867 ] Stephen O'Donnell commented on HDFS-13170: -- [~xiaochen] Thanks for the review. * Syntax of the

[jira] [Commented] (HDFS-13176) WebHdfs file path gets truncated when having semicolon (;) inside

2018-03-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386872#comment-16386872 ] genericqa commented on HDFS-13176: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13170) Port webhdfs unmaskedpermission parameter to HTTPFS

2018-03-05 Thread Stephen O'Donnell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-13170: - Attachment: HDFS-13170.003.patch > Port webhdfs unmaskedpermission parameter to HTTPFS >

[jira] [Updated] (HDFS-13224) RBF: Mount points across multiple subclusters

2018-03-05 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13224: --- Attachment: HDFS-13224.002.patch > RBF: Mount points across multiple subclusters >

[jira] [Commented] (HDFS-13170) Port webhdfs unmaskedpermission parameter to HTTPFS

2018-03-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386887#comment-16386887 ] Xiao Chen commented on HDFS-13170: -- bq. checkstyle ... Sorry I missed the fact that this is due to the

[jira] [Commented] (HDFS-13109) Support fully qualified hdfs path in EZ commands

2018-03-05 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386687#comment-16386687 ] Rushabh S Shah commented on HDFS-13109: --- bq. we will still miss the relative path and path

[jira] [Commented] (HDFS-13109) Support fully qualified hdfs path in EZ commands

2018-03-05 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386710#comment-16386710 ] Rushabh S Shah commented on HDFS-13109: --- Please ignore my last comment. bq. However, the path

[jira] [Updated] (HDFS-13164) File not closed if streamer fail with DSQuotaExceededException

2018-03-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13164: - Resolution: Fixed Fix Version/s: 2.8.4 Status: Resolved (was: Patch Available) > File

[jira] [Assigned] (HDFS-240) Should HDFS restrict the names used for files?

2018-03-05 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HDFS-240: --- Assignee: (was: John Zhuge) > Should HDFS restrict the names used for files? >

[jira] [Commented] (HDFS-240) Should HDFS restrict the names used for files?

2018-03-05 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386758#comment-16386758 ] John Zhuge commented on HDFS-240: - Unfortunately don't have time to work on it. > Should HDFS restrict the

[jira] [Updated] (HDFS-13224) RBF: Mount points across multiple subclusters

2018-03-05 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13224: --- Attachment: HDFS-13224.001.patch > RBF: Mount points across multiple subclusters >

[jira] [Updated] (HDFS-13148) Unit test for EZ with KMS and Federation

2018-03-05 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-13148: -- Attachment: HDFS-13148.002.patch > Unit test for EZ with KMS and Federation >

[jira] [Commented] (HDFS-13148) Unit test for EZ with KMS and Federation

2018-03-05 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386677#comment-16386677 ] Hanisha Koneru commented on HDFS-13148: --- Thanks for the review [~xyao]. Addressed all the comments

[jira] [Commented] (HDFS-13164) File not closed if streamer fail with DSQuotaExceededException

2018-03-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386729#comment-16386729 ] genericqa commented on HDFS-13164: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13164) File not closed if streamer fail with DSQuotaExceededException

2018-03-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386739#comment-16386739 ] Xiao Chen commented on HDFS-13164: -- Test failures look unrelated to patch. Had an cdh test that passed.

[jira] [Commented] (HDFS-13164) File not closed if streamer fail with DSQuotaExceededException

2018-03-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386742#comment-16386742 ] Xiao Chen commented on HDFS-13164: -- Committed to branch-2.8. Thanks all. > File not closed if streamer

[jira] [Commented] (HDFS-13170) Port webhdfs unmaskedpermission parameter to HTTPFS

2018-03-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386964#comment-16386964 ] genericqa commented on HDFS-13170: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-13008) Ozone: Add DN container open/close state to container report

2018-03-05 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13008: -- Attachment: HDFS-13008-HDFS-7240.005.patch > Ozone: Add DN container open/close state to container

[jira] [Commented] (HDFS-13224) RBF: Mount points across multiple subclusters

2018-03-05 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386998#comment-16386998 ] Wei Yan commented on HDFS-13224: Thanks for the patch, [~elgoiri]. Took a quick pass, and the entire

[jira] [Commented] (HDFS-13224) RBF: Mount points across multiple subclusters

2018-03-05 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387012#comment-16387012 ] Íñigo Goiri commented on HDFS-13224: Thanks [~ywskycn] for the comments. * {{RANDOM}} should do the

[jira] [Commented] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-05 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387080#comment-16387080 ] Dennis Huo commented on HDFS-13056: --- Uploaded [^HDFS-13056-branch-2.8.004.patch] and 

[jira] [Updated] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-05 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated HDFS-13056: -- Attachment: HDFS-13056.007.patch > Expose file-level composite CRCs in HDFS which are comparable across

[jira] [Updated] (HDFS-13233) RBF:getMountPoint doesn't return the correct mount point of the mount table

2018-03-05 Thread wangzhiyuan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangzhiyuan updated HDFS-13233: --- Description: Method MountTableResolver->getMountPoint will traverse mount table and return the first

[jira] [Commented] (HDFS-13008) Ozone: Add DN container open/close state to container report

2018-03-05 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387195#comment-16387195 ] Nanda kumar commented on HDFS-13008: Thanks [~xyao] for updating the patch. LGTM, +1 on patch v005. I

[jira] [Commented] (HDFS-13008) Ozone: Add DN container open/close state to container report

2018-03-05 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386981#comment-16386981 ] Xiaoyu Yao commented on HDFS-13008: --- {quote}bq. Since we are already setting {{containerID}} as part of

[jira] [Updated] (HDFS-13233) RBF:getMountPoint return wrong mount point if the input path contains the mount point

2018-03-05 Thread wangzhiyuan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangzhiyuan updated HDFS-13233: --- Status: Patch Available (was: Open) > RBF:getMountPoint return wrong mount point if the input path

[jira] [Assigned] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-05 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-13056: Assignee: Dennis Huo > Expose file-level composite CRCs in HDFS which are comparable

[jira] [Updated] (HDFS-13008) Ozone: Add DN container open/close state to container report

2018-03-05 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-13008: --- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) >

[jira] [Comment Edited] (HDFS-13214) RBF: Configuration on Router conflicts with client side configuration

2018-03-05 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387211#comment-16387211 ] Yiqun Lin edited comment on HDFS-13214 at 3/6/18 3:27 AM: -- Attach the updated

[jira] [Commented] (HDFS-13195) DataNode conf page cannot display the current value after reconfig

2018-03-05 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387244#comment-16387244 ] maobaolong commented on HDFS-13195: --- [~bharatviswa] [~wheat9] Please take a look at this patch >

[jira] [Commented] (HDFS-13148) Unit test for EZ with KMS and Federation

2018-03-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386937#comment-16386937 ] genericqa commented on HDFS-13148: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13233) RBF:getMountPoint return wrong mount point if the input path contains the mount point

2018-03-05 Thread wangzhiyuan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangzhiyuan updated HDFS-13233: --- Attachment: HDFS-13233.001.patch > RBF:getMountPoint return wrong mount point if the input path

[jira] [Commented] (HDFS-13008) Ozone: Add DN container open/close state to container report

2018-03-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387184#comment-16387184 ] genericqa commented on HDFS-13008: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >