[jira] [Updated] (HDFS-13233) RBF: MountTableResolver doesn't return the correct mount point of the given path

2018-03-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13233: - Issue Type: Sub-task (was: Bug) Parent: HDFS-12615 > RBF: MountTableResolver doesn't return the c

[jira] [Updated] (HDFS-13233) RBF: MountTableResolver doesn't return the correct mount point of the given path

2018-03-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13233: - Affects Version/s: (was: 3.2.0) 3.0.0 Hadoop Flags: Reviewed Targe

[jira] [Updated] (HDFS-13233) RBF: MountTableResolver doesn't return the correct mount point of the given path

2018-03-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13233: - Resolution: Fixed Status: Resolved (was: Patch Available) > RBF: MountTableResolver doesn't retur

[jira] [Commented] (HDFS-13212) RBF: Fix router location cache issue

2018-03-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392541#comment-16392541 ] genericqa commented on HDFS-13212: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13233) RBF: MountTableResolver doesn't return the correct mount point of the given path

2018-03-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392535#comment-16392535 ] Yiqun Lin commented on HDFS-13233: -- Failed UTs are not related. +1. Committing... > RBF:

[jira] [Updated] (HDFS-13233) RBF: MountTableResolver doesn't return the correct mount point of the given path

2018-03-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13233: - Summary: RBF: MountTableResolver doesn't return the correct mount point of the given path (was: RBF: getM

[jira] [Commented] (HDFS-13233) RBF: getMountPoint doesn't return the correct mount point of the mount table

2018-03-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392523#comment-16392523 ] genericqa commented on HDFS-13233: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13240) RBF: Update some inaccurate document descriptions

2018-03-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392515#comment-16392515 ] genericqa commented on HDFS-13240: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-08 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392502#comment-16392502 ] Bharat Viswanadham commented on HDFS-13239: --- [~xiaochen] Updated patch v02, to

[jira] [Updated] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-08 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13239: -- Attachment: HDFS-13239.02.patch > Fix non-empty dir warning message when setting default

[jira] [Commented] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-08 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392482#comment-16392482 ] Bharat Viswanadham commented on HDFS-13239: --- Yes, [~xiaochen]  patch proposed so

[jira] [Commented] (HDFS-13087) Fix: Snapshots On encryption zones get incorrect EZ settings when encryption zone changes

2018-03-08 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392481#comment-16392481 ] Xiao Chen commented on HDFS-13087: -- Thanks for creating the jira and fixing it, [~GeLiXin

[jira] [Commented] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-08 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392472#comment-16392472 ] Xiao Chen commented on HDFS-13239: -- As the property name suggests, that is an NN configur

[jira] [Comment Edited] (HDFS-13240) RBF: Update some inaccurate document descriptions

2018-03-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392470#comment-16392470 ] Yiqun Lin edited comment on HDFS-13240 at 3/9/18 6:12 AM: -- Thanks

[jira] [Commented] (HDFS-13240) RBF: Update some inaccurate document descriptions

2018-03-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392470#comment-16392470 ] Yiqun Lin commented on HDFS-13240: -- Thanks for the review, [~ywskycn]! {quote} This one l

[jira] [Updated] (HDFS-13240) RBF: Update some inaccurate document descriptions

2018-03-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13240: - Attachment: HDFS-13240.002.patch > RBF: Update some inaccurate document descriptions > ---

[jira] [Commented] (HDFS-13252) Code refactoring: Remove Diff.ListType

2018-03-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392467#comment-16392467 ] genericqa commented on HDFS-13252: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-13233) RBF: getMountPoint doesn't return the correct mount point of the mount table

2018-03-08 Thread wangzhiyuan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392445#comment-16392445 ] wangzhiyuan edited comment on HDFS-13233 at 3/9/18 5:51 AM: Hi

[jira] [Comment Edited] (HDFS-13233) RBF: getMountPoint doesn't return the correct mount point of the mount table

2018-03-08 Thread wangzhiyuan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392445#comment-16392445 ] wangzhiyuan edited comment on HDFS-13233 at 3/9/18 5:50 AM: Hi

[jira] [Commented] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-08 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392449#comment-16392449 ] Bharat Viswanadham commented on HDFS-13239: --- Hi [~xiaochen] If you see the upda

[jira] [Commented] (HDFS-13233) RBF: getMountPoint doesn't return the correct mount point of the mount table

2018-03-08 Thread wangzhiyuan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392445#comment-16392445 ] wangzhiyuan commented on HDFS-13233: Hi [~linyiqun]  OK, will fix it > RBF: getMount

[jira] [Commented] (HDFS-13212) RBF: Fix router location cache issue

2018-03-08 Thread Weiwei Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392430#comment-16392430 ] Weiwei Wu commented on HDFS-13212: -- Add a default name service id "0" in the TestMountTab

[jira] [Updated] (HDFS-13212) RBF: Fix router location cache issue

2018-03-08 Thread Weiwei Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Wu updated HDFS-13212: - Attachment: HDFS-13212-008.patch > RBF: Fix router location cache issue >

[jira] [Commented] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-08 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392391#comment-16392391 ] Ajay Kumar commented on HDFS-13056: --- [~dennishuo] thanks for updating the patch to handl

[jira] [Commented] (HDFS-11394) Add method for getting erasure coding policy through WebHDFS

2018-03-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392380#comment-16392380 ] genericqa commented on HDFS-11394: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392379#comment-16392379 ] genericqa commented on HDFS-13224: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13235) DiskBalancer: Update Documentation to add newly added options

2018-03-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392362#comment-16392362 ] genericqa commented on HDFS-13235: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-13233) RBF: getMountPoint doesn't return the correct mount point of the mount table

2018-03-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13233: - Attachment: HDFS-13233.005.patch > RBF: getMountPoint doesn't return the correct mount point of the mount

[jira] [Commented] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-08 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392355#comment-16392355 ] Xiao Chen commented on HDFS-13239: -- If you look into the code, null is handled at: {code:

[jira] [Commented] (HDFS-13233) RBF: getMountPoint doesn't return the correct mount point of the mount table

2018-03-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392353#comment-16392353 ] Yiqun Lin commented on HDFS-13233: -- Thanks for fixing this, [~striver.wang]. LGTM, +1 Bef

[jira] [Updated] (HDFS-13252) Code refactoring: Remove Diff.ListType

2018-03-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-13252: --- Status: Patch Available (was: Open) > Code refactoring: Remove Diff.ListType > --

[jira] [Commented] (HDFS-13252) Code refactoring: Remove Diff.ListType

2018-03-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392335#comment-16392335 ] Tsz Wo Nicholas Sze commented on HDFS-13252: h13252_20170308.patch: 1st patch

[jira] [Updated] (HDFS-13252) Code refactoring: Remove Diff.ListType

2018-03-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-13252: --- Attachment: h13252_20170308.patch > Code refactoring: Remove Diff.ListType > -

[jira] [Created] (HDFS-13252) Code refactoring: Remove Diff.ListType

2018-03-08 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-13252: -- Summary: Code refactoring: Remove Diff.ListType Key: HDFS-13252 URL: https://issues.apache.org/jira/browse/HDFS-13252 Project: Hadoop HDFS Issue

[jira] [Comment Edited] (HDFS-13243) Get CorruptBlock because of calling close and sync in same time

2018-03-08 Thread Zephyr Guo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392309#comment-16392309 ] Zephyr Guo edited comment on HDFS-13243 at 3/9/18 2:55 AM: --- {{[~

[jira] [Comment Edited] (HDFS-13243) Get CorruptBlock because of calling close and sync in same time

2018-03-08 Thread Zephyr Guo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392309#comment-16392309 ] Zephyr Guo edited comment on HDFS-13243 at 3/9/18 2:54 AM: --- {{[~

[jira] [Commented] (HDFS-13243) Get CorruptBlock because of calling close and sync in same time

2018-03-08 Thread Zephyr Guo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392309#comment-16392309 ] Zephyr Guo commented on HDFS-13243: --- {{[~jojochuang], Thanks for reviewing.}} {{{quote}

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392308#comment-16392308 ] Yiqun Lin commented on HDFS-13226: -- [~maobaolong], thanks for updating the patch. Besides

[jira] [Updated] (HDFS-13251) Avoid using hard coded datanode data dirs in unit tests

2018-03-08 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13251: -- Description: There are a few unit tests that rely on hard-coded MiniDFSCluster data dir names.   * Te

[jira] [Created] (HDFS-13251) Avoid using hard coded datanode data dirs in unit tests

2018-03-08 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-13251: - Summary: Avoid using hard coded datanode data dirs in unit tests Key: HDFS-13251 URL: https://issues.apache.org/jira/browse/HDFS-13251 Project: Hadoop HDFS Issue T

[jira] [Commented] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392270#comment-16392270 ] genericqa commented on HDFS-13239: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13235) DiskBalancer: Update Documentation to add newly added options

2018-03-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392260#comment-16392260 ] Arpit Agarwal commented on HDFS-13235: -- +1 pending Jenkins. > DiskBalancer: Update D

[jira] [Commented] (HDFS-11394) Add method for getting erasure coding policy through WebHDFS

2018-03-08 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392240#comment-16392240 ] Hanisha Koneru commented on HDFS-11394: --- Thanks for the review, [~arpitagarwal]. Ad

[jira] [Updated] (HDFS-11394) Add method for getting erasure coding policy through WebHDFS

2018-03-08 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11394: -- Attachment: HDFS-11394.006.patch > Add method for getting erasure coding policy through WebHDFS

[jira] [Commented] (HDFS-13235) DiskBalancer: Update Documentation to add newly added options

2018-03-08 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392218#comment-16392218 ] Bharat Viswanadham commented on HDFS-13235: --- Thank You [~arpitagarwal] for revie

[jira] [Updated] (HDFS-13235) DiskBalancer: Update Documentation to add newly added options

2018-03-08 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13235: -- Attachment: HDFS-13235.01.patch > DiskBalancer: Update Documentation to add newly added

[jira] [Updated] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13224: --- Attachment: HDFS-13224.004.patch > RBF: Resolvers to support mount points across multiple subclusters

[jira] [Commented] (HDFS-13235) DiskBalancer: Update Documentation to add newly added options

2018-03-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392192#comment-16392192 ] Arpit Agarwal commented on HDFS-13235: -- Thanks for updating the docs [~bharatviswa].

[jira] [Commented] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-08 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392176#comment-16392176 ] Dennis Huo commented on HDFS-13056: --- Variable-sized blocks within a file are indeed supp

[jira] [Commented] (HDFS-13244) Add stack, conf, metrics links to utilities dropdown in NN webUI

2018-03-08 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392179#comment-16392179 ] Hanisha Koneru commented on HDFS-13244: --- No but just wanted Jenkins to +1 it to foll

[jira] [Comment Edited] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-08 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392175#comment-16392175 ] Bharat Viswanadham edited comment on HDFS-13239 at 3/9/18 12:39 AM:

[jira] [Commented] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-08 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392175#comment-16392175 ] Bharat Viswanadham commented on HDFS-13239: --- Hi [~xiaochen] As we are reading t

[jira] [Commented] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392165#comment-16392165 ] genericqa commented on HDFS-13224: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-08 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392142#comment-16392142 ] Xiao Chen commented on HDFS-13239: -- Thanks [~hanishakoneru] for reporting the issue and [

[jira] [Commented] (HDFS-13250) RBF: Router to manage requests across multiple subclusters

2018-03-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392136#comment-16392136 ] Íñigo Goiri commented on HDFS-13250: I added [^HDFS-13250.000.patch] temporarily until

[jira] [Updated] (HDFS-13250) RBF: Router to manage requests across multiple subclusters

2018-03-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13250: --- Attachment: HDFS-13250.000.patch > RBF: Router to manage requests across multiple subclusters > --

[jira] [Updated] (HDFS-13250) RBF: Router to manage requests across multiple subclusters

2018-03-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13250: --- Description: HDFS-13124 introduces the concept of mount points spanning multiple subclusters. The Rout

[jira] [Commented] (HDFS-11394) Add method for getting erasure coding policy through WebHDFS

2018-03-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392122#comment-16392122 ] Arpit Agarwal commented on HDFS-11394: -- The patch looks good. +1 with the javac war

[jira] [Assigned] (HDFS-13250) RBF: Router to manage requests across multiple subclusters

2018-03-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri reassigned HDFS-13250: -- Assignee: Íñigo Goiri > RBF: Router to manage requests across multiple subclusters > --

[jira] [Commented] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392120#comment-16392120 ] Íñigo Goiri commented on HDFS-13224: In [^HDFS-13224.003.patch] I left only the resol

[jira] [Created] (HDFS-13250) RBF: Router to manage requests across multiple subclusters

2018-03-08 Thread JIRA
Íñigo Goiri created HDFS-13250: -- Summary: RBF: Router to manage requests across multiple subclusters Key: HDFS-13250 URL: https://issues.apache.org/jira/browse/HDFS-13250 Project: Hadoop HDFS Is

[jira] [Updated] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13224: --- Attachment: HDFS-13224.003.patch > RBF: Resolvers to support mount points across multiple subclusters

[jira] [Commented] (HDFS-13136) Avoid taking FSN lock while doing group member lookup for FSD permission check

2018-03-08 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392106#comment-16392106 ] Xiaoyu Yao commented on HDFS-13136: --- Agree, HADOOP-11238 + HADOOP-13263 definitely will

[jira] [Commented] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392107#comment-16392107 ] Arpit Agarwal commented on HDFS-13056: -- Hi [~dennishuo], I haven't read your design d

[jira] [Updated] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13224: --- Summary: RBF: Resolvers to support mount points across multiple subclusters (was: RBF: Mount points a

[jira] [Commented] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-08 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392096#comment-16392096 ] Hanisha Koneru commented on HDFS-13239: --- Thanks [~bharatviswa]. +1 for patch v01 pe

[jira] [Commented] (HDFS-13148) Unit test for EZ with KMS and Federation

2018-03-08 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392091#comment-16392091 ] Hanisha Koneru commented on HDFS-13148: --- Hi [~shahrs87], thanks for the review. If

[jira] [Commented] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-08 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392071#comment-16392071 ] Bharat Viswanadham commented on HDFS-13239: --- [~hanishakoneru] Thanks for the rev

[jira] [Updated] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-08 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13239: -- Attachment: HDFS-13239.01.patch > Fix non-empty dir warning message when setting default

[jira] [Commented] (HDFS-13141) WebHDFS: Add support for getting snasphottable directory list

2018-03-08 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392068#comment-16392068 ] Xiaoyu Yao commented on HDFS-13141: --- Thanks [~ljain] for working on this. The patch look

[jira] [Commented] (HDFS-13190) Document WebHDFS support for snasphot diff

2018-03-08 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391937#comment-16391937 ] Xiaoyu Yao commented on HDFS-13190: --- Thanks [~ljain] for the update. v2 patch LGTM, +1 p

[jira] [Commented] (HDFS-12614) FSPermissionChecker#getINodeAttrs() throws NPE when INodeAttributesProvider configured

2018-03-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391888#comment-16391888 ] Kihwal Lee commented on HDFS-12614: --- Committed to branch-2, branch-2.9 and branch-2.8.

[jira] [Updated] (HDFS-12614) FSPermissionChecker#getINodeAttrs() throws NPE when INodeAttributesProvider configured

2018-03-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-12614: -- Fix Version/s: 2.8.4 2.9.1 2.10.0 > FSPermissionChecker#getINodeAt

[jira] [Commented] (HDFS-13244) Add stack, conf, metrics links to utilities dropdown in NN webUI

2018-03-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391854#comment-16391854 ] Íñigo Goiri commented on HDFS-13244: Does Jenkins check anything for html and js? > A

[jira] [Commented] (HDFS-12614) FSPermissionChecker#getINodeAttrs() throws NPE when INodeAttributesProvider configured

2018-03-08 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391850#comment-16391850 ] Xiao Chen commented on HDFS-12614: -- +1 based on diff. Thanks Kihwal! > FSPermissionCheck

[jira] [Commented] (HDFS-13244) Add stack, conf, metrics links to utilities dropdown in NN webUI

2018-03-08 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391848#comment-16391848 ] Hanisha Koneru commented on HDFS-13244: --- +1 pending Jenkins. Will trigger a Jenkins

[jira] [Commented] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-08 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391816#comment-16391816 ] Hanisha Koneru commented on HDFS-13239: --- Thanks [~bharatviswa]. Got it now. Can we

[jira] [Commented] (HDFS-13232) RBF: ConnectionPool should return first usable connection

2018-03-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391756#comment-16391756 ] Íñigo Goiri commented on HDFS-13232: This is what happens when you mess up the commit

[jira] [Commented] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-08 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391751#comment-16391751 ] Bharat Viswanadham commented on HDFS-13239: --- Hi [~hanishakoneru] I have thought

[jira] [Commented] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-08 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391730#comment-16391730 ] Hanisha Koneru commented on HDFS-13239: --- Thanks for working on this, [~bharatviswa].

[jira] [Commented] (HDFS-13232) RBF: ConnectionPool should return first usable connection

2018-03-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391726#comment-16391726 ] Hudson commented on HDFS-13232: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-13186) [WRITE] Multipart Multinode uploader API + Implementations

2018-03-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391714#comment-16391714 ] genericqa commented on HDFS-13186: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391695#comment-16391695 ] Íñigo Goiri commented on HDFS-13230: {quote} BTW, you forgot branch-2? {quote} Committ

[jira] [Updated] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13230: --- Fix Version/s: 2.10.0 > RBF: ConnectionManager's cleanup task will compare each pool's own active > c

[jira] [Updated] (HDFS-13190) Document WebHDFS support for snasphot diff

2018-03-08 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-13190: --- Attachment: HDFS-13190.002.patch > Document WebHDFS support for snasphot diff > --

[jira] [Commented] (HDFS-13190) Document WebHDFS support for snasphot diff

2018-03-08 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391685#comment-16391685 ] Lokesh Jain commented on HDFS-13190: [~ajisakaa] Thanks for reviewing the patch! v2 pa

[jira] [Commented] (HDFS-12614) FSPermissionChecker#getINodeAttrs() throws NPE when INodeAttributesProvider configured

2018-03-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391680#comment-16391680 ] Kihwal Lee commented on HDFS-12614: --- Attaching a branch-2 version. The only change is i

[jira] [Updated] (HDFS-12614) FSPermissionChecker#getINodeAttrs() throws NPE when INodeAttributesProvider configured

2018-03-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-12614: -- Attachment: HDFS-12614.branch-2.patch > FSPermissionChecker#getINodeAttrs() throws NPE when INodeAttribu

[jira] [Created] (HDFS-13249) Document webhdfs support for getting snapshottable directory list

2018-03-08 Thread Lokesh Jain (JIRA)
Lokesh Jain created HDFS-13249: -- Summary: Document webhdfs support for getting snapshottable directory list Key: HDFS-13249 URL: https://issues.apache.org/jira/browse/HDFS-13249 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13212) RBF: Fix router location cache issue

2018-03-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391628#comment-16391628 ] Íñigo Goiri commented on HDFS-13212: After a deeper look, the part that concerns me is

[jira] [Commented] (HDFS-13236) Standby NN down with error encountered while tailing edits

2018-03-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391622#comment-16391622 ] Kihwal Lee commented on HDFS-13236: --- For block placement differences, {{DFSNetworkTopolo

[jira] [Assigned] (HDFS-13212) RBF: Fix router location cache issue

2018-03-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri reassigned HDFS-13212: -- Assignee: Weiwei Wu > RBF: Fix router location cache issue > --

[jira] [Commented] (HDFS-13233) RBF: getMountPoint doesn't return the correct mount point of the mount table

2018-03-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391611#comment-16391611 ] Íñigo Goiri commented on HDFS-13233: Thanks [~striver.wang] for the fix. The fix to {{

[jira] [Commented] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-08 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391607#comment-16391607 ] Wei Yan commented on HDFS-13230: {quote}I would hate to waste a Yetus so clean as this one

[jira] [Commented] (HDFS-11481) hdfs snapshotDiff /.reserved/raw/... fails on snapshottable directories

2018-03-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391601#comment-16391601 ] Yongjun Zhang commented on HDFS-11481: -- Hi [~mavinmar...@gmail.com], Thanks for your

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391604#comment-16391604 ] Íñigo Goiri commented on HDFS-13226: I like the new unit test in [^HDFS-13226.005.pat

[jira] [Commented] (HDFS-13241) RBF: TestRouterSafemode failed if the port 8888 is in use

2018-03-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391596#comment-16391596 ] Íñigo Goiri commented on HDFS-13241: Surprising that this only affects this unit test.

[jira] [Commented] (HDFS-12615) Router-based HDFS federation phase 2

2018-03-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391593#comment-16391593 ] Íñigo Goiri commented on HDFS-12615: {quote} BTW, I have a question, should us config

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391591#comment-16391591 ] genericqa commented on HDFS-13226: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-08 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391586#comment-16391586 ] Chao Sun commented on HDFS-13230: - Thanks [~elgoiri] and [~ywskycn] for the review! BTW: I

  1   2   >