[jira] [Updated] (HDFS-9666) Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read

2018-03-01 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-9666: Attachment: HDFS-9666.003.patch > Enable hdfs-client to read even remote SSD/RAM prior to local disk

[jira] [Created] (HDFS-13218) Log audit event only used last EC policy name when add multiple policies from file

2018-03-01 Thread liaoyuxiangqin (JIRA)
liaoyuxiangqin created HDFS-13218: - Summary: Log audit event only used last EC policy name when add multiple policies from file Key: HDFS-13218 URL: https://issues.apache.org/jira/browse/HDFS-13218

[jira] [Created] (HDFS-13217) Log audit event only used last EC policy name when add multiple policies from file

2018-03-01 Thread liaoyuxiangqin (JIRA)
liaoyuxiangqin created HDFS-13217: - Summary: Log audit event only used last EC policy name when add multiple policies from file Key: HDFS-13217 URL: https://issues.apache.org/jira/browse/HDFS-13217

[jira] [Comment Edited] (HDFS-13212) RBF: Fix router location cache issue

2018-03-01 Thread Weiwei Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383260#comment-16383260 ] Weiwei Wu edited comment on HDFS-13212 at 3/2/18 6:51 AM: -- [~elgoiri] [~linyiqun]

[jira] [Commented] (HDFS-13212) RBF: Fix router location cache issue

2018-03-01 Thread Weiwei Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383260#comment-16383260 ] Weiwei Wu commented on HDFS-13212: -- [~elgoiri] [~linyiqun] Upload a new patch with unit test, please

[jira] [Updated] (HDFS-13212) RBF: Fix router location cache issue

2018-03-01 Thread Weiwei Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Wu updated HDFS-13212: - Attachment: HDFS-13212-002.patch > RBF: Fix router location cache issue >

[jira] [Commented] (HDFS-13214) RBF: Configuration on Router conflicts with client side configuration

2018-03-01 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383236#comment-16383236 ] Tao Jie commented on HDFS-13214: [~elgoiri] [~ywskycn] [~linyiqun] thank you for your response. {quote} In

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-01 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383206#comment-16383206 ] maobaolong commented on HDFS-13215: --- +1, good idea.  > RBF: Move Router to its own module >

[jira] [Commented] (HDFS-13197) Ozone: Fix ConfServlet#getOzoneTags cmd after HADOOP-15007

2018-03-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383195#comment-16383195 ] genericqa commented on HDFS-13197: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-01 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383178#comment-16383178 ] Dennis Huo commented on HDFS-13056: --- Added [^HDFS-13056.005.patch] to fix TestHdfsConfigFields (and also

[jira] [Updated] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-01 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated HDFS-13056: -- Status: Patch Available (was: Open) > Expose file-level composite CRCs in HDFS which are comparable

[jira] [Updated] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-01 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated HDFS-13056: -- Status: Open (was: Patch Available) > Expose file-level composite CRCs in HDFS which are comparable

[jira] [Updated] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-01 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated HDFS-13056: -- Attachment: HDFS-13056.005.patch > Expose file-level composite CRCs in HDFS which are comparable across

[jira] [Commented] (HDFS-9666) Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read

2018-03-01 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383168#comment-16383168 ] Jiandan Yang commented on HDFS-9666: - fix compiler error and upload v2 patch > Enable hdfs-client to

[jira] [Updated] (HDFS-9666) Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read

2018-03-01 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-9666: Attachment: HDFS-9666.002.patch > Enable hdfs-client to read even remote SSD/RAM prior to local disk

[jira] [Commented] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383166#comment-16383166 ] genericqa commented on HDFS-13056: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-01 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383162#comment-16383162 ] Dennis Huo commented on HDFS-13056: --- Also added a backport to branch-2.8 which I was able to

[jira] [Updated] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-01 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated HDFS-13056: -- Attachment: HDFS-13056-branch-2.8.002.patch > Expose file-level composite CRCs in HDFS which are

[jira] [Commented] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383143#comment-16383143 ] genericqa commented on HDFS-13056: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9666) Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read

2018-03-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383136#comment-16383136 ] genericqa commented on HDFS-9666: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13210) Fix the typo in MiniDFSCluster class

2018-03-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383126#comment-16383126 ] Hudson commented on HDFS-13210: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #13756 (See

[jira] [Updated] (HDFS-13210) Fix the typo in MiniDFSCluster class

2018-03-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13210: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 Status: Resolved

[jira] [Commented] (HDFS-13210) Fix the typo in MiniDFSCluster class

2018-03-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383125#comment-16383125 ] Yiqun Lin commented on HDFS-13210: -- +1. > Fix the typo in MiniDFSCluster class >

[jira] [Commented] (HDFS-13210) Fix the typo in MiniDFSCluster class

2018-03-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383120#comment-16383120 ] genericqa commented on HDFS-13210: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-03-01 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383114#comment-16383114 ] He Xiaoqiao commented on HDFS-13183: [~xkrogen] {quote}if the SbNN goes down, the ANN is not aware of

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-03-01 Thread TanYuxin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383110#comment-16383110 ] TanYuxin commented on HDFS-12749: - Thanks [~hexiaoqiao]  [~xkrogen] very much for reviewing and resolving

[jira] [Resolved] (HDFS-13216) HDFS

2018-03-01 Thread mster (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mster resolved HDFS-13216. -- Resolution: Fixed > HDFS > > > Key: HDFS-13216 > URL:

[jira] [Updated] (HDFS-13216) HDFS

2018-03-01 Thread mster (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mster updated HDFS-13216: - Priority: Trivial (was: Major) Issue Type: Task (was: Bug) > HDFS > > > Key:

[jira] [Updated] (HDFS-13216) HDFS

2018-03-01 Thread mster (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mster updated HDFS-13216: - Affects Version/s: (was: 3.0.0) Description: (was: if (!isRef && isDir && dir.isWithSnapshot())

[jira] [Commented] (HDFS-12641) Backport HDFS-11755 into branch-2.7 to fix a regression in HDFS-11445

2018-03-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383085#comment-16383085 ] genericqa commented on HDFS-12641: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9666) Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read

2018-03-01 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-9666: Status: Patch Available (was: Open) > Enable hdfs-client to read even remote SSD/RAM prior to local

[jira] [Assigned] (HDFS-9666) Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read

2018-03-01 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang reassigned HDFS-9666: --- Assignee: Jiandan Yang (was: ade) > Enable hdfs-client to read even remote SSD/RAM prior to

[jira] [Commented] (HDFS-9666) Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read

2018-03-01 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383083#comment-16383083 ] Jiandan Yang commented on HDFS-9666: - upload v1 patch based trunk > Enable hdfs-client to read even

[jira] [Updated] (HDFS-9666) Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read

2018-03-01 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-9666: Attachment: HDFS-9666.001.patch > Enable hdfs-client to read even remote SSD/RAM prior to local disk

[jira] [Updated] (HDFS-13216) HDFS

2018-03-01 Thread mster (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mster updated HDFS-13216: - Component/s: snapshots > HDFS > > > Key: HDFS-13216 > URL:

[jira] [Updated] (HDFS-13216) HDFS

2018-03-01 Thread mster (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mster updated HDFS-13216: - Description: if (!isRef && isDir && dir.isWithSnapshot()) { } else if (isRef && isDir && !lastComp) { // we

[jira] [Commented] (HDFS-13204) RBF: Optimize name service safe mode icon

2018-03-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383076#comment-16383076 ] Íñigo Goiri commented on HDFS-13204: What would {{federationdfshealth-router-safemode}} be? > RBF:

[jira] [Commented] (HDFS-13214) RBF: Configuration on Router conflicts with client side configuration

2018-03-01 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383074#comment-16383074 ] Yiqun Lin commented on HDFS-13214: -- Hi [~Tao Jie], I just looked into the related logic of this. Looks

[jira] [Commented] (HDFS-12641) Backport HDFS-11755 into branch-2.7 to fix a regression in HDFS-11445

2018-03-01 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383065#comment-16383065 ] Arpit Agarwal commented on HDFS-12641: -- +1 on the change, it looks correct to me. I also see the new

[jira] [Commented] (HDFS-12257) Expose getSnapshottableDirListing as a public API in HdfsAdmin

2018-03-01 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383063#comment-16383063 ] Huafeng Wang commented on HDFS-12257: - Hi [~Sammi], I'm not sure about that. The patch hasn't been

[jira] [Commented] (HDFS-11885) createEncryptionZone should not block on initializing EDEK cache

2018-03-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383051#comment-16383051 ] genericqa commented on HDFS-11885: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11885) createEncryptionZone should not block on initializing EDEK cache

2018-03-01 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383049#comment-16383049 ] SammiChen commented on HDFS-11885: -- Is it still on target for 2.9.1?  If not, can we push this out from

[jira] [Commented] (HDFS-13204) RBF: Optimize name service safe mode icon

2018-03-01 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383039#comment-16383039 ] maobaolong commented on HDFS-13204: --- [~elgoiri] Do you think the following make sense? - Routers -

[jira] [Updated] (HDFS-13216) HDFS

2018-03-01 Thread mster (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mster updated HDFS-13216: - Description: if (!isRef && isDir && dir.isWithSnapshot()) { //if the path is a non-snapshot path, update the

[jira] [Commented] (HDFS-12257) Expose getSnapshottableDirListing as a public API in HdfsAdmin

2018-03-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383034#comment-16383034 ] genericqa commented on HDFS-12257: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-12257) Expose getSnapshottableDirListing as a public API in HdfsAdmin

2018-03-01 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383028#comment-16383028 ] SammiChen edited comment on HDFS-12257 at 3/2/18 2:29 AM: -- Hi  [~HuafengWang], 

[jira] [Commented] (HDFS-12257) Expose getSnapshottableDirListing as a public API in HdfsAdmin

2018-03-01 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383028#comment-16383028 ] SammiChen commented on HDFS-12257: -- Hi  [~HuafengWang],  does this target for 2.9.1?  If not, can we push

[jira] [Updated] (HDFS-13216) HDFS

2018-03-01 Thread mster (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mster updated HDFS-13216: - Labels: INodesInPath (was: ) > HDFS > > > Key: HDFS-13216 > URL:

[jira] [Updated] (HDFS-13216) HDFS

2018-03-01 Thread mster (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mster updated HDFS-13216: - Affects Version/s: 3.0.0 > HDFS > > > Key: HDFS-13216 > URL:

[jira] [Updated] (HDFS-13216) HDFS

2018-03-01 Thread mster (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mster updated HDFS-13216: - Component/s: hdfs > HDFS > > > Key: HDFS-13216 > URL:

[jira] [Created] (HDFS-13216) HDFS

2018-03-01 Thread mster (JIRA)
mster created HDFS-13216: Summary: HDFS Key: HDFS-13216 URL: https://issues.apache.org/jira/browse/HDFS-13216 Project: Hadoop HDFS Issue Type: Bug Reporter: mster -- This message

[jira] [Commented] (HDFS-1686) Federation: Add more Balancer tests with federation setting

2018-03-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383010#comment-16383010 ] genericqa commented on HDFS-1686: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13197) Ozone: Fix ConfServlet#getOzoneTags cmd after HADOOP-15007

2018-03-01 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13197: -- Status: Patch Available (was: Open) > Ozone: Fix ConfServlet#getOzoneTags cmd after HADOOP-15007 >

[jira] [Commented] (HDFS-13210) Fix the typo in MiniDFSCluster class

2018-03-01 Thread fang zhenyi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382941#comment-16382941 ] fang zhenyi commented on HDFS-13210: Fix checkstyle in HDFS-13210.003.patch. > Fix the typo in

[jira] [Updated] (HDFS-13210) Fix the typo in MiniDFSCluster class

2018-03-01 Thread fang zhenyi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fang zhenyi updated HDFS-13210: --- Status: In Progress (was: Patch Available) > Fix the typo in MiniDFSCluster class >

[jira] [Updated] (HDFS-13210) Fix the typo in MiniDFSCluster class

2018-03-01 Thread fang zhenyi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fang zhenyi updated HDFS-13210: --- Attachment: HDFS-13210.003.patch > Fix the typo in MiniDFSCluster class >

[jira] [Updated] (HDFS-13210) Fix the typo in MiniDFSCluster class

2018-03-01 Thread fang zhenyi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fang zhenyi updated HDFS-13210: --- Status: Patch Available (was: In Progress) > Fix the typo in MiniDFSCluster class >

[jira] [Commented] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-01 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382938#comment-16382938 ] Dennis Huo commented on HDFS-13056: --- [~ajayydv] Thanks for helping test and reviewing! Applied most of

[jira] [Updated] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-01 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated HDFS-13056: -- Status: Patch Available (was: Open) > Expose file-level composite CRCs in HDFS which are comparable

[jira] [Updated] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-01 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated HDFS-13056: -- Status: Open (was: Patch Available) > Expose file-level composite CRCs in HDFS which are comparable

[jira] [Updated] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-01 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated HDFS-13056: -- Attachment: HDFS-13056.004.patch > Expose file-level composite CRCs in HDFS which are comparable across

[jira] [Commented] (HDFS-11394) Add method for getting erasure coding policy through WebHDFS

2018-03-01 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382905#comment-16382905 ] Hanisha Koneru commented on HDFS-11394: --- Hi [~lewuathe], are you planning to continue working on

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-01 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382888#comment-16382888 ] Chris Douglas commented on HDFS-13215: -- Breaking server-side code into multiple modules is less

[jira] [Updated] (HDFS-13197) Ozone: Fix ConfServlet#getOzoneTags cmd after HADOOP-15007

2018-03-01 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13197: -- Attachment: HDFS-13197-HDFS-7240.000.patch > Ozone: Fix ConfServlet#getOzoneTags cmd after HADOOP-15007

[jira] [Updated] (HDFS-1686) Federation: Add more Balancer tests with federation setting

2018-03-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-1686: -- Hadoop Flags: Reviewed +1 the 02 patch looks good. Will wait for the Jenkins report. >

[jira] [Updated] (HDFS-13197) Ozone: Fix ConfServlet#getOzoneTags cmd after HADOOP-15007

2018-03-01 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13197: -- Fix Version/s: HDFS-7240 > Ozone: Fix ConfServlet#getOzoneTags cmd after HADOOP-15007 >

[jira] [Comment Edited] (HDFS-13171) Handle Deletion of nodes in SnasphotSkipList

2018-03-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382768#comment-16382768 ] Tsz Wo Nicholas Sze edited comment on HDFS-13171 at 3/1/18 10:44 PM: -

[jira] [Commented] (HDFS-1686) Federation: Add more Balancer tests with federation setting

2018-03-01 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382795#comment-16382795 ] Bharat Viswanadham commented on HDFS-1686: -- [~szetszwo] Thanks for review. replication factor is

[jira] [Updated] (HDFS-1686) Federation: Add more Balancer tests with federation setting

2018-03-01 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-1686: - Attachment: HDFS-1686.02.patch > Federation: Add more Balancer tests with federation

[jira] [Commented] (HDFS-13211) Fix a bug in DirectoryDiffList.getMinListForRange

2018-03-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382790#comment-16382790 ] Hudson commented on HDFS-13211: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13752 (See

[jira] [Commented] (HDFS-13171) Handle Deletion of nodes in SnasphotSkipList

2018-03-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382768#comment-16382768 ] Tsz Wo Nicholas Sze commented on HDFS-13171: - As mentioned previously, the remove code never

[jira] [Updated] (HDFS-13211) Fix a bug in DirectoryDiffList.getMinListForRange

2018-03-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-13211: --- Description: HDFS-13102 implements the DiffList interface for storing Directory Diffs

[jira] [Updated] (HDFS-13211) Fix a bug in DirectoryDiffList.getMinListForRange

2018-03-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-13211: --- Resolution: Fixed Fix Version/s: 3.2.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-13211) Fix a bug in DirectoryDiffList.getMinListForRange

2018-03-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-13211: --- Summary: Fix a bug in DirectoryDiffList.getMinListForRange (was: Refactor Unit

[jira] [Updated] (HDFS-13211) Fix a bug in DirectoryDiffList.getMinListForRange

2018-03-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-13211: --- Hadoop Flags: Reviewed +1 the 002 patch looks good. > Fix a bug in

[jira] [Commented] (HDFS-1686) Federation: Add more Balancer tests with federation setting

2018-03-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382663#comment-16382663 ] Tsz Wo Nicholas Sze commented on HDFS-1686: --- - Question: why multiplying replication in computing

[jira] [Resolved] (HDFS-13206) IllegalStateException: Unable to finalize edits file

2018-03-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-13206. --- Resolution: Invalid > IllegalStateException: Unable to finalize edits file >

[jira] [Commented] (HDFS-13212) RBF: Fix router location cache issue

2018-03-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382554#comment-16382554 ] Íñigo Goiri commented on HDFS-13212: HDFS-13208 reported the same issue (closed as duplicated of this

[jira] [Commented] (HDFS-1686) Federation: Add more Balancer tests with federation setting

2018-03-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382533#comment-16382533 ] Tsz Wo Nicholas Sze commented on HDFS-1686: --- Sure, will do. > Federation: Add more Balancer

[jira] [Comment Edited] (HDFS-13208) RBF: Mount path not available after ADD-REMOVE-ADD

2018-03-01 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382519#comment-16382519 ] Wei Yan edited comment on HDFS-13208 at 3/1/18 7:40 PM: Ok, finally I got through

[jira] [Resolved] (HDFS-13208) RBF: Mount path not available after ADD-REMOVE-ADD

2018-03-01 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan resolved HDFS-13208. Resolution: Duplicate > RBF: Mount path not available after ADD-REMOVE-ADD >

[jira] [Commented] (HDFS-13208) RBF: Mount path not available after ADD-REMOVE-ADD

2018-03-01 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382519#comment-16382519 ] Wei Yan commented on HDFS-13208: Ok, finally I got through the pipeline. In short, it can be resolved by

[jira] [Commented] (HDFS-1686) Federation: Add more Balancer tests with federation setting

2018-03-01 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382512#comment-16382512 ] Bharat Viswanadham commented on HDFS-1686: -- Hi [~szetszwo] Can you help in reviewing this jira?  

[jira] [Commented] (HDFS-5226) Trash::moveToTrash doesn't work across multiple namespace

2018-03-01 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382499#comment-16382499 ] Bharat Viswanadham commented on HDFS-5226: -- [~jrottinghuis] Thank You for reporting this. I

[jira] [Comment Edited] (HDFS-12512) RBF: Add WebHDFS

2018-03-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16358972#comment-16358972 ] Íñigo Goiri edited comment on HDFS-12512 at 3/1/18 6:16 PM: It doesn't look

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382416#comment-16382416 ] Íñigo Goiri commented on HDFS-13215: YARN itself has done a pretty good job at partitioning the

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-01 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382413#comment-16382413 ] Wei Yan commented on HDFS-13215: +1, so we unit tests will be much easier... > RBF: Move Router to its

[jira] [Updated] (HDFS-13215) RBF: Move Router to its own module

2018-03-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13215: --- Summary: RBF: Move Router to its own module (was: RBF: move Router to its own module) > RBF: Move

[jira] [Created] (HDFS-13215) RBF: move Router to its own module

2018-03-01 Thread JIRA
Íñigo Goiri created HDFS-13215: -- Summary: RBF: move Router to its own module Key: HDFS-13215 URL: https://issues.apache.org/jira/browse/HDFS-13215 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-13214) RBF: Configuration on Router conflicts with client side configuration

2018-03-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382402#comment-16382402 ] Íñigo Goiri commented on HDFS-13214: I think you can have a name service without HA and then that's

[jira] [Commented] (HDFS-13195) DataNode conf page cannot display the current value after reconfig

2018-03-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382390#comment-16382390 ] Íñigo Goiri commented on HDFS-13195: Apparently, this part of code was introduced by HDFS-8572.

[jira] [Commented] (HDFS-13214) RBF: Configuration on Router conflicts with client side configuration

2018-03-01 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382386#comment-16382386 ] Wei Yan commented on HDFS-13214: dfs.namenode.rpc-address.ns1 host1:8020 The field here should

[jira] [Commented] (HDFS-13208) RBF: Mount path not available after ADD-REMOVE-ADD

2018-03-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382381#comment-16382381 ] Íñigo Goiri commented on HDFS-13208: bq. Tried HDFS-13212 this morning and the problem resolved. Let

[jira] [Commented] (HDFS-13214) RBF: Configuration on Router conflicts with client side configuration

2018-03-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382378#comment-16382378 ] Íñigo Goiri commented on HDFS-13214: In our internal setup, we configure {{dfs.nameservice.id}}. Does

[jira] [Commented] (HDFS-13202) Fix the outdated javadocs in HAUtil

2018-03-01 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382376#comment-16382376 ] Chao Sun commented on HDFS-13202: - Thanks [~linyiqun] for reviewing and committing the patch! > Fix the

[jira] [Commented] (HDFS-13208) RBF: Mount path not available after ADD-REMOVE-ADD

2018-03-01 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382375#comment-16382375 ] Wei Yan commented on HDFS-13208: Tried HDFS-13212 this morning and the problem resolved. Let me

[jira] [Updated] (HDFS-13214) RBF: Configuration on Router conflicts with client side configuration

2018-03-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13214: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-12615 > RBF: Configuration on Router conflicts

[jira] [Commented] (HDFS-13204) RBF: Optimize name service safe mode icon

2018-03-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382371#comment-16382371 ] Íñigo Goiri commented on HDFS-13204: [~raviprak], can you provide some feedback? My proposal currently

[jira] [Commented] (HDFS-13208) RBF: Mount path not available after ADD-REMOVE-ADD

2018-03-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382364#comment-16382364 ] Íñigo Goiri commented on HDFS-13208: It might be something related to the cache. They just reported

[jira] [Commented] (HDFS-13212) RBF: Fix router location cache issue

2018-03-01 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382357#comment-16382357 ] Íñigo Goiri commented on HDFS-13212: [~wuweiwei], thanks for catching this, we had a similar issue in

  1   2   >