[jira] [Updated] (HDFS-13279) Datanodes usage is imbalanced if number of nodes per rack is not equal

2018-03-22 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Jie updated HDFS-13279: --- Attachment: HDFS-13279.003.patch > Datanodes usage is imbalanced if number of nodes per rack is not equal > --

[jira] [Updated] (HDFS-13291) RBF: Implement available space based OrderResolver

2018-03-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13291: - Attachment: HDFS-13291.004.patch > RBF: Implement available space based OrderResolver > --

[jira] [Commented] (HDFS-13291) RBF: Implement available space based OrderResolver

2018-03-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409202#comment-16409202 ] Yiqun Lin commented on HDFS-13291: -- Thanks [~elgoiri] for the comments. Update the patch.

[jira] [Created] (HDFS-13327) Ratis should handle failure conditions where append request to followers can fail

2018-03-22 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-13327: Summary: Ratis should handle failure conditions where append request to followers can fail Key: HDFS-13327 URL: https://issues.apache.org/jira/browse/HDFS-13327

[jira] [Updated] (HDFS-13314) NameNode should optionally exit if it detects FsImage corruption

2018-03-22 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-13314: --- Hadoop Flags: Reviewed +1 the 04 patch looks good. Thanks, [~arpitagarwal]. > NameNo

[jira] [Updated] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-22 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-13056: --- Attachment: IMG_1964.JPG > Expose file-level composite CRCs in HDFS which are comparab

[jira] [Commented] (HDFS-13291) RBF: Implement available space based OrderResolver

2018-03-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409352#comment-16409352 ] genericqa commented on HDFS-13291: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-13291) RBF: Implement available space based OrderResolver

2018-03-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13291: - Attachment: HDFS-13291.005.patch > RBF: Implement available space based OrderResolver > --

[jira] [Commented] (HDFS-13291) RBF: Implement available space based OrderResolver

2018-03-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409412#comment-16409412 ] Yiqun Lin commented on HDFS-13291: -- Attach the updated patch to fix checkstyle issues. >

[jira] [Commented] (HDFS-13279) Datanodes usage is imbalanced if number of nodes per rack is not equal

2018-03-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409445#comment-16409445 ] genericqa commented on HDFS-13279: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13314) NameNode should optionally exit if it detects FsImage corruption

2018-03-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409463#comment-16409463 ] genericqa commented on HDFS-13314: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13291) RBF: Implement available space based OrderResolver

2018-03-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409490#comment-16409490 ] genericqa commented on HDFS-13291: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Created] (HDFS-13328) Abstract ReencryptionHandler recursive logic in separate class.

2018-03-22 Thread Surendra Singh Lilhore (JIRA)
Surendra Singh Lilhore created HDFS-13328: - Summary: Abstract ReencryptionHandler recursive logic in separate class. Key: HDFS-13328 URL: https://issues.apache.org/jira/browse/HDFS-13328 Proje

[jira] [Commented] (HDFS-13328) Abstract ReencryptionHandler recursive logic in separate class.

2018-03-22 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409549#comment-16409549 ] Surendra Singh Lilhore commented on HDFS-13328: --- cc : [~xiaochen], [~umamahe

[jira] [Commented] (HDFS-13314) NameNode should optionally exit if it detects FsImage corruption

2018-03-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409657#comment-16409657 ] Arpit Agarwal commented on HDFS-13314: -- Thanks [~szetszwo]. I'll hold off committing

[jira] [Updated] (HDFS-13310) [WRITE] The DatanodeProtocol should be have DNA_BACKUP to backup blocks

2018-03-22 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13310: -- Attachment: HDFS-13310-HDFS-12090.001.patch > [WRITE] The DatanodeProtocol should be have DNA_BACKUP to

[jira] [Updated] (HDFS-13310) [WRITE] The DatanodeProtocol should be have DNA_BACKUP to backup blocks

2018-03-22 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-13310: -- Status: Patch Available (was: Open) Adding patch that introduces the API between NN and DN through the

[jira] [Updated] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13056: - Attachment: (was: IMG_1964.JPG) > Expose file-level composite CRCs in HDFS which are comparabl

[jira] [Commented] (HDFS-13300) Ozone: Remove DatanodeID dependency from HDSL and Ozone

2018-03-22 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409726#comment-16409726 ] Elek, Marton commented on HDFS-13300: - Thanks the answers [~nandakumar131]. {quote}The

[jira] [Updated] (HDFS-13318) RBF: Fix FindBugs in hadoop-hdfs-rbf

2018-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13318: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.1 3.2.0

[jira] [Updated] (HDFS-12792) RBF: Test Router-based federation using HDFSContract

2018-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12792: --- Attachment: HDFS-12792.011.patch > RBF: Test Router-based federation using HDFSContract >

[jira] [Commented] (HDFS-12792) RBF: Test Router-based federation using HDFSContract

2018-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409827#comment-16409827 ] Íñigo Goiri commented on HDFS-12792: [^HDFS-12792.011.patch] fixes the checkstyle and

[jira] [Commented] (HDFS-12512) RBF: Add WebHDFS

2018-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409836#comment-16409836 ] Íñigo Goiri commented on HDFS-12512: [^HDFS-12512.009.patch] looks good. We are only m

[jira] [Updated] (HDFS-12512) RBF: Add WebHDFS

2018-03-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated HDFS-12512: --- Attachment: HDFS-12512.010.patch > RBF: Add WebHDFS > > > Key: HDFS-12512 >

[jira] [Commented] (HDFS-12512) RBF: Add WebHDFS

2018-03-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409849#comment-16409849 ] Wei Yan commented on HDFS-12512: Finally Yetus runs rbf testcases. I add the hdfs.xml in [

[jira] [Commented] (HDFS-13314) NameNode should optionally exit if it detects FsImage corruption

2018-03-22 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409860#comment-16409860 ] Daryn Sharp commented on HDFS-13314: bq. Is there anything you suggest doing different

[jira] [Commented] (HDFS-13318) RBF: Fix FindBugs in hadoop-hdfs-rbf

2018-03-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409864#comment-16409864 ] Hudson commented on HDFS-13318: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-13291) RBF: Implement available space based OrderResolver

2018-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409885#comment-16409885 ] Íñigo Goiri commented on HDFS-13291: * We can make have a constructor with the conf an

[jira] [Comment Edited] (HDFS-13291) RBF: Implement available space based OrderResolver

2018-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409885#comment-16409885 ] Íñigo Goiri edited comment on HDFS-13291 at 3/22/18 4:55 PM: -

[jira] [Commented] (HDFS-13314) NameNode should optionally exit if it detects FsImage corruption

2018-03-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409895#comment-16409895 ] Arpit Agarwal commented on HDFS-13314: -- bq. Yes, no config option. Detected corruptio

[jira] [Commented] (HDFS-13314) NameNode should optionally exit if it detects FsImage corruption

2018-03-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409920#comment-16409920 ] Arpit Agarwal commented on HDFS-13314: -- bq. not halting the NN risks removing the onl

[jira] [Commented] (HDFS-9319) Make DatanodeInfo thread safe

2018-03-22 Thread Liu Junhong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409922#comment-16409922 ] Liu Junhong commented on HDFS-9319: --- [~jingzhao] Is there any more plan for  this issue?

[jira] [Commented] (HDFS-12792) RBF: Test Router-based federation using HDFSContract

2018-03-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409927#comment-16409927 ] Wei Yan commented on HDFS-12792: +1 for [^HDFS-12792.011.patch]. One minor, as we disable

[jira] [Commented] (HDFS-13195) DataNode conf page cannot display the current value after reconfig

2018-03-22 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409929#comment-16409929 ] Kihwal Lee commented on HDFS-13195: --- +1 looks good. > DataNode conf page cannot displa

[jira] [Commented] (HDFS-13326) RBF: router webUI's MountTable tab doesn't show "readonly" info

2018-03-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409932#comment-16409932 ] Wei Yan commented on HDFS-13326: {quote}The APIs already allow that so it should be a matt

[jira] [Commented] (HDFS-12792) RBF: Test Router-based federation using HDFSContract

2018-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409936#comment-16409936 ] Íñigo Goiri commented on HDFS-12792: {quote} One minor, as we disable SAFEMODE, so we

[jira] [Updated] (HDFS-12792) RBF: Test Router-based federation using HDFSContract

2018-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12792: --- Attachment: HDFS-12792.012.patch > RBF: Test Router-based federation using HDFSContract >

[jira] [Commented] (HDFS-13326) RBF: router webUI's MountTable tab doesn't show "readonly" info

2018-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409940#comment-16409940 ] Íñigo Goiri commented on HDFS-13326: {quote} Agree. Let's add a "update" cmd there. BT

[jira] [Commented] (HDFS-12792) RBF: Test Router-based federation using HDFSContract

2018-03-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409942#comment-16409942 ] genericqa commented on HDFS-12792: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-9319) Make DatanodeInfo thread safe

2018-03-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409945#comment-16409945 ] genericqa commented on HDFS-9319: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-13195) DataNode conf page cannot display the current value after reconfig

2018-03-22 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-13195: -- Fix Version/s: (was: 2.7.1) 3.1.1 3.2.0 3.0.

[jira] [Commented] (HDFS-13195) DataNode conf page cannot display the current value after reconfig

2018-03-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409965#comment-16409965 ] Hudson commented on HDFS-13195: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-13195) DataNode conf page cannot display the current value after reconfig

2018-03-22 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409967#comment-16409967 ] Kihwal Lee commented on HDFS-13195: --- Just committed this to trunk, branch-3.1, branch-3.

[jira] [Updated] (HDFS-13195) DataNode conf page cannot display the current value after reconfig

2018-03-22 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-13195: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) > Data

[jira] [Commented] (HDFS-13243) Get CorruptBlock because of calling close and sync in same time

2018-03-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409969#comment-16409969 ] Wei-Chiu Chuang commented on HDFS-13243: Reviewing the patch again, at first I th

[jira] [Commented] (HDFS-13316) Ozone: Update the ksm/scm CLI usage info

2018-03-22 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409984#comment-16409984 ] Elek, Marton commented on HDFS-13316: - +1.  Small steps towards to a better word. I a

[jira] [Commented] (HDFS-13310) [WRITE] The DatanodeProtocol should be have DNA_BACKUP to backup blocks

2018-03-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409998#comment-16409998 ] genericqa commented on HDFS-13310: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13291) RBF: Implement available space based OrderResolver

2018-03-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410017#comment-16410017 ] Wei Yan commented on HDFS-13291: Thanks [~linyiqun] for the patch. Some minors: * Typo "s

[jira] [Updated] (HDFS-13326) RBF: Improve the interfaces to modify and view mount tables

2018-03-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated HDFS-13326: --- Summary: RBF: Improve the interfaces to modify and view mount tables (was: RBF: router webUI's MountTable tab

[jira] [Updated] (HDFS-13326) RBF: Improve the interfaces to modify and view mount tables

2018-03-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated HDFS-13326: --- Description: 1. From DFSRouterAdmin cmd, currently the update logic is implemented inside add operation, wher

[jira] [Assigned] (HDFS-13326) RBF: Improve the interfaces to modify and view mount tables

2018-03-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan reassigned HDFS-13326: -- Assignee: (was: Wei Yan) > RBF: Improve the interfaces to modify and view mount tables > --

[jira] [Commented] (HDFS-13326) RBF: Improve the interfaces to modify and view mount tables

2018-03-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410029#comment-16410029 ] Wei Yan commented on HDFS-13326: [~elgoiri], could u help add [~gangli2384] as a contribut

[jira] [Assigned] (HDFS-13326) RBF: Improve the interfaces to modify and view mount tables

2018-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri reassigned HDFS-13326: -- Assignee: Gang Li > RBF: Improve the interfaces to modify and view mount tables > -

[jira] [Commented] (HDFS-12792) RBF: Test Router-based federation using HDFSContract

2018-03-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410034#comment-16410034 ] genericqa commented on HDFS-12792: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-13326) RBF: Improve the interfaces to modify and view mount tables

2018-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410037#comment-16410037 ] Íñigo Goiri commented on HDFS-13326: Awesome. Assigned [~gangli2384] to this JIRA. >

[jira] [Commented] (HDFS-13326) RBF: Improve the interfaces to modify and view mount tables

2018-03-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410043#comment-16410043 ] Wei Yan commented on HDFS-13326: thanks, [~elgoiri] > RBF: Improve the interfaces to modi

[jira] [Commented] (HDFS-12792) RBF: Test Router-based federation using HDFSContract

2018-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410048#comment-16410048 ] Íñigo Goiri commented on HDFS-12792: The yetus speed today is scary. Anyway, I'll go a

[jira] [Commented] (HDFS-11900) Hedged reads thread pool creation not synchronized

2018-03-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410049#comment-16410049 ] Wei-Chiu Chuang commented on HDFS-11900: Committing it. > Hedged reads thread poo

[jira] [Updated] (HDFS-11900) Hedged reads thread pool creation not synchronized

2018-03-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11900: --- Resolution: Fixed Fix Version/s: 3.2.0 Status: Resolved (was: Patch Availabl

[jira] [Commented] (HDFS-12792) RBF: Test Router-based federation using HDFSContract

2018-03-22 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410066#comment-16410066 ] Ajay Kumar commented on HDFS-12792: --- [~elgoiri], patch v11 looks good. Few comments: #

[jira] [Updated] (HDFS-12792) RBF: Test Router-based federation using HDFSContract

2018-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12792: --- Attachment: HDFS-12792.013.patch > RBF: Test Router-based federation using HDFSContract >

[jira] [Commented] (HDFS-12792) RBF: Test Router-based federation using HDFSContract

2018-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410109#comment-16410109 ] Íñigo Goiri commented on HDFS-12792: Thanks [~ajayydv] for the comments; they make sen

[jira] [Updated] (HDFS-12792) RBF: Test Router-based federation using HDFSContract

2018-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12792: --- Attachment: (was: HDFS-12792.013.patch) > RBF: Test Router-based federation using HDFSContract > -

[jira] [Updated] (HDFS-13058) Fix dfs.namenode.shared.edits.dir in TestJournalNode

2018-03-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13058: - Component/s: qjm > Fix dfs.namenode.shared.edits.dir in TestJournalNode >

[jira] [Updated] (HDFS-12792) RBF: Test Router-based federation using HDFSContract

2018-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12792: --- Attachment: HDFS-12792.013.patch > RBF: Test Router-based federation using HDFSContract >

[jira] [Updated] (HDFS-13062) Provide support for JN to use separate journal disk per namespace

2018-03-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13062: - Component/s: qjm federation > Provide support for JN to use separate journal disk

[jira] [Updated] (HDFS-13023) Journal Sync does not work on a secure cluster

2018-03-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13023: - Component/s: qjm > Journal Sync does not work on a secure cluster > --

[jira] [Updated] (HDFS-13073) Cleanup code in InterQJournalProtocol.proto

2018-03-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13073: - Component/s: qjm > Cleanup code in InterQJournalProtocol.proto > -

[jira] [Updated] (HDFS-13023) Journal Sync does not work on a secure cluster

2018-03-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13023: - Component/s: (was: qjm) journal-node > Journal Sync does not work on a secure

[jira] [Updated] (HDFS-12845) JournalNode Test failures

2018-03-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12845: - Component/s: qjm > JournalNode Test failures > - > > Key:

[jira] [Updated] (HDFS-12498) Journal Syncer is not started in Federated + HA cluster

2018-03-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12498: - Component/s: journal-node federation > Journal Syncer is not started in Federated

[jira] [Updated] (HDFS-12486) GetConf to get journalnodeslist

2018-03-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12486: - Component/s: (was: tools) shell > GetConf to get journalnodeslist > -

[jira] [Updated] (HDFS-12486) GetConf to get journalnodeslist

2018-03-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12486: - Component/s: tools journal-node > GetConf to get journalnodeslist > -

[jira] [Updated] (HDFS-13062) Provide support for JN to use separate journal disk per namespace

2018-03-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13062: - Component/s: (was: qjm) journal-node > Provide support for JN to use separate

[jira] [Updated] (HDFS-13073) Cleanup code in InterQJournalProtocol.proto

2018-03-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13073: - Component/s: (was: qjm) journal-node > Cleanup code in InterQJournalProtocol.

[jira] [Updated] (HDFS-12845) JournalNode Test failures

2018-03-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12845: - Component/s: (was: qjm) > JournalNode Test failures > - > >

[jira] [Updated] (HDFS-13058) Fix dfs.namenode.shared.edits.dir in TestJournalNode

2018-03-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13058: - Component/s: (was: qjm) test journal-node > Fix dfs.namenode

[jira] [Updated] (HDFS-12553) Add nameServiceId to QJournalProtocol

2018-03-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12553: - Component/s: (was: qjm) journal-node > Add nameServiceId to QJournalProtocol

[jira] [Updated] (HDFS-12375) Fail to start/stop journalnodes using start-dfs.sh/stop-dfs.sh.

2018-03-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12375: - Component/s: journal-node > Fail to start/stop journalnodes using start-dfs.sh/stop-dfs.sh. >

[jira] [Commented] (HDFS-12950) [oiv] ls will fail in secure cluster

2018-03-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410118#comment-16410118 ] Wei-Chiu Chuang commented on HDFS-12950: [~brahmareddy] would you mind if I take o

[jira] [Updated] (HDFS-12576) JournalNodes are getting started, even though dfs.namenode.shared.edits.dir is not configured

2018-03-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12576: - Component/s: journal-node > JournalNodes are getting started, even though dfs.namenode.shared.edit

[jira] [Commented] (HDFS-11900) Hedged reads thread pool creation not synchronized

2018-03-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410122#comment-16410122 ] Hudson commented on HDFS-11900: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Work started] (HDFS-13329) Add/ Update disk space counters for trash (trash used, disk remaining etc.)

2018-03-22 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13329 started by Bharat Viswanadham. - > Add/ Update disk space counters for trash (trash used, disk remaining

[jira] [Work started] (HDFS-13282) Create UT for ReplicaFileDeleteTask without minidfs cluster

2018-03-22 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13282 started by Bharat Viswanadham. - > Create UT for ReplicaFileDeleteTask without minidfs cluster > ---

[jira] [Created] (HDFS-13329) Add/ Update disk space counters for trash (trash used, disk remaining etc.)

2018-03-22 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HDFS-13329: - Summary: Add/ Update disk space counters for trash (trash used, disk remaining etc.) Key: HDFS-13329 URL: https://issues.apache.org/jira/browse/HDFS-13329

[jira] [Commented] (HDFS-12792) RBF: Test Router-based federation using HDFSContract

2018-03-22 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410163#comment-16410163 ] Ajay Kumar commented on HDFS-12792: --- +1 pending jenkins > RBF: Test Router-based federa

[jira] [Commented] (HDFS-12512) RBF: Add WebHDFS

2018-03-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410178#comment-16410178 ] genericqa commented on HDFS-12512: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13326) RBF: Improve the interfaces to modify and view mount tables

2018-03-22 Thread Gang Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410179#comment-16410179 ] Gang Li commented on HDFS-13326: Thank you [~elgoiri] > RBF: Improve the interfaces to mo

[jira] [Updated] (HDFS-13328) Abstract ReencryptionHandler recursive logic in separate class.

2018-03-22 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-13328: -- Attachment: HDFS-13328-01.patch > Abstract ReencryptionHandler recursive logic i

[jira] [Commented] (HDFS-13328) Abstract ReencryptionHandler recursive logic in separate class.

2018-03-22 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410184#comment-16410184 ] Surendra Singh Lilhore commented on HDFS-13328: --- Attached initial patch. Ple

[jira] [Commented] (HDFS-12512) RBF: Add WebHDFS

2018-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410188#comment-16410188 ] Íñigo Goiri commented on HDFS-12512: Let me commit HDFS-12792 once Yetus comes back an

[jira] [Commented] (HDFS-12792) RBF: Test Router-based federation using HDFSContract

2018-03-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410210#comment-16410210 ] genericqa commented on HDFS-12792: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-13277) Improve move to account for usage (number of files) to limit trash dir size

2018-03-22 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410218#comment-16410218 ] Hanisha Koneru commented on HDFS-13277: --- Thanks [~bharatviswa]. The unit test LGTM

[jira] [Updated] (HDFS-13314) NameNode should optionally exit if it detects FsImage corruption

2018-03-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13314: - Attachment: HDFS-13314.05.patch > NameNode should optionally exit if it detects FsImage corruption

[jira] [Commented] (HDFS-13314) NameNode should optionally exit if it detects FsImage corruption

2018-03-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410236#comment-16410236 ] Arpit Agarwal commented on HDFS-13314: -- v05 patch: Remove the config key which made t

[jira] [Updated] (HDFS-13314) NameNode should optionally exit if it detects FsImage corruption

2018-03-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-13314: - Description: The NameNode should optionally exit after writing an FsImage if it detects the follo

[jira] [Commented] (HDFS-12792) RBF: Test Router-based federation using HDFSContract

2018-03-22 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410251#comment-16410251 ] Giovanni Matteo Fumarola commented on HDFS-12792: - Thanks [~elgoiri] +1 fo

[jira] [Updated] (HDFS-12792) RBF: Test Router-based federation using HDFSContract

2018-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12792: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.1 3.2.0

[jira] [Commented] (HDFS-12792) RBF: Test Router-based federation using HDFSContract

2018-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410256#comment-16410256 ] Íñigo Goiri commented on HDFS-12792: Thanks [~ywskycn], [~ajayydv], and [~giovanni.fum

[jira] [Commented] (HDFS-12512) RBF: Add WebHDFS

2018-03-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410258#comment-16410258 ] Íñigo Goiri commented on HDFS-12512: I committed HDFS-12792 already. Do you mind rebas

  1   2   3   >