[jira] [Updated] (HDFS-13008) Ozone: Add DN container open/close state to container report

2018-02-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13008: -- Attachment: HDFS-13008-HDFS-7240.003.patch > Ozone: Add DN container open/close state to container

[jira] [Commented] (HDFS-13008) Ozone: Add DN container open/close state to container report

2018-02-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365207#comment-16365207 ] genericqa commented on HDFS-13008: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13130) Log object instance get incorrectly in SlowDiskTracker

2018-02-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13130: - Target Version/s: 3.2.0 (was: 3.1.0) Fix Version/s: (was: 3.1.0) 3.2.0

[jira] [Comment Edited] (HDFS-13142) Define and Implement a DiifList Interface to store and manage SnapshotDiffs

2018-02-14 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365195#comment-16365195 ] Tsz Wo Nicholas Sze edited comment on HDFS-13142 at 2/15/18 7:27 AM: -

[jira] [Commented] (HDFS-13142) Define and Implement a DiifList Interface to store and manage SnapshotDiffs

2018-02-14 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365195#comment-16365195 ] Tsz Wo Nicholas Sze commented on HDFS-13142: There are still 2 checkstyle warnings and many

[jira] [Commented] (HDFS-13136) Avoid taking FSN lock while doing group member lookup for FSD permission check

2018-02-14 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365193#comment-16365193 ] Tsz Wo Nicholas Sze commented on HDFS-13136: Thanks for the update! +1 on the 002 patch. >

[jira] [Commented] (HDFS-8693) refreshNamenodes does not support adding a new standby to a running DN

2018-02-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365188#comment-16365188 ] Vinayakumar B commented on HDFS-8693: - bq. Unlikely to be an issue though unless it's constantly

[jira] [Updated] (HDFS-13008) Ozone: Add DN container open/close state to container report

2018-02-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13008: -- Attachment: HDFS-13008-HDFS-7240.002.patch > Ozone: Add DN container open/close state to container

[jira] [Commented] (HDFS-9608) Disk IO imbalance in HDFS with heterogeneous storages

2018-02-14 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365171#comment-16365171 ] Brahma Reddy Battula commented on HDFS-9608: Yes, It's nice to have. > Disk IO imbalance in

[jira] [Commented] (HDFS-8277) Safemode enter fails when Standby NameNode is down

2018-02-14 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365168#comment-16365168 ] Surendra Singh Lilhore commented on HDFS-8277: -- Hi, [~arpitagarwal], [~vinayrpet] and

[jira] [Commented] (HDFS-13110) [SPS]: Reduce the number of APIs in NamenodeProtocol used by external satisfier

2018-02-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365166#comment-16365166 ] Rakesh R commented on HDFS-13110: - Attached new patch, where I renamed the following classes as now it

[jira] [Updated] (HDFS-13110) [SPS]: Reduce the number of APIs in NamenodeProtocol used by external satisfier

2018-02-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13110: Attachment: HDFS-13110-HDFS-10285-05.patch > [SPS]: Reduce the number of APIs in NamenodeProtocol used by

[jira] [Commented] (HDFS-13008) Ozone: Add DN container open/close state to container report

2018-02-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365155#comment-16365155 ] genericqa commented on HDFS-13008: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12051) Reimplement NameCache in NameNode: Intern duplicate byte[] arrays (mainly those denoting file/directory names) to save memory

2018-02-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365131#comment-16365131 ] genericqa commented on HDFS-12051: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365105#comment-16365105 ] He Xiaoqiao commented on HDFS-12749: [~kihwal],[~xkrogen] Thanks for your comments. {quote}the problem

[jira] [Commented] (HDFS-12452) TestDataNodeVolumeFailureReporting fails in trunk Jenkins runs

2018-02-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365087#comment-16365087 ] Wangda Tan commented on HDFS-12452: --- [~xyao], if this patch can be done by this week, please commit to

[jira] [Updated] (HDFS-13008) Ozone: Add DN container open/close state to container report

2018-02-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13008: -- Attachment: HDFS-13008-HDFS-7240.001.patch > Ozone: Add DN container open/close state to container

[jira] [Updated] (HDFS-13008) Ozone: Add DN container open/close state to container report

2018-02-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13008: -- Attachment: (was: HDFS-13008.001.patch) > Ozone: Add DN container open/close state to container

[jira] [Commented] (HDFS-13008) Ozone: Add DN container open/close state to container report

2018-02-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365050#comment-16365050 ] genericqa commented on HDFS-13008: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13008) Ozone: Add DN container open/close state to container report

2018-02-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13008: -- Status: Patch Available (was: Open) > Ozone: Add DN container open/close state to container report >

[jira] [Updated] (HDFS-13008) Ozone: Add DN container open/close state to container report

2018-02-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13008: -- Attachment: HDFS-13008.001.patch > Ozone: Add DN container open/close state to container report >

[jira] [Commented] (HDFS-13081) Datanode#checkSecureConfig should check HTTPS and SASL encryption

2018-02-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365041#comment-16365041 ] genericqa commented on HDFS-13081: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12051) Reimplement NameCache in NameNode: Intern duplicate byte[] arrays (mainly those denoting file/directory names) to save memory

2018-02-14 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365020#comment-16365020 ] Misha Dmitriev commented on HDFS-12051: --- [~atm] I've just submitted a patch where I've addressed

[jira] [Updated] (HDFS-12051) Reimplement NameCache in NameNode: Intern duplicate byte[] arrays (mainly those denoting file/directory names) to save memory

2018-02-14 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12051: -- Release Note: Addressed the @atm's comments Status: Patch Available (was: In

[jira] [Updated] (HDFS-12051) Reimplement NameCache in NameNode: Intern duplicate byte[] arrays (mainly those denoting file/directory names) to save memory

2018-02-14 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12051: -- Attachment: HDFS-12051.12.patch > Reimplement NameCache in NameNode: Intern duplicate byte[]

[jira] [Updated] (HDFS-12051) Reimplement NameCache in NameNode: Intern duplicate byte[] arrays (mainly those denoting file/directory names) to save memory

2018-02-14 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12051: -- Status: In Progress (was: Patch Available) > Reimplement NameCache in NameNode: Intern

[jira] [Commented] (HDFS-13134) Ozone: Format open containers on datanode restart

2018-02-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365007#comment-16365007 ] Anu Engineer commented on HDFS-13134: - [~ljain] meanwhile you might want to look at the checkstyl,

[jira] [Comment Edited] (HDFS-13134) Ozone: Format open containers on datanode restart

2018-02-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364777#comment-16364777 ] Anu Engineer edited comment on HDFS-13134 at 2/15/18 12:34 AM: --- [~ljain] The

[jira] [Commented] (HDFS-13134) Ozone: Format open containers on datanode restart

2018-02-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365005#comment-16365005 ] genericqa commented on HDFS-13134: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11699) Ozone:SCM: Add support for close containers in SCM

2018-02-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364943#comment-16364943 ] genericqa commented on HDFS-11699: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12452) TestDataNodeVolumeFailureReporting fails in trunk Jenkins runs

2018-02-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364922#comment-16364922 ] genericqa commented on HDFS-12452: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13149) Ozone: Rename Corona to Freon

2018-02-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364911#comment-16364911 ] Anu Engineer commented on HDFS-13149: - [~msingh], [~elek] This patch may break internal stress and

[jira] [Updated] (HDFS-13149) Ozone: Rename Corona to Freon

2018-02-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-13149: Attachment: HDFS-13149-HDFS-7240.001.patch > Ozone: Rename Corona to Freon >

[jira] [Commented] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-02-14 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364893#comment-16364893 ] Daryn Sharp commented on HDFS-13040: So many points to cover.  You're on the right path. *SPNEGO*

[jira] [Updated] (HDFS-13149) Ozone: Rename Corona to Freon

2018-02-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-13149: Description: While reviewing Ozone  [~jghoman] and in the a comment  in HDFS-12992,

[jira] [Created] (HDFS-13149) Ozone: Rename Corona to Freon

2018-02-14 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-13149: --- Summary: Ozone: Rename Corona to Freon Key: HDFS-13149 URL: https://issues.apache.org/jira/browse/HDFS-13149 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-13081) Datanode#checkSecureConfig should check HTTPS and SASL encryption

2018-02-14 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364862#comment-16364862 ] Ajay Kumar commented on HDFS-13081: --- [~daryn] thanks for the valuable input. Updated the patch to allow

[jira] [Updated] (HDFS-13081) Datanode#checkSecureConfig should check HTTPS and SASL encryption

2018-02-14 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13081: -- Attachment: HDFS-13081.001.patch > Datanode#checkSecureConfig should check HTTPS and SASL encryption >

[jira] [Commented] (HDFS-12452) TestDataNodeVolumeFailureReporting fails in trunk Jenkins runs

2018-02-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364804#comment-16364804 ] genericqa commented on HDFS-12452: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13134) Ozone: Format open containers on datanode restart

2018-02-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364777#comment-16364777 ] Anu Engineer commented on HDFS-13134: - [~ljain] The change looks good, I am going to take a week to

[jira] [Commented] (HDFS-12983) Block Storage: provide docker-compose file for cblock clusters

2018-02-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364773#comment-16364773 ] Anu Engineer commented on HDFS-12983: - [~elek] I am +1 on this patch. However, we have 50070, just

[jira] [Commented] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-02-14 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364764#comment-16364764 ] Daryn Sharp commented on HDFS-13040: Let me catch up. > Kerberized inotify client fails despite kinit

[jira] [Commented] (HDFS-11699) Ozone:SCM: Add support for close containers in SCM

2018-02-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364733#comment-16364733 ] Anu Engineer commented on HDFS-11699: - [~elek] Thanks for the code review comments. The patch v2

[jira] [Updated] (HDFS-11699) Ozone:SCM: Add support for close containers in SCM

2018-02-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11699: Attachment: HDFS-11699-HDFS-7240.002.patch > Ozone:SCM: Add support for close containers in SCM >

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364731#comment-16364731 ] Kihwal Lee commented on HDFS-12749: --- I see. The old registration looks identical to the new one, so NN

[jira] [Commented] (HDFS-13136) Avoid taking FSN lock while doing group member lookup for FSD permission check

2018-02-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364718#comment-16364718 ] genericqa commented on HDFS-13136: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13114) CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path

2018-02-14 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364719#comment-16364719 ] Hanisha Koneru commented on HDFS-13114: --- Thanks for the review, [~jojochuang]. I have created 

[jira] [Created] (HDFS-13148) Unit test for KMS and EZ with Federation

2018-02-14 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDFS-13148: - Summary: Unit test for KMS and EZ with Federation Key: HDFS-13148 URL: https://issues.apache.org/jira/browse/HDFS-13148 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-12452) TestDataNodeVolumeFailureReporting fails in trunk Jenkins runs

2018-02-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364595#comment-16364595 ] Gabor Bota commented on HDFS-12452: --- Thanks for the patch Xiaoyu! I just found when going through the

[jira] [Commented] (HDFS-12452) TestDataNodeVolumeFailureReporting fails in trunk Jenkins runs

2018-02-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364677#comment-16364677 ] Xiaoyu Yao commented on HDFS-12452: --- good catch. Upload v2 patch that fixed the typo. >

[jira] [Updated] (HDFS-12452) TestDataNodeVolumeFailureReporting fails in trunk Jenkins runs

2018-02-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12452: -- Attachment: HDFS-12452.002.patch > TestDataNodeVolumeFailureReporting fails in trunk Jenkins runs >

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads

2018-02-14 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364636#comment-16364636 ] Erik Krogen commented on HDFS-12345: Just want to ping watchers that the description has been updated

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads

2018-02-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364655#comment-16364655 ] Íñigo Goiri commented on HDFS-12345: I'm personally interested on pushing HDFS as a MapReduce job into

[jira] [Comment Edited] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads

2018-02-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364655#comment-16364655 ] Íñigo Goiri edited comment on HDFS-12345 at 2/14/18 7:32 PM: - I'm personally

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads

2018-02-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364651#comment-16364651 ] Anu Engineer commented on HDFS-12345: - [~xkrogen] I have looked at the source and read the excellent

[jira] [Updated] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

2018-02-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HDFS-11187: -- Status: Open (was: Patch Available) > Optimize disk access for last partial chunk checksum of

[jira] [Commented] (HDFS-8693) refreshNamenodes does not support adding a new standby to a running DN

2018-02-14 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364637#comment-16364637 ] Daryn Sharp commented on HDFS-8693: --- Caveat is I believe this will cause a small memory leak of the rpc

[jira] [Commented] (HDFS-12985) NameNode crashes during restart after an OpenForWrite file present in the Snapshot got deleted

2018-02-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364626#comment-16364626 ] Arpit Agarwal commented on HDFS-12985: -- Hi [~manojg], I was looking at the test case to understand

[jira] [Updated] (HDFS-12452) TestDataNodeVolumeFailureReporting fails in trunk Jenkins runs

2018-02-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12452: -- Status: Patch Available (was: Open) > TestDataNodeVolumeFailureReporting fails in trunk Jenkins runs >

[jira] [Comment Edited] (HDFS-12452) TestDataNodeVolumeFailureReporting fails in trunk Jenkins runs

2018-02-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364595#comment-16364595 ] Gabor Bota edited comment on HDFS-12452 at 2/14/18 6:48 PM: Thanks for the

[jira] [Updated] (HDFS-12452) TestDataNodeVolumeFailureReporting fails in trunk Jenkins runs

2018-02-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12452: -- Attachment: HDFS-12452.001.patch > TestDataNodeVolumeFailureReporting fails in trunk Jenkins runs >

[jira] [Commented] (HDFS-13147) Support -c argument for DFS command head and tail

2018-02-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364530#comment-16364530 ] genericqa commented on HDFS-13147: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-12452) TestDataNodeVolumeFailureReporting fails in trunk Jenkins runs

2018-02-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-12452: - Assignee: Xiaoyu Yao > TestDataNodeVolumeFailureReporting fails in trunk Jenkins runs >

[jira] [Comment Edited] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-14 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364520#comment-16364520 ] Erik Krogen edited comment on HDFS-12749 at 2/14/18 6:00 PM: - [~kihwal], IIUC,

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-14 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364520#comment-16364520 ] Erik Krogen commented on HDFS-12749: [~kihwal], IIUC, the problem is that the NN correctly processed

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364508#comment-16364508 ] Kihwal Lee commented on HDFS-12749: --- What was the command that failed when you saw "Error processing

[jira] [Commented] (HDFS-13119) RBF: Manage unavailable clusters

2018-02-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364497#comment-16364497 ] Íñigo Goiri commented on HDFS-13119: [~linyiqun], yep the retry logic kind of break the flow. Anyway,

[jira] [Comment Edited] (HDFS-13136) Avoid taking FSN lock while doing group member lookup for FSD permission check

2018-02-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364469#comment-16364469 ] Xiaoyu Yao edited comment on HDFS-13136 at 2/14/18 5:29 PM: Thanks [~szetszwo]

[jira] [Commented] (HDFS-13136) Avoid taking FSN lock while doing group member lookup for FSD permission check

2018-02-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364469#comment-16364469 ] Xiaoyu Yao commented on HDFS-13136: --- Thanks [~szetszwo] for the review. Update patch v2 that fixed the

[jira] [Updated] (HDFS-13136) Avoid taking FSN lock while doing group member lookup for FSD permission check

2018-02-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13136: -- Attachment: HDFS-13136.002.patch > Avoid taking FSN lock while doing group member lookup for FSD

[jira] [Comment Edited] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-14 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364356#comment-16364356 ] Erik Krogen edited comment on HDFS-12749 at 2/14/18 4:38 PM: - Hey

[jira] [Commented] (HDFS-13113) Use Log.*(Object, Throwable) overload to log exceptions

2018-02-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364361#comment-16364361 ] Steve Loughran commented on HDFS-13113: --- this is in HDFS 3.1; leaving the JIRA open in case we want

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-14 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364356#comment-16364356 ] Erik Krogen commented on HDFS-12749: Hey [~hexiaoqiao], I have to admit I'm not familiar with this

[jira] [Commented] (HDFS-13142) Define and Implement a DiifList Interface to store and manage SnapshotDiffs

2018-02-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364327#comment-16364327 ] genericqa commented on HDFS-13142: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364305#comment-16364305 ] genericqa commented on HDFS-12749: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364280#comment-16364280 ] He Xiaoqiao commented on HDFS-12749: ping [~xkrogen] I also had seen this problems in our big

[jira] [Commented] (HDFS-13119) RBF: Manage unavailable clusters

2018-02-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364194#comment-16364194 ] genericqa commented on HDFS-13119: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13147) Support -c argument for DFS command head and tail

2018-02-14 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang updated HDFS-13147: - Status: Patch Available (was: In Progress) Patch 003: Fix the testcase failure which is related.

[jira] [Updated] (HDFS-13147) Support -c argument for DFS command head and tail

2018-02-14 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang updated HDFS-13147: - Attachment: HDFS-13147.003.patch > Support -c argument for DFS command head and tail >

[jira] [Updated] (HDFS-13147) Support -c argument for DFS command head and tail

2018-02-14 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang updated HDFS-13147: - Status: In Progress (was: Patch Available) > Support -c argument for DFS command head and tail >

[jira] [Commented] (HDFS-13119) RBF: Manage unavailable clusters

2018-02-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364058#comment-16364058 ] Yiqun Lin commented on HDFS-13119: -- Thanks for the review, [~elgoiri]. {quote}Otherwise, we could just

[jira] [Comment Edited] (HDFS-13119) RBF: Manage unavailable clusters

2018-02-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364058#comment-16364058 ] Yiqun Lin edited comment on HDFS-13119 at 2/14/18 1:51 PM: --- Thanks for the

[jira] [Updated] (HDFS-13119) RBF: Manage unavailable clusters

2018-02-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13119: - Attachment: HDFS-13119.003.patch > RBF: Manage unavailable clusters > >

[jira] [Commented] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

2018-02-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364040#comment-16364040 ] genericqa commented on HDFS-11187: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

2018-02-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HDFS-11187: -- Status: Patch Available (was: Open) Added fix for FsDatasetImpl#append as requested. > Optimize disk

[jira] [Updated] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

2018-02-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HDFS-11187: -- Status: Open (was: Patch Available) > Optimize disk access for last partial chunk checksum of

[jira] [Updated] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

2018-02-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HDFS-11187: -- Attachment: HDFS-11187-branch-2.004.patch > Optimize disk access for last partial chunk checksum of

[jira] [Updated] (HDFS-13142) Define and Implement a DiifList Interface to store and manage SnapshotDiffs

2018-02-14 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-13142: --- Attachment: HDFS-13142.002.patch > Define and Implement a DiifList Interface to store

[jira] [Commented] (HDFS-13142) Define and Implement a DiifList Interface to store and manage SnapshotDiffs

2018-02-14 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363869#comment-16363869 ] Shashikant Banerjee commented on HDFS-13142: Thanks [~szetszwo], for the review. patch v2

[jira] [Commented] (HDFS-13108) Ozone: OzoneFileSystem: Simplified url schema for Ozone File System

2018-02-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363850#comment-16363850 ] Steve Loughran commented on HDFS-13108: --- Where is the documentation of the URI ? h3.

[jira] [Commented] (HDFS-13136) Avoid taking FSN lock while doing group member lookup for FSD permission check

2018-02-14 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363842#comment-16363842 ] Tsz Wo Nicholas Sze commented on HDFS-13136: +1 the 001 patch looks good. Thanks for the

[jira] [Commented] (HDFS-13142) Define and Implement a DiifList Interface to store and manage SnapshotDiffs

2018-02-14 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363825#comment-16363825 ] Tsz Wo Nicholas Sze commented on HDFS-13142: Thank [~shashikant], the patch looks good. There

[jira] [Commented] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-02-14 Thread Istvan Fajth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363771#comment-16363771 ] Istvan Fajth commented on HDFS-13040: - Hi [~xiaochen], I have checked into the proposal, a few

[jira] [Commented] (HDFS-13147) Support -c argument for DFS command head and tail

2018-02-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363754#comment-16363754 ] genericqa commented on HDFS-13147: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13113) Use Log.*(Object, Throwable) overload to log exceptions

2018-02-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-13113: -- Status: Patch Available (was: Open) > Use Log.*(Object, Throwable) overload to log exceptions

[jira] [Updated] (HDFS-13113) Use Log.*(Object, Throwable) overload to log exceptions

2018-02-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-13113: -- Attachment: HADOOP-10571.07.patch > Use Log.*(Object, Throwable) overload to log exceptions >

[jira] [Updated] (HDFS-13113) Use Log.*(Object, Throwable) overload to log exceptions

2018-02-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-13113: -- Status: Open (was: Patch Available) > Use Log.*(Object, Throwable) overload to log exceptions

[jira] [Commented] (HDFS-13110) [SPS]: Reduce the number of APIs in NamenodeProtocol used by external satisfier

2018-02-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363735#comment-16363735 ] Rakesh R commented on HDFS-13110: - Addressed all the above Uma's comments. [~daryn], [~umamaheswararao],

[jira] [Commented] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-02-14 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363687#comment-16363687 ] genericqa commented on HDFS-13040: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13052) WebHDFS: Add support for snasphot diff

2018-02-14 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363648#comment-16363648 ] Lokesh Jain commented on HDFS-13052: [~xyao] the checkstyle issues appear in NamenodeWebHdfsMethods

  1   2   >