[jira] [Commented] (HDFS-10860) Switch HttpFS from Tomcat to Jetty

[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15848089#comment-15848089 ] John Zhuge commented on HDFS-10860: --- {{HttpServer2#isInstrumentationAccessAllowed}} requires the

[jira] [Updated] (HDFS-11377) Balancer hung due to no available mover threads

[ https://issues.apache.org/jira/browse/HDFS-11377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11377: - Target Version/s: 2.9.0, 3.0.0-alpha3 Component/s: balancer & mover Summary:

[jira] [Commented] (HDFS-11335) Remove HdfsClientConfigKeys.DFS_CLIENT_SLOW_IO_WARNING_THRESHOLD_KEY usage from DNConf

[ https://issues.apache.org/jira/browse/HDFS-11335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15848080#comment-15848080 ] Hudson commented on HDFS-11335: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11193 (See

[jira] [Commented] (HDFS-11377) Balancer hung due to "No mover threads available"

[ https://issues.apache.org/jira/browse/HDFS-11377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15848076#comment-15848076 ] Yiqun Lin commented on HDFS-11377: -- Thanks [~zhaoyunjiong] for reporting this and thanks [~manojg] for

[jira] [Commented] (HDFS-11340) DataNode reconfigure for disks doesn't remove the failed volumes

[ https://issues.apache.org/jira/browse/HDFS-11340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15848074#comment-15848074 ] Lei (Eddy) Xu commented on HDFS-11340: -- Thanks for the explanation, [~manojg]. It makes sense. >

[jira] [Updated] (HDFS-11335) Remove HdfsClientConfigKeys.DFS_CLIENT_SLOW_IO_WARNING_THRESHOLD_KEY usage from DNConf

[ https://issues.apache.org/jira/browse/HDFS-11335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-11335: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (HDFS-11370) Optimize NamenodeFsck#getReplicaInfo

[ https://issues.apache.org/jira/browse/HDFS-11370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15848049#comment-15848049 ] Hadoop QA commented on HDFS-11370: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-10983) OIV tool should make an EC file explicit

[ https://issues.apache.org/jira/browse/HDFS-10983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847993#comment-15847993 ] Manoj Govindassamy edited comment on HDFS-10983 at 2/1/17 4:11 AM: ---

[jira] [Commented] (HDFS-10983) OIV tool should make an EC file explicit

[ https://issues.apache.org/jira/browse/HDFS-10983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847993#comment-15847993 ] Manoj Govindassamy commented on HDFS-10983: --- [~andrew.wang], [~jojochuang], Here are the

[jira] [Updated] (HDFS-11370) Optimize NamenodeFsck#getReplicaInfo

[ https://issues.apache.org/jira/browse/HDFS-11370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-11370: Attachment: HDFS-11370.6.patch Thanks for your thoughtful comments, [~manojg] and

[jira] [Commented] (HDFS-4025) QJM: Sychronize past log segments to JNs that missed them

[ https://issues.apache.org/jira/browse/HDFS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847912#comment-15847912 ] Hadoop QA commented on HDFS-4025: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-11383) String duplication in org.apache.hadoop.fs.BlockLocation

Misha Dmitriev created HDFS-11383: - Summary: String duplication in org.apache.hadoop.fs.BlockLocation Key: HDFS-11383 URL: https://issues.apache.org/jira/browse/HDFS-11383 Project: Hadoop HDFS

[jira] [Updated] (HDFS-4025) QJM: Sychronize past log segments to JNs that missed them

[ https://issues.apache.org/jira/browse/HDFS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-4025: - Attachment: HDFS-4025.009.patch Patch v09 has some changes. * Checkstyle corrections * Minor

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847858#comment-15847858 ] Andrew Wang commented on HDFS-7859: --- I re-read through the history of this JIRA, and it seems like we've

[jira] [Commented] (HDFS-10860) Switch HttpFS from Tomcat to Jetty

[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847851#comment-15847851 ] Hadoop QA commented on HDFS-10860: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11370) Optimize NamenodeFsck#getReplicaInfo

[ https://issues.apache.org/jira/browse/HDFS-11370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847850#comment-15847850 ] Manoj Govindassamy commented on HDFS-11370: --- bq. maybe we can add a java doc for

[jira] [Commented] (HDFS-11370) Optimize NamenodeFsck#getReplicaInfo

[ https://issues.apache.org/jira/browse/HDFS-11370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847847#comment-15847847 ] Jing Zhao commented on HDFS-11370: -- Thanks for the discussion, [~manojg] and [~tasanuma0829]. I agree

[jira] [Commented] (HDFS-10860) Switch HttpFS from Tomcat to Jetty

[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847827#comment-15847827 ] Xiao Chen commented on HDFS-10860: -- Thanks [~jzhuge]. As discussed, there're really 2 issues with

[jira] [Commented] (HDFS-11370) Optimize NamenodeFsck#getReplicaInfo

[ https://issues.apache.org/jira/browse/HDFS-11370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847826#comment-15847826 ] Manoj Govindassamy commented on HDFS-11370: --- Thanks [~tasanuma0829]. bq. I think it is the

[jira] [Commented] (HDFS-11377) Balancer hung due to "No mover threads available"

[ https://issues.apache.org/jira/browse/HDFS-11377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847789#comment-15847789 ] Manoj Govindassamy commented on HDFS-11377: --- Thanks [~zhaoyunjiong]. In

[jira] [Commented] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847736#comment-15847736 ] Chris Douglas commented on HDFS-6984: - bq. serialization that omits fields for efficiency isn't

[jira] [Updated] (HDFS-11210) Enhance key rolling to be guarantee new KeyVersion is returned from generateEncryptedKeys after a key version is rolled

[ https://issues.apache.org/jira/browse/HDFS-11210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11210: - Summary: Enhance key rolling to be guarantee new KeyVersion is returned from generateEncryptedKeys after

[jira] [Updated] (HDFS-11210) Enhance key rolling to be atomic

[ https://issues.apache.org/jira/browse/HDFS-11210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11210: - Attachment: HDFS-11210.02.patch Thanks for the review Andrew, really appreciate the quality review of

[jira] [Commented] (HDFS-11243) [SPS]: Add a protocol command from NN to DN for dropping the SPS work and queues

[ https://issues.apache.org/jira/browse/HDFS-11243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847699#comment-15847699 ] Uma Maheswara Rao G commented on HDFS-11243: Thank you [~rakeshr] for the review and commit >

[jira] [Commented] (HDFS-11370) Optimize NamenodeFsck#getReplicaInfo

[ https://issues.apache.org/jira/browse/HDFS-11370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847693#comment-15847693 ] Hadoop QA commented on HDFS-11370: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11100) Recursively deleting file protected by sticky bit should fail

[ https://issues.apache.org/jira/browse/HDFS-11100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11100: -- Status: In Progress (was: Patch Available) > Recursively deleting file protected by sticky bit should

[jira] [Updated] (HDFS-10629) Federation Router

[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10629: --- Attachment: routerlatency.png Latency of a Router with a Namenode compared to a single Namenode and

[jira] [Commented] (HDFS-10629) Federation Router

[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847663#comment-15847663 ] Hadoop QA commented on HDFS-10629: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10629) Federation Router

[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847662#comment-15847662 ] Inigo Goiri commented on HDFS-10629: [~grey], I just uploaded a figure showing the latency of the

[jira] [Updated] (HDFS-10860) Switch HttpFS from Tomcat to Jetty

[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10860: -- Attachment: HDFS-10860.007.patch Patch 007 - Xiao’s comments - Test simple request in

[jira] [Commented] (HDFS-10860) Switch HttpFS from Tomcat to Jetty

[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847657#comment-15847657 ] John Zhuge commented on HDFS-10860: --- bq. Sorry should have asked this in the KMS jira. The new

[jira] (HDFS-8430) Erasure coding: compute file checksum for striped files (stripe by stripe)

[ https://issues.apache.org/jira/browse/HDFS-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8430: -- Priority: Blocker (was: Major) Target Version/s: 3.0.0-alpha3 Component/s:

[jira] (HDFS-11152) Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors

[ https://issues.apache.org/jira/browse/HDFS-11152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11152: --- Priority: Blocker (was: Major) Component/s: erasure-coding Marking ec must do's as blockers

[jira] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10971: --- Priority: Blocker (was: Major) Marking ec must do's as blockers for alpha3 > Distcp should not copy

[jira] (HDFS-11314) Validate client-provided EC schema on the NameNode

[ https://issues.apache.org/jira/browse/HDFS-11314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11314: --- Priority: Blocker (was: Major) Marking ec must do's as blockers for alpha3 > Validate

[jira] (HDFS-8112) Enforce authorization policy to protect administration operations for EC zone and schemas

[ https://issues.apache.org/jira/browse/HDFS-8112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8112: -- Priority: Blocker (was: Major) Marking ec must do's as blockers for alpha3 > Enforce authorization

[jira] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7859: -- Priority: Blocker (was: Major) Target Version/s: 3.0.0-alpha3 Marking ec must do's as

[jira] (HDFS-10629) Federation Router

[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847495#comment-15847495 ] Lei Guo commented on HDFS-10629: [~elgoiri] [~jakace], do we have rough idea about the overhead

[jira] (HDFS-11382) Persist Erasure Coding Policy ID in a new optional field in INodeFile in FSImage

[ https://issues.apache.org/jira/browse/HDFS-11382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11382: --- Hadoop Flags: Incompatible change > Persist Erasure Coding Policy ID in a new optional field in

[jira] (HDFS-11382) Persist Erasure Coding Policy ID in a new optional field in INodeFile in FSImage

Manoj Govindassamy created HDFS-11382: - Summary: Persist Erasure Coding Policy ID in a new optional field in INodeFile in FSImage Key: HDFS-11382 URL: https://issues.apache.org/jira/browse/HDFS-11382

[jira] (HDFS-10983) OIV tool should make an EC file explicit

[ https://issues.apache.org/jira/browse/HDFS-10983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847307#comment-15847307 ] Manoj Govindassamy commented on HDFS-10983: --- Thanks [~andrew.wang]. Filed HDFS-11382 to track

[jira] (HDFS-11243) [SPS]: Add a protocol command from NN to DN for dropping the SPS work and queues

[ https://issues.apache.org/jira/browse/HDFS-11243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847248#comment-15847248 ] Rakesh R commented on HDFS-11243: - Thank you [~umamaheswararao]. Committed to branch HDFS-10285 > [SPS]:

[jira] (HDFS-11243) [SPS]: Add a protocol command from NN to DN for dropping the SPS work and queues

[ https://issues.apache.org/jira/browse/HDFS-11243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11243: Resolution: Fixed Fix Version/s: HDFS-10285 Target Version/s: (was: HDFS-10285)

[jira] (HDFS-10983) OIV tool should make an EC file explicit

[ https://issues.apache.org/jira/browse/HDFS-10983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847225#comment-15847225 ] Andrew Wang commented on HDFS-10983: Hi Manoj, We reused the replication field so the in-memory

[jira] (HDFS-10860) Switch HttpFS from Tomcat to Jetty

[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847222#comment-15847222 ] John Zhuge commented on HDFS-10860: --- Confirmed NPE without the check for daemonlog request, and for

[jira] (HDFS-11243) [SPS]: Add a protocol command from NN to DN for dropping the SPS work and queues

[ https://issues.apache.org/jira/browse/HDFS-11243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847211#comment-15847211 ] Uma Maheswara Rao G commented on HDFS-11243: {quote}

[jira] (HDFS-11350) Document the missing settings relevant to DataNode disk IO statistics

[ https://issues.apache.org/jira/browse/HDFS-11350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847207#comment-15847207 ] Arpit Agarwal commented on HDFS-11350: -- Hi [~linyiqun], I want to hold off documenting these settings

[jira] (HDFS-10860) Switch HttpFS from Tomcat to Jetty

[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847205#comment-15847205 ] John Zhuge commented on HDFS-10860: --- bq. MDCFilter:java: why do we need to check getPathInfo() being

[jira] (HDFS-10860) Switch HttpFS from Tomcat to Jetty

[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847137#comment-15847137 ] John Zhuge commented on HDFS-10860: --- Thanks [~xiaochen] for the review. bq.