[jira] [Comment Edited] (HDFS-11643) Balancer fencing fails when writing erasure coded lock file

2017-05-02 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994367#comment-15994367 ] SammiChen edited comment on HDFS-11643 at 5/3/17 6:58 AM: -- I add

[jira] [Updated] (HDFS-11643) Balancer fencing fails when writing erasure coded lock file

2017-05-02 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11643: - Attachment: HDFS-11643.008.patch Add check that ID lock file should be a replicate file > Balancer fencin

[jira] [Commented] (HDFS-11708) positional read will fail if replicas moved to different DNs after stream is opened

2017-05-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994347#comment-15994347 ] Hadoop QA commented on HDFS-11708: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-05-02 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994323#comment-15994323 ] Yiqun Lin commented on HDFS-11580: -- {quote} It's not a good way to generate id everywhere

[jira] [Updated] (HDFS-11744) Ozone: Implement the trace ID generator

2017-05-02 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11744: - Description: Currently in ozone, if a client wants to call a container operation command, it requires clie

[jira] [Created] (HDFS-11744) Ozone: Implement the trace ID generator

2017-05-02 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-11744: Summary: Ozone: Implement the trace ID generator Key: HDFS-11744 URL: https://issues.apache.org/jira/browse/HDFS-11744 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-05-02 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11580: - Attachment: HDFS-11580-HDFS-7240.006.patch Hi [~msingh], thanks for your review! The comments you suggeste

[jira] [Commented] (HDFS-11546) Federation Router RPC server

2017-05-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994284#comment-15994284 ] Hadoop QA commented on HDFS-11546: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11738) hedged pread takes more time when block moved from initial locations

2017-05-02 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994270#comment-15994270 ] Vinayakumar B commented on HDFS-11738: -- Test failures and findbugs are unrelated. >

[jira] [Updated] (HDFS-11708) positional read will fail if replicas moved to different DNs after stream is opened

2017-05-02 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-11708: - Attachment: HDFS-11708-04.patch Updated patch to fix checkstyle warning. Please review. > positio

[jira] [Commented] (HDFS-11674) reserveSpaceForReplicas is not released if append request failed due to mirror down and replica recovered

2017-05-02 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994262#comment-15994262 ] Vinayakumar B commented on HDFS-11674: -- Hi [~arpitagarwal], can you please review thi

[jira] [Updated] (HDFS-11546) Federation Router RPC server

2017-05-02 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11546: --- Attachment: (was: HDFS-11546-HDFS-10467-007.patch) > Federation Router RPC server > --

[jira] [Updated] (HDFS-11546) Federation Router RPC server

2017-05-02 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11546: --- Attachment: HDFS-11546-HDFS-10467-007.patch Fixing compilation because of rebase and check style. > F

[jira] [Updated] (HDFS-11546) Federation Router RPC server

2017-05-02 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11546: --- Attachment: (was: HDFS-11546-HDFS-10467-006.patch) > Federation Router RPC server > --

[jira] [Commented] (HDFS-11546) Federation Router RPC server

2017-05-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994224#comment-15994224 ] Hadoop QA commented on HDFS-11546: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11725) Ozone: Revise create container CLI specification and implementation

2017-05-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11725: --- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) > Oz

[jira] [Commented] (HDFS-11725) Ozone: Revise create container CLI specification and implementation

2017-05-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994218#comment-15994218 ] Weiwei Yang commented on HDFS-11725: Thanks [~anu] for the review and +1, I am going t

[jira] [Updated] (HDFS-11546) Federation Router RPC server

2017-05-02 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11546: --- Attachment: HDFS-11546-HDFS-10467-007.patch * Rebase to HDFS-10467 * Fixing {{ConnectionPool}} ** Mana

[jira] [Commented] (HDFS-11643) Balancer fencing fails when writing erasure coded lock file

2017-05-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994194#comment-15994194 ] Andrew Wang commented on HDFS-11643: Woops, I missed that, thanks Sammi. Still, given

[jira] [Commented] (HDFS-11687) Add new public encryption APIs required by Hive

2017-05-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994193#comment-15994193 ] Hadoop QA commented on HDFS-11687: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10999) Introduce separate stats for Replicated and Erasure Coded Blocks apart from the current Aggregated stats

2017-05-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994188#comment-15994188 ] Andrew Wang commented on HDFS-10999: Thanks Manoj for taking on this substantial task.

[jira] [Commented] (HDFS-11698) Ozone: SCM: CLI: Add Debug command

2017-05-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994190#comment-15994190 ] Weiwei Yang commented on HDFS-11698: Hi [~vagarychen], a minor comment, can you make s

[jira] [Commented] (HDFS-11712) Ozone: Reuse ObjectMapper instance to improve the performance

2017-05-02 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994165#comment-15994165 ] Yiqun Lin commented on HDFS-11712: -- Failure tests are not related. Hi [~anu], would you t

[jira] [Commented] (HDFS-11709) StandbyCheckpointer should handle an non-existing legacyOivImageDir gracefully

2017-05-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994163#comment-15994163 ] Hudson commented on HDFS-11709: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-11643) Balancer fencing fails when writing erasure coded lock file

2017-05-02 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994164#comment-15994164 ] SammiChen commented on HDFS-11643: -- Hi [~andrew.wang], the changes to use the new should

[jira] [Commented] (HDFS-11717) Add unit test for HDFS-11709 StandbyCheckpointer should handle non-existing legacyOivImageDir gracefully

2017-05-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994162#comment-15994162 ] Hudson commented on HDFS-11717: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-11717) Add unit test for HDFS-11709 StandbyCheckpointer should handle non-existing legacyOivImageDir gracefully

2017-05-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11717: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.2

[jira] [Commented] (HDFS-11717) Add unit test for HDFS-11709 StandbyCheckpointer should handle non-existing legacyOivImageDir gracefully

2017-05-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994115#comment-15994115 ] Konstantin Shvachko commented on HDFS-11717: +1 tests are passing locally exce

[jira] [Updated] (HDFS-11687) Add new public encryption APIs required by Hive

2017-05-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-11687: - Attachment: HDFS-11687.00.patch Add {{HdfsAdmin#getKeyProvider}} and change the visibility of {{D

[jira] [Updated] (HDFS-11687) Add new public encryption APIs required by Hive

2017-05-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-11687: - Status: Patch Available (was: Open) > Add new public encryption APIs required by Hive > -

[jira] [Commented] (HDFS-10630) Federation State Store FS Implementation

2017-05-02 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994090#comment-15994090 ] Inigo Goiri commented on HDFS-10630: The failed unit test and the find bugs are not re

[jira] [Updated] (HDFS-10630) Federation State Store FS Implementation

2017-05-02 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10630: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10467 Status: Resol

[jira] [Commented] (HDFS-10630) Federation State Store FS Implementation

2017-05-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994086#comment-15994086 ] Hadoop QA commented on HDFS-10630: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10631) Federation State Store ZooKeeper implementation

2017-05-02 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10631: --- Attachment: HDFS-10631-HDFS-10467-005.patch Added curator and fixed check style. > Federation State S

[jira] [Commented] (HDFS-11661) GetContentSummary uses excessive amounts of memory

2017-05-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994067#comment-15994067 ] Yongjun Zhang commented on HDFS-11661: -- HI [~jojochuang], Thanks for working on this

[jira] [Commented] (HDFS-7933) fsck should also report decommissioning replicas.

2017-05-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994057#comment-15994057 ] Zhe Zhang commented on HDFS-7933: - Thanks [~brahmareddy]. I filed HDFS-11743. Actually can

[jira] [Commented] (HDFS-11717) Add unit test for HDFS-11709 StandbyCheckpointer should handle non-existing legacyOivImageDir gracefully

2017-05-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994054#comment-15994054 ] Hadoop QA commented on HDFS-11717: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10631) Federation State Store ZooKeeper implementation

2017-05-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994047#comment-15994047 ] Hadoop QA commented on HDFS-10631: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11742) Revert the core changes from HDFS-8818

2017-05-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994031#comment-15994031 ] Hadoop QA commented on HDFS-11742: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11698) Ozone: SCM: CLI: Add Debug command

2017-05-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994018#comment-15994018 ] Hadoop QA commented on HDFS-11698: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11167) IBM java can not start secure datanode with HDFS_DATANODE_SECURE_EXTRA_OPTS "-jvm server"

2017-05-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994003#comment-15994003 ] Hadoop QA commented on HDFS-11167: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-11742) Revert the core changes from HDFS-8818

2017-05-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994001#comment-15994001 ] Kihwal Lee edited comment on HDFS-11742 at 5/2/17 11:26 PM: !h

[jira] [Commented] (HDFS-11742) Revert the core changes from HDFS-8818

2017-05-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994001#comment-15994001 ] Kihwal Lee commented on HDFS-11742: --- !https://issues.apache.org/jira/secure/attachment/1

[jira] [Commented] (HDFS-11546) Federation Router RPC server

2017-05-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993998#comment-15993998 ] Hadoop QA commented on HDFS-11546: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10631) Federation State Store ZooKeeper implementation

2017-05-02 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10631: --- Attachment: HDFS-10631-HDFS-10467-004.patch Rebased to HDFS-10467 given that HDFS-10630 already covere

[jira] [Updated] (HDFS-11742) Revert the core changes from HDFS-8818

2017-05-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11742: -- Attachment: balancer2.8.png > Revert the core changes from HDFS-8818 > -

[jira] [Commented] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2017-05-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993979#comment-15993979 ] Hadoop QA commented on HDFS-6984: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-11546) Federation Router RPC server

2017-05-02 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993970#comment-15993970 ] Chris Douglas commented on HDFS-11546: -- Thanks for the iterations, I think this is cl

[jira] [Commented] (HDFS-11698) Ozone: SCM: CLI: Add Debug command

2017-05-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993952#comment-15993952 ] Chen Liang commented on HDFS-11698: --- Thanks [~anu] for the comments! bq. May be as anot

[jira] [Updated] (HDFS-11167) IBM java can not start secure datanode with HDFS_DATANODE_SECURE_EXTRA_OPTS "-jvm server"

2017-05-02 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-11167: Fix Version/s: (was: 3.0.0-alpha3) > IBM java can not start secure datanode with HDFS_DA

[jira] [Commented] (HDFS-11167) IBM java can not start secure datanode with HDFS_DATANODE_SECURE_EXTRA_OPTS "-jvm server"

2017-05-02 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993943#comment-15993943 ] Allen Wittenauer commented on HDFS-11167: - We should be avoiding putting specific

[jira] [Updated] (HDFS-11713) Use MoveFileEx to allow renaming a file when the destination exists

2017-05-02 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-11713: Fix Version/s: (was: 3.0.0-alpha2) > Use MoveFileEx to allow renaming a file when the de

[jira] [Commented] (HDFS-11725) Ozone: Revise create container CLI specification and implementation

2017-05-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993930#comment-15993930 ] Anu Engineer commented on HDFS-11725: - [~cheersyang] Thanks for taking care of this. +

[jira] [Updated] (HDFS-10630) Federation State Store FS Implementation

2017-05-02 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10630: --- Attachment: HDFS-10630-HDFS-10467-010.patch Tackling [~chris.douglas] comments and ready for commit.

[jira] [Commented] (HDFS-11698) Ozone: SCM: CLI: Add Debug command

2017-05-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993926#comment-15993926 ] Anu Engineer commented on HDFS-11698: - [~vagarychen] Thank you for getting this done.

[jira] [Comment Edited] (HDFS-11742) Revert the core changes from HDFS-8818

2017-05-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993912#comment-15993912 ] Tsz Wo Nicholas Sze edited comment on HDFS-11742 at 5/2/17 10:40 PM: ---

[jira] [Created] (HDFS-11743) Revert HDFS-7933 from branch-2.7 (fsck reporting decommissioning replicas)

2017-05-02 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-11743: Summary: Revert HDFS-7933 from branch-2.7 (fsck reporting decommissioning replicas) Key: HDFS-11743 URL: https://issues.apache.org/jira/browse/HDFS-11743 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-8818) Allow Balancer to run faster

2017-05-02 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer reassigned HDFS-8818: -- Assignee: Tsz Wo Nicholas Sze (was: Kihwal Lee) > Allow Balancer to run faster > --

[jira] [Comment Edited] (HDFS-11742) Revert the core changes from HDFS-8818

2017-05-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993912#comment-15993912 ] Tsz Wo Nicholas Sze edited comment on HDFS-11742 at 5/2/17 10:31 PM: ---

[jira] [Commented] (HDFS-11742) Revert the core changes from HDFS-8818

2017-05-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993912#comment-15993912 ] Tsz Wo Nicholas Sze commented on HDFS-11742: What we need is HDFS-7639. The n

[jira] [Commented] (HDFS-11643) Balancer fencing fails when writing erasure coded lock file

2017-05-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993894#comment-15993894 ] Andrew Wang commented on HDFS-11643: Hi Sammi, I noticed that the 007 patch doesn't in

[jira] [Commented] (HDFS-10630) Federation State Store FS Implementation

2017-05-02 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993893#comment-15993893 ] Chris Douglas commented on HDFS-10630: -- +1 lgtm Minor, not blocking commit * param j

[jira] [Commented] (HDFS-10630) Federation State Store FS Implementation

2017-05-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993871#comment-15993871 ] Hadoop QA commented on HDFS-10630: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-11742) Revert the core changes from HDFS-8818

2017-05-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993870#comment-15993870 ] Tsz Wo Nicholas Sze commented on HDFS-11742: > ... The reason is explained in

[jira] [Updated] (HDFS-11717) Add unit test for HDFS-11709 StandbyCheckpointer should handle non-existing legacyOivImageDir gracefully

2017-05-02 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-11717: --- Attachment: HDFS-11717.002.patch Fixed the minor checkstyle warning in v002 patch... {{TestMetadataVe

[jira] [Comment Edited] (HDFS-11717) Add unit test for HDFS-11709 StandbyCheckpointer should handle non-existing legacyOivImageDir gracefully

2017-05-02 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993867#comment-15993867 ] Erik Krogen edited comment on HDFS-11717 at 5/2/17 9:58 PM: Fi

[jira] [Updated] (HDFS-11742) Revert the core changes from HDFS-8818

2017-05-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11742: -- Description: This is to revert the core changes made by HDFS-8818. The reason is explained in the jira

[jira] [Commented] (HDFS-11742) Revert the core changes from HDFS-8818

2017-05-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993862#comment-15993862 ] Tsz Wo Nicholas Sze commented on HDFS-11742: Hi Kihwal Lee, let's have a more

[jira] [Commented] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-05-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993858#comment-15993858 ] Andrew Wang commented on HDFS-11741: Hi Wei-chiu, patch looks good overall, few quick

[jira] [Commented] (HDFS-8818) Allow Balancer to run faster

2017-05-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993855#comment-15993855 ] Tsz Wo Nicholas Sze commented on HDFS-8818: --- Hi [~kihwal], let's have a more deta

[jira] [Updated] (HDFS-11742) Revert the core changes from HDFS-8818

2017-05-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11742: -- Assignee: Kihwal Lee Status: Patch Available (was: Open) > Revert the core changes from HDFS-8818

[jira] [Updated] (HDFS-11742) Revert the core changes from HDFS-8818

2017-05-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11742: -- Attachment: HDFS-11742.trunk.patch HDFS-11742.branch-2.patch HDFS-11742.b

[jira] [Updated] (HDFS-8818) Allow Balancer to run faster

2017-05-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8818: - Attachment: (was: bal_revert.branch-2.patch) > Allow Balancer to run faster > -

[jira] [Updated] (HDFS-8818) Allow Balancer to run faster

2017-05-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8818: - Attachment: (was: bal_revert.trunk.patch) > Allow Balancer to run faster >

[jira] [Updated] (HDFS-8818) Allow Balancer to run faster

2017-05-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8818: - Attachment: (was: bal_revert.branch-2.8.patch) > Allow Balancer to run faster > ---

[jira] [Created] (HDFS-11742) Revert the core changes from HDFS-8818

2017-05-02 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-11742: - Summary: Revert the core changes from HDFS-8818 Key: HDFS-11742 URL: https://issues.apache.org/jira/browse/HDFS-11742 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-8818) Allow Balancer to run faster

2017-05-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-8818. -- Resolution: Fixed > Allow Balancer to run faster > > > Key:

[jira] [Updated] (HDFS-8818) Allow Balancer to run faster

2017-05-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8818: - Attachment: bal_revert.trunk.patch bal_revert.branch-2.patch bal_revert.bran

[jira] [Commented] (HDFS-8818) Allow Balancer to run faster

2017-05-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993840#comment-15993840 ] Kihwal Lee commented on HDFS-8818: -- I will open a new one and post the patch there. > All

[jira] [Commented] (HDFS-10630) Federation State Store FS Implementation

2017-05-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993833#comment-15993833 ] Hadoop QA commented on HDFS-10630: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-8818) Allow Balancer to run faster

2017-05-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993824#comment-15993824 ] Andrew Wang commented on HDFS-8818: --- Can we open a new JIRA to track the revert in the ch

[jira] [Reopened] (HDFS-8818) Allow Balancer to run faster

2017-05-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reopened HDFS-8818: -- Reopening for revert. git won't revert it cleanly since there have been other changes since the commit. I m

[jira] [Assigned] (HDFS-8818) Allow Balancer to run faster

2017-05-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reassigned HDFS-8818: Assignee: Kihwal Lee (was: Tsz Wo Nicholas Sze) > Allow Balancer to run faster > --

[jira] [Commented] (HDFS-11739) Fix regression in tests caused by YARN-679

2017-05-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993777#comment-15993777 ] Hadoop QA commented on HDFS-11739: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11698) Ozone: SCM: CLI: Add Debug command

2017-05-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11698: -- Attachment: HDFS-11698-HDFS-7240.001.patch > Ozone: SCM: CLI: Add Debug command > -

[jira] [Updated] (HDFS-11698) Ozone: SCM: CLI: Add Debug command

2017-05-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11698: -- Status: Patch Available (was: Open) > Ozone: SCM: CLI: Add Debug command > ---

[jira] [Updated] (HDFS-11698) Ozone: SCM: CLI: Add Debug command

2017-05-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11698: -- Attachment: (was: HDFS-11698.001.patch) > Ozone: SCM: CLI: Add Debug command >

[jira] [Updated] (HDFS-11698) Ozone: SCM: CLI: Add Debug command

2017-05-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11698: -- Attachment: HDFS-11698.001.patch Post v001 patch. This patch adds basic structure for the convert. And o

[jira] [Commented] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-05-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993731#comment-15993731 ] Hadoop QA commented on HDFS-11741: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-8818) Allow Balancer to run faster

2017-05-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993723#comment-15993723 ] Kihwal Lee commented on HDFS-8818: -- Thanks for the update, [~jojochuang]. That fixes the h

[jira] [Commented] (HDFS-11721) When Standby NameNode is paused using kill -SIGSTOP clients hang rather than moving to the active.

2017-05-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993714#comment-15993714 ] Yongjun Zhang commented on HDFS-11721: -- Hi [~thomaskwscott], The client will not tim

[jira] [Commented] (HDFS-9922) Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes

2017-05-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993672#comment-15993672 ] Andrew Wang commented on HDFS-9922: --- We need to keep the 2.9.0 fix version, since only ma

[jira] [Updated] (HDFS-9922) Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes

2017-05-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9922: -- Fix Version/s: 2.9.0 > Upgrade Domain placement policy status marks a good block in violation when > the

[jira] [Comment Edited] (HDFS-8818) Allow Balancer to run faster

2017-05-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993664#comment-15993664 ] Wei-Chiu Chuang edited comment on HDFS-8818 at 5/2/17 8:25 PM: --

[jira] [Commented] (HDFS-8818) Allow Balancer to run faster

2017-05-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993664#comment-15993664 ] Wei-Chiu Chuang commented on HDFS-8818: --- [~kihwal] FWIW, the hung you mentioned is fi

[jira] [Updated] (HDFS-7541) Upgrade Domains in HDFS

2017-05-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7541: -- Fix Version/s: 2.9.0 > Upgrade Domains in HDFS > --- > > Key: HDFS-75

[jira] [Commented] (HDFS-11721) When Standby NameNode is paused using kill -SIGSTOP clients hang rather than moving to the active.

2017-05-02 Thread Thomas Scott (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993655#comment-15993655 ] Thomas Scott commented on HDFS-11721: - [~yzhangal] from HADOOP-12672 it seems the symp

[jira] [Commented] (HDFS-8818) Allow Balancer to run faster

2017-05-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993654#comment-15993654 ] Kihwal Lee commented on HDFS-8818: -- -1. Proposing revert of this untested change. We've r

[jira] [Updated] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2017-05-02 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-6984: Status: Patch Available (was: Open) > In Hadoop 3, make FileStatus serialize itself via protobuf > -

[jira] [Updated] (HDFS-10630) Federation State Store FS Implementation

2017-05-02 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10630: --- Attachment: HDFS-10630-HDFS-10467-009.patch Fixing FindBug and white space. > Federation State Store

  1   2   >