[jira] [Comment Edited] (HDFS-11742) Revert the core changes from HDFS-8818

[ https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993912#comment-15993912 ] Tsz Wo Nicholas Sze edited comment on HDFS-11742 at 5/2/17 10:40 PM: -

[jira] [Updated] (HDFS-11167) IBM java can not start secure datanode with HDFS_DATANODE_SECURE_EXTRA_OPTS "-jvm server"

[ https://issues.apache.org/jira/browse/HDFS-11167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-11167: Fix Version/s: (was: 3.0.0-alpha3) > IBM java can not start secure datanode with

[jira] [Commented] (HDFS-11167) IBM java can not start secure datanode with HDFS_DATANODE_SECURE_EXTRA_OPTS "-jvm server"

[ https://issues.apache.org/jira/browse/HDFS-11167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993943#comment-15993943 ] Allen Wittenauer commented on HDFS-11167: - We should be avoiding putting specific JVM fixes in the

[jira] [Commented] (HDFS-11698) Ozone: SCM: CLI: Add Debug command

[ https://issues.apache.org/jira/browse/HDFS-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993952#comment-15993952 ] Chen Liang commented on HDFS-11698: --- Thanks [~anu] for the comments! bq. May be as another JIRA – some

[jira] [Commented] (HDFS-11546) Federation Router RPC server

[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993970#comment-15993970 ] Chris Douglas commented on HDFS-11546: -- Thanks for the iterations, I think this is close. bq. How do

[jira] [Comment Edited] (HDFS-11742) Revert the core changes from HDFS-8818

[ https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994001#comment-15994001 ] Kihwal Lee edited comment on HDFS-11742 at 5/2/17 11:26 PM:

[jira] [Commented] (HDFS-11698) Ozone: SCM: CLI: Add Debug command

[ https://issues.apache.org/jira/browse/HDFS-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994018#comment-15994018 ] Hadoop QA commented on HDFS-11698: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11742) Revert the core changes from HDFS-8818

[ https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994031#comment-15994031 ] Hadoop QA commented on HDFS-11742: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10631) Federation State Store ZooKeeper implementation

[ https://issues.apache.org/jira/browse/HDFS-10631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994047#comment-15994047 ] Hadoop QA commented on HDFS-10631: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11717) Add unit test for HDFS-11709 StandbyCheckpointer should handle non-existing legacyOivImageDir gracefully

[ https://issues.apache.org/jira/browse/HDFS-11717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994054#comment-15994054 ] Hadoop QA commented on HDFS-11717: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7933) fsck should also report decommissioning replicas.

[ https://issues.apache.org/jira/browse/HDFS-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994057#comment-15994057 ] Zhe Zhang commented on HDFS-7933: - Thanks [~brahmareddy]. I filed HDFS-11743. Actually can we make this

[jira] [Commented] (HDFS-11661) GetContentSummary uses excessive amounts of memory

[ https://issues.apache.org/jira/browse/HDFS-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994067#comment-15994067 ] Yongjun Zhang commented on HDFS-11661: -- HI [~jojochuang], Thanks for working on this, it seems a

[jira] [Updated] (HDFS-10631) Federation State Store ZooKeeper implementation

[ https://issues.apache.org/jira/browse/HDFS-10631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10631: --- Attachment: HDFS-10631-HDFS-10467-005.patch Added curator and fixed check style. > Federation State

[jira] [Commented] (HDFS-10630) Federation State Store FS Implementation

[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994086#comment-15994086 ] Hadoop QA commented on HDFS-10630: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10630) Federation State Store FS Implementation

[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10630: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10467 Status:

[jira] [Commented] (HDFS-10630) Federation State Store FS Implementation

[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994090#comment-15994090 ] Inigo Goiri commented on HDFS-10630: The failed unit test and the find bugs are not related. Comitting

[jira] [Updated] (HDFS-11687) Add new public encryption APIs required by Hive

[ https://issues.apache.org/jira/browse/HDFS-11687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-11687: - Status: Patch Available (was: Open) > Add new public encryption APIs required by Hive >

[jira] [Updated] (HDFS-11687) Add new public encryption APIs required by Hive

[ https://issues.apache.org/jira/browse/HDFS-11687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-11687: - Attachment: HDFS-11687.00.patch Add {{HdfsAdmin#getKeyProvider}} and change the visibility of

[jira] [Commented] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993979#comment-15993979 ] Hadoop QA commented on HDFS-6984: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11742) Revert the core changes from HDFS-8818

[ https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994001#comment-15994001 ] Kihwal Lee commented on HDFS-11742: ---

[jira] [Commented] (HDFS-11167) IBM java can not start secure datanode with HDFS_DATANODE_SECURE_EXTRA_OPTS "-jvm server"

[ https://issues.apache.org/jira/browse/HDFS-11167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994003#comment-15994003 ] Hadoop QA commented on HDFS-11167: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-8818) Allow Balancer to run faster

[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer reassigned HDFS-8818: -- Assignee: Tsz Wo Nicholas Sze (was: Kihwal Lee) > Allow Balancer to run faster >

[jira] [Created] (HDFS-11743) Revert HDFS-7933 from branch-2.7 (fsck reporting decommissioning replicas)

Zhe Zhang created HDFS-11743: Summary: Revert HDFS-7933 from branch-2.7 (fsck reporting decommissioning replicas) Key: HDFS-11743 URL: https://issues.apache.org/jira/browse/HDFS-11743 Project: Hadoop

[jira] [Commented] (HDFS-11698) Ozone: SCM: CLI: Add Debug command

[ https://issues.apache.org/jira/browse/HDFS-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993926#comment-15993926 ] Anu Engineer commented on HDFS-11698: - [~vagarychen] Thank you for getting this done. This undoubtedly

[jira] [Commented] (HDFS-11546) Federation Router RPC server

[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993998#comment-15993998 ] Hadoop QA commented on HDFS-11546: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11725) Ozone: Revise create container CLI specification and implementation

[ https://issues.apache.org/jira/browse/HDFS-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993930#comment-15993930 ] Anu Engineer commented on HDFS-11725: - [~cheersyang] Thanks for taking care of this. +1 > Ozone:

[jira] [Updated] (HDFS-10630) Federation State Store FS Implementation

[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10630: --- Attachment: HDFS-10630-HDFS-10467-010.patch Tackling [~chris.douglas] comments and ready for commit.

[jira] [Updated] (HDFS-11713) Use MoveFileEx to allow renaming a file when the destination exists

[ https://issues.apache.org/jira/browse/HDFS-11713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-11713: Fix Version/s: (was: 3.0.0-alpha2) > Use MoveFileEx to allow renaming a file when the

[jira] [Updated] (HDFS-11742) Revert the core changes from HDFS-8818

[ https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11742: -- Attachment: balancer2.8.png > Revert the core changes from HDFS-8818 >

[jira] [Updated] (HDFS-10631) Federation State Store ZooKeeper implementation

[ https://issues.apache.org/jira/browse/HDFS-10631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10631: --- Attachment: HDFS-10631-HDFS-10467-004.patch Rebased to HDFS-10467 given that HDFS-10630 already

[jira] [Updated] (HDFS-9922) Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes

[ https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9922: -- Attachment: HDFS-9922.branch-2.8.001.patch > Upgrade Domain placement policy status marks a good block in

[jira] [Updated] (HDFS-9922) Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes

[ https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9922: -- Status: Patch Available (was: Reopened) > Upgrade Domain placement policy status marks a good block in

[jira] [Commented] (HDFS-11694) Block Storage: Add Support for 2 BlockIDBuffers and also for periodic flush of BlockIDBuffer

[ https://issues.apache.org/jira/browse/HDFS-11694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993376#comment-15993376 ] Chen Liang commented on HDFS-11694: --- Thanks [~msingh] for the patch! A few clarification notes: 1.

[jira] [Updated] (HDFS-10630) Federation State Store FS Implementation

[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10630: --- Attachment: HDFS-10630-HDFS-10467-008.patch Fixed/improved: * Checkstyles * Findbugs *

[jira] [Comment Edited] (HDFS-11694) Block Storage: Add Support for 2 BlockIDBuffers and also for periodic flush of BlockIDBuffer

[ https://issues.apache.org/jira/browse/HDFS-11694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993376#comment-15993376 ] Chen Liang edited comment on HDFS-11694 at 5/2/17 5:48 PM: --- Thanks [~msingh] for

[jira] [Commented] (HDFS-9807) Add an optional StorageID to writes

[ https://issues.apache.org/jira/browse/HDFS-9807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993431#comment-15993431 ] Virajith Jalaparti commented on HDFS-9807: -- bq. was concerned that this will break when running

[jira] [Updated] (HDFS-11739) Fix regression in tests caused by YARN-679

[ https://issues.apache.org/jira/browse/HDFS-11739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-11739: -- Status: Patch Available (was: Open) > Fix regression in tests caused by YARN-679 >

[jira] [Commented] (HDFS-11740) Ozone: Differentiate time interval for different DatanodeStateMachine state tasks

[ https://issues.apache.org/jira/browse/HDFS-11740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993302#comment-15993302 ] Anu Engineer commented on HDFS-11740: - [~cheersyang] Thanks for the proposal. I am fine with having

[jira] [Reopened] (HDFS-9922) Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes

[ https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma reopened HDFS-9922: --- > Upgrade Domain placement policy status marks a good block in violation when > there are decommissioned nodes >

[jira] [Updated] (HDFS-11717) Add unit test for HDFS-11709 StandbyCheckpointer should handle non-existing legacyOivImageDir gracefully

[ https://issues.apache.org/jira/browse/HDFS-11717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-11717: --- Attachment: HDFS-11717.001.patch Okay, thank you for the discussion [~shv]. I changed the log level

[jira] [Updated] (HDFS-11493) Ozone: SCM: Add the ability to handle container reports

[ https://issues.apache.org/jira/browse/HDFS-11493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11493: Attachment: exploring-scalability-scm.pdf During the review of this JIRA, both [~cheersyang] and

[jira] [Created] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

Wei-Chiu Chuang created HDFS-11741: -- Summary: Long running balancer may fail due to expired DataEncryptionKey Key: HDFS-11741 URL: https://issues.apache.org/jira/browse/HDFS-11741 Project: Hadoop

[jira] [Commented] (HDFS-9922) Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes

[ https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993580#comment-15993580 ] Hadoop QA commented on HDFS-9922: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11741: --- Attachment: HDFS-11741.001.patch Patch rev 001: a very simple fix with a unit test. The fix

[jira] [Updated] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11741: --- Status: Patch Available (was: Open) > Long running balancer may fail due to expired

[jira] [Updated] (HDFS-11725) Ozone: Revise create container CLI specification and implementation

[ https://issues.apache.org/jira/browse/HDFS-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11725: --- Status: Patch Available (was: Open) > Ozone: Revise create container CLI specification and

[jira] [Updated] (HDFS-11643) Balancer fencing fails when writing erasure coded lock file

[ https://issues.apache.org/jira/browse/HDFS-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11643: - Attachment: HDFS-11643.007.patch Add SHOULD_REPLICATE CreateFlag to indicate create a replicate file >

[jira] [Updated] (HDFS-11737) Backport HDFS-7964 to branch-2.7: add support for async edit logging

[ https://issues.apache.org/jira/browse/HDFS-11737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-11737: - Priority: Critical (was: Major) > Backport HDFS-7964 to branch-2.7: add support for async edit logging >

[jira] [Commented] (HDFS-11674) reserveSpaceForReplicas is not released if append request failed due to mirror down and replica recovered

[ https://issues.apache.org/jira/browse/HDFS-11674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992512#comment-15992512 ] Hadoop QA commented on HDFS-11674: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11708) positional read will fail if replicas moved to different DNs after stream is opened

[ https://issues.apache.org/jira/browse/HDFS-11708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992500#comment-15992500 ] Hadoop QA commented on HDFS-11708: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10614) Appended blocks can be closed even before IBRs from DataNodes

[ https://issues.apache.org/jira/browse/HDFS-10614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-10614: - Attachment: HDFS-10614.03.patch Updated the patch. Added genstamp check before removing the

[jira] [Updated] (HDFS-11674) reserveSpaceForReplicas is not released if append request failed due to mirror down and replica recovered

[ https://issues.apache.org/jira/browse/HDFS-11674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-11674: - Attachment: HDFS-11674-02.patch Updated the patch. Please review. > reserveSpaceForReplicas is

[jira] [Updated] (HDFS-11725) Ozone: Revise create container CLI specification and implementation

[ https://issues.apache.org/jira/browse/HDFS-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11725: --- Attachment: HDFS-11725-HDFS-7240.001.patch > Ozone: Revise create container CLI specification and

[jira] [Commented] (HDFS-11717) Add unit test for HDFS-11709 StandbyCheckpointer should handle non-existing legacyOivImageDir gracefully

[ https://issues.apache.org/jira/browse/HDFS-11717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993602#comment-15993602 ] Hadoop QA commented on HDFS-11717: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-7541) Upgrade Domains in HDFS

[ https://issues.apache.org/jira/browse/HDFS-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7541: -- Fix Version/s: (was: 2.9.0) 2.8.2 > Upgrade Domains in HDFS > --- > >

[jira] [Updated] (HDFS-9922) Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes

[ https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9922: -- Resolution: Fixed Fix Version/s: (was: 2.9.0) 2.8.2 Status: Resolved

[jira] [Commented] (HDFS-7541) Upgrade Domains in HDFS

[ https://issues.apache.org/jira/browse/HDFS-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993607#comment-15993607 ] Ming Ma commented on HDFS-7541: --- Sounds good. HDFS-9005, HDFS-9016 and HDFS-9922 have been committed to

[jira] [Updated] (HDFS-11698) Ozone: SCM: CLI: Add Debug command

[ https://issues.apache.org/jira/browse/HDFS-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11698: -- Status: Patch Available (was: Open) > Ozone: SCM: CLI: Add Debug command >

[jira] [Updated] (HDFS-11698) Ozone: SCM: CLI: Add Debug command

[ https://issues.apache.org/jira/browse/HDFS-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11698: -- Attachment: (was: HDFS-11698.001.patch) > Ozone: SCM: CLI: Add Debug command >

[jira] [Commented] (HDFS-8818) Allow Balancer to run faster

[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993840#comment-15993840 ] Kihwal Lee commented on HDFS-8818: -- I will open a new one and post the patch there. > Allow Balancer to

[jira] [Commented] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993858#comment-15993858 ] Andrew Wang commented on HDFS-11741: Hi Wei-chiu, patch looks good overall, few quick questions: *

[jira] [Commented] (HDFS-11742) Revert the core changes from HDFS-8818

[ https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993862#comment-15993862 ] Tsz Wo Nicholas Sze commented on HDFS-11742: Hi Kihwal Lee, let's have a more detailed

[jira] [Updated] (HDFS-11742) Revert the core changes from HDFS-8818

[ https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11742: -- Description: This is to revert the core changes made by HDFS-8818. The reason is explained in the jira

[jira] [Commented] (HDFS-10630) Federation State Store FS Implementation

[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993893#comment-15993893 ] Chris Douglas commented on HDFS-10630: -- +1 lgtm Minor, not blocking commit * param javadoc for

[jira] [Updated] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-6984: Status: Patch Available (was: Open) > In Hadoop 3, make FileStatus serialize itself via protobuf >

[jira] [Updated] (HDFS-10630) Federation State Store FS Implementation

[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10630: --- Attachment: HDFS-10630-HDFS-10467-009.patch Fixing FindBug and white space. > Federation State Store

[jira] [Commented] (HDFS-8818) Allow Balancer to run faster

[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993654#comment-15993654 ] Kihwal Lee commented on HDFS-8818: -- -1. Proposing revert of this untested change. We've run it on a small

[jira] [Commented] (HDFS-9922) Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes

[ https://issues.apache.org/jira/browse/HDFS-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993672#comment-15993672 ] Andrew Wang commented on HDFS-9922: --- We need to keep the 2.9.0 fix version, since only major and minor

[jira] [Updated] (HDFS-11698) Ozone: SCM: CLI: Add Debug command

[ https://issues.apache.org/jira/browse/HDFS-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11698: -- Attachment: HDFS-11698.001.patch Post v001 patch. This patch adds basic structure for the convert. And

[jira] [Reopened] (HDFS-8818) Allow Balancer to run faster

[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reopened HDFS-8818: -- Reopening for revert. git won't revert it cleanly since there have been other changes since the commit. I

[jira] [Assigned] (HDFS-8818) Allow Balancer to run faster

[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reassigned HDFS-8818: Assignee: Kihwal Lee (was: Tsz Wo Nicholas Sze) > Allow Balancer to run faster >

[jira] [Updated] (HDFS-8818) Allow Balancer to run faster

[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8818: - Attachment: bal_revert.trunk.patch bal_revert.branch-2.patch

[jira] [Commented] (HDFS-11643) Balancer fencing fails when writing erasure coded lock file

[ https://issues.apache.org/jira/browse/HDFS-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993894#comment-15993894 ] Andrew Wang commented on HDFS-11643: Hi Sammi, I noticed that the 007 patch doesn't include any

[jira] [Updated] (HDFS-10630) Federation State Store FS Implementation

[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10630: --- Attachment: (was: HDFS-10630-HDFS-10467-009.patch) > Federation State Store FS Implementation >

[jira] [Commented] (HDFS-8818) Allow Balancer to run faster

[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993723#comment-15993723 ] Kihwal Lee commented on HDFS-8818: -- Thanks for the update, [~jojochuang]. That fixes the hang, but the

[jira] [Commented] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993731#comment-15993731 ] Hadoop QA commented on HDFS-11741: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11698) Ozone: SCM: CLI: Add Debug command

[ https://issues.apache.org/jira/browse/HDFS-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11698: -- Attachment: HDFS-11698-HDFS-7240.001.patch > Ozone: SCM: CLI: Add Debug command >

[jira] [Commented] (HDFS-11739) Fix regression in tests caused by YARN-679

[ https://issues.apache.org/jira/browse/HDFS-11739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993777#comment-15993777 ] Hadoop QA commented on HDFS-11739: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10630) Federation State Store FS Implementation

[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993833#comment-15993833 ] Hadoop QA commented on HDFS-10630: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10630) Federation State Store FS Implementation

[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993871#comment-15993871 ] Hadoop QA commented on HDFS-10630: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Comment Edited] (HDFS-11742) Revert the core changes from HDFS-8818

[ https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993912#comment-15993912 ] Tsz Wo Nicholas Sze edited comment on HDFS-11742 at 5/2/17 10:31 PM: -

[jira] [Commented] (HDFS-11721) When Standby NameNode is paused using kill -SIGSTOP clients hang rather than moving to the active.

[ https://issues.apache.org/jira/browse/HDFS-11721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993655#comment-15993655 ] Thomas Scott commented on HDFS-11721: - [~yzhangal] from HADOOP-12672 it seems the symptom is an

[jira] [Updated] (HDFS-11717) Add unit test for HDFS-11709 StandbyCheckpointer should handle non-existing legacyOivImageDir gracefully

[ https://issues.apache.org/jira/browse/HDFS-11717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-11717: --- Attachment: HDFS-11717.002.patch Fixed the minor checkstyle warning in v002 patch...

[jira] [Comment Edited] (HDFS-11717) Add unit test for HDFS-11709 StandbyCheckpointer should handle non-existing legacyOivImageDir gracefully

[ https://issues.apache.org/jira/browse/HDFS-11717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993867#comment-15993867 ] Erik Krogen edited comment on HDFS-11717 at 5/2/17 9:58 PM: Fixed the minor

[jira] [Commented] (HDFS-11742) Revert the core changes from HDFS-8818

[ https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993870#comment-15993870 ] Tsz Wo Nicholas Sze commented on HDFS-11742: > ... The reason is explained in the jira

[jira] [Commented] (HDFS-11742) Revert the core changes from HDFS-8818

[ https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993912#comment-15993912 ] Tsz Wo Nicholas Sze commented on HDFS-11742: What we need is HDFS-7639. The number of moves

[jira] [Commented] (HDFS-11732) Backport HDFS-8498 to branch-2.7: Blocks can be committed with wrong size

[ https://issues.apache.org/jira/browse/HDFS-11732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992650#comment-15992650 ] Hadoop QA commented on HDFS-11732: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11643) Balancer fencing fails when writing erasure coded lock file

[ https://issues.apache.org/jira/browse/HDFS-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992604#comment-15992604 ] Hadoop QA commented on HDFS-11643: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10614) Appended blocks can be closed even before IBRs from DataNodes

[ https://issues.apache.org/jira/browse/HDFS-10614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992654#comment-15992654 ] Hadoop QA commented on HDFS-10614: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992697#comment-15992697 ] Hadoop QA commented on HDFS-11530: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11725) Ozone: Revise create container CLI specification and implementation

[ https://issues.apache.org/jira/browse/HDFS-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992565#comment-15992565 ] Hadoop QA commented on HDFS-11725: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11725) Ozone: Revise create container CLI specification and implementation

[ https://issues.apache.org/jira/browse/HDFS-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992583#comment-15992583 ] Hadoop QA commented on HDFS-11725: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-11738) hdged pread takes more time when block moved from initial locations

Vinayakumar B created HDFS-11738: Summary: hdged pread takes more time when block moved from initial locations Key: HDFS-11738 URL: https://issues.apache.org/jira/browse/HDFS-11738 Project: Hadoop

[jira] [Updated] (HDFS-11738) hedged pread takes more time when block moved from initial locations

[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-11738: - Summary: hedged pread takes more time when block moved from initial locations (was: hdged pread

[jira] [Updated] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11530: - Attachment: HDFS-11530.014.patch Thanks [~arpitagarwal] for the review! Post the new patch to address the

[jira] [Commented] (HDFS-11721) When Standby NameNode is paused using kill -SIGSTOP clients hang rather than moving to the active.

[ https://issues.apache.org/jira/browse/HDFS-11721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992751#comment-15992751 ] Thomas Scott commented on HDFS-11721: - [~andrew.wang] Hadoop version is 2.6.0 from CDH5.8.5. We have

[jira] [Commented] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992773#comment-15992773 ] Mukul Kumar Singh commented on HDFS-11580: -- Thanks Yiqun Lin for the updated patch. Following are

[jira] [Commented] (HDFS-11643) Balancer fencing fails when writing erasure coded lock file

[ https://issues.apache.org/jira/browse/HDFS-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992825#comment-15992825 ] SammiChen commented on HDFS-11643: -- Double checked the failed unit test. They also failed without the

[jira] [Updated] (HDFS-11739) Fix regression in tests caused by YARN-679

[ https://issues.apache.org/jira/browse/HDFS-11739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-11739: -- Attachment: HADOOP-14368-001.patch > Fix regression in tests caused by YARN-679 >

[jira] [Updated] (HDFS-11739) Fix regression in tests caused by YARN-679

[ https://issues.apache.org/jira/browse/HDFS-11739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-11739: -- Description: Test the patch in HADOOP-14368 with the hdfs test suite under jenkins (was: Test

  1   2   >