[jira] [Commented] (HDFS-12826) Document Saying the RPC port, But it's required IPC port in Balancer Document.

2017-11-22 Thread usharani (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262252#comment-16262252 ] usharani commented on HDFS-12826: - [~vagarychen] thanks for taking a look. bq. changing ipc to rpc

[jira] [Updated] (HDFS-12853) Ozone: Optimize chunk writes for Ratis by avoiding double writes

2017-11-22 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12853: - Description: Ozone, in replicated mode writes the data twice, once to the raft log and

[jira] [Updated] (HDFS-12851) Ozone: Upgrade to latest ratis build

2017-11-22 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12851: - Attachment: HDFS-12851-HDFS-7240.001.patch > Ozone: Upgrade to latest ratis build >

[jira] [Commented] (HDFS-12741) ADD support for KSM --createObjectStore command

2017-11-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262167#comment-16262167 ] Yiqun Lin commented on HDFS-12741: -- Thanks for working on this, [~shashikant]. Overall looks good to me

[jira] [Commented] (HDFS-7240) Object store in HDFS

2017-11-22 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263485#comment-16263485 ] Aaron Fabbri commented on HDFS-7240: Thanks for taking notes, and thank you for the lively discussion.

[jira] [Created] (HDFS-12856) BlockReconstructionWork.chooseTargets() violates namesystem locking

2017-11-22 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-12856: -- Summary: BlockReconstructionWork.chooseTargets() violates namesystem locking Key: HDFS-12856 URL: https://issues.apache.org/jira/browse/HDFS-12856

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-11-22 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263553#comment-16263553 ] Tsz Wo Nicholas Sze commented on HDFS-12638: Since this is about NameNode failed by

[jira] [Commented] (HDFS-12836) startTxId could be greater than endTxId when tailing in-progress edit log

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263526#comment-16263526 ] Hadoop QA commented on HDFS-12836: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263573#comment-16263573 ] Hadoop QA commented on HDFS-12832: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12856) BlockReconstructionWork.chooseTargets() violates namesystem locking

2017-11-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263497#comment-16263497 ] Konstantin Shvachko commented on HDFS-12856: This to address [~xkrogen]'s

[jira] [Updated] (HDFS-12299) Race Between update pipeline and DN Re-Registration

2017-11-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12299: --- Attachment: HDFS-12299.001.branch-2.7.patch I made a branch-2.7 patch. Kindly review. It's

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-11-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263522#comment-16263522 ] Junping Du commented on HDFS-12638: --- [~jingzhao] and [~szetszwo], any comments on Konstantin's proposal

[jira] [Commented] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263537#comment-16263537 ] Hadoop QA commented on HDFS-12665: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-11-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263561#comment-16263561 ] Konstantin Shvachko commented on HDFS-12638: I looked more closely through the changes

[jira] [Commented] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263596#comment-16263596 ] Hadoop QA commented on HDFS-12832: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263524#comment-16263524 ] Hadoop QA commented on HDFS-12832: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9754) Avoid unnecessary getBlockCollection calls in BlockManager

2017-11-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263565#comment-16263565 ] Konstantin Shvachko commented on HDFS-9754: --- Proposing to revert this in HDFS-12638. [See this

[jira] [Commented] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263499#comment-16263499 ] Konstantin Shvachko commented on HDFS-12832: Also file HDFS-12856 to further address

[jira] [Commented] (HDFS-7240) Object store in HDFS

2017-11-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263515#comment-16263515 ] Anu Engineer commented on HDFS-7240: h1. Ozone - Second community meeting Time: Friday, November 17,

[jira] [Updated] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-11-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12638: -- Target Version/s: 2.8.3, 3.0.0, 2.9.1 (was: 2.8.3) > NameNode exits due to ReplicationMonitor thread

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-11-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263649#comment-16263649 ] Junping Du commented on HDFS-12638: --- Should be a blocker for 2.9.1 and 3.0.0 as well. Add them into

[jira] [Updated] (HDFS-12786) Ozone: add port/service names to the ksm/scm web ui

2017-11-22 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12786: Attachment: HDFS-12786-HDFS-7240.002.patch > Ozone: add port/service names to the ksm/scm web ui >

[jira] [Updated] (HDFS-12786) Ozone: add port/service names to the ksm/scm web ui

2017-11-22 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12786: Attachment: (was: /tmp/HDFS-12786-HDFS-7240.002.patch) > Ozone: add port/service names to the

[jira] [Commented] (HDFS-12786) Ozone: add port/service names to the ksm/scm web ui

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262490#comment-16262490 ] Hadoop QA commented on HDFS-12786: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Created] (HDFS-12854) Centralized Cache Management should support ViewFileSystem.

2017-11-22 Thread Harshakiran Reddy (JIRA)
Harshakiran Reddy created HDFS-12854: Summary: Centralized Cache Management should support ViewFileSystem. Key: HDFS-12854 URL: https://issues.apache.org/jira/browse/HDFS-12854 Project: Hadoop

[jira] [Commented] (HDFS-12786) Ozone: add port/service names to the ksm/scm web ui

2017-11-22 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262424#comment-16262424 ] Elek, Marton commented on HDFS-12786: - Sure, I removed the colon. I was also hesitated about the right

[jira] [Commented] (HDFS-12854) Centralized Cache Management should support ViewFileSystem.

2017-11-22 Thread Sreejith MV (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262420#comment-16262420 ] Sreejith MV commented on HDFS-12854: I would like to work on this issue > Centralized Cache

[jira] [Commented] (HDFS-12681) Make HdfsLocatedFileStatus a subtype of LocatedFileStatus

2017-11-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262341#comment-16262341 ] Steve Loughran commented on HDFS-12681: --- It's nice to see the builder pattern here. I've been doing

[jira] [Commented] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263620#comment-16263620 ] Konstantin Shvachko commented on HDFS-12832: TestUnbuffer is tracked under HDFS-12815. Other

[jira] [Commented] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-22 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263903#comment-16263903 ] Erik Krogen commented on HDFS-12832: Hey [~shv], changes look good to me and thank you for filing the

[jira] [Reopened] (HDFS-12780) Fix spelling mistake in DistCpUtils.java

2017-11-22 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang reopened HDFS-12780: -- > Fix spelling mistake in DistCpUtils.java > > >

[jira] [Commented] (HDFS-12641) Backport HDFS-11755 into branch-2.7 to fix a regression in HDFS-11445

2017-11-22 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262705#comment-16262705 ] Brahma Reddy Battula commented on HDFS-12641: - [~jojochuang] thanks for working on this.

[jira] [Updated] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-22 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-12754: --- Attachment: HDFS-12754.009.patch Thank you [~xiaochen], I missed putting up the version which had the

[jira] [Commented] (HDFS-12812) Ozone: dozone: initialize scm directory on cluster startup

2017-11-22 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262551#comment-16262551 ] Elek, Marton commented on HDFS-12812: - The patch requires new base image. I uploaded the source of the

[jira] [Updated] (HDFS-12786) Ozone: add port/service names to the ksm/scm web ui

2017-11-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12786: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-12681) Make HdfsLocatedFileStatus a subtype of LocatedFileStatus

2017-11-22 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262929#comment-16262929 ] Chris Douglas commented on HDFS-12681: -- bq. I've been doing some stuff with subclasses of FileStatus

[jira] [Commented] (HDFS-12851) Ozone: Upgrade to latest ratis build

2017-11-22 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262938#comment-16262938 ] Mukul Kumar Singh commented on HDFS-12851: -- [~szetszwo] & [~anu] Please have a look. > Ozone:

[jira] [Updated] (HDFS-12851) Ozone: Upgrade to latest ratis build

2017-11-22 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12851: - Status: Patch Available (was: Open) > Ozone: Upgrade to latest ratis build >

[jira] [Commented] (HDFS-12588) Use GenericOptionsParser for scm and ksm daemon

2017-11-22 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262937#comment-16262937 ] Elek, Marton commented on HDFS-12588: - Patch is rebased on top of HDFS-7240 according to the latest

[jira] [Updated] (HDFS-12851) Ozone: Upgrade to latest ratis build

2017-11-22 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12851: - Attachment: HDFS-12851-HDFS-7240.002.patch > Ozone: Upgrade to latest ratis build >

[jira] [Commented] (HDFS-12836) startTxId could be greater than endTxId when tailing in-progress edit log

2017-11-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262958#comment-16262958 ] Wei-Chiu Chuang commented on HDFS-12836: Thanks [~csun]. The fix and test looks good to me. Would

[jira] [Commented] (HDFS-12786) Ozone: add port/service names to the ksm/scm web ui

2017-11-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262979#comment-16262979 ] Xiaoyu Yao commented on HDFS-12786: --- +1 for v2 patch. I will commit it shortly. > Ozone: add

[jira] [Updated] (HDFS-12807) Ozone: Expose RockDB stats via JMX for Ozone metadata stores

2017-11-22 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12807: Status: In Progress (was: Patch Available) Back to in-progress to check the unit tests and

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263202#comment-16263202 ] Hudson commented on HDFS-12754: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13271 (See

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-22 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263201#comment-16263201 ] Kihwal Lee commented on HDFS-12754: --- [~andrew.wang], I think it is good to add this to 3.0.0. If you

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263074#comment-16263074 ] Hadoop QA commented on HDFS-12754: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12847) Regenerate editsStored and editsStored.xml in HDFS tests

2017-11-22 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12847: - Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-12851) Ozone: Upgrade to latest ratis build

2017-11-22 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263103#comment-16263103 ] Tsz Wo Nicholas Sze commented on HDFS-12851: Thanks, Mukul. Patch looks good. Some minor

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-22 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263121#comment-16263121 ] Kihwal Lee commented on HDFS-12754: --- +1 looks good. > Lease renewal can hit a deadlock >

[jira] [Commented] (HDFS-12847) Regenerate editsStored and editsStored.xml in HDFS tests

2017-11-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263131#comment-16263131 ] Hudson commented on HDFS-12847: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13270 (See

[jira] [Updated] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-22 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-12754: -- Fix Version/s: 3.1.0 > Lease renewal can hit a deadlock > - > >

[jira] [Commented] (HDFS-12588) Use GenericOptionsParser for scm and ksm daemon

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263346#comment-16263346 ] Hadoop QA commented on HDFS-12588: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12851) Ozone: Upgrade to latest ratis build

2017-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263365#comment-16263365 ] Hadoop QA commented on HDFS-12851: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12588) Use GenericOptionsParser for scm and ksm daemon

2017-11-22 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12588: Attachment: HDFS-12588-HDFS-7240.005.patch > Use GenericOptionsParser for scm and ksm daemon >

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-22 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12665: -- Attachment: HDFS-12665-HDFS-9806.008.patch Posting a new patch that fixes the findbugs,

[jira] [Updated] (HDFS-12836) startTxId could be greater than endTxId when tailing in-progress edit log

2017-11-22 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12836: Status: Patch Available (was: Open) > startTxId could be greater than endTxId when tailing in-progress

[jira] [Updated] (HDFS-12836) startTxId could be greater than endTxId when tailing in-progress edit log

2017-11-22 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-12836: Attachment: HDFS-12836.2.patch Thanks [~jojochuang]. Yes I think this is a good suggestion. Uploaded patch

[jira] [Created] (HDFS-12855) Fsck violates namesystem locking

2017-11-22 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-12855: -- Summary: Fsck violates namesystem locking Key: HDFS-12855 URL: https://issues.apache.org/jira/browse/HDFS-12855 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-9146) HDFS forward seek() within a block shouldn't spawn new TCP Peer/RemoteBlockReader

2017-11-22 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HDFS-9146: -- Affects Version/s: 3.0.0 > HDFS forward seek() within a block shouldn't spawn new TCP > Peer/RemoteBlockReader

[jira] [Commented] (HDFS-12809) [READ] Fix the randomized selection of locations in {{ProvidedBlocksBuilder}}.

2017-11-22 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263324#comment-16263324 ] Virajith Jalaparti commented on HDFS-12809: --- [~elgoiri], the existing tests ensure that there

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-22 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12665: -- Status: Open (was: Patch Available) > [AliasMap] Create a version of the AliasMap that

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-22 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12665: -- Status: Patch Available (was: Open) > [AliasMap] Create a version of the AliasMap that

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263261#comment-16263261 ] Andrew Wang commented on HDFS-12754: Agree, please get it into branch-3.0.0 as well since we're

[jira] [Comment Edited] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263282#comment-16263282 ] Konstantin Shvachko edited comment on HDFS-12832 at 11/22/17 8:18 PM: --

[jira] [Updated] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-12832: --- Attachment: HDFS-12832.002.patch The 002 patch fixes the issue of calling

[jira] [Updated] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-22 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-12754: -- Fix Version/s: 3.0.0 > Lease renewal can hit a deadlock > - > >

[jira] [Updated] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-12832: --- Status: Patch Available (was: Open) > INode.getFullPathName may throw

[jira] [Commented] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263296#comment-16263296 ] Konstantin Shvachko commented on HDFS-12832: Filed HDFS-12855. > INode.getFullPathName may

[jira] [Assigned] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko reassigned HDFS-12832: -- Assignee: Konstantin Shvachko > INode.getFullPathName may throw

[jira] [Updated] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-12832: --- Attachment: HDFS-12832-branch-2.002.patch Branch-2 patch is different from trunk and

[jira] [Updated] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-12832: --- Attachment: HDFS-12832-branch-2.7.002.patch branch-2.7 patch. A bit more changes as I