[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530221#comment-15530221 ] Xiaoyu Yao commented on HDFS-10690: --- [~fenghua_hu]: the patch v06 looks good. I plan to commit it by EOD

[jira] [Updated] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10896: --- Attachment: HDFS-10896.003.patch Attached v003 patch with checkstyle fix. Thanks for the review,

[jira] [Commented] (HDFS-10919) Provide admin/debug tool to dump out info of a given block

[ https://issues.apache.org/jira/browse/HDFS-10919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530311#comment-15530311 ] Yongjun Zhang commented on HDFS-10919: -- Many thanks [~kihwal]! I was not aware of this fsck switch

[jira] [Commented] (HDFS-9850) DiskBalancer : Explore removing references to FsVolumeSpi

[ https://issues.apache.org/jira/browse/HDFS-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530382#comment-15530382 ] Manoj Govindassamy commented on HDFS-9850: -- Thanks [~anu], [~eddyxu] for the review and commit

[jira] [Commented] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530148#comment-15530148 ] Anu Engineer commented on HDFS-10824: - I am good with the changes. Thanks [~cnauroth] and

[jira] [Commented] (HDFS-10919) Provide admin/debug tool to dump out info of a given block

[ https://issues.apache.org/jira/browse/HDFS-10919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530196#comment-15530196 ] Kihwal Lee commented on HDFS-10919: --- Given a block ID you can use {{fsck -blockId}} to get the file it

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530131#comment-15530131 ] Brahma Reddy Battula commented on HDFS-10810: - Thanks [~szetszwo]. > Setreplication removing

[jira] [Updated] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-10810: Attachment: HDFS-10810-003.patch Uploaded the patch to remove the fixed time

[jira] [Commented] (HDFS-10906) Add unit tests for Trash with HDFS encryption zones

[ https://issues.apache.org/jira/browse/HDFS-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530249#comment-15530249 ] Mingliang Liu commented on HDFS-10906: -- Thanks for the to do list, [~xyao]. +1 for the proposal. It

[jira] [Commented] (HDFS-10906) Add unit tests for Trash with HDFS encryption zones

[ https://issues.apache.org/jira/browse/HDFS-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530300#comment-15530300 ] Xiaoyu Yao commented on HDFS-10906: --- Agree. Regrading adding Kerberos enabled trash related unit test

[jira] [Commented] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530458#comment-15530458 ] Xiao Chen commented on HDFS-10918: -- Hi [~andrew.wang], Could you take a look and see if this makes sense

[jira] [Commented] (HDFS-10911) Change edit log OP_UPDATE_BLOCKS to store delta blocks only.

[ https://issues.apache.org/jira/browse/HDFS-10911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530215#comment-15530215 ] Kihwal Lee commented on HDFS-10911: --- IIRC, namenode didn't use to log all blocks all the time, but it

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530236#comment-15530236 ] Mingliang Liu commented on HDFS-10810: -- Thanks [~brahmareddy]. That's true that [HDFS-10666] has not

[jira] [Commented] (HDFS-10913) Refactor BlockReceiver by introducing faults injector to enhance testability of detecting slow mirrors

[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530342#comment-15530342 ] Xiaobing Zhou commented on HDFS-10913: -- v001 patch added brand new injector instance to avoid side

[jira] [Updated] (HDFS-10913) Refactor BlockReceiver by introducing faults injector to enhance testability of detecting slow mirrors

[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10913: - Attachment: HDFS-10913.001.patch > Refactor BlockReceiver by introducing faults injector to

[jira] [Commented] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530343#comment-15530343 ] Lei (Eddy) Xu commented on HDFS-10896: -- The patch is mostly moving code to the new classes. +1

[jira] [Commented] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530234#comment-15530234 ] Hadoop QA commented on HDFS-10921: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10919) Provide admin/debug tool to dump out info of a given block

[ https://issues.apache.org/jira/browse/HDFS-10919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10919: - Target Version/s: 3.0.0-alpha2 > Provide admin/debug tool to dump out info of a given block >

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530405#comment-15530405 ] Hadoop QA commented on HDFS-10810: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10824: - Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-10629) Federation Router

[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531269#comment-15531269 ] Inigo Goiri commented on HDFS-10629: [~jakace], we should remove the JMX related code and leave it for

[jira] [Updated] (HDFS-10923) Make InstrumentedLock require ReentrantLock

[ https://issues.apache.org/jira/browse/HDFS-10923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10923: - Attachment: HDFS-10923.01.patch The patch also renames InstrumentedLock to

[jira] [Commented] (HDFS-10683) Make class Token$PrivateToken private

[ https://issues.apache.org/jira/browse/HDFS-10683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531839#comment-15531839 ] Wei-Chiu Chuang commented on HDFS-10683: +1 > Make class Token$PrivateToken private >

[jira] [Commented] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530075#comment-15530075 ] Hadoop QA commented on HDFS-10921: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10922) Adding additional unit tests for Trash

[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530965#comment-15530965 ] Xiaoyu Yao commented on HDFS-10922: --- Propose to add the following test cases: # test users can delete

[jira] [Updated] (HDFS-10916) Switch from "raw" to "system" xattr namespace for erasure coding policy

[ https://issues.apache.org/jira/browse/HDFS-10916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10916: --- Summary: Switch from "raw" to "system" xattr namespace for erasure coding policy (was: Switch from

[jira] [Commented] (HDFS-10779) Rename does not need to re-solve destination

[ https://issues.apache.org/jira/browse/HDFS-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531097#comment-15531097 ] Kihwal Lee commented on HDFS-10779: --- +1 nice improvement to not re-resolve the same thing multiple

[jira] [Commented] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530788#comment-15530788 ] Xiaobing Zhou commented on HDFS-10824: -- Thank you [~arpiagariu], [~cnauroth] and [~anu] for

[jira] [Commented] (HDFS-10915) Fix time measurement bug in TestDatanodeRestart#testWaitForRegistrationOnRestart

[ https://issues.apache.org/jira/browse/HDFS-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530790#comment-15530790 ] Xiaobing Zhou commented on HDFS-10915: -- Thank you [~liuml07] for committing it. > Fix time

[jira] [Created] (HDFS-10922) Adding additional unit tests for Trash

Xiaoyu Yao created HDFS-10922: - Summary: Adding additional unit tests for Trash Key: HDFS-10922 URL: https://issues.apache.org/jira/browse/HDFS-10922 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-10897) Ozone: SCM: Add NodeManager

[ https://issues.apache.org/jira/browse/HDFS-10897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530949#comment-15530949 ] Anu Engineer commented on HDFS-10897: - [~jingzhao] Thanks for taking time out to review the code and

[jira] [Commented] (HDFS-10912) Ozone:SCM: Add safe mode support to NodeManager.

[ https://issues.apache.org/jira/browse/HDFS-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531044#comment-15531044 ] Arpit Agarwal commented on HDFS-10912: -- bq. Arpit also made the same comment, and suggested that I

[jira] [Commented] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531104#comment-15531104 ] Hadoop QA commented on HDFS-10824: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10912) Ozone:SCM: Add safe mode support to NodeManager.

[ https://issues.apache.org/jira/browse/HDFS-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530970#comment-15530970 ] Anu Engineer commented on HDFS-10912: - [~jingzhao] Thanks for your comments. bq. the first one is to

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531057#comment-15531057 ] Fenghua Hu commented on HDFS-10690: --- [~xyao], thanks for the help! > Optimize insertion/removal of

[jira] [Commented] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531081#comment-15531081 ] Andrew Wang commented on HDFS-10918: Thanks for working on this Xiao, a few comments: * I don't think

[jira] [Commented] (HDFS-10916) Switch from "raw" to "system" xattr namespace for erasure coding policy

[ https://issues.apache.org/jira/browse/HDFS-10916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531033#comment-15531033 ] Andrew Wang commented on HDFS-10916: Test failures look unrelated. > Switch from "raw" to "system"

[jira] [Comment Edited] (HDFS-10897) Ozone: SCM: Add NodeManager

[ https://issues.apache.org/jira/browse/HDFS-10897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530818#comment-15530818 ] Jing Zhao edited comment on HDFS-10897 at 9/28/16 8:43 PM: --- Thanks for working

[jira] [Commented] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530628#comment-15530628 ] Hadoop QA commented on HDFS-10896: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10826) The result of fsck should be CRITICAL when there are unrecoverable ec block groups.

[ https://issues.apache.org/jira/browse/HDFS-10826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530710#comment-15530710 ] Jing Zhao commented on HDFS-10826: -- # The failure of TestLeaseRecoveryStriped seems related. Could you

[jira] [Commented] (HDFS-10314) A new tool to sync current HDFS view to specified snapshot

[ https://issues.apache.org/jira/browse/HDFS-10314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530595#comment-15530595 ] Yongjun Zhang commented on HDFS-10314: -- Had a discussion with [~jingzhao], and we had the following

[jira] [Commented] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530774#comment-15530774 ] Jitendra Nath Pandey commented on HDFS-10892: - I think it makes sense to track utf8 tests

[jira] [Commented] (HDFS-10912) Ozone:SCM: Add safe mode support to NodeManager.

[ https://issues.apache.org/jira/browse/HDFS-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530843#comment-15530843 ] Jing Zhao commented on HDFS-10912: -- Thanks for the work, [~anu]. For SCM, I think we may have two

[jira] [Updated] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10824: - Resolution: Fixed Fix Version/s: 3.0.0-alpha2 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530601#comment-15530601 ] Hudson commented on HDFS-10824: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10508 (See

[jira] [Updated] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10824: - Attachment: HDFS-10824-branch-2.006.patch > MiniDFSCluster#storageCapacities has no effects on

[jira] [Updated] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10824: - Status: Patch Available (was: Reopened) > MiniDFSCluster#storageCapacities has no effects on

[jira] [Reopened] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reopened HDFS-10824: -- > MiniDFSCluster#storageCapacities has no effects on real capacity >

[jira] [Commented] (HDFS-10913) Refactor BlockReceiver by introducing faults injector to enhance testability of detecting slow mirrors

[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530612#comment-15530612 ] Hadoop QA commented on HDFS-10913: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530725#comment-15530725 ] Hanisha Koneru commented on HDFS-10896: --- +1 for v3 patch. Thanks [~xkrogen] for including changes

[jira] [Commented] (HDFS-10897) Ozone: SCM: Add NodeManager

[ https://issues.apache.org/jira/browse/HDFS-10897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530818#comment-15530818 ] Jing Zhao commented on HDFS-10897: -- Thanks for working on this, [~anu]. The patch looks good to me

[jira] [Updated] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10892: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-10797) Disk usage summary of snapshots causes renamed blocks to get counted twice

[ https://issues.apache.org/jira/browse/HDFS-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531199#comment-15531199 ] Sean Mackrory commented on HDFS-10797: -- Thanks for pointing that out [~jingzhao]. I added test cases

[jira] [Commented] (HDFS-9390) Block management for maintenance states

[ https://issues.apache.org/jira/browse/HDFS-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531219#comment-15531219 ] Lei (Eddy) Xu commented on HDFS-9390: - Hi, [~mingma] Thanks so much for posting this patch. It looks

[jira] [Commented] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531405#comment-15531405 ] Hadoop QA commented on HDFS-10918: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10913) Refactor BlockReceiver by introducing faults injector to enhance testability of detecting slow mirrors

[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530416#comment-15530416 ] Xiaoyu Yao commented on HDFS-10913: --- Thanks [~xiaobingo] for reporting the issue and posting the patch

[jira] [Commented] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531189#comment-15531189 ] Hudson commented on HDFS-10892: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10509 (See

[jira] [Commented] (HDFS-10914) Move remnants of oah.hdfs.client to hadoop-hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531186#comment-15531186 ] Hudson commented on HDFS-10914: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10509 (See

[jira] [Commented] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531394#comment-15531394 ] Andrew Wang commented on HDFS-10918: I think we still are missing handling relative paths and

[jira] [Commented] (HDFS-10850) getEZForPath should NOT throw FNF

[ https://issues.apache.org/jira/browse/HDFS-10850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531151#comment-15531151 ] Daryn Sharp commented on HDFS-10850: I'll try to dig out the stacktrace, but the code in question was

[jira] [Updated] (HDFS-10779) Rename does not need to re-solve destination

[ https://issues.apache.org/jira/browse/HDFS-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10779: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-10914) Move remnants of oah.hdfs.client to hadoop-hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10914: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.8.0 Release Note: The

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531228#comment-15531228 ] stack commented on HDFS-10690: -- Skimmed. Patch LGTM. Unfortunate we leave behind some perf but agree on

[jira] [Commented] (HDFS-10897) Ozone: SCM: Add NodeManager

[ https://issues.apache.org/jira/browse/HDFS-10897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531259#comment-15531259 ] Jing Zhao commented on HDFS-10897: -- Thanks for the reply, Anu. bq. The reason of breaking up these data

[jira] [Commented] (HDFS-10850) getEZForPath should NOT throw FNF

[ https://issues.apache.org/jira/browse/HDFS-10850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531377#comment-15531377 ] Andrew Wang commented on HDFS-10850: Agree about throwing a specific rename exception. I poked around

[jira] [Updated] (HDFS-10913) Refactor BlockReceiver by introducing faults injector to enhance testability of detecting slow mirrors

[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10913: - Attachment: HDFS-10913.002.patch > Refactor BlockReceiver by introducing faults injector to

[jira] [Commented] (HDFS-10913) Refactor BlockReceiver by introducing faults injector to enhance testability of detecting slow mirrors

[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531397#comment-15531397 ] Xiaobing Zhou commented on HDFS-10913: -- [~xyao] thank you for reviews. I posted patch v002 with some

[jira] [Commented] (HDFS-10797) Disk usage summary of snapshots causes renamed blocks to get counted twice

[ https://issues.apache.org/jira/browse/HDFS-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531432#comment-15531432 ] Jing Zhao commented on HDFS-10797: -- [~mackrorysd], I agree it will be great to have a consistent and

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531447#comment-15531447 ] Arpit Agarwal commented on HDFS-9668: - Hi [~jingcheng...@intel.com], You can probably split out the

[jira] [Commented] (HDFS-10922) Adding additional unit tests for Trash

[ https://issues.apache.org/jira/browse/HDFS-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531670#comment-15531670 ] Weiwei Yang commented on HDFS-10922: Hello [~xyao] I recently worked on some JIRAs about Trash, I can

[jira] [Commented] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531709#comment-15531709 ] Hadoop QA commented on HDFS-10918: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10629) Federation Router

[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531543#comment-15531543 ] Ming Ma commented on HDFS-10629: Sorry for [~elgoiri] and [~jakace] for the late reply. Yes let us take

[jira] [Commented] (HDFS-10913) Refactor BlockReceiver by introducing faults injector to enhance testability of detecting slow mirrors

[ https://issues.apache.org/jira/browse/HDFS-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531554#comment-15531554 ] Hadoop QA commented on HDFS-10913: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10923) Make InstrumentedLock require ReentrantLock

[ https://issues.apache.org/jira/browse/HDFS-10923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531580#comment-15531580 ] Hadoop QA commented on HDFS-10923: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10910) HDFS Erasure Coding doc should state its currently supported erasure coding policies

[ https://issues.apache.org/jira/browse/HDFS-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531781#comment-15531781 ] SammiChen commented on HDFS-10910: -- Thanks Yiqun for update the patch. The v2 patch seems good to me. >

[jira] [Updated] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10921: --- Attachment: HDFS-10921.002.patch Looked deeper into this and saw that {{cluster = new

[jira] [Updated] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10921: --- Status: Patch Available (was: Open) > TestDiskspaceQuotaUpdate doesn't wait for NN to get out of

[jira] [Commented] (HDFS-10804) Use separate lock for ReplicaMap

[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530010#comment-15530010 ] Hadoop QA commented on HDFS-10804: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530014#comment-15530014 ] Eric Badger commented on HDFS-10921: [~rushabh.shah], [~daryn], [~kihwal], do you think it's

[jira] [Updated] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingcheng Du updated HDFS-9668: --- Attachment: HDFS-9668-14.patch Refine the comments mentioned in HDFS-10828 by [~drankye] in a new

[jira] [Commented] (HDFS-10826) The result of fsck should be CRITICAL when there are unrecoverable ec block groups.

[ https://issues.apache.org/jira/browse/HDFS-10826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528613#comment-15528613 ] Takanobu Asanuma commented on HDFS-10826: - [~jingzhao] Thank you for your review and proposal! I

[jira] [Commented] (HDFS-10804) Use separate lock for ReplicaMap

[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528661#comment-15528661 ] Fenghua Hu commented on HDFS-10804: --- Thanks [~arpitagarwal] for updating the description to reflect the

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528584#comment-15528584 ] Fenghua Hu commented on HDFS-10690: --- This fix doesn't change any interface, and I have run the unit test

[jira] [Issue Comment Deleted] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingcheng Du updated HDFS-9668: --- Comment: was deleted (was: Hi [~arpitagarwal], I read the code in HDFS-10828. I think the callers of

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528629#comment-15528629 ] Mingliang Liu commented on HDFS-10810: -- Thanks for your confirmation, [~szetszwo]. I'll hold on

[jira] [Updated] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingcheng Du updated HDFS-9668: --- Attachment: HDFS-9668-13.patch Rebase the code after HDFS-10828, and upload a new patch V13. >

[jira] [Comment Edited] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528522#comment-15528522 ] Jingcheng Du edited comment on HDFS-9668 at 9/28/16 6:21 AM: - Hi

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528580#comment-15528580 ] Fenghua Hu commented on HDFS-9668: -- hi [~jingcheng...@intel.com], regarding ReplicaMap lock, I opened a

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528616#comment-15528616 ] Tsz Wo Nicholas Sze commented on HDFS-10810: Thanks for the explanation. It sounds good. >

[jira] [Updated] (HDFS-10804) Use separate lock for ReplicaMap

[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fenghua Hu updated HDFS-10804: -- Attachment: HDFS-10804-003.patch > Use separate lock for ReplicaMap >

[jira] [Updated] (HDFS-10826) The result of fsck should be CRITICAL when there are unrecoverable ec block groups.

[ https://issues.apache.org/jira/browse/HDFS-10826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-10826: Attachment: HDFS-10826.3.patch [~ajisakaa], [~jingzhao] I updated the patch based on your

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528701#comment-15528701 ] Jingcheng Du commented on HDFS-9668: Thanks [~fenghua_hu]. I reverted part of the code from HDFS-10828.

[jira] [Updated] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingcheng Du updated HDFS-9668: --- Attachment: HDFS-9668-14.patch Re-attach the patch V14 to trigger the Hadoop QA. > Optimize the

[jira] [Commented] (HDFS-10826) The result of fsck should be CRITICAL when there are unrecoverable ec block groups.

[ https://issues.apache.org/jira/browse/HDFS-10826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529238#comment-15529238 ] Hadoop QA commented on HDFS-10826: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529304#comment-15529304 ] Hadoop QA commented on HDFS-9668: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingcheng Du updated HDFS-9668: --- Attachment: HDFS-9668-15.patch Upload a new patch V15 to fix the newly added checkstyle warning. >

[jira] [Commented] (HDFS-10920) TestStorageMover#testNoSpaceDisk is failing intermittently

[ https://issues.apache.org/jira/browse/HDFS-10920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529427#comment-15529427 ] Hadoop QA commented on HDFS-10920: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingcheng Du updated HDFS-9668: --- Attachment: (was: HDFS-9668-14.patch) > Optimize the locking in FsDatasetImpl >

[jira] [Updated] (HDFS-9668) Optimize the locking in FsDatasetImpl

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingcheng Du updated HDFS-9668: --- Attachment: HDFS-9668-14.patch The failure of unit tests should not be related with this patch.

[jira] [Updated] (HDFS-10920) TestStorageMover#testNoSpaceDisk is failing intermittently

[ https://issues.apache.org/jira/browse/HDFS-10920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10920: Attachment: HDFS-10920-00.patch It looks like the test failed due to not waiting to see all its replicas

  1   2   >