[jira] [Updated] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-09-14 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingcheng Du updated HDFS-9668: --- Attachment: HDFS-9668-9.patch Upload a new patch V9 to fix the whitespace warning. > Optimize the

[jira] [Created] (HDFS-10863) hadoop superusergroup supergroup issue

2016-09-14 Thread www.jbigdata.fr (JIRA)
www.jbigdata.fr created HDFS-10863: -- Summary: hadoop superusergroup supergroup issue Key: HDFS-10863 URL: https://issues.apache.org/jira/browse/HDFS-10863 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15490287#comment-15490287 ] Hadoop QA commented on HDFS-9668: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

2016-09-14 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15490646#comment-15490646 ] Tsz Wo Nicholas Sze commented on HDFS-10810: Thanks for the explanation. However, the new

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15490754#comment-15490754 ] Xiaoyu Yao commented on HDFS-10690: --- Thanks [~fenghua_hu] for providing the new numbers. Considering the

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

2016-09-14 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15490765#comment-15490765 ] Brahma Reddy Battula commented on HDFS-10810: - Can you please look at v2 patch..v3 is uploaded

[jira] [Commented] (HDFS-10475) Adding metrics for long FSNamesystem read and write locks

2016-09-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15490522#comment-15490522 ] Kihwal Lee commented on HDFS-10475: --- While I think this is a very useful feature, I am afraid it might

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15490641#comment-15490641 ] Hadoop QA commented on HDFS-9668: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

2016-09-14 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15490974#comment-15490974 ] Tsz Wo Nicholas Sze commented on HDFS-10810: [~brahmareddy], I believe you have found a real

[jira] [Commented] (HDFS-10805) Reduce runtime for append test

2016-09-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15490923#comment-15490923 ] Hudson commented on HDFS-10805: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10442 (See

[jira] [Updated] (HDFS-10805) Reduce runtime for append test

2016-09-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10805: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

2016-09-14 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15490968#comment-15490968 ] Tsz Wo Nicholas Sze commented on HDFS-10810: The v2 and v3 patches are the same except for

[jira] [Updated] (HDFS-10797) Disk usage summary of snapshots causes renamed blocks to get counted twice

2016-09-14 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HDFS-10797: - Attachment: HDFS-10797.001.patch Attaching a patch that tries to identify files where the

[jira] [Updated] (HDFS-10805) Reduce runtime for append test

2016-09-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10805: - Assignee: Gergely Novák > Reduce runtime for append test > -- > >

[jira] [Commented] (HDFS-10805) Reduce runtime for append test

2016-09-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15490869#comment-15490869 ] Arpit Agarwal commented on HDFS-10805: -- +1 for the patch. The unit test failures are unrelated. >

[jira] [Updated] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

2016-09-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10810: - Attachment: (was: HDFS-10810-003.patch) > Setreplication removing block from

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

2016-09-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491119#comment-15491119 ] Mingliang Liu commented on HDFS-10810: -- {quote} Brahma Reddy Battula: we can remove v3 patch from

[jira] [Commented] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

2016-09-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491124#comment-15491124 ] Konstantin Shvachko commented on HDFS-10843: You are right, the control flow looks awkward

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-09-14 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491142#comment-15491142 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- [~arpiagariu] Storage reports are anyway

[jira] [Updated] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-09-14 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10637: -- Status: Patch Available (was: Open) > Modifications to remove the assumption that

[jira] [Updated] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-09-14 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10637: -- Attachment: HDFS-10637.007.patch Updated patch to work with the most recent patch of

[jira] [Commented] (HDFS-10475) Adding metrics for long FSNamesystem read and write locks

2016-09-14 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491251#comment-15491251 ] Erik Krogen commented on HDFS-10475: Thanks for the pointer to RpcDetailedActivity, [~andrew.wang].

[jira] [Commented] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491383#comment-15491383 ] Hadoop QA commented on HDFS-10637: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2016-09-14 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated HDFS-10763: --- Fix Version/s: 2.6.5 Cherry-picked it to 2.6.5 (trivial). > Open files can leak permanently due to

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-09-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491507#comment-15491507 ] Arpit Agarwal commented on HDFS-10301: -- I don't think it is safe to remove storages (and hence

[jira] [Updated] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10824: - Attachment: (was: HDFS-10824.002.patch) > MiniDFSCluster#storageCapacities has no effects on

[jira] [Updated] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-09-14 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10637: -- Status: Open (was: Patch Available) > Modifications to remove the assumption that

[jira] [Commented] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491523#comment-15491523 ] Xiaobing Zhou commented on HDFS-10824: -- Thanks for review [~anu]. v002 is posted. 1. The member is

[jira] [Commented] (HDFS-10475) Adding metrics for long FSNamesystem read and write locks

2016-09-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491551#comment-15491551 ] Zhe Zhang commented on HDFS-10475: -- Nice discussion guys. A quick note from looking at the code: {code}

[jira] [Updated] (HDFS-10745) Directly resolve paths into INodesInPath

2016-09-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10745: - Status: Patch Available (was: Reopened) > Directly resolve paths into INodesInPath >

[jira] [Commented] (HDFS-10475) Adding metrics for long FSNamesystem read and write locks

2016-09-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491427#comment-15491427 ] Andrew Wang commented on HDFS-10475: bq. how we would publish the histograms? We already have

[jira] [Updated] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10824: - Attachment: HDFS-10824.002.patch > MiniDFSCluster#storageCapacities has no effects on real

[jira] [Commented] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

2016-09-14 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491505#comment-15491505 ] Erik Krogen commented on HDFS-10843: What advantage is there to wrapping those two specific calls in a

[jira] [Comment Edited] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-09-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491507#comment-15491507 ] Arpit Agarwal edited comment on HDFS-10301 at 9/14/16 9:34 PM: --- I don't

[jira] [Commented] (HDFS-9333) Some tests using MiniDFSCluster errored complaining port in use

2016-09-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491495#comment-15491495 ] Andrew Wang commented on HDFS-9333: --- I think even if we leave it as {{restartDataNodes(true)}}, just

[jira] [Updated] (HDFS-10745) Directly resolve paths into INodesInPath

2016-09-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10745: - Attachment: HDFS-10745-branch-2.7.patch Backport to branch-2.7 was quite unclean. I'm taking another look

[jira] [Reopened] (HDFS-10745) Directly resolve paths into INodesInPath

2016-09-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reopened HDFS-10745: -- Sorry to reopen the JIRA, testing branch-2.7 patch. > Directly resolve paths into INodesInPath >

[jira] [Commented] (HDFS-10489) Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones

2016-09-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491851#comment-15491851 ] Andrew Wang commented on HDFS-10489: We can certainly deprecate 2.x and remove for 3.x if we wish, but

[jira] [Updated] (HDFS-10823) Implement HttpFSFileSystem#listStatusIterator

2016-09-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10823: --- Attachment: HDFS-10823.003.patch One more pass over precommit. > Implement

[jira] [Commented] (HDFS-10823) Implement HttpFSFileSystem#listStatusIterator

2016-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491863#comment-15491863 ] Hadoop QA commented on HDFS-10823: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10823) Implement HttpFSFileSystem#listStatusIterator

2016-09-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10823: --- Attachment: HDFS-10823.003.patch Woops, consolidated patch attached. > Implement

[jira] [Updated] (HDFS-10823) Implement HttpFSFileSystem#listStatusIterator

2016-09-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10823: --- Attachment: (was: HDFS-10823.003.patch) > Implement HttpFSFileSystem#listStatusIterator >

[jira] [Updated] (HDFS-10489) Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones

2016-09-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10489: - Attachment: HDFS-10489.02.patch > Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones >

[jira] [Commented] (HDFS-10489) Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones

2016-09-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491923#comment-15491923 ] Xiao Chen commented on HDFS-10489: -- Thanks for the input, Andrew! It totally makes sense to me, attached

[jira] [Updated] (HDFS-10489) Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones

2016-09-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10489: - Status: Patch Available (was: Open) > Deprecate dfs.encryption.key.provider.uri for HDFS encryption

[jira] [Commented] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491925#comment-15491925 ] Hadoop QA commented on HDFS-10637: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-09-14 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10637: -- Attachment: HDFS-10637.008.patch > Modifications to remove the assumption that

[jira] [Updated] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-09-14 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10637: -- Status: Patch Available (was: Open) > Modifications to remove the assumption that

[jira] [Commented] (HDFS-10745) Directly resolve paths into INodesInPath

2016-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491729#comment-15491729 ] Hadoop QA commented on HDFS-10745: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10489) Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones

2016-09-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491727#comment-15491727 ] Andrew Wang commented on HDFS-10489: Deprecation typically means adding a DeprecationDelta so that it

[jira] [Commented] (HDFS-10745) Directly resolve paths into INodesInPath

2016-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491737#comment-15491737 ] Hadoop QA commented on HDFS-10745: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491738#comment-15491738 ] Hadoop QA commented on HDFS-10824: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10823) Implement HttpFSFileSystem#listStatusIterator

2016-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491771#comment-15491771 ] Hadoop QA commented on HDFS-10823: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9895) Remove unnecessary conf cache in DataNode

2016-09-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9895: Summary: Remove unnecessary conf cache in DataNode (was: Push up DataNode#conf to base class) >

[jira] [Updated] (HDFS-9895) Remove unnecessary conf cache from DataNode

2016-09-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9895: Attachment: (was: HDFS-9895.002.patch) > Remove unnecessary conf cache from DataNode >

[jira] [Commented] (HDFS-10489) Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones

2016-09-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491803#comment-15491803 ] Xiao Chen commented on HDFS-10489: -- Thanks for the explanation, so this jira will deprecate in 3.x, and

[jira] [Updated] (HDFS-9895) Remove unnecessary conf cache from DataNode

2016-09-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9895: Summary: Remove unnecessary conf cache from DataNode (was: Remove unnecessary conf cache in

[jira] [Updated] (HDFS-9895) Remove unnecessary conf cache from DataNode

2016-09-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9895: Attachment: HDFS-9895.002.patch > Remove unnecessary conf cache from DataNode >

[jira] [Updated] (HDFS-9895) Remove unnecessary conf cache from DataNode

2016-09-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9895: Attachment: HDFS-9895-HDFS-9000.002.patch > Remove unnecessary conf cache from DataNode >

[jira] [Commented] (HDFS-9895) Remove unnecessary conf cache from DataNode

2016-09-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491812#comment-15491812 ] Xiaobing Zhou commented on HDFS-9895: - Thank you [~arpiagariu] for review. v002 is posted. It changed

[jira] [Updated] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10824: - Attachment: HDFS-10824.002.patch > MiniDFSCluster#storageCapacities has no effects on real

[jira] [Updated] (HDFS-10862) Typos in 7 log messages

2016-09-14 Thread Mehran Hassani (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mehran Hassani updated HDFS-10862: -- Description: I am conducting research on log related bugs. I tried to make a tool to fix

[jira] [Updated] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-09-14 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingcheng Du updated HDFS-9668: --- Attachment: HDFS-9668-8.patch Rebase the code for the updates in HDFS-10636 and upload a new patch V8,

[jira] [Commented] (HDFS-10777) DataNode should report volume failures if DU cannot access files

2016-09-14 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15490027#comment-15490027 ] Akira Ajisaka commented on HDFS-10777: -- bq. Disks can come back. That's especially if the disk

[jira] [Commented] (HDFS-10777) DataNode should report volume failures if DU cannot access files

2016-09-14 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15490031#comment-15490031 ] Akira Ajisaka commented on HDFS-10777: -- Therefore just logging or increment a metric is fine. >

[jira] [Updated] (HDFS-10861) Refactor StatefulStripeReader and PositionStripeReader, use ECChunk version decode API

2016-09-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10861: - Attachment: HDFS-10861-v2.patch Fixed 3 checkstyle issues. Other 2 checkstyle issues are not necessary.

[jira] [Commented] (HDFS-10861) Refactor StatefulStripeReader and PositionStripeReader, use ECChunk version decode API

2016-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489819#comment-15489819 ] Hadoop QA commented on HDFS-10861: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8858) DU should be re-executed if the target directory exists

2016-09-14 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489879#comment-15489879 ] Akira Ajisaka commented on HDFS-8858: - Unintentionally fixed by HADOOP-12973, but if HDFS-10777 is

[jira] [Commented] (HDFS-9895) Remove unnecessary conf cache from DataNode

2016-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15492022#comment-15492022 ] Hadoop QA commented on HDFS-9895: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10823) Implement HttpFSFileSystem#listStatusIterator

2016-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15492030#comment-15492030 ] Hadoop QA commented on HDFS-10823: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

2016-09-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491607#comment-15491607 ] Konstantin Shvachko commented on HDFS-10843: I am just trying to make the coupling of

[jira] [Comment Edited] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

2016-09-14 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491505#comment-15491505 ] Erik Krogen edited comment on HDFS-10843 at 9/14/16 10:26 PM: -- What advantage

[jira] [Updated] (HDFS-10823) Implement HttpFSFileSystem#listStatusIterator

2016-09-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10823: --- Attachment: HDFS-10823.002.patch New patch attached. Fixed up the precommit checks. Also downgraded

[jira] [Commented] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

2016-09-14 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491623#comment-15491623 ] Erik Krogen commented on HDFS-10843: But you shouldn't be calling {{BlockInfo.convertToCompleteBlock}}

[jira] [Commented] (HDFS-10823) Implement HttpFSFileSystem#listStatusIterator

2016-09-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15492463#comment-15492463 ] Xiao Chen commented on HDFS-10823: -- Thanks for the patch Andrew! I didn't find a better alternative, and

[jira] [Commented] (HDFS-10862) Typos in 7 log messages

2016-09-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15492098#comment-15492098 ] Yiqun Lin commented on HDFS-10862: -- Hi, [~MehranHassani], thanks for finding so many typos. Are you ready

[jira] [Commented] (HDFS-10489) Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones

2016-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15492134#comment-15492134 ] Hadoop QA commented on HDFS-10489: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||