[jira] [Updated] (HDFS-10861) Refactor StripeReaders and use ECChunk version decode API

2016-09-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10861: - Attachment: HDFS-10861-v6.patch The broken link in {{StripedBlockUtil}} is also fixed. > Refactor

[jira] [Commented] (HDFS-10828) Fix usage of FsDatasetImpl object lock in ReplicaMap

2016-09-19 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505692#comment-15505692 ] Kai Zheng commented on HDFS-10828: -- Hi [~arpitagarwal], thanks for working on this. Having read the

[jira] [Commented] (HDFS-10875) Optimize du -x to cache intermediate result

2016-09-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505678#comment-15505678 ] Hudson commented on HDFS-10875: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10463 (See

[jira] [Updated] (HDFS-10861) Refactor StripeReaders and use ECChunk version decode API

2016-09-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10861: - Attachment: (was: HDFS-10861-v6.patch) > Refactor StripeReaders and use ECChunk version decode API >

[jira] [Updated] (HDFS-10861) Refactor StripeReaders and use ECChunk version decode API

2016-09-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10861: - Attachment: HDFS-10861-v6.patch Fix 2 failed test cases > Refactor StripeReaders and use ECChunk version

[jira] [Updated] (HDFS-10745) Directly resolve paths into INodesInPath

2016-09-19 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10745: - Attachment: HDFS-10745-branch-2.7.02.patch The {{FSDirWriteFileOp}} refactor made the cherry-pick really

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505643#comment-15505643 ] Hadoop QA commented on HDFS-9668: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10875) Optimize du -x to cache intermediate result

2016-09-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10875: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 2.8.0

[jira] [Updated] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-09-19 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingcheng Du updated HDFS-9668: --- Attachment: HDFS-9668-11.patch Re-attach the patch V11 with the correct name. > Optimize the locking

[jira] [Updated] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-09-19 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingcheng Du updated HDFS-9668: --- Attachment: hdfs-9668-11.patch Upload a new patch V11 to fix most of the new checkstyle issues . Part

[jira] [Updated] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-09-19 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingcheng Du updated HDFS-9668: --- Attachment: (was: hdfs-9668-11.patch) > Optimize the locking in FsDatasetImpl >

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-09-19 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505329#comment-15505329 ] Jingcheng Du commented on HDFS-9668: My mistake, I used 100 characters in a line that I used for HBase.

[jira] [Commented] (HDFS-10875) Optimize du -x to cache intermediate result

2016-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505323#comment-15505323 ] Hadoop QA commented on HDFS-10875: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505320#comment-15505320 ] Hadoop QA commented on HDFS-10713: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10871) DiskBalancerWorkItem should not import jackson relocated by htrace

2016-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505251#comment-15505251 ] Hadoop QA commented on HDFS-10871: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10875) Optimize du -x to cache intermediate result

2016-09-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505216#comment-15505216 ] Jing Zhao commented on HDFS-10875: -- +1 pending Jenkins. > Optimize du -x to cache intermediate result >

[jira] [Commented] (HDFS-10874) libhdfs++: Public API headers should not depend on internal implementation

2016-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505200#comment-15505200 ] Hadoop QA commented on HDFS-10874: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-09-19 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505167#comment-15505167 ] Kai Zheng commented on HDFS-9668: - Hi [~jingcheng...@intel.com], looks like the many check styles also need

[jira] [Commented] (HDFS-10861) Refactor StripeReaders and use ECChunk version decode API

2016-09-19 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505155#comment-15505155 ] Kai Zheng commented on HDFS-10861: -- Note two links broken in StripedBlockUtil. > Refactor StripeReaders

[jira] [Commented] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-09-19 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505094#comment-15505094 ] Virajith Jalaparti commented on HDFS-10637: --- Hi [~eddyxu], A couple of questions: bq. In

[jira] [Comment Edited] (HDFS-10314) A new tool to sync current HDFS view to specified snapshot

2016-09-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505086#comment-15505086 ] Yongjun Zhang edited comment on HDFS-10314 at 9/20/16 12:02 AM: BTW

[jira] [Commented] (HDFS-10314) A new tool to sync current HDFS view to specified snapshot

2016-09-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505086#comment-15505086 ] Yongjun Zhang commented on HDFS-10314: -- BTW [~jingzhao], The usage of the solution is: 1. distsync

[jira] [Commented] (HDFS-8986) Add option to -du to calculate directory space usage excluding snapshots

2016-09-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505079#comment-15505079 ] Xiao Chen commented on HDFS-8986: - Thanks [~jingzhao] for the great comment! I created HDFS-10875 and

[jira] [Updated] (HDFS-10875) Optimize du -x to cache intermediate result

2016-09-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10875: - Status: Patch Available (was: Open) > Optimize du -x to cache intermediate result >

[jira] [Updated] (HDFS-10875) Optimize du -x to cache intermediate result

2016-09-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10875: - Attachment: HDFS-10875.01.patch > Optimize du -x to cache intermediate result >

[jira] [Created] (HDFS-10875) Optimize du -x to cache intermediate result

2016-09-19 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-10875: Summary: Optimize du -x to cache intermediate result Key: HDFS-10875 URL: https://issues.apache.org/jira/browse/HDFS-10875 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-19 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-10713: -- Attachment: HDFS-10713.012.patch Thanks [~chris.douglas] for reviewing the patch. - I have

[jira] [Commented] (HDFS-10832) Propagate ACL bit and isEncrypted bit in HttpFS FileStatus permissions

2016-09-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505048#comment-15505048 ] Xiao Chen commented on HDFS-10832: -- oops, thanks for correcting the fix versions for me Andrew! >

[jira] [Updated] (HDFS-10832) Propagate ACL bit and isEncrypted bit in HttpFS FileStatus permissions

2016-09-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10832: --- Fix Version/s: (was: 2.9.0) > Propagate ACL bit and isEncrypted bit in HttpFS FileStatus

[jira] [Updated] (HDFS-10489) Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones

2016-09-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10489: --- Fix Version/s: (was: 2.9.0) > Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones

[jira] [Comment Edited] (HDFS-10489) Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones

2016-09-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505041#comment-15505041 ] Xiao Chen edited comment on HDFS-10489 at 9/19/16 11:40 PM: Committed this to

[jira] [Updated] (HDFS-10489) Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones

2016-09-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10489: - Fix Version/s: 2.9.0 2.8.0 > Deprecate dfs.encryption.key.provider.uri for HDFS

[jira] [Commented] (HDFS-10489) Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones

2016-09-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505041#comment-15505041 ] Xiao Chen commented on HDFS-10489: -- Committed this to branch-2 and branch-2.8. > Deprecate

[jira] [Commented] (HDFS-10832) Propagate ACL bit and isEncrypted bit in HttpFS FileStatus permissions

2016-09-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505039#comment-15505039 ] Xiao Chen commented on HDFS-10832: -- FYI - I have backported this to branch-2.8 for cleaner backport of

[jira] [Updated] (HDFS-10832) Propagate ACL bit and isEncrypted bit in HttpFS FileStatus permissions

2016-09-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10832: - Fix Version/s: 2.8.0 > Propagate ACL bit and isEncrypted bit in HttpFS FileStatus permissions >

[jira] [Updated] (HDFS-10489) Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones

2016-09-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10489: - Hadoop Flags: Reviewed (was: Incompatible change,Reviewed) > Deprecate dfs.encryption.key.provider.uri

[jira] [Commented] (HDFS-10871) DiskBalancerWorkItem should not import jackson relocated by htrace

2016-09-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505000#comment-15505000 ] Anu Engineer commented on HDFS-10871: - [~manojg] Thanks for fixing this so quickly. +1, pending

[jira] [Updated] (HDFS-10871) DiskBalancerWorkItem should not import jackson relocated by htrace

2016-09-19 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10871: -- Status: Patch Available (was: Open) > DiskBalancerWorkItem should not import jackson

[jira] [Updated] (HDFS-10871) DiskBalancerWorkItem should not import jackson relocated by htrace

2016-09-19 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10871: -- Target Version/s: 3.0.0-alpha2 > DiskBalancerWorkItem should not import jackson

[jira] [Updated] (HDFS-10871) DiskBalancerWorkItem should not import jackson relocated by htrace

2016-09-19 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10871: -- Attachment: HDFS-10871.001.patch Attcached v01 patch. * Added

[jira] [Commented] (HDFS-10857) Rolling upgrade can make data unavailable when the cluster has many failed volumes

2016-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504990#comment-15504990 ] Hadoop QA commented on HDFS-10857: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10489) Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones

2016-09-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504980#comment-15504980 ] Xiao Chen commented on HDFS-10489: -- Thanks [~andrew.wang] for the suggestion. I removed the 'Incompatible

[jira] [Updated] (HDFS-10874) libhdfs++: Public API headers should not depend on internal implementation

2016-09-19 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10874: --- Status: Patch Available (was: Open) > libhdfs++: Public API headers should not depend on

[jira] [Updated] (HDFS-10874) libhdfs++: Public API headers should not depend on internal implementation

2016-09-19 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10874: --- Attachment: HDFS-10874.HDFS-8707.000.patch It looks like URI was the only thing causing

[jira] [Assigned] (HDFS-10874) libhdfs++: Public API headers should not depend on internal implementation

2016-09-19 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer reassigned HDFS-10874: -- Assignee: James Clampffer > libhdfs++: Public API headers should not depend on

[jira] [Commented] (HDFS-10871) DiskBalancerWorkItem should not import jackson relocated by htrace

2016-09-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504814#comment-15504814 ] Anu Engineer commented on HDFS-10871: - Thanks for taking care of this issue. I like proposal 1. Since

[jira] [Created] (HDFS-10874) libhdfs++: Public API headers should not depend on internal implementation

2016-09-19 Thread James Clampffer (JIRA)
James Clampffer created HDFS-10874: -- Summary: libhdfs++: Public API headers should not depend on internal implementation Key: HDFS-10874 URL: https://issues.apache.org/jira/browse/HDFS-10874

[jira] [Commented] (HDFS-10489) Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones

2016-09-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504799#comment-15504799 ] Andrew Wang commented on HDFS-10489: Hey Xiao, do you want to commit this to branch-2 and branch-2.8

[jira] [Commented] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

2016-09-19 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504800#comment-15504800 ] Erik Krogen commented on HDFS-10843: Test failure does not appear to be related and runs successfully

[jira] [Commented] (HDFS-10871) DiskBalancerWorkItem should not import jackson relocated by htrace

2016-09-19 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504793#comment-15504793 ] Manoj Govindassamy commented on HDFS-10871: --- I am able to recreate the problem with htrace

[jira] [Commented] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

2016-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504783#comment-15504783 ] Hadoop QA commented on HDFS-10843: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10857) Rolling upgrade can make data unavailable when the cluster has many failed volumes

2016-09-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504768#comment-15504768 ] Kihwal Lee commented on HDFS-10857: --- The patch partially brings in changes available in branch-2.7 to

[jira] [Updated] (HDFS-10857) Rolling upgrade can make data unavailable when the cluster has many failed volumes

2016-09-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10857: -- Status: Patch Available (was: Open) > Rolling upgrade can make data unavailable when the cluster has

[jira] [Updated] (HDFS-10857) Rolling upgrade can make data unavailable when the cluster has many failed volumes

2016-09-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10857: -- Attachment: HDFS-10857.branch-2.6.patch > Rolling upgrade can make data unavailable when the cluster

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-19 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504738#comment-15504738 ] Chris Douglas commented on HDFS-10713: -- +0 on v11. Since HDFS-10817 and related JIRAs are adding some

[jira] [Updated] (HDFS-10475) Adding metrics for long FSNamesystem read and write locks

2016-09-19 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10475: - Target Version/s: 2.7.4 > Adding metrics for long FSNamesystem read and write locks >

[jira] [Updated] (HDFS-10475) Adding metrics for long FSNamesystem read and write locks

2016-09-19 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10475: - Labels: metrics (was: ) > Adding metrics for long FSNamesystem read and write locks >

[jira] [Updated] (HDFS-10475) Adding metrics for long FSNamesystem read and write locks

2016-09-19 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10475: - Issue Type: New Feature (was: Improvement) > Adding metrics for long FSNamesystem read and write locks >

[jira] [Updated] (HDFS-10866) Fix Eclipse Java 8 compile errors related to generic parameters.

2016-09-19 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10866: - Attachment: Screen Shot 2016-09-19 at 1.50.22 PM.png Thanks Konstantin. v2 patch works for my IntelliJ

[jira] [Created] (HDFS-10873) Add histograms for FSNamesystemLock Metrics

2016-09-19 Thread Erik Krogen (JIRA)
Erik Krogen created HDFS-10873: -- Summary: Add histograms for FSNamesystemLock Metrics Key: HDFS-10873 URL: https://issues.apache.org/jira/browse/HDFS-10873 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-09-19 Thread Erik Krogen (JIRA)
Erik Krogen created HDFS-10872: -- Summary: Add MutableRate metrics for FSNamesystemLock operations Key: HDFS-10872 URL: https://issues.apache.org/jira/browse/HDFS-10872 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10475) Adding metrics for long FSNamesystem read and write locks

2016-09-19 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504617#comment-15504617 ] Erik Krogen commented on HDFS-10475: After offline discussion with Zhe we have decided it would be

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-09-19 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504561#comment-15504561 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- [~arpiagariu] I understand that we may

[jira] [Commented] (HDFS-10776) Revisit Hdfs Audit Logging

2016-09-19 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504551#comment-15504551 ] Allen Wittenauer commented on HDFS-10776: - Sorry, I've been distracted by security holes and life

[jira] [Commented] (HDFS-10776) Revisit Hdfs Audit Logging

2016-09-19 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504549#comment-15504549 ] Kuhu Shukla commented on HDFS-10776: [~aw], Thank you! Could you point me to the blog post or share

[jira] [Updated] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

2016-09-19 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10843: --- Attachment: HDFS-10843.005.patch After offline discussion with Konstantin, attaching v005 patch with

[jira] [Updated] (HDFS-8865) Improve quota initialization performance

2016-09-19 Thread Nicolas Fraison (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Fraison updated HDFS-8865: -- Attachment: HDFS-8865_branch-2.6.patch Thanks [~kihwal] Patch for 2.6 branch added > Improve

[jira] [Commented] (HDFS-8865) Improve quota initialization performance

2016-09-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504488#comment-15504488 ] Kihwal Lee commented on HDFS-8865: -- Just added you as a HDFS contributor. > Improve quota initialization

[jira] [Commented] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2016-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504474#comment-15504474 ] Hadoop QA commented on HDFS-6984: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2016-09-19 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504330#comment-15504330 ] Chris Douglas commented on HDFS-6984: - bq. I actually planned on replacing DistCp's usage of FileStatus

[jira] [Commented] (HDFS-10868) Remove stray references to DFS_HDFS_BLOCKS_METADATA_ENABLED

2016-09-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504304#comment-15504304 ] Hudson commented on HDFS-10868: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10460 (See

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2016-09-19 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504298#comment-15504298 ] Chris Douglas commented on HDFS-7878: - bq. How about using name service id ("dfs.nameservice.id") here?

[jira] [Commented] (HDFS-8986) Add option to -du to calculate directory space usage excluding snapshots

2016-09-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504296#comment-15504296 ] Jing Zhao commented on HDFS-8986: - Thanks for the work, [~xiaochen]. For the following code, doing the

[jira] [Updated] (HDFS-10870) Wrong dfs.namenode.acls.enabled default in HdfsPermissionsGuide.apt.vm

2016-09-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-10870: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to branch-2.6 and

[jira] [Commented] (HDFS-10870) Wrong dfs.namenode.acls.enabled default in HdfsPermissionsGuide.apt.vm

2016-09-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504280#comment-15504280 ] Lei (Eddy) Xu commented on HDFS-10870: -- +1. LGTM. The warnings are not relevant. > Wrong

[jira] [Commented] (HDFS-10870) Wrong dfs.namenode.acls.enabled default in HdfsPermissionsGuide.apt.vm

2016-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504274#comment-15504274 ] Hadoop QA commented on HDFS-10870: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10868) Remove stray references to DFS_HDFS_BLOCKS_METADATA_ENABLED

2016-09-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10868: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-10870) Wrong dfs.namenode.acls.enabled default in HdfsPermissionsGuide.apt.vm

2016-09-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504196#comment-15504196 ] John Zhuge commented on HDFS-10870: --- The whitespace and asflicense warnings are unrelated. Probably

[jira] [Updated] (HDFS-10871) DiskBalancerWorkItem should not import jackson relocated by htrace

2016-09-19 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10871: -- Assignee: Manoj Govindassamy (was: Anu Engineer) Taking up this issue after discussing

[jira] [Commented] (HDFS-10608) Include event for AddBlock in Inotify Event Stream

2016-09-19 Thread churro morales (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504011#comment-15504011 ] churro morales commented on HDFS-10608: --- [~cmccabe] are you good with the patch in its current form?

[jira] [Updated] (HDFS-10871) DiskBalancerWorkItem should not import jackson relocated by htrace

2016-09-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10871: Issue Type: Sub-task (was: Bug) Parent: HDFS-10576 > DiskBalancerWorkItem should not

[jira] [Assigned] (HDFS-10871) DiskBalancerWorkItem should not import jackson relocated by htrace

2016-09-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-10871: --- Assignee: Anu Engineer > DiskBalancerWorkItem should not import jackson relocated by htrace

[jira] [Commented] (HDFS-8865) Improve quota initialization performance

2016-09-19 Thread Nicolas Fraison (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15503952#comment-15503952 ] Nicolas Fraison commented on HDFS-8865: --- [~kihwal] I would appreciate to be added as a contributor.

[jira] [Commented] (HDFS-10871) DiskBalancerWorkItem should not import jackson relocated by htrace

2016-09-19 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15503945#comment-15503945 ] Masatake Iwasaki commented on HDFS-10871: - {noformat} [ERROR] Failed to execute goal

[jira] [Created] (HDFS-10871) DiskBalancerWorkItem should not import jackson relocated by htrace

2016-09-19 Thread Masatake Iwasaki (JIRA)
Masatake Iwasaki created HDFS-10871: --- Summary: DiskBalancerWorkItem should not import jackson relocated by htrace Key: HDFS-10871 URL: https://issues.apache.org/jira/browse/HDFS-10871 Project:

[jira] [Commented] (HDFS-10870) Wrong dfs.namenode.acls.enabled default in HdfsPermissionsGuide.apt.vm

2016-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15503916#comment-15503916 ] Hadoop QA commented on HDFS-10870: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8865) Improve quota initialization performance

2016-09-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15503897#comment-15503897 ] Kihwal Lee commented on HDFS-8865: -- [~nfraison.criteo], if you plan to contribute code to the HDFS project

[jira] [Updated] (HDFS-10870) Wrong dfs.namenode.acls.enabled default in HdfsPermissionsGuide.apt.vm

2016-09-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10870: -- Fix Version/s: 2.6.5 Status: Patch Available (was: Open) > Wrong dfs.namenode.acls.enabled

[jira] [Updated] (HDFS-10870) Wrong dfs.namenode.acls.enabled default in HdfsPermissionsGuide.apt.vm

2016-09-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10870: -- Attachment: HDFS-10870-branch-2.6.001.patch Patch 001: * Change default from true to false for

[jira] [Created] (HDFS-10870) Wrong dfs.namenode.acls.enabled default in HdfsPermissionsGuide.apt.vm

2016-09-19 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10870: - Summary: Wrong dfs.namenode.acls.enabled default in HdfsPermissionsGuide.apt.vm Key: HDFS-10870 URL: https://issues.apache.org/jira/browse/HDFS-10870 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8865) Improve quota initialization performance

2016-09-19 Thread Nicolas Fraison (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15503755#comment-15503755 ] Nicolas Fraison commented on HDFS-8865: --- We have backported this patch to our 2.6 builds. Could you

[jira] [Commented] (HDFS-10426) TestPendingInvalidateBlock failed in trunk

2016-09-19 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15503750#comment-15503750 ] Masatake Iwasaki commented on HDFS-10426: - Thanks for the update again, [~linyiqun]. The patch

[jira] [Commented] (HDFS-10869) Unused method checkId() in InodeId.java file

2016-09-19 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15503673#comment-15503673 ] Brahma Reddy Battula commented on HDFS-10869: - Assigned to you.. > Unused method checkId() in

[jira] [Updated] (HDFS-10869) Unused method checkId() in InodeId.java file

2016-09-19 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-10869: Assignee: Jagadesh Kiran N > Unused method checkId() in InodeId.java file >

[jira] [Commented] (HDFS-10869) Unused method checkId() in InodeId.java file

2016-09-19 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15503607#comment-15503607 ] Jagadesh Kiran N commented on HDFS-10869: - Pls assign to me > Unused method checkId() in

[jira] [Created] (HDFS-10869) Unused method checkId() in InodeId.java file

2016-09-19 Thread Jagadesh Kiran N (JIRA)
Jagadesh Kiran N created HDFS-10869: --- Summary: Unused method checkId() in InodeId.java file Key: HDFS-10869 URL: https://issues.apache.org/jira/browse/HDFS-10869 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10861) Refactor StripeReaders and use ECChunk version decode API

2016-09-19 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15503482#comment-15503482 ] Kai Zheng commented on HDFS-10861: -- Looks like the two failures are relevant. > Refactor StripeReaders

[jira] [Commented] (HDFS-9333) Some tests using MiniDFSCluster errored complaining port in use

2016-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15503292#comment-15503292 ] Hadoop QA commented on HDFS-9333: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10861) Refactor StripeReaders and use ECChunk version decode API

2016-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15503252#comment-15503252 ] Hadoop QA commented on HDFS-10861: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9333) Some tests using MiniDFSCluster errored complaining port in use

2016-09-19 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9333: --- Attachment: HDFS-9333.003.patch attaching updated patch. I fixed tests using

  1   2   >