[jira] [Commented] (HDFS-12317) HDFS metrics render error in the page of git respository

2017-08-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148704#comment-16148704 ] Yiqun Lin commented on HDFS-12317: -- Thanks for the review, [~ajisakaa]. Will commit this shortly. > HDFS

[jira] [Updated] (HDFS-12317) HDFS metrics render error in the page of Github

2017-08-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12317: - Summary: HDFS metrics render error in the page of Github (was: HDFS metrics render error in the page of

[jira] [Updated] (HDFS-12100) Ozone: KSM: Allocate key should honour volume quota if quota is set on the volume

2017-08-31 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-12100: --- Attachment: HDFS-12100-HDFS-7240.002.patch Fixed checkstyle issues and added a test for multiple key

[jira] [Commented] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148831#comment-16148831 ] Hadoop QA commented on HDFS-12235: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-08-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12235: --- Attachment: HDFS-12235-HDFS-7240.004.patch > Ozone: DeleteKey-3: KSM SCM block deletion message and

[jira] [Updated] (HDFS-12317) HDFS metrics render error in the page of Github

2017-08-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12317: - Fix Version/s: 3.0.0-beta1 > HDFS metrics render error in the page of Github >

[jira] [Commented] (HDFS-12380) Simplify dataQueue.wait condition logical operation

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148635#comment-16148635 ] Hadoop QA commented on HDFS-12380: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12317) HDFS metrics render error in the page of git respository

2017-08-31 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148688#comment-16148688 ] Akira Ajisaka commented on HDFS-12317: -- +1, thanks Yiqun and Erik. > HDFS metrics render error in

[jira] [Updated] (HDFS-12317) HDFS metrics render error in the page of Github

2017-08-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12317: - Attachment: HDFS-12317-branch-2.001.patch Attach the patch for branch-2. > HDFS metrics render error in

[jira] [Commented] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-08-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148683#comment-16148683 ] Weiwei Yang commented on HDFS-12235: Uploaded a new patch based on [~yuanbo]'s v3 patch, added

[jira] [Commented] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-08-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148709#comment-16148709 ] Weiwei Yang commented on HDFS-12370: Hi [~linyiqun] Thanks for uploading the patch, it looks good to

[jira] [Commented] (HDFS-12317) HDFS metrics render error in the page of Github

2017-08-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148742#comment-16148742 ] Hudson commented on HDFS-12317: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12283 (See

[jira] [Commented] (HDFS-12317) HDFS metrics render error in the page of Github

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148809#comment-16148809 ] Hadoop QA commented on HDFS-12317: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-12100) Ozone: KSM: Allocate key should honour volume quota if quota is set on the volume

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148869#comment-16148869 ] Hadoop QA commented on HDFS-12100: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11799) Introduce a config to allow setting up write pipeline with fewer nodes than replication factor

2017-08-31 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11799: Attachment: HDFS-11799-006.patch Uploaded the patch to address checkstyle and

[jira] [Commented] (HDFS-11078) Fix NPE in LazyPersistFileScrubber

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149709#comment-16149709 ] Junping Du commented on HDFS-11078: --- I don't find this fix landed in branch-2.8 or branch-2.8.2.

[jira] [Commented] (HDFS-12182) BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149736#comment-16149736 ] Andrew Wang commented on HDFS-12182: Can the backport be committed? Else I'd like to resolve for the

[jira] [Updated] (HDFS-1068) Reduce NameNode GC by reusing HdfsFileStatus objects in RPC handlers

2017-08-31 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-1068: Attachment: Screen Shot 2017-08-31 at 3.58.15 PM.png > Reduce NameNode GC by reusing HdfsFileStatus objects

[jira] [Updated] (HDFS-12356) Unit test for JournalNode sync during Rolling Upgrade

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12356: --- Fix Version/s: 3.0.0-beta1 > Unit test for JournalNode sync during Rolling Upgrade >

[jira] [Updated] (HDFS-12356) Unit test for JournalNode sync during Rolling Upgrade

2017-08-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12356: - Fix Version/s: (was: 2.9.0) > Unit test for JournalNode sync during Rolling Upgrade >

[jira] [Updated] (HDFS-12138) Remove redundant 'public' modifiers from BlockCollection

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12138: --- Fix Version/s: (was: 3.0.0-alpha4) 3.0.0-beta1 > Remove redundant 'public'

[jira] [Commented] (HDFS-12043) Add counters for block re-replication

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149759#comment-16149759 ] Andrew Wang commented on HDFS-12043: Bit of unfortunate history on this JIRA, looks like alpha4 was

[jira] [Updated] (HDFS-12043) Add counters for block re-replication

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12043: --- Fix Version/s: (was: 3.0.0-alpha4) 3.0.0-beta1 > Add counters for block

[jira] [Commented] (HDFS-12335) Federation Metrics

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149780#comment-16149780 ] Hadoop QA commented on HDFS-12335: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12300) Audit-log delegation token related operations

2017-08-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149787#comment-16149787 ] Xiao Chen commented on HDFS-12300: -- Hey Ravi, Thanks a lot for reviewing! I was only deducting about

[jira] [Updated] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-10763: -- Fix Version/s: 2.8.0 2.9.0 > Open files can leak permanently due to inconsistent

[jira] [Commented] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149856#comment-16149856 ] Junping Du commented on HDFS-10763: --- Add 2.8.0, 2.9.0 in fix version given patch get landed there. >

[jira] [Commented] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-08-31 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149869#comment-16149869 ] Kai Zheng commented on HDFS-11882: -- Thanks [~andrew.wang] for adding so many comments in the codes which

[jira] [Commented] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149868#comment-16149868 ] Andrew Wang commented on HDFS-12384: [~busbey] yea, that sounded wrong to me, thus asking the expert

[jira] [Commented] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-08-31 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149912#comment-16149912 ] Yongjun Zhang commented on HDFS-12357: -- Hi [~atm], [~daryn] [~manojg], any comments/thoughts on my

[jira] [Commented] (HDFS-12381) [Documentation] Adding configuration keys for the Router

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149933#comment-16149933 ] Hadoop QA commented on HDFS-12381: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12383) Re-encryption updater should handle canceled tasks better

2017-08-31 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149790#comment-16149790 ] Wei-Chiu Chuang commented on HDFS-12383: ReencryptionUpdater does not capture

[jira] [Commented] (HDFS-12222) Add EC information to BlockLocation

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149832#comment-16149832 ] Andrew Wang commented on HDFS-1: Hi Huafeng, thanks for the rev, looks good. Please proceed with a

[jira] [Updated] (HDFS-9382) Track the acks for the packets which are sent from ErasureCodingWorker as part of reconstruction work

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9382: -- Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-8031) > Track the acks for the

[jira] [Resolved] (HDFS-9386) Erasure coding: updateBlockForPipeline sometimes returns non-striped block for striped file

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-9386. --- Resolution: Cannot Reproduce Target Version/s: (was: ) Haven't seen this recently and bug

[jira] [Commented] (HDFS-9696) Garbage snapshot records lingering forever

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149858#comment-16149858 ] Junping Du commented on HDFS-9696: -- Add 2.8.0 and 2.9.0 in fix version given patch get landed there. >

[jira] [Updated] (HDFS-9696) Garbage snapshot records lingering forever

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9696: - Fix Version/s: 2.8.0 2.9.0 > Garbage snapshot records lingering forever >

[jira] [Updated] (HDFS-11553) Erasure Coding: Missing parity blocks in the block group are warned as corrupt blocks

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11553: --- Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-8031) > Erasure Coding:

[jira] [Updated] (HDFS-9381) When same block came for replication for Striped mode, we can move that block to PendingReplications

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9381: -- Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-8031) > When same block came for

[jira] [Updated] (HDFS-9381) When same block came for replication for Striped mode, we can move that block to PendingReplications

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9381: -- Labels: hdfs-ec-3.0-nice-to-have (was: ) > When same block came for replication for Striped mode, we

[jira] [Updated] (HDFS-11394) Add method for getting erasure coding policy through WebHDFS

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11394: --- Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-8031) > Add method for

[jira] [Commented] (HDFS-8196) Erasure Coding related information on NameNode UI

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149867#comment-16149867 ] Hadoop QA commented on HDFS-8196: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12380) Simplify dataQueue.wait condition logical operation

2017-08-31 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liaoyuxiangqin updated HDFS-12380: -- Status: Patch Available (was: Open) > Simplify dataQueue.wait condition logical operation >

[jira] [Updated] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-08-31 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12384: --- Description: {{hadoop-client-modules}} is failing because of dependences added by

[jira] [Commented] (HDFS-12300) Audit-log delegation token related operations

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149906#comment-16149906 ] Hadoop QA commented on HDFS-12300: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12380) Simplify dataQueue.wait condition logical operation

2017-08-31 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149062#comment-16149062 ] Rushabh S Shah commented on HDFS-12380: --- Thanks [~liaoyuxiangqin] for the find and the patch. The

[jira] [Updated] (HDFS-11294) libhdfs++: Segfault in HA failover if DNS lookup for both Namenodes fails

2017-08-31 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11294: --- Status: Patch Available (was: Reopened) > libhdfs++: Segfault in HA failover if DNS lookup

[jira] [Updated] (HDFS-11294) libhdfs++: Segfault in HA failover if DNS lookup for both Namenodes fails

2017-08-31 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11294: --- Attachment: HDFS-8707.HDFS-11294.000.patch > libhdfs++: Segfault in HA failover if DNS lookup

[jira] [Commented] (HDFS-11294) libhdfs++: Segfault in HA failover if DNS lookup for both Namenodes fails

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149138#comment-16149138 ] Hadoop QA commented on HDFS-11294: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11799) Introduce a config to allow setting up write pipeline with fewer nodes than replication factor

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149067#comment-16149067 ] Hadoop QA commented on HDFS-11799: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11964) RS-6-3-LEGACY has a decoding bug when it is used for pread

2017-08-31 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-11964: Status: Patch Available (was: Open) > RS-6-3-LEGACY has a decoding bug when it is used for

[jira] [Commented] (HDFS-12359) Re-encryption should operate with minimum KMS ACL requirements.

2017-08-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149170#comment-16149170 ] Xiao Chen commented on HDFS-12359: -- Test failures not related, HDFS-12360, HDFS-12377 and HDFS-12378. >

[jira] [Comment Edited] (HDFS-12379) NameNode getListing should use FileStatus instead of HdfsFileStatus

2017-08-31 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149161#comment-16149161 ] Rushabh S Shah edited comment on HDFS-12379 at 8/31/17 3:54 PM:

[jira] [Commented] (HDFS-12379) NameNode getListing should use FileStatus instead of HdfsFileStatus

2017-08-31 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149161#comment-16149161 ] Rushabh S Shah commented on HDFS-12379: --- Mover#processPaths calls {{dfs#listPaths(fullPath,

[jira] [Commented] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-08-31 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149203#comment-16149203 ] Uma Maheswara Rao G commented on HDFS-12291: Thank you so much [~surendrasingh] for working on

[jira] [Updated] (HDFS-11964) RS-6-3-LEGACY has a decoding bug when it is used for pread

2017-08-31 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-11964: Status: Open (was: Patch Available) > RS-6-3-LEGACY has a decoding bug when it is used for

[jira] [Updated] (HDFS-11964) RS-6-3-LEGACY has a decoding bug when it is used for pread

2017-08-31 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-11964: Attachment: (was: HDFS-11964.3.patch) > RS-6-3-LEGACY has a decoding bug when it is

[jira] [Updated] (HDFS-12228) [SPS]: Add storage policy satisfier related metrics

2017-08-31 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-12228: --- Parent Issue: HDFS-10285 (was: HDFS-12226) > [SPS]: Add storage policy satisfier

[jira] [Commented] (HDFS-12300) Audit-log delegation token related operations

2017-08-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149172#comment-16149172 ] Xiao Chen commented on HDFS-12300: -- Any watchers have cycle to review? (Will address checkstyle with any

[jira] [Updated] (HDFS-11964) RS-6-3-LEGACY has a decoding bug when it is used for pread

2017-08-31 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-11964: Attachment: HDFS-11964.3.patch Something is wrong with jenkins. Resubmitted the latest

[jira] [Commented] (HDFS-11964) RS-6-3-LEGACY has a decoding bug when it is used for pread

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149491#comment-16149491 ] Hadoop QA commented on HDFS-11964: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-12382) Ozone: SCM: BlockManager creates a new container for each allocateBlock call

2017-08-31 Thread Nandakumar (JIRA)
Nandakumar created HDFS-12382: - Summary: Ozone: SCM: BlockManager creates a new container for each allocateBlock call Key: HDFS-12382 URL: https://issues.apache.org/jira/browse/HDFS-12382 Project: Hadoop

[jira] [Commented] (HDFS-12381) [Documentation] Adding configuration keys

2017-08-31 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149412#comment-16149412 ] Íñigo Goiri commented on HDFS-12381: As [~brahmareddy] suggested, I will add a tabular with all the

[jira] [Created] (HDFS-12381) [Documentation] Adding configuration keys

2017-08-31 Thread JIRA
Íñigo Goiri created HDFS-12381: -- Summary: [Documentation] Adding configuration keys Key: HDFS-12381 URL: https://issues.apache.org/jira/browse/HDFS-12381 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-12376) Enable JournalNode Sync by default

2017-08-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149341#comment-16149341 ] Arpit Agarwal commented on HDFS-12376: -- +1 for the patch. The unit test coverage looks pretty good.

[jira] [Commented] (HDFS-10304) Implement moveToLocal

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149344#comment-16149344 ] Hadoop QA commented on HDFS-10304: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10304) Implement moveToLocal

2017-08-31 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-10304: Component/s: (was: scripts) shell > Implement moveToLocal >

[jira] [Updated] (HDFS-11921) Ozone: KSM: Unable to put keys with zero length

2017-08-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11921: -- Attachment: HDFS-11921-HDFS-7240.001.patch Right now, the behaviour is that if a length of 0 is given,

[jira] [Commented] (HDFS-11921) Ozone: KSM: Unable to put keys with zero length

2017-08-31 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149451#comment-16149451 ] Anu Engineer commented on HDFS-11921: - [~vagarychen] Thanks for bringing this up. I am debugging that

[jira] [Updated] (HDFS-12382) Ozone: SCM: BlockManager creates a new container for each allocateBlock call

2017-08-31 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12382: -- Attachment: HDFS-12382-HDFS-7240.000.patch > Ozone: SCM: BlockManager creates a new container for each

[jira] [Commented] (HDFS-12382) Ozone: SCM: BlockManager creates a new container for each allocateBlock call

2017-08-31 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149557#comment-16149557 ] Anu Engineer commented on HDFS-12382: - [~nandakumar131] Thanks for the patch. If this blocking your

[jira] [Commented] (HDFS-12382) Ozone: SCM: BlockManager creates a new container for each allocateBlock call

2017-08-31 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149591#comment-16149591 ] Anu Engineer commented on HDFS-12382: - cc : [~xyao] FYI .. > Ozone: SCM: BlockManager creates a new

[jira] [Commented] (HDFS-12268) Ozone: Add metrics for pending storage container requests

2017-08-31 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149612#comment-16149612 ] Chen Liang commented on HDFS-12268: --- Thanks [~linyiqun] for the patch. v004 patch looks good to me

[jira] [Updated] (HDFS-12382) Ozone: SCM: BlockManager creates a new container for each allocateBlock call

2017-08-31 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12382: -- Status: Patch Available (was: Open) > Ozone: SCM: BlockManager creates a new container for each

[jira] [Commented] (HDFS-12367) Ozone: Too many open files error while running corona

2017-08-31 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149554#comment-16149554 ] Nandakumar commented on HDFS-12367: --- If corona was executed in one of the datanode, HDFS-12382 would

[jira] [Commented] (HDFS-12382) Ozone: SCM: BlockManager creates a new container for each allocateBlock call

2017-08-31 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149566#comment-16149566 ] Nandakumar commented on HDFS-12382: --- Because of this I was getting "Too many open files" error in corona

[jira] [Created] (HDFS-12383) Re-encryption updater should handle canceled tasks

2017-08-31 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-12383: Summary: Re-encryption updater should handle canceled tasks Key: HDFS-12383 URL: https://issues.apache.org/jira/browse/HDFS-12383 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-12383) Re-encryption updater should handle canceled tasks

2017-08-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12383: - Description: Seen an instance where the re-encryption updater exited due to an exception, and later

[jira] [Updated] (HDFS-12383) Re-encryption updater should handle canceled tasks better

2017-08-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12383: - Summary: Re-encryption updater should handle canceled tasks better (was: Re-encryption updater should

[jira] [Updated] (HDFS-12383) Re-encryption updater should handle canceled tasks better

2017-08-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12383: - Description: Seen an instance where the re-encryption updater exited due to an exception, and later

[jira] [Commented] (HDFS-12382) Ozone: SCM: BlockManager creates a new container for each allocateBlock call

2017-08-31 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149590#comment-16149590 ] Xiaoyu Yao commented on HDFS-12382: --- Thanks [~nandakumar131] for reporting and fix the issue. The fix

[jira] [Commented] (HDFS-12382) Ozone: SCM: BlockManager creates a new container for each allocateBlock call

2017-08-31 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149589#comment-16149589 ] Anu Engineer commented on HDFS-12382: - +1, I will commit this as soon as we have a jenkins run. >

[jira] [Updated] (HDFS-12383) Re-encryption updater should handle canceled tasks better

2017-08-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12383: - Status: Patch Available (was: Open) > Re-encryption updater should handle canceled tasks better >

[jira] [Updated] (HDFS-12383) Re-encryption updater should handle canceled tasks better

2017-08-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12383: - Attachment: HDFS-12383.01.patch > Re-encryption updater should handle canceled tasks better >

[jira] [Updated] (HDFS-12381) [Documentation] Adding configuration keys for the Router

2017-08-31 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12381: --- Summary: [Documentation] Adding configuration keys for the Router (was: [Documentation] Adding

[jira] [Created] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-08-31 Thread JIRA
Íñigo Goiri created HDFS-12384: -- Summary: Fixing compilation issue with BanDuplicateClasses Key: HDFS-12384 URL: https://issues.apache.org/jira/browse/HDFS-12384 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-08-31 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12384: --- Attachment: HDFS-12384-HDFS-10467-000.patch As [~brahmareddy] pointed out, building the

[jira] [Updated] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-08-31 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12384: --- Status: Patch Available (was: Open) > Fixing compilation issue with BanDuplicateClasses >

[jira] [Commented] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149661#comment-16149661 ] Hadoop QA commented on HDFS-12384: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12335) Federation Metrics

2017-08-31 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12335: - Attachment: HDFS-12335-HDFS-10467.006.patch +1 overall. Uploaded a minor variant with the

[jira] [Commented] (HDFS-12376) Enable JournalNode Sync by default

2017-08-31 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149663#comment-16149663 ] Hanisha Koneru commented on HDFS-12376: --- I have tested this feature extensively on a long running

[jira] [Commented] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-08-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149676#comment-16149676 ] Xiao Chen commented on HDFS-12291: -- (sorry for the partial comment - fat fingered. still reviewing...) >

[jira] [Commented] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-08-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149674#comment-16149674 ] Xiao Chen commented on HDFS-12291: -- Thanks [~surendrasingh] for the work. When writing re-encryption code

[jira] [Updated] (HDFS-12335) Federation Metrics

2017-08-31 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12335: - Attachment: HDFS-12335-HDFS-10467.007.patch > Federation Metrics > -- > >

[jira] [Commented] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-08-31 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149702#comment-16149702 ] Íñigo Goiri commented on HDFS-12384: It looks like the patch fixes the compilation. Waiting for review

[jira] [Commented] (HDFS-12102) VolumeScanner throttle dropped (fast scan enabled) when there is a corrupt block

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149706#comment-16149706 ] Junping Du commented on HDFS-12102: --- Drop 2.8.2 in fix version given patch haven't been committed. >

[jira] [Updated] (HDFS-12102) VolumeScanner throttle dropped (fast scan enabled) when there is a corrupt block

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-12102: -- Fix Version/s: (was: 2.8.2) > VolumeScanner throttle dropped (fast scan enabled) when there is a

[jira] [Commented] (HDFS-12382) Ozone: SCM: BlockManager creates a new container for each allocateBlock call

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149716#comment-16149716 ] Hadoop QA commented on HDFS-12382: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-08-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149674#comment-16149674 ] Xiao Chen edited comment on HDFS-12291 at 8/31/17 10:37 PM: Thanks

[jira] [Issue Comment Deleted] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-08-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12291: - Comment: was deleted (was: (sorry for the partial comment - fat fingered. still reviewing...)) > [SPS]:

  1   2   >