[jira] [Commented] (HDFS-12300) Audit-log delegation token related operations

2017-08-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16150134#comment-16150134 ] Hudson commented on HDFS-12300: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-1068) Reduce NameNode GC by reusing HdfsFileStatus objects in RPC handlers

2017-08-31 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-1068: Attachment: HDFS-1068.00.patch Attaching a very rough PoC patch to demonstrate idea. > Reduce NameNode GC by

[jira] [Updated] (HDFS-1068) Reduce NameNode GC by reusing HdfsFileStatus objects in RPC handlers

2017-08-31 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-1068: Status: Patch Available (was: Open) > Reduce NameNode GC by reusing HdfsFileStatus objects in RPC handlers >

[jira] [Commented] (HDFS-12380) Simplify dataQueue.wait condition logical operation in DataStreamer::run()

2017-08-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16150116#comment-16150116 ] Hudson commented on HDFS-12380: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-12383) Re-encryption updater should handle canceled tasks better

2017-08-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16150108#comment-16150108 ] Xiao Chen commented on HDFS-12383: -- Test failures not related to this patch. Not sure wha

[jira] [Updated] (HDFS-12300) Audit-log delegation token related operations

2017-08-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12300: - Fix Version/s: 3.0.0-beta1 > Audit-log delegation token related operations > -

[jira] [Commented] (HDFS-12300) Audit-log delegation token related operations

2017-08-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16150104#comment-16150104 ] Xiao Chen commented on HDFS-12300: -- Committed this to trunk. Thanks Ravi for the review.

[jira] [Updated] (HDFS-12380) Simplify dataQueue.wait condition logical operation in DataStreamer::run()

2017-08-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-12380: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1 Status:

[jira] [Updated] (HDFS-12380) Simplify dataQueue.wait condition logical operation in DataStreamer::run()

2017-08-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-12380: - Summary: Simplify dataQueue.wait condition logical operation in DataStreamer::run() (was: Simplif

[jira] [Commented] (HDFS-12383) Re-encryption updater should handle canceled tasks better

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16150098#comment-16150098 ] Hadoop QA commented on HDFS-12383: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12363) Possible NPE in BlockManager$StorageInfoDefragmenter#scanAndCompactStorages

2017-08-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16150097#comment-16150097 ] Xiao Chen commented on HDFS-12363: -- Thanks a lot [~liuml07] for the review and commit! Al

[jira] [Commented] (HDFS-12300) Audit-log delegation token related operations

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16150095#comment-16150095 ] Hadoop QA commented on HDFS-12300: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12376) Enable JournalNode Sync by default

2017-08-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16150089#comment-16150089 ] Mingliang Liu commented on HDFS-12376: -- I've been watching progress of related scope

[jira] [Commented] (HDFS-12374) Document the missing -ns option of haadmin.

2017-08-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16150086#comment-16150086 ] Mingliang Liu commented on HDFS-12374: -- Lovely as the new format is, I think this JIR

[jira] [Commented] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16150084#comment-16150084 ] Hadoop QA commented on HDFS-12235: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12383) Re-encryption updater should handle canceled tasks better

2017-08-31 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16150082#comment-16150082 ] Wei-Chiu Chuang commented on HDFS-12383: +1 pending Jenkins. thanks! > Re-encrypt

[jira] [Commented] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-08-31 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16150081#comment-16150081 ] Sean Busbey commented on HDFS-12384: Ah. The correct solution is to update the exclusi

[jira] [Commented] (HDFS-12363) Possible NPE in BlockManager$StorageInfoDefragmenter#scanAndCompactStorages

2017-08-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16150079#comment-16150079 ] Hudson commented on HDFS-12363: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-12363) Possible NPE in BlockManager$StorageInfoDefragmenter#scanAndCompactStorages

2017-08-31 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-12363: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1 Status:

[jira] [Commented] (HDFS-12300) Audit-log delegation token related operations

2017-08-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16150021#comment-16150021 ] Xiao Chen commented on HDFS-12300: -- Thanks again Ravi! Last pre-commit mvn install seems

[jira] [Comment Edited] (HDFS-12300) Audit-log delegation token related operations

2017-08-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16150021#comment-16150021 ] Xiao Chen edited comment on HDFS-12300 at 9/1/17 4:12 AM: -- Thanks

[jira] [Commented] (HDFS-12335) Federation Metrics

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149994#comment-16149994 ] Hadoop QA commented on HDFS-12335: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-12383) Re-encryption updater should handle canceled tasks better

2017-08-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149993#comment-16149993 ] Xiao Chen edited comment on HDFS-12383 at 9/1/17 3:44 AM: -- Test f

[jira] [Commented] (HDFS-12383) Re-encryption updater should handle canceled tasks better

2017-08-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149993#comment-16149993 ] Xiao Chen commented on HDFS-12383: -- Test failure unrelated, just triggered another run in

[jira] [Commented] (HDFS-12377) Refactor TestReadStripedFileWithDecoding to avoid test timeouts

2017-08-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149988#comment-16149988 ] Xiao Chen commented on HDFS-12377: -- Thanks Andrew for taking care of pre-commits here! Lo

[jira] [Updated] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-08-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12235: --- Attachment: HDFS-12235-HDFS-7240.005.patch > Ozone: DeleteKey-3: KSM SCM block deletion message and AC

[jira] [Commented] (HDFS-12367) Ozone: Too many open files error while running corona

2017-08-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149974#comment-16149974 ] Weiwei Yang commented on HDFS-12367: Thanks [~nandakumar131], I will do some more test

[jira] [Commented] (HDFS-12335) Federation Metrics

2017-08-31 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149949#comment-16149949 ] Chris Douglas commented on HDFS-12335: -- +1 lgtm > Federation Metrics > -

[jira] [Updated] (HDFS-10467) Router-based HDFS federation

2017-08-31 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-10467: --- Attachment: HDFS-10467.002.patch Attaching patch with the status of the HDFS-10467 by August 31st for

[jira] [Commented] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-08-31 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149947#comment-16149947 ] Chris Douglas commented on HDFS-12357: -- Sorry to be dense, but why can't this live in

[jira] [Commented] (HDFS-12381) [Documentation] Adding configuration keys for the Router

2017-08-31 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149942#comment-16149942 ] Íñigo Goiri commented on HDFS-12381: Given the comment from [~manojg] about recommenda

[jira] [Commented] (HDFS-12380) Simplify dataQueue.wait condition logical operation

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149939#comment-16149939 ] Hadoop QA commented on HDFS-12380: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12383) Re-encryption updater should handle canceled tasks better

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149936#comment-16149936 ] Hadoop QA commented on HDFS-12383: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12381) [Documentation] Adding configuration keys for the Router

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149933#comment-16149933 ] Hadoop QA commented on HDFS-12381: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12317) HDFS metrics render error in the page of Github

2017-08-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12317: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status: Resolved (was

[jira] [Updated] (HDFS-12381) [Documentation] Adding configuration keys for the Router

2017-08-31 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12381: --- Attachment: HDFS-12381-HDFS-10467.000.patch > [Documentation] Adding configuration keys for the Router

[jira] [Updated] (HDFS-12381) [Documentation] Adding configuration keys for the Router

2017-08-31 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12381: --- Status: Patch Available (was: Open) > [Documentation] Adding configuration keys for the Router >

[jira] [Updated] (HDFS-12335) Federation Metrics

2017-08-31 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12335: --- Attachment: HDFS-12335-HDFS-10467.009.patch Fixing checkstyle. > Federation Metrics > ---

[jira] [Commented] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-08-31 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149912#comment-16149912 ] Yongjun Zhang commented on HDFS-12357: -- Hi [~atm], [~daryn] [~manojg], any comments/t

[jira] [Commented] (HDFS-12300) Audit-log delegation token related operations

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149906#comment-16149906 ] Hadoop QA commented on HDFS-12300: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-08-31 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12384: --- Description: {{hadoop-client-modules}} is failing because of dependences added by {{CuratorManager}}:

[jira] [Commented] (HDFS-12335) Federation Metrics

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149900#comment-16149900 ] Hadoop QA commented on HDFS-12335: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12380) Simplify dataQueue.wait condition logical operation

2017-08-31 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149898#comment-16149898 ] liaoyuxiangqin commented on HDFS-12380: --- Thanks [~shahrs87] for review on this, i ha

[jira] [Updated] (HDFS-12380) Simplify dataQueue.wait condition logical operation

2017-08-31 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liaoyuxiangqin updated HDFS-12380: -- Status: Patch Available (was: Open) > Simplify dataQueue.wait condition logical operation > ---

[jira] [Updated] (HDFS-12380) Simplify dataQueue.wait condition logical operation

2017-08-31 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liaoyuxiangqin updated HDFS-12380: -- Attachment: HDFS-12380.002.patch > Simplify dataQueue.wait condition logical operation > ---

[jira] [Updated] (HDFS-12380) Simplify dataQueue.wait condition logical operation

2017-08-31 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liaoyuxiangqin updated HDFS-12380: -- Status: Open (was: Patch Available) > Simplify dataQueue.wait condition logical operation > ---

[jira] [Commented] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149881#comment-16149881 ] Andrew Wang commented on HDFS-11882: Thanks for taking a look Kai, I can update the pa

[jira] [Commented] (HDFS-11394) Add method for getting erasure coding policy through WebHDFS

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149876#comment-16149876 ] Hadoop QA commented on HDFS-11394: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12379) NameNode getListing should use FileStatus instead of HdfsFileStatus

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149873#comment-16149873 ] Andrew Wang commented on HDFS-12379: I'm -1 on any change that breaks wire compatibili

[jira] [Commented] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-08-31 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149869#comment-16149869 ] Kai Zheng commented on HDFS-11882: -- Thanks [~andrew.wang] for adding so many comments in

[jira] [Commented] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149868#comment-16149868 ] Andrew Wang commented on HDFS-12384: [~busbey] yea, that sounded wrong to me, thus ask

[jira] [Updated] (HDFS-9381) When same block came for replication for Striped mode, we can move that block to PendingReplications

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9381: -- Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-8031) > When same block came for

[jira] [Updated] (HDFS-11394) Add method for getting erasure coding policy through WebHDFS

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11394: --- Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-8031) > Add method for getting

[jira] [Updated] (HDFS-9381) When same block came for replication for Striped mode, we can move that block to PendingReplications

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9381: -- Labels: hdfs-ec-3.0-nice-to-have (was: ) > When same block came for replication for Striped mode, we can

[jira] [Commented] (HDFS-8196) Erasure Coding related information on NameNode UI

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149867#comment-16149867 ] Hadoop QA commented on HDFS-8196: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-11553) Erasure Coding: Missing parity blocks in the block group are warned as corrupt blocks

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11553: --- Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-8031) > Erasure Coding: Missin

[jira] [Updated] (HDFS-11553) Erasure Coding: Missing parity blocks in the block group are warned as corrupt blocks

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11553: --- Component/s: erasure-coding > Erasure Coding: Missing parity blocks in the block group are warned as

[jira] [Updated] (HDFS-8196) Erasure Coding related information on NameNode UI

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8196: -- Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-8031) > Erasure Coding related in

[jira] [Commented] (HDFS-9603) Erasure Coding: Use ErasureCoder to encode/decode a block group

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149866#comment-16149866 ] Hadoop QA commented on HDFS-9603: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-08-31 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149863#comment-16149863 ] Sean Busbey commented on HDFS-12384: Sorry, I'm on mobile so reading patch files is di

[jira] [Commented] (HDFS-8196) Erasure Coding related information on NameNode UI

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149864#comment-16149864 ] Andrew Wang commented on HDFS-8196: --- Ping, think we can get this patch revved and in? >

[jira] [Resolved] (HDFS-8295) Add MODIFY and REMOVE ECSchema editlog operations

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-8295. --- Resolution: Invalid I'm resolving this since it's likely stale, we've substantially revisited the plug

[jira] [Updated] (HDFS-11611) Handle unsuccessful encode and decode calls

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11611: --- Issue Type: Bug (was: Sub-task) Parent: (was: HDFS-8031) > Handle unsuccessful encode and

[jira] [Updated] (HDFS-9657) Schedule EC tasks at proper time to reduce the impact of recovery traffic

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9657: -- Issue Type: Improvement (was: Bug) > Schedule EC tasks at proper time to reduce the impact of recovery t

[jira] [Updated] (HDFS-11543) Test multiple erasure coding implementations

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11543: --- Issue Type: Improvement (was: Bug) > Test multiple erasure coding implementations > -

[jira] [Updated] (HDFS-9657) Schedule EC tasks at proper time to reduce the impact of recovery traffic

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9657: -- Component/s: erasure-coding > Schedule EC tasks at proper time to reduce the impact of recovery traffic >

[jira] [Updated] (HDFS-9603) Erasure Coding: Use ErasureCoder to encode/decode a block group

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9603: -- Component/s: erasure-coding > Erasure Coding: Use ErasureCoder to encode/decode a block group > -

[jira] [Updated] (HDFS-11543) Test multiple erasure coding implementations

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11543: --- Labels: test (was: hdfs-ec-3.0-nice-to-have test) > Test multiple erasure coding implementations > --

[jira] [Resolved] (HDFS-9604) Move ErasureCodingPolicyManager to FSDirectory

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-9604. --- Resolution: Invalid This code has been refactored a few times now, no longer valid. > Move ErasureCodi

[jira] [Updated] (HDFS-9603) Erasure Coding: Use ErasureCoder to encode/decode a block group

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9603: -- Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-8031) > Erasure Coding: Use Erasu

[jira] [Updated] (HDFS-9657) Schedule EC tasks at proper time to reduce the impact of recovery traffic

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9657: -- Issue Type: Bug (was: Sub-task) Parent: (was: HDFS-8031) > Schedule EC tasks at proper time

[jira] [Updated] (HDFS-11543) Test multiple erasure coding implementations

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11543: --- Issue Type: Bug (was: Sub-task) Parent: (was: HDFS-8031) > Test multiple erasure coding i

[jira] [Commented] (HDFS-9696) Garbage snapshot records lingering forever

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149858#comment-16149858 ] Junping Du commented on HDFS-9696: -- Add 2.8.0 and 2.9.0 in fix version given patch get lan

[jira] [Updated] (HDFS-9696) Garbage snapshot records lingering forever

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9696: - Fix Version/s: 2.8.0 2.9.0 > Garbage snapshot records lingering forever > --

[jira] [Commented] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149856#comment-16149856 ] Junping Du commented on HDFS-10763: --- Add 2.8.0, 2.9.0 in fix version given patch get lan

[jira] [Updated] (HDFS-10763) Open files can leak permanently due to inconsistent lease update

2017-08-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-10763: -- Fix Version/s: 2.8.0 2.9.0 > Open files can leak permanently due to inconsistent leas

[jira] [Commented] (HDFS-9381) When same block came for replication for Striped mode, we can move that block to PendingReplications

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149851#comment-16149851 ] Hadoop QA commented on HDFS-9381: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-08-31 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149853#comment-16149853 ] Sean Busbey commented on HDFS-12384: Gimme time to gain context here. > Fixing compil

[jira] [Commented] (HDFS-9374) Inform user when a file with corrupted data blocks are read

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149852#comment-16149852 ] Hadoop QA commented on HDFS-9374: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-8881) Erasure Coding: internal blocks got missed and got over-replicated at the same time

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8881: -- Issue Type: Bug (was: Sub-task) Parent: (was: HDFS-8031) > Erasure Coding: internal blocks g

[jira] [Updated] (HDFS-9256) Erasure Coding: Improve failure handling of ECWorker striped block reconstruction

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9256: -- Component/s: erasure-coding > Erasure Coding: Improve failure handling of ECWorker striped block > recon

[jira] [Commented] (HDFS-12377) Refactor TestReadStripedFileWithDecoding to avoid test timeouts

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149847#comment-16149847 ] Hadoop QA commented on HDFS-12377: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-8931) Erasure Coding: Notify exception to client side from ParityGenerator.

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8931: -- Issue Type: Bug (was: Sub-task) Parent: (was: HDFS-8031) > Erasure Coding: Notify exception

[jira] [Updated] (HDFS-8225) EC client code should not print info log message

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8225: -- Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-8031) > EC client code should not

[jira] [Updated] (HDFS-8881) Erasure Coding: internal blocks got missed and got over-replicated at the same time

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8881: -- Component/s: erasure-coding > Erasure Coding: internal blocks got missed and got over-replicated at the

[jira] [Updated] (HDFS-9256) Erasure Coding: Improve failure handling of ECWorker striped block reconstruction

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9256: -- Labels: hdfs-ec-3.0-nice-to-have (was: ) > Erasure Coding: Improve failure handling of ECWorker striped

[jira] [Updated] (HDFS-9345) Erasure Coding: create dummy coder and schema

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9345: -- Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-8031) > Erasure Coding: create du

[jira] [Updated] (HDFS-9256) Erasure Coding: Improve failure handling of ECWorker striped block reconstruction

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9256: -- Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-8031) > Erasure Coding: Improve f

[jira] [Updated] (HDFS-9374) Inform user when a file with corrupted data blocks are read

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9374: -- Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-8031) > Inform user when a file w

[jira] [Commented] (HDFS-9381) When same block came for replication for Striped mode, we can move that block to PendingReplications

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149845#comment-16149845 ] Andrew Wang commented on HDFS-9381: --- [~eddyxu] could you triage this one, since you've be

[jira] [Updated] (HDFS-9374) Inform user when a file with corrupted data blocks are read

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9374: -- Labels: hdfs-ec-3.0-nice-to-have supportability (was: supportability) > Inform user when a file with cor

[jira] [Updated] (HDFS-9382) Track the acks for the packets which are sent from ErasureCodingWorker as part of reconstruction work

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9382: -- Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-8031) > Track the acks for the pa

[jira] [Resolved] (HDFS-9386) Erasure coding: updateBlockForPipeline sometimes returns non-striped block for striped file

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-9386. --- Resolution: Cannot Reproduce Target Version/s: (was: ) Haven't seen this recently and bug i

[jira] [Resolved] (HDFS-8140) ECSchema supports for offline EditsVisitor over an OEV XML file

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-8140. --- Resolution: Duplicate This is a dupe of HDFS-11467. > ECSchema supports for offline EditsVisitor over

[jira] [Commented] (HDFS-11467) Support ErasureCodingPolicyManager section in OIV XML/ReverseXML and OEV tools

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149838#comment-16149838 ] Andrew Wang commented on HDFS-11467: Hi [~Sammi] FYI that with HDFS-7859, we also need

[jira] [Updated] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7859: -- Labels: hdfs-ec-3.0-must-do (was: ) > Erasure Coding: Persist erasure coding policies in NameNode >

[jira] [Issue Comment Deleted] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-08-31 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-11882: - Comment: was deleted (was: Travel today. Please expect slow response. ) > Client fails if acknowledged s

[jira] [Commented] (HDFS-12222) Add EC information to BlockLocation

2017-08-31 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149832#comment-16149832 ] Andrew Wang commented on HDFS-1: Hi Huafeng, thanks for the rev, looks good. Pleas

[jira] [Commented] (HDFS-12335) Federation Metrics

2017-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149824#comment-16149824 ] Hadoop QA commented on HDFS-12335: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12382) Ozone: SCM: BlockManager creates a new container for each allocateBlock call

2017-08-31 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12382: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target Ver

  1   2   3   >