[jira] [Updated] (HADOOP-11021) Configurable replication degree in the hadoop archive command

2014-08-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-11021: --- Attachment: HDFS-6968-2.patch Thanks [~andrew.wang] for the comments. Configurable replication

[jira] [Commented] (HADOOP-11021) Configurable replication factor in the hadoop archive command

2014-08-29 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115924#comment-14115924 ] Zhe Zhang commented on HADOOP-11021: Cool! Thanks for the great feedback on doc

[jira] [Commented] (HADOOP-11541) Raw XOR coder

2015-02-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310521#comment-14310521 ] Zhe Zhang commented on HADOOP-11541: Just finished reading the updated patch. Looks

[jira] [Commented] (HADOOP-11542) Raw Reed-Solomon coder in pure Java

2015-02-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310427#comment-14310427 ] Zhe Zhang commented on HADOOP-11542: Thanks Kai! I imagine RS will be our main codec

[jira] [Commented] (HADOOP-11541) Raw XOR coder

2015-02-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310514#comment-14310514 ] Zhe Zhang commented on HADOOP-11541: Hi Kai, you need a +1 from someone else (not

[jira] [Commented] (HADOOP-11541) Raw XOR coder

2015-02-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308361#comment-14308361 ] Zhe Zhang commented on HADOOP-11541: Thanks [~drankye] for the patch, great to see

[jira] [Commented] (HADOOP-11542) Raw Reed-Solomon coder in pure Java

2015-02-11 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317522#comment-14317522 ] Zhe Zhang commented on HADOOP-11542: Looks good, +1. Thanks Kai for the good work!

[jira] [Commented] (HADOOP-11542) Raw Reed-Solomon coder in pure Java

2015-02-11 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317331#comment-14317331 ] Zhe Zhang commented on HADOOP-11542: Thanks Kai for the rev! It looks good. +1

[jira] [Commented] (HADOOP-11514) Raw Erasure Coder API for concrete encoding and decoding

2015-01-27 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294330#comment-14294330 ] Zhe Zhang commented on HADOOP-11514: No worries, I'll make the package name change.

[jira] [Commented] (HADOOP-11514) Raw Erasure Coder API for concrete encoding and decoding

2015-01-27 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294350#comment-14294350 ] Zhe Zhang commented on HADOOP-11514: Just saw one issue not addressed: dataSize,

[jira] [Commented] (HADOOP-11514) Raw Erasure Coder API for concrete encoding and decoding

2015-01-27 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294401#comment-14294401 ] Zhe Zhang commented on HADOOP-11514: [~drankye] When you make the next rev, could

[jira] [Commented] (HADOOP-11514) Raw Erasure Coder API for concrete encoding and decoding

2015-01-27 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294321#comment-14294321 ] Zhe Zhang commented on HADOOP-11514: I agree, let's commit after changing package

[jira] [Commented] (HADOOP-11514) Raw Erasure Coder API for concrete encoding and decoding

2015-01-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14295813#comment-14295813 ] Zhe Zhang commented on HADOOP-11514: bq. In fact whole ECChunk class itself is

[jira] [Commented] (HADOOP-11542) Raw Reed-Solomon coder in pure Java

2015-02-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318491#comment-14318491 ] Zhe Zhang commented on HADOOP-11542: Thanks Kai! Quickly comment: maybe you should

[jira] [Commented] (HADOOP-11542) Raw Reed-Solomon coder in pure Java

2015-02-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312739#comment-14312739 ] Zhe Zhang commented on HADOOP-11542: Thanks Kai for the updated patch. Structures:

[jira] [Commented] (HADOOP-11676) Add API to NetworkTopology for getting all racks

2015-03-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14363972#comment-14363972 ] Zhe Zhang commented on HADOOP-11676: I committed to HDFS-7285. Thanks Walter for the

[jira] [Updated] (HADOOP-11676) Add API to NetworkTopology for getting all racks

2015-03-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-11676: --- Resolution: Fixed Status: Resolved (was: Patch Available) Add API to NetworkTopology for

[jira] [Updated] (HADOOP-11706) Refine a little bit erasure coder API

2015-03-18 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-11706: --- Issue Type: Sub-task (was: Improvement) Parent: HADOOP-11264 Refine a little bit erasure

[jira] [Updated] (HADOOP-11676) Add API to NetworkTopology for getting all racks

2015-03-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-11676: --- Issue Type: Sub-task (was: Improvement) Parent: HADOOP-11264 Add API to NetworkTopology

[jira] [Updated] (HADOOP-11676) Add API to NetworkTopology for getting all racks

2015-03-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-11676: --- Fix Version/s: HDFS-7285 Add API to NetworkTopology for getting all racks

[jira] [Commented] (HADOOP-11676) Add API to NetworkTopology for getting all racks

2015-03-13 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359993#comment-14359993 ] Zhe Zhang commented on HADOOP-11676: Thanks Walter! LGTM and +1 pending Jenkins.

[jira] [Commented] (HADOOP-11676) Add API to NetworkTopology for getting all racks

2015-03-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359098#comment-14359098 ] Zhe Zhang commented on HADOOP-11676: Thanks [~aw] for the question.

[jira] [Commented] (HADOOP-11664) Loading predefined EC schemas from configuration

2015-03-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14387024#comment-14387024 ] Zhe Zhang commented on HADOOP-11664: Thanks Kai for making the additional change. I

[jira] [Commented] (HADOOP-11740) Combine erasure encoder and decoder interfaces

2015-03-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14387651#comment-14387651 ] Zhe Zhang commented on HADOOP-11740: I agree. The current patch does this actually.

[jira] [Resolved] (HADOOP-11664) Loading predefined EC schemas from configuration

2015-03-27 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HADOOP-11664. Resolution: Fixed Loading predefined EC schemas from configuration

[jira] [Updated] (HADOOP-11664) Loading predefined EC schemas from configuration

2015-03-27 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-11664: --- Fix Version/s: HDFS-7285 Loading predefined EC schemas from configuration

[jira] [Commented] (HADOOP-11664) Loading predefined EC schemas from configuration

2015-03-27 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14384755#comment-14384755 ] Zhe Zhang commented on HADOOP-11664: I agree. +1 on the patch; I committed it.

[jira] [Commented] (HADOOP-11664) Loading predefined EC schemas from configuration

2015-03-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383027#comment-14383027 ] Zhe Zhang commented on HADOOP-11664: Thanks Kai for the patch! The main logic looks

[jira] [Updated] (HADOOP-11740) Combine erasure encoder and decoder interfaces

2015-03-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-11740: --- Attachment: HADOOP-11740-000.patch This initial patch simply removes {{ErasureEncoder}} and

[jira] [Work started] (HADOOP-11740) Combine erasure encoder and decoder interfaces

2015-03-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-11740 started by Zhe Zhang. -- Combine erasure encoder and decoder interfaces

[jira] [Assigned] (HADOOP-11740) Combine erasure encoder and decoder interfaces

2015-03-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reassigned HADOOP-11740: -- Assignee: Zhe Zhang Combine erasure encoder and decoder interfaces

[jira] [Commented] (HADOOP-11664) Loading predefined EC schemas from configuration

2015-03-23 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14377340#comment-14377340 ] Zhe Zhang commented on HADOOP-11664: Great idea Vinay! — Sent from Mailbox On

[jira] [Created] (HADOOP-11740) Combine erasure encoder and decoder interfaces

2015-03-23 Thread Zhe Zhang (JIRA)
Zhe Zhang created HADOOP-11740: -- Summary: Combine erasure encoder and decoder interfaces Key: HADOOP-11740 URL: https://issues.apache.org/jira/browse/HADOOP-11740 Project: Hadoop Common Issue

[jira] [Resolved] (HADOOP-11676) Add API to NetworkTopology for getting all racks

2015-03-23 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HADOOP-11676. Resolution: Won't Fix Reverted per discussion under HDFS-7891 Add API to NetworkTopology for

[jira] [Reopened] (HADOOP-11676) Add API to NetworkTopology for getting all racks

2015-03-23 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reopened HADOOP-11676: Add API to NetworkTopology for getting all racks

[jira] [Commented] (HADOOP-11828) Implement the Hitchhiker erasure coding algorithm

2015-04-13 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14492780#comment-14492780 ] Zhe Zhang commented on HADOOP-11828: Thanks Uma for moving this to COMMON; good

[jira] [Commented] (HADOOP-11847) Enhance raw coder allowing to read least required inputs in decoding

2015-04-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14506111#comment-14506111 ] Zhe Zhang commented on HADOOP-11847: Thanks Kai for the patch. Please find my review

[jira] [Commented] (HADOOP-11847) Enhance raw coder allowing to read least required inputs in decoding

2015-04-24 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14512109#comment-14512109 ] Zhe Zhang commented on HADOOP-11847: Thanks Kai for the updated patch. A few quick

[jira] [Commented] (HADOOP-11847) Enhance raw coder allowing to read least required inputs in decoding

2015-04-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517142#comment-14517142 ] Zhe Zhang commented on HADOOP-11847: bq. erasedIndexes - erasedIndices I did a

[jira] [Commented] (HADOOP-11566) Add tests and fix for erasure coders to recover erased parity units

2015-05-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531680#comment-14531680 ] Zhe Zhang commented on HADOOP-11566: The patch looks good. [~drankye] Do you mean

[jira] [Commented] (HADOOP-11566) Add tests and fix for erasure coders to recover erased parity units

2015-05-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14527794#comment-14527794 ] Zhe Zhang commented on HADOOP-11566: Should this be under HADOOP-11264? Add tests

[jira] [Commented] (HADOOP-11566) Add tests and fix for erasure coders to recover erased parity units

2015-05-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14532021#comment-14532021 ] Zhe Zhang commented on HADOOP-11566: Thanks for clarifying Kai. Since HADOOP-11920

[jira] [Commented] (HADOOP-11920) Refactor some codes for erasure coders

2015-05-11 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14538183#comment-14538183 ] Zhe Zhang commented on HADOOP-11920: {code} 101 pick 3140bc0 HADOOP-11921. Enhance

[jira] [Commented] (HADOOP-11920) Refactor some codes for erasure coders

2015-05-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14544485#comment-14544485 ] Zhe Zhang commented on HADOOP-11920: Since there's only HADOOP-11566 ahead of these

[jira] [Commented] (HADOOP-11566) Add tests and fix for erasure coders to recover erased parity units

2015-05-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14541001#comment-14541001 ] Zhe Zhang commented on HADOOP-11566: Thanks Kai for the rebase. Again it looks good

[jira] [Commented] (HADOOP-11847) Enhance raw coder allowing to read least required inputs in decoding

2015-05-13 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14541410#comment-14541410 ] Zhe Zhang commented on HADOOP-11847: When HADOOP-11566 is committed, does this patch

[jira] [Commented] (HADOOP-11805) Better to rename some raw erasure coders

2015-04-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14482173#comment-14482173 ] Zhe Zhang commented on HADOOP-11805: Thanks for the work Kai. So the main updates

[jira] [Updated] (HADOOP-11740) Combine erasure encoder and decoder interfaces

2015-04-03 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-11740: --- Attachment: HADOOP-11740-002.patch Thanks Kai for the review! I read the test classes again and

[jira] [Commented] (HADOOP-11740) Combine erasure encoder and decoder interfaces

2015-04-03 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14395172#comment-14395172 ] Zhe Zhang commented on HADOOP-11740: Thanks Kai! I just committed the patch.

[jira] [Resolved] (HADOOP-11740) Combine erasure encoder and decoder interfaces

2015-04-03 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HADOOP-11740. Resolution: Fixed Fix Version/s: HDFS-7285 Combine erasure encoder and decoder interfaces

[jira] [Updated] (HADOOP-11782) Correct two thrown messages in ECSchema class

2015-04-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-11782: --- Issue Type: Sub-task (was: Bug) Parent: HADOOP-11264 Correct two thrown messages in

[jira] [Commented] (HADOOP-11540) Raw Reed-Solomon coder using Intel ISA-L library

2015-04-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392930#comment-14392930 ] Zhe Zhang commented on HADOOP-11540: Really impressive results! Thanks for the great

[jira] [Updated] (HADOOP-11740) Combine erasure encoder and decoder interfaces

2015-04-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-11740: --- Attachment: HADOOP-11740-001.patch Thanks Kai for the review! The updated patch addresses the issue

[jira] [Commented] (HADOOP-12040) Adjust inputs order for the decode API in raw erasure coder

2015-06-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575284#comment-14575284 ] Zhe Zhang commented on HADOOP-12040: Thanks for taking this task Kai! It's a good

[jira] [Created] (HADOOP-12017) Hadoop archives command should use configurable replication factor when closing

2015-05-21 Thread Zhe Zhang (JIRA)
Zhe Zhang created HADOOP-12017: -- Summary: Hadoop archives command should use configurable replication factor when closing Key: HADOOP-12017 URL: https://issues.apache.org/jira/browse/HADOOP-12017

[jira] [Updated] (HADOOP-12017) Hadoop archives command should use configurable replication factor when closing

2015-05-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-12017: --- Description: {{HadoopArchives#HArchivesReducer#close}} uses hard-coded replication factor. It

[jira] [Commented] (HADOOP-12013) Generate fixed data to perform erasure coder test

2015-05-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1463#comment-1463 ] Zhe Zhang commented on HADOOP-12013: Thanks for the clarification. I see, so the

[jira] [Commented] (HADOOP-12013) Generate fixed data to perform erasure coder test

2015-05-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554906#comment-14554906 ] Zhe Zhang commented on HADOOP-12013: Thanks Kai for the work. The overall structure

[jira] [Commented] (HADOOP-12009) Clarify FileSystem.listStatus() sorting order fix FileSystemContractBaseTest:testListStatus

2015-06-29 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14607198#comment-14607198 ] Zhe Zhang commented on HADOOP-12009: [~andreina] The patch is causing

[jira] [Commented] (HADOOP-12017) Hadoop archives command should use configurable replication factor when closing

2015-07-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636318#comment-14636318 ] Zhe Zhang commented on HADOOP-12017: Thanks Bibin for fixing the issue! Also thanks

[jira] [Resolved] (HADOOP-9311) hadoop-auth: Kerberos token expiration results in an error

2015-10-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HADOOP-9311. --- Resolution: Duplicate Fix Version/s: 2.4.0 HADOOP-10301 has added a similar logic to address

[jira] [Updated] (HADOOP-9311) hadoop-auth: Kerberos token expiration results in an error

2015-10-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-9311: -- Assignee: Joel Firehammer (was: Zhe Zhang) > hadoop-auth: Kerberos token expiration results in an

[jira] [Assigned] (HADOOP-9311) hadoop-auth: Kerberos token expiration results in an error

2015-10-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reassigned HADOOP-9311: - Assignee: Zhe Zhang > hadoop-auth: Kerberos token expiration results in an error >

[jira] [Updated] (HADOOP-9692) SequenceFile reader throws EOFException on zero-length file

2015-10-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-9692: -- Attachment: HADOOP-9692.20151021.patch Reading the patch again I agree with the suggestion from

[jira] [Commented] (HADOOP-9692) Improving log message when SequenceFile reader throws EOFException on zero-length file

2015-10-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970005#comment-14970005 ] Zhe Zhang commented on HADOOP-9692: --- Thanks! > Improving log message when SequenceFile reader throws

[jira] [Commented] (HADOOP-12041) Implement another Reed-Solomon coder in pure Java

2015-10-27 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977720#comment-14977720 ] Zhe Zhang commented on HADOOP-12041: Thanks Kai! Sure, I will review the patch soon. > Implement

[jira] [Commented] (HADOOP-9692) Improving log message when SequenceFile reader throws EOFException on zero-length file

2015-10-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14969404#comment-14969404 ] Zhe Zhang commented on HADOOP-9692: --- [~ozawa] I find 2 git commits in trunk and the 2nd one

[jira] [Commented] (HADOOP-9692) Improving log message when SequenceFile reader throws EOFException on zero-length file

2015-10-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14969378#comment-14969378 ] Zhe Zhang commented on HADOOP-9692: --- Thanks [~ozawa] for reviewing again! > Improving log message when

[jira] [Commented] (HADOOP-12559) KMS connection failures should trigger TGT renewal

2015-11-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007625#comment-15007625 ] Zhe Zhang commented on HADOOP-12559: The fix should be on the client side. When working on the patch

[jira] [Commented] (HADOOP-11828) Implement the Hitchhiker erasure coding algorithm

2015-11-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14994586#comment-14994586 ] Zhe Zhang commented on HADOOP-11828: [~rashmikv] Phase 1 of EC was tracked under HDFS-7285 /

[jira] [Commented] (HADOOP-11887) Introduce Intel ISA-L erasure coding library for native erasure encoding support

2015-11-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992276#comment-14992276 ] Zhe Zhang commented on HADOOP-11887: Thanks Kai for the great work and Colin for the review! Looking

[jira] [Commented] (HADOOP-12544) Erasure Coding: create dummy raw coder

2015-11-03 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988503#comment-14988503 ] Zhe Zhang commented on HADOOP-12544: Thanks Rui! The patch looks good overall. A tiny suggestion is

[jira] [Updated] (HADOOP-12544) Erasure Coding: create dummy raw coder to isolate performance issues in testing

2015-11-03 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-12544: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Target

[jira] [Updated] (HADOOP-12544) Erasure Coding: create dummy raw coder to isolate performance issues in testing

2015-11-03 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-12544: --- Summary: Erasure Coding: create dummy raw coder to isolate performance issues in testing (was:

[jira] [Created] (HADOOP-12559) KMS connection failures should trigger TGT renewal

2015-11-06 Thread Zhe Zhang (JIRA)
Zhe Zhang created HADOOP-12559: -- Summary: KMS connection failures should trigger TGT renewal Key: HADOOP-12559 URL: https://issues.apache.org/jira/browse/HADOOP-12559 Project: Hadoop Common

[jira] [Commented] (HADOOP-9692) SequenceFile reader throws EOFException on zero-length file

2015-07-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621064#comment-14621064 ] Zhe Zhang commented on HADOOP-9692: --- [~ozawa] [~zjshen]: Maybe we should quickly

[jira] [Commented] (HADOOP-9522) web interfaces are not logged until after opening

2015-07-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621203#comment-14621203 ] Zhe Zhang commented on HADOOP-9522: --- [~aw] I wonder if you are still seeing the issue

[jira] [Updated] (HADOOP-11887) Introduce Intel ISA-L erasure coding library for the native support

2015-09-07 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-11887: --- Fix Version/s: (was: HDFS-7285) > Introduce Intel ISA-L erasure coding library for the native

[jira] [Commented] (HADOOP-11828) Implement the Hitchhiker erasure coding algorithm

2015-12-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047114#comment-15047114 ] Zhe Zhang commented on HADOOP-11828: Thanks [~jack_liuquan]! Per question from [~rashmikv] above, is

[jira] [Commented] (HADOOP-11828) Implement the Hitchhiker erasure coding algorithm

2015-12-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047116#comment-15047116 ] Zhe Zhang commented on HADOOP-11828: Could you also click "Submit Patch"? Thanks. > Implement the

[jira] [Updated] (HADOOP-12559) KMS connection failures should trigger TGT renewal

2015-12-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-12559: --- Attachment: HADOOP-12559.00.patch Initial patch to fix the issue. > KMS connection failures should

[jira] [Commented] (HADOOP-12559) KMS connection failures should trigger TGT renewal

2015-12-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049304#comment-15049304 ] Zhe Zhang commented on HADOOP-12559: [~qwertymaniac] Thanks for reporting the new issue. Which

[jira] [Updated] (HADOOP-12559) KMS connection failures should trigger TGT renewal

2015-12-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-12559: --- Status: Patch Available (was: Open) > KMS connection failures should trigger TGT renewal >

[jira] [Commented] (HADOOP-12604) Exception may be swallowed in KMSClientProvider

2015-12-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060634#comment-15060634 ] Zhe Zhang commented on HADOOP-12604: Thanks Yongjun for the work and Steve for the review. The

[jira] [Commented] (HADOOP-12615) Fix NPE in MiniKMS.start()

2015-12-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060979#comment-15060979 ] Zhe Zhang commented on HADOOP-12615: Thanks Wei-Chiu. +1 on the latest patch pending a couple of

[jira] [Updated] (HADOOP-12615) Fix NPE in MiniKMS.start()

2015-12-17 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-12615: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status:

[jira] [Updated] (HADOOP-12615) Fix NPE in MiniKMS.start()

2015-12-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-12615: --- Component/s: test > Fix NPE in MiniKMS.start() > -- > >

[jira] [Commented] (HADOOP-12615) Fix NPE in MiniKMS.start()

2015-12-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056832#comment-15056832 ] Zhe Zhang commented on HADOOP-12615: Thanks Wei-Chiu for the fix! A few questions/comments # We

[jira] [Updated] (HADOOP-12559) KMS connection failures should trigger TGT renewal

2015-12-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-12559: --- Attachment: HADOOP-12559.01.patch Thanks Andrew for taking a look! I believe adding the check in

[jira] [Commented] (HADOOP-12615) Fix NPE in MiniKMS.start()

2015-12-15 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15058892#comment-15058892 ] Zhe Zhang commented on HADOOP-12615: Thanks Steve for the suggestion; good point. Thank you for the

[jira] [Updated] (HADOOP-12559) KMS connection failures should trigger TGT renewal

2015-12-15 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-12559: --- Attachment: HADOOP-12559.02.patch Thanks ATM for reviewing. Could you take a look at this updated

[jira] [Commented] (HADOOP-12041) Implement another Reed-Solomon coder in pure Java

2016-01-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086391#comment-15086391 ] Zhe Zhang commented on HADOOP-12041: Thanks Kai for the work. I'm still reviewing the patch but

[jira] [Commented] (HADOOP-12546) Improve TestKMS

2016-01-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086481#comment-15086481 ] Zhe Zhang commented on HADOOP-12546: I think the conflict is from HADOOP-12682. I tried applying v03

[jira] [Commented] (HADOOP-12685) Input buffer position after encode/decode not consistent between different kinds of buffers

2016-01-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083945#comment-15083945 ] Zhe Zhang commented on HADOOP-12685: Thanks Rui for the good fix. The patch LGTM. +1 and I'll commit

[jira] [Updated] (HADOOP-12685) Input buffer position after encode/decode not consistent between different kinds of buffers

2016-01-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-12685: --- Affects Version/s: 3.0.0 > Input buffer position after encode/decode not consistent between

[jira] [Updated] (HADOOP-12685) Input buffer position after encode/decode not consistent between different kinds of buffers

2016-01-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-12685: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status:

[jira] [Updated] (HADOOP-12685) Input buffer position after encode/decode not consistent between different kinds of buffers

2016-01-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-12685: --- Target Version/s: 3.0.0 > Input buffer position after encode/decode not consistent between

[jira] [Commented] (HADOOP-12546) Improve TestKMS

2016-01-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086331#comment-15086331 ] Zhe Zhang commented on HADOOP-12546: 03 patch LGTM as well. [~templedf] Do you mind rebasing the

[jira] [Commented] (HADOOP-12041) Implement another Reed-Solomon coder in pure Java

2016-01-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090120#comment-15090120 ] Zhe Zhang commented on HADOOP-12041: Agreed, let's do the rename separately. > Implement another

[jira] [Updated] (HADOOP-12559) KMS connection failures should trigger TGT renewal

2015-12-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HADOOP-12559: --- Attachment: HADOOP-12559.05.patch Thanks for the helpful discussion Xiaoyu. I don't think it's easy

  1   2   3   >