[jira] [Updated] (HDFS-10994) Support an XOR policy XOR-2-1-64k in HDFS

2016-11-03 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10994: - Attachment: HDFS-10994-v3.patch 1. Rebase the patch against trunk 2. Fix one style issue > Support an

[jira] [Commented] (HDFS-10815) The state of the EC file is erroneously recognized when you restart the NameNode.

2016-11-01 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15624793#comment-15624793 ] SammiChen commented on HDFS-10815: -- Hi [~ademu], thanks for providing this information. Will try to

[jira] [Assigned] (HDFS-10854) Remove createStripedFile and addBlockToFile by creating real EC files

2016-10-30 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-10854: Assignee: SammiChen > Remove createStripedFile and addBlockToFile by creating real EC files >

[jira] [Commented] (HDFS-10996) Ability to specify per-file EC policy at create time

2016-10-30 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15621030#comment-15621030 ] SammiChen commented on HDFS-10996: -- Thanks Kai to provide the good idea, I create JIRA HDFS-11075 to

[jira] [Created] (HDFS-11075) Provide a tool to help covert existing file of default 3x replication to EC striped layout

2016-10-30 Thread SammiChen (JIRA)
SammiChen created HDFS-11075: Summary: Provide a tool to help covert existing file of default 3x replication to EC striped layout Key: HDFS-11075 URL: https://issues.apache.org/jira/browse/HDFS-11075

[jira] [Commented] (HDFS-10996) Ability to specify per-file EC policy at create time

2016-10-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15614695#comment-15614695 ] SammiChen commented on HDFS-10996: -- Thanks Andrew for your suggestion! Yes, I will consider the

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2016-10-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15614679#comment-15614679 ] SammiChen commented on HDFS-11072: -- Agree, arbitrary replication factors should be supported. I have

[jira] [Commented] (HDFS-10926) Update staled configuration properties related to erasure coding

2016-10-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15614509#comment-15614509 ] SammiChen commented on HDFS-10926: -- Thanks Kai for help reviewing and committing the patch! > Update

[jira] [Commented] (HDFS-10994) Support an XOR policy XOR-2-1-64k in HDFS

2016-10-27 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15614171#comment-15614171 ] SammiChen commented on HDFS-10994: -- Hi Kai, I have gone through all these check style issues. There are

[jira] [Commented] (HDFS-10996) Ability to specify per-file EC policy at create time

2016-10-27 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15614112#comment-15614112 ] SammiChen commented on HDFS-10996: -- Set EC policy to an existing none empty file or unset EC policy from

[jira] [Assigned] (HDFS-11072) Add ability to unset and change directory EC policy

2016-10-27 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-11072: Assignee: SammiChen > Add ability to unset and change directory EC policy >

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2016-10-27 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15614029#comment-15614029 ] SammiChen commented on HDFS-11072: -- Hi [~andrew.wang], thanks for fire this JIRA, I'd like to work on it.

[jira] [Updated] (HDFS-10935) Java-based EC codec does not reconstruct blocks correctly

2016-10-25 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10935: - Status: Patch Available (was: Open) > Java-based EC codec does not reconstruct blocks correctly >

[jira] [Commented] (HDFS-9594) DataNode threw NullPointerException

2016-10-25 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15604495#comment-15604495 ] SammiChen commented on HDFS-9594: - I think this Null pointer exception is because one data node is killed

[jira] [Updated] (HDFS-10935) Java-based EC codec does not reconstruct blocks correctly

2016-10-25 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10935: - Attachment: HDFS-10935-v1.patch Initial patch > Java-based EC codec does not reconstruct blocks

[jira] [Commented] (HDFS-10935) Java-based EC codec does not reconstruct blocks correctly

2016-10-25 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15604480#comment-15604480 ] SammiChen commented on HDFS-10935: -- Hi [~jojochuang], it's found out that this "Checksum mismatches"

[jira] [Commented] (HDFS-11033) Add documents for native raw erasure coder in XOR codes

2016-10-22 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15599066#comment-15599066 ] SammiChen commented on HDFS-11033: -- Thanks to [~jojochuang] and [~andrew.wang] for reviewing the patch

[jira] [Commented] (HDFS-8411) Add bytes count metrics to datanode for ECWorker

2016-10-22 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15599055#comment-15599055 ] SammiChen commented on HDFS-8411: - Hi Andrew, thanks for provide so many insightful comments. I will do

[jira] [Commented] (HDFS-8410) Add computation time metrics to datanode for ECWorker

2016-10-22 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15599044#comment-15599044 ] SammiChen commented on HDFS-8410: - Thanks Andrew for review and commit the patch! > Add computation time

[jira] [Commented] (HDFS-10815) The state of the EC file is erroneously recognized when you restart the NameNode.

2016-10-20 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15591320#comment-15591320 ] SammiChen commented on HDFS-10815: -- Hi Eisuke Umeda, thanks for provide more information! Have you ever

[jira] [Commented] (HDFS-8410) Add computation time metrics to datanode for ECWorker

2016-10-20 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15591061#comment-15591061 ] SammiChen commented on HDFS-8410: - 1. The failed test is irrelevant. The failure reason is "Adress already

[jira] [Commented] (HDFS-11033) Add documents for native raw erasure coder in XOR codes

2016-10-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15590875#comment-15590875 ] SammiChen commented on HDFS-11033: -- Thanks so much Wei-Chiu for reviewing the patch! I have uploaded a

[jira] [Updated] (HDFS-11033) Add documents for native raw erasure coder in XOR codes

2016-10-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11033: - Attachment: HDFS-11033-v2.patch > Add documents for native raw erasure coder in XOR codes >

[jira] [Updated] (HDFS-8410) Add computation time metrics to datanode for ECWorker

2016-10-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8410: Attachment: HDFS-8410-005.patch 1. add "final" to metric variable 2. the previous checkstyle issue is about

[jira] [Commented] (HDFS-8410) Add computation time metrics to datanode for ECWorker

2016-10-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15590805#comment-15590805 ] SammiChen commented on HDFS-8410: - It costs about 2 milliseconds in my desktop to decode a strip group with

[jira] [Commented] (HDFS-8410) Add computation time metrics to datanode for ECWorker

2016-10-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15590592#comment-15590592 ] SammiChen commented on HDFS-8410: - Hi Andrew, thanks for the comments. Yea, It's better to use "final" for

[jira] [Updated] (HDFS-8411) Add bytes count metrics to datanode for ECWorker

2016-10-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8411: Status: Patch Available (was: Open) > Add bytes count metrics to datanode for ECWorker >

[jira] [Updated] (HDFS-8411) Add bytes count metrics to datanode for ECWorker

2016-10-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8411: Attachment: HDFS-8411-004.patch Rebase and refactor the patch > Add bytes count metrics to datanode for

[jira] [Assigned] (HDFS-8411) Add bytes count metrics to datanode for ECWorker

2016-10-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-8411: --- Assignee: SammiChen (was: Li Bo) > Add bytes count metrics to datanode for ECWorker >

[jira] [Updated] (HDFS-11033) Add documents for native raw eraure coder in XOR codes

2016-10-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11033: - Description: Add document for native raw erasure coder in XOR codes. > Add documents for native raw

[jira] [Updated] (HDFS-11033) Add documents for native raw erasure coder in XOR codes

2016-10-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11033: - Summary: Add documents for native raw erasure coder in XOR codes (was: Add documents for native raw

[jira] [Updated] (HDFS-11033) Add documents for native raw eraure coder in XOR codes

2016-10-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11033: - Attachment: HDFS-11033-v1.patch Initial patch > Add documents for native raw eraure coder in XOR codes >

[jira] [Created] (HDFS-11033) Add documents for native raw eraure coder in XOR codes

2016-10-19 Thread SammiChen (JIRA)
SammiChen created HDFS-11033: Summary: Add documents for native raw eraure coder in XOR codes Key: HDFS-11033 URL: https://issues.apache.org/jira/browse/HDFS-11033 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-8410) Add computation time metrics to datanode for ECWorker

2016-10-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587987#comment-15587987 ] SammiChen commented on HDFS-8410: - Thanks Andrew, for taking time review the patch and give detail

[jira] [Updated] (HDFS-8410) Add computation time metrics to datanode for ECWorker

2016-10-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8410: Attachment: HDFS-8410-004.patch > Add computation time metrics to datanode for ECWorker >

[jira] [Updated] (HDFS-8410) Add computation time metrics to datanode for ECWorker

2016-10-17 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8410: Status: Patch Available (was: Open) > Add computation time metrics to datanode for ECWorker >

[jira] [Updated] (HDFS-8410) Add computation time metrics to datanode for ECWorker

2016-10-17 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8410: Attachment: HDFS-8410-003.patch 1. Rebase patch against trunk 2. Improve test function > Add computation

[jira] [Assigned] (HDFS-8410) Add computation time metrics to datanode for ECWorker

2016-10-17 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-8410: --- Assignee: SammiChen (was: Li Bo) > Add computation time metrics to datanode for ECWorker >

[jira] [Commented] (HDFS-7674) [umbrella] Adding metrics for Erasure Coding

2016-10-17 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584117#comment-15584117 ] SammiChen commented on HDFS-7674: - Hi Andrew, it seems these tasks cannot be closed so far. I will take

[jira] [Commented] (HDFS-10935) TestFileChecksum tests are failing after HDFS-10460 (Mac only?)

2016-10-17 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15581508#comment-15581508 ] SammiChen commented on HDFS-10935: -- Don't worry! I am doing investigation using Kai's environment since

[jira] [Updated] (HDFS-10994) Support an XOR policy XOR-2-1-64k in HDFS

2016-10-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10994: - Attachment: HDFS-10994-v2.patch 1. Fixed most of styles issue. The left are filed name pattern

[jira] [Updated] (HDFS-10926) Erasure coding background recovery work configuration parameters names are stale in HDFSErasureCoding doc

2016-10-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10926: - Status: Patch Available (was: Open) > Erasure coding background recovery work configuration parameters

[jira] [Updated] (HDFS-10926) Erasure coding background recovery work configuration parameters names are stale in HDFSErasureCoding doc

2016-10-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10926: - Attachment: HDFS-10926-v1.patch Initial patch > Erasure coding background recovery work configuration

[jira] [Updated] (HDFS-10994) Support an XOR policy XOR-2-1-64k in HDFS

2016-10-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10994: - Attachment: HDFS-10994-v1.patch Initial patch > Support an XOR policy XOR-2-1-64k in HDFS >

[jira] [Updated] (HDFS-10994) Support an XOR policy XOR-2-1-64k in HDFS

2016-10-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10994: - Status: Patch Available (was: Open) > Support an XOR policy XOR-2-1-64k in HDFS >

[jira] [Updated] (HDFS-10994) Support an XOR policy XOR-2-1-64k in HDFS

2016-10-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10994: - Summary: Support an XOR policy XOR-2-1-64k in HDFS (was: Support an XOR policy in HDFS) > Support an

[jira] [Commented] (HDFS-10996) Ability to specify per-file EC policy at create time

2016-10-13 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571012#comment-15571012 ] SammiChen commented on HDFS-10996: -- Hi [~andrew.wang], I'd like to take this task if you don't mind. >

[jira] [Commented] (HDFS-10935) TestFileChecksum tests are failing after HDFS-10460 (Mac only?)

2016-10-13 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571000#comment-15571000 ] SammiChen commented on HDFS-10935: -- Hi Wei-CHiu, I'd like to know how you launch the TestFileChecksum

[jira] [Commented] (HDFS-10935) TestFileChecksum tests are failing after HDFS-10460 (Mac only?)

2016-10-13 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570992#comment-15570992 ] SammiChen commented on HDFS-10935: -- Hi Wei-Chiu Chuang, "java.lang.OutOfMemoryError" indicate that JVM

[jira] [Commented] (HDFS-10935) TestFileChecksum tests are failing after HDFS-10460 (Mac only?)

2016-10-12 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567858#comment-15567858 ] SammiChen commented on HDFS-10935: -- TestFileChecksum tests all passed on my Linux server. My JDK is

[jira] [Commented] (HDFS-10935) TestFileChecksum tests are failing after HDFS-10460 (Mac only?)

2016-10-12 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567791#comment-15567791 ] SammiChen commented on HDFS-10935: -- Hi, Kai, sure, I will look into it. > TestFileChecksum tests are

[jira] [Assigned] (HDFS-10935) TestFileChecksum tests are failing after HDFS-10460 (Mac only?)

2016-10-12 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-10935: Assignee: SammiChen > TestFileChecksum tests are failing after HDFS-10460 (Mac only?) >

[jira] [Created] (HDFS-10994) Support "XOR-2-1-64k" policy in "hdfs erasurecode" command

2016-10-10 Thread SammiChen (JIRA)
SammiChen created HDFS-10994: Summary: Support "XOR-2-1-64k" policy in "hdfs erasurecode" command Key: HDFS-10994 URL: https://issues.apache.org/jira/browse/HDFS-10994 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-10926) Erasure coding background recovery work configuration parameters names are stale in HDFSErasureCoding doc

2016-10-10 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10926: - Summary: Erasure coding background recovery work configuration parameters names are stale in

[jira] [Updated] (HDFS-10926) Erasure coding background recovery work configuration parameters name is stale in HDFSErasureCoding doc

2016-10-10 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10926: - Summary: Erasure coding background recovery work configuration parameters name is stale in

[jira] [Updated] (HDFS-10895) Update HDFS Erasure Coding doc to add how to use ISA-L based coder

2016-10-09 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10895: - Attachment: HDFS-10895-v5.patch Improve the patch after offline discussion with Kai. > Update HDFS

[jira] [Issue Comment Deleted] (HDFS-10910) HDFS Erasure Coding doc should state its currently supported erasure coding policies

2016-10-09 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10910: - Comment: was deleted (was: Holiday from Oct. 1 to Oct. 7, please expect no response. Thanks. ) > HDFS

[jira] [Updated] (HDFS-10895) Update HDFS Erasure Coding document about how to enable ISA-L library for erasure code codec

2016-10-09 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10895: - Attachment: HDFS-10895-v4.patch remove whitespaces > Update HDFS Erasure Coding document about how to

[jira] [Updated] (HDFS-10895) Update HDFS Erasure Coding document about how to enable ISA-L library for erasure code codec

2016-10-09 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10895: - Attachment: HDFS-10895-v3.patch Improve the document by leverage "Build instructions for

[jira] [Updated] (HDFS-10895) Update HDFS Erasure Coding document about how to enable ISA-L library for erasure code codec

2016-10-08 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10895: - Attachment: HDFS-10895-v2.patch Rebase patch against latest trunk doc > Update HDFS Erasure Coding

[jira] [Commented] (HDFS-10910) HDFS Erasure Coding doc should state its currently supported erasure coding policies

2016-09-30 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537537#comment-15537537 ] SammiChen commented on HDFS-10910: -- Holiday from Oct. 1 to Oct. 7, please expect no response. Thanks.

[jira] [Updated] (HDFS-10926) Erasure coding background recovery work configuration parameters name is stale in ErasureCode doc

2016-09-29 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10926: - Description: The Erasure coding background recovery work configuration parameter names are stale in doc.

[jira] [Updated] (HDFS-10926) Erasure coding background recovery work configuration parameters name is stale in ErasureCode doc

2016-09-29 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10926: - Description: The Erasure coding background recovery work configuration parameter names are stale in doc.

[jira] [Created] (HDFS-10926) Erasure coding background recovery work configuration parameters name is stale in ErasureCode doc

2016-09-29 Thread SammiChen (JIRA)
SammiChen created HDFS-10926: Summary: Erasure coding background recovery work configuration parameters name is stale in ErasureCode doc Key: HDFS-10926 URL: https://issues.apache.org/jira/browse/HDFS-10926

[jira] [Assigned] (HDFS-10926) Erasure coding background recovery work configuration parameters name is stale in ErasureCode doc

2016-09-29 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-10926: Assignee: SammiChen > Erasure coding background recovery work configuration parameters name is >

[jira] [Commented] (HDFS-10910) HDFS Erasure Coding doc should state its currently supported erasure coding policies

2016-09-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531781#comment-15531781 ] SammiChen commented on HDFS-10910: -- Thanks Yiqun for update the patch. The v2 patch seems good to me. >

[jira] [Updated] (HDFS-10895) Update HDFS Erasure Coding document about how to enable ISA-L library for erasure code codec

2016-09-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10895: - Status: Patch Available (was: Open) > Update HDFS Erasure Coding document about how to enable ISA-L

[jira] [Updated] (HDFS-10895) Update HDFS Erasure Coding document about how to enable ISA-L library for erasure code codec

2016-09-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10895: - Attachment: HDFS-10895-v1.patch Initial patch > Update HDFS Erasure Coding document about how to enable

[jira] [Commented] (HDFS-10910) HDFS Erasure Coding doc should state its currently supported erasure coding policies

2016-09-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15528702#comment-15528702 ] SammiChen commented on HDFS-10910: -- It's great to add currently supported erasure coding policies in the

[jira] [Created] (HDFS-10895) Update HDFS Erasure Coding document about how to enable ISA-L library for erasure code codec

2016-09-23 Thread SammiChen (JIRA)
SammiChen created HDFS-10895: Summary: Update HDFS Erasure Coding document about how to enable ISA-L library for erasure code codec Key: HDFS-10895 URL: https://issues.apache.org/jira/browse/HDFS-10895

[jira] [Commented] (HDFS-10861) Refactor StripeReaders and use ECChunk version decode API

2016-09-20 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508390#comment-15508390 ] SammiChen commented on HDFS-10861: -- Thanks Kai for take time review the patch and commit it! > Refactor

[jira] [Commented] (HDFS-10861) Refactor StripeReaders and use ECChunk version decode API

2016-09-20 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505957#comment-15505957 ] SammiChen commented on HDFS-10861: -- Hadoop QA run the test with the old v5 patch > Refactor

[jira] [Updated] (HDFS-10861) Refactor StripeReaders and use ECChunk version decode API

2016-09-20 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10861: - Attachment: HDFS-10861-v6.patch Resubmit patch v6 to trigger Hadoop QA run the test against v6 >

[jira] [Updated] (HDFS-10861) Refactor StripeReaders and use ECChunk version decode API

2016-09-20 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10861: - Attachment: (was: HDFS-10861-v6.patch) > Refactor StripeReaders and use ECChunk version decode API >

[jira] [Updated] (HDFS-10861) Refactor StripeReaders and use ECChunk version decode API

2016-09-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10861: - Attachment: HDFS-10861-v6.patch The broken link in {{StripedBlockUtil}} is also fixed. > Refactor

[jira] [Updated] (HDFS-10861) Refactor StripeReaders and use ECChunk version decode API

2016-09-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10861: - Attachment: (was: HDFS-10861-v6.patch) > Refactor StripeReaders and use ECChunk version decode API >

[jira] [Updated] (HDFS-10861) Refactor StripeReaders and use ECChunk version decode API

2016-09-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10861: - Attachment: HDFS-10861-v6.patch Fix 2 failed test cases > Refactor StripeReaders and use ECChunk version

[jira] [Updated] (HDFS-10861) Refactor StripeReaders and use ECChunk version decode API

2016-09-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10861: - Attachment: HDFS-10861-v5.patch Update the patch, 1. fix 1 code style 2. refine code, import protected

[jira] [Updated] (HDFS-10861) Refactor StripeReaders and use ECChunk version decode API

2016-09-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10861: - Attachment: HDFS-10861-v4.patch After discussion with Kai, I re-factored the patch. Here is the

[jira] [Updated] (HDFS-10861) Refactor StripeReaders and use ECChunk version decode API

2016-09-18 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10861: - Attachment: HDFS-10861-v3.patch extract StripeReader from DfsStripedInputStream class > Refactor

[jira] [Updated] (HDFS-10861) Refactor StatefulStripeReader and PositionStripeReader, use ECChunk version decode API

2016-09-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10861: - Attachment: HDFS-10861-v2.patch Fixed 3 checkstyle issues. Other 2 checkstyle issues are not necessary.

[jira] [Commented] (HDFS-8957) Consolidate client striping input stream codes for stateful read and positional read

2016-09-13 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489137#comment-15489137 ] SammiChen commented on HDFS-8957: - For easy review, I created " HDFS-10861 Refactor StatefulStripeReader

[jira] [Updated] (HDFS-10861) Refactor StatefulStripeReader and PositionStripeReader, use ECChunk version decode API

2016-09-13 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10861: - Attachment: HDFS-10861-v1.patch > Refactor StatefulStripeReader and PositionStripeReader, use ECChunk

[jira] [Updated] (HDFS-10861) Refactor StatefulStripeReader and PositionStripeReader, use ECChunk version decode API

2016-09-13 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10861: - Status: Patch Available (was: Open) > Refactor StatefulStripeReader and PositionStripeReader, use

[jira] [Created] (HDFS-10861) Refactor StatefulStripeReader and PositionStripeReader, use ECChunk version decode API

2016-09-13 Thread SammiChen (JIRA)
SammiChen created HDFS-10861: Summary: Refactor StatefulStripeReader and PositionStripeReader, use ECChunk version decode API Key: HDFS-10861 URL: https://issues.apache.org/jira/browse/HDFS-10861

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

2016-09-08 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15475782#comment-15475782 ] SammiChen commented on HDFS-8901: - Thanks Zhe for contribute so much effort to review the patch and give

[jira] [Commented] (HDFS-10844) test_libhdfs_threaded_hdfs_static and test_libhdfs_zerocopy_hdfs_static are failing

2016-09-08 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15473572#comment-15473572 ] SammiChen commented on HDFS-10844: -- Thanks Akira Ajisaka and Allen Wittenauer for all the effort to

[jira] [Issue Comment Deleted] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

2016-09-08 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8905: Comment: was deleted (was: Thanks, Akira Ajisaka! Sure, I will look into it.) > Refactor

[jira] [Commented] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

2016-09-08 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15473070#comment-15473070 ] SammiChen commented on HDFS-8905: - Thanks, Akira Ajisaka! Sure, I will look into it. > Refactor

[jira] [Commented] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

2016-09-08 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15473069#comment-15473069 ] SammiChen commented on HDFS-8905: - Thanks, Akira Ajisaka! Sure, I will look into it. > Refactor

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

2016-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466024#comment-15466024 ] SammiChen commented on HDFS-8901: - 1. Run {{hadoop.net.TestDNS}} locally, it passed without any failure.

[jira] [Updated] (HDFS-8901) Use ByteBuffer in striping positional read

2016-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8901: Attachment: HDFS-8901-v20.patch 1. remove "//buffer.position(buffer.position() + bytesToRead)" 2. use

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

2016-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464454#comment-15464454 ] SammiChen commented on HDFS-8901: - Thanks Zhe! Thanks Kai! bq. Why do we need to flip? In the previous

[jira] [Updated] (HDFS-10839) Add new BlockReader#readAll(ByteBuffer buf, int len) API

2016-09-04 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10839: - Description: Add a ByteBuffer version readAll API in BlockReader interface, to facilitate read data from

[jira] [Updated] (HDFS-10839) Add new BlockReaderl#readAll(ByteBuffer buf, int len) API

2016-09-04 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10839: - Status: Patch Available (was: Open) > Add new BlockReaderl#readAll(ByteBuffer buf, int len) API >

[jira] [Updated] (HDFS-10839) Add new BlockReaderl#readAll(ByteBuffer buf, int len) API

2016-09-04 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10839: - Status: Open (was: Patch Available) > Add new BlockReaderl#readAll(ByteBuffer buf, int len) API >

[jira] [Updated] (HDFS-10839) Add new BlockReaderl#readAll(ByteBuffer buf, int len) API

2016-09-04 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10839: - Attachment: HDFS-10839-v1.patch > Add new BlockReaderl#readAll(ByteBuffer buf, int len) API >

[jira] [Updated] (HDFS-10839) Add new BlockReaderl#readAll(ByteBuffer buf, int len) API

2016-09-04 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10839: - Attachment: (was: HDFS-10839-v1.patch) > Add new BlockReaderl#readAll(ByteBuffer buf, int len) API >

[jira] [Updated] (HDFS-10839) Add new BlockReaderl#readAll(ByteBuffer buf, int len) API

2016-09-04 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10839: - Status: Patch Available (was: Open) > Add new BlockReaderl#readAll(ByteBuffer buf, int len) API >

[jira] [Updated] (HDFS-10839) Add new BlockReaderl#readAll(ByteBuffer buf, int len) API

2016-09-04 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10839: - Attachment: HDFS-10839-v1.patch implement the new readAll API > Add new BlockReaderl#readAll(ByteBuffer

<    1   2   3   4   5   6   7   >