[jira] [Assigned] (HDFS-11647) Add -E option in hdfs "count" command to show erasure policy summarization

[ https://issues.apache.org/jira/browse/HDFS-11647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-11647: Assignee: SammiChen > Add -E option in hdfs "count" command to show erasure policy summarization >

[jira] [Assigned] (HDFS-11646) Add -E option in 'ls' to list erasure coding policy of each file and directory if applicable

[ https://issues.apache.org/jira/browse/HDFS-11646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-11646: Assignee: SammiChen > Add -E option in 'ls' to list erasure coding policy of each file and > direc

[jira] [Updated] (HDFS-11646) Add -E option in 'ls' to list erasure coding policy of each file and directory if applicable

[ https://issues.apache.org/jira/browse/HDFS-11646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11646: - Labels: hdfs-ec-3.0-nice-to-have (was: ) > Add -E option in 'ls' to list erasure coding policy of each fi

[jira] [Updated] (HDFS-11646) Add -E option in 'ls' to list erasure coding policy of each file and directory if applicable

[ https://issues.apache.org/jira/browse/HDFS-11646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11646: - Tags: (was: hdfs-ec-3.0-nice-to-have) > Add -E option in 'ls' to list erasure coding policy of each file

[jira] [Commented] (HDFS-10531) Add EC policy and storage policy related usage summarization function to dfs du command

[ https://issues.apache.org/jira/browse/HDFS-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15965638#comment-15965638 ] SammiChen commented on HDFS-10531: -- Thanks [~andrew.wang] for your thoughts! Created HDF

[jira] [Created] (HDFS-11647) Add -E option in hdfs "count" command to show erasure policy summarization

SammiChen created HDFS-11647: Summary: Add -E option in hdfs "count" command to show erasure policy summarization Key: HDFS-11647 URL: https://issues.apache.org/jira/browse/HDFS-11647 Project: Hadoop HDFS

[jira] [Created] (HDFS-11646) Add -E option in 'ls' to list erasure coding policy of each file and directory if applicable

SammiChen created HDFS-11646: Summary: Add -E option in 'ls' to list erasure coding policy of each file and directory if applicable Key: HDFS-11646 URL: https://issues.apache.org/jira/browse/HDFS-11646 Pr

[jira] [Updated] (HDFS-10996) Ability to specify per-file EC policy at create time

[ https://issues.apache.org/jira/browse/HDFS-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10996: - Attachment: HDFS-10996-v6.patch Thanks Andrew for review the patch! A new version is uploaded. > Abilit

[jira] [Updated] (HDFS-11604) Define and parse erasure code codecs, schemas and policies

[ https://issues.apache.org/jira/browse/HDFS-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11604: - Status: Patch Available (was: Open) > Define and parse erasure code codecs, schemas and policies > --

[jira] [Commented] (HDFS-11643) Balancer fencing fails when writing erasure coded lock file

[ https://issues.apache.org/jira/browse/HDFS-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15965269#comment-15965269 ] SammiChen commented on HDFS-11643: -- Hi [~andrew.wang], yea, we need face this a "replicat

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964172#comment-15964172 ] SammiChen commented on HDFS-7337: - For remove policy, one suggestion is the lazy remove. Th

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15963957#comment-15963957 ] SammiChen commented on HDFS-7859: - This JIRA will focus on persist erasure coding policies

[jira] [Assigned] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-7859: --- Assignee: SammiChen > Erasure Coding: Persist erasure coding policies in NameNode > --

[jira] [Updated] (HDFS-11604) Define and parse erasure code codecs, schemas and policies

[ https://issues.apache.org/jira/browse/HDFS-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11604: - Attachment: ec-policy-config-sample-v2.xml 1. ADD comments 2. ADD field 'options' > Define and parse era

[jira] [Updated] (HDFS-9342) Erasure coding: client should update and commit block based on acknowledged size

[ https://issues.apache.org/jira/browse/HDFS-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-9342: Status: Patch Available (was: Open) > Erasure coding: client should update and commit block based on acknowl

[jira] [Updated] (HDFS-9342) Erasure coding: client should update and commit block based on acknowledged size

[ https://issues.apache.org/jira/browse/HDFS-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-9342: Attachment: HDFS-9342.04.patch Refine the v3 patch > Erasure coding: client should update and commit block b

[jira] [Commented] (HDFS-10531) Add EC policy and storage policy related usage summarization function to dfs du command

[ https://issues.apache.org/jira/browse/HDFS-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956441#comment-15956441 ] SammiChen commented on HDFS-10531: -- bq. If instead we want some way of printing out the E

[jira] [Commented] (HDFS-11604) Define and parse erasure code codecs, schemas and policies

[ https://issues.apache.org/jira/browse/HDFS-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15951943#comment-15951943 ] SammiChen commented on HDFS-11604: -- Thanks Kai for the comments! bq. We need a header as

[jira] [Comment Edited] (HDFS-11604) Define and parse erasure code codecs, schemas and policies

[ https://issues.apache.org/jira/browse/HDFS-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15950632#comment-15950632 ] SammiChen edited comment on HDFS-11604 at 3/31/17 10:05 AM: I

[jira] [Updated] (HDFS-11604) Define and parse erasure code codecs, schemas and policies

[ https://issues.apache.org/jira/browse/HDFS-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11604: - Attachment: ec-config-sample.xml I drafted a sample erasure coding schema and policy configuration file. A

[jira] [Assigned] (HDFS-10531) Add EC policy and storage policy related usage summarization function to dfs du command

[ https://issues.apache.org/jira/browse/HDFS-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-10531: Assignee: SammiChen (was: Wei-Chiu Chuang) > Add EC policy and storage policy related usage summar

[jira] [Commented] (HDFS-10531) Add EC policy and storage policy related usage summarization function to dfs du command

[ https://issues.apache.org/jira/browse/HDFS-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15950430#comment-15950430 ] SammiChen commented on HDFS-10531: -- Reassign the task after offline discussed with Andrew

[jira] [Commented] (HDFS-9822) Erasure Coding: Avoids scheduling multiple reconstruction tasks for a striped block at the same time

[ https://issues.apache.org/jira/browse/HDFS-9822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15950376#comment-15950376 ] SammiChen commented on HDFS-9822: - Hi [~rakeshr], do you have plan to continue working on i

[jira] [Assigned] (HDFS-10848) Move hadoop-hdfs-native-client module into hadoop-hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-10848: Assignee: Huafeng Wang > Move hadoop-hdfs-native-client module into hadoop-hdfs-client > --

[jira] [Commented] (HDFS-10996) Ability to specify per-file EC policy at create time

[ https://issues.apache.org/jira/browse/HDFS-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15948469#comment-15948469 ] SammiChen commented on HDFS-10996: -- Thanks [~andrew.wang] for very detail suggestion! I

[jira] [Comment Edited] (HDFS-10996) Ability to specify per-file EC policy at create time

[ https://issues.apache.org/jira/browse/HDFS-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15948469#comment-15948469 ] SammiChen edited comment on HDFS-10996 at 3/30/17 6:00 AM: --- Than

[jira] [Updated] (HDFS-10996) Ability to specify per-file EC policy at create time

[ https://issues.apache.org/jira/browse/HDFS-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10996: - Attachment: HDFS-10996-v5.patch > Ability to specify per-file EC policy at create time > -

[jira] [Commented] (HDFS-10996) Ability to specify per-file EC policy at create time

[ https://issues.apache.org/jira/browse/HDFS-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15948476#comment-15948476 ] SammiChen commented on HDFS-10996: -- HDFS-11595 is created for clean up all the create() o

[jira] [Commented] (HDFS-10848) Move hadoop-hdfs-native-client module into hadoop-hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15948293#comment-15948293 ] SammiChen commented on HDFS-10848: -- Hi Andrew, OK, will look into this one together. >

[jira] [Created] (HDFS-11595) Clean up all the create() overloads in DFSClient

SammiChen created HDFS-11595: Summary: Clean up all the create() overloads in DFSClient Key: HDFS-11595 URL: https://issues.apache.org/jira/browse/HDFS-11595 Project: Hadoop HDFS Issue Type: Impr

[jira] [Updated] (HDFS-10996) Ability to specify per-file EC policy at create time

[ https://issues.apache.org/jira/browse/HDFS-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10996: - Attachment: HDFS-10996-v4.patch Rebase v3 against latest trunk and get v4 > Ability to specify per-file E

[jira] [Commented] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15946663#comment-15946663 ] SammiChen commented on HDFS-9705: - Thanks Andrew and Kai for reviewing the patch! > Refine

[jira] [Commented] (HDFS-11541) Call RawErasureEncoder and RawErasureDecoder release() methods

[ https://issues.apache.org/jira/browse/HDFS-11541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15946662#comment-15946662 ] SammiChen commented on HDFS-11541: -- Thanks [~rakeshr] for review and commit the patch! T

[jira] [Updated] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-9705: Attachment: HDFS-9705-branch-2.002.patch fix one style issue > Refine the behaviour of getFileChecksum when

[jira] [Commented] (HDFS-11541) Call RawErasureEncoder and RawErasureDecoder release() methods

[ https://issues.apache.org/jira/browse/HDFS-11541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15944616#comment-15944616 ] SammiChen commented on HDFS-11541: -- Thanks [~rakeshr] ! Uploaded a new patch! > Call R

[jira] [Updated] (HDFS-11541) Call RawErasureEncoder and RawErasureDecoder release() methods

[ https://issues.apache.org/jira/browse/HDFS-11541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11541: - Attachment: HDFS-11541-03.patch > Call RawErasureEncoder and RawErasureDecoder release() methods > ---

[jira] [Updated] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-9705: Attachment: HDFS-9705-branch-2.001.patch Patch for back port to branch-2 > Refine the behaviour of getFileCh

[jira] [Reopened] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reopened HDFS-9705: - Assignee: SammiChen (was: Kai Zheng) Reopen issue for back port to branch-2 > Refine the behaviour of g

[jira] [Updated] (HDFS-11170) Add builder-based create API to FileSystem

[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11170: - Attachment: HDFS-11170-branch-2.001.patch Patch for branch-2 > Add builder-based create API to FileSystem

[jira] [Commented] (HDFS-11170) Add builder-based create API to FileSystem

[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15942514#comment-15942514 ] SammiChen commented on HDFS-11170: -- Thanks Andrew for review and commit the patch! Sure,

[jira] [Commented] (HDFS-11541) Call RawErasureEncoder and RawErasureDecoder release() methods

[ https://issues.apache.org/jira/browse/HDFS-11541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15940031#comment-15940031 ] SammiChen commented on HDFS-11541: -- Thanks [~rakeshr] for the quick review! I will uploa

[jira] [Updated] (HDFS-11541) Call RawErasureEncoder and RawErasureDecoder release() methods

[ https://issues.apache.org/jira/browse/HDFS-11541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11541: - Attachment: HDFS-11541-02.patch > Call RawErasureEncoder and RawErasureDecoder release() methods > ---

[jira] [Updated] (HDFS-11541) Call RawErasureEncoder and RawErasureDecoder release() methods

[ https://issues.apache.org/jira/browse/HDFS-11541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11541: - Attachment: (was: HDFS-11541-02.patch) > Call RawErasureEncoder and RawErasureDecoder release() method

[jira] [Updated] (HDFS-11541) Call RawErasureEncoder and RawErasureDecoder release() methods

[ https://issues.apache.org/jira/browse/HDFS-11541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11541: - Attachment: HDFS-11541-02.patch > Call RawErasureEncoder and RawErasureDecoder release() methods > ---

[jira] [Assigned] (HDFS-11538) Move ConfiguredFailoverProxyProvider into hadoop-hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-11538: Assignee: SammiChen > Move ConfiguredFailoverProxyProvider into hadoop-hdfs-client > --

[jira] [Commented] (HDFS-11541) Call RawErasureEncoder and RawErasureDecoder release() methods

[ https://issues.apache.org/jira/browse/HDFS-11541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15939930#comment-15939930 ] SammiChen commented on HDFS-11541: -- Hi [~rakeshr], do you mind of taking a look at this p

[jira] [Updated] (HDFS-11541) Call RawErasureEncoder and RawErasureDecoder release() methods

[ https://issues.apache.org/jira/browse/HDFS-11541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11541: - Status: Patch Available (was: Open) > Call RawErasureEncoder and RawErasureDecoder release() methods > --

[jira] [Updated] (HDFS-11541) Call RawErasureEncoder and RawErasureDecoder release() methods

[ https://issues.apache.org/jira/browse/HDFS-11541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11541: - Attachment: HDFS-11541-01.patch Initial patch > Call RawErasureEncoder and RawErasureDecoder release() me

[jira] [Commented] (HDFS-9345) Erasure Coding: create dummy coder and schema

[ https://issues.apache.org/jira/browse/HDFS-9345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15939854#comment-15939854 ] SammiChen commented on HDFS-9345: - Some thoughts so far. The motivation of this JIRA is to

[jira] [Updated] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11170: - Attachment: HDFS-11170-08.patch > Add create API in filesystem public class to support assign parameter th

[jira] [Comment Edited] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15939584#comment-15939584 ] SammiChen edited comment on HDFS-11170 at 3/24/17 2:28 AM: --- Hi A

[jira] [Commented] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15939584#comment-15939584 ] SammiChen commented on HDFS-11170: -- Hi Andrew, thanks for the comments! I will refine th

[jira] [Updated] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11170: - Attachment: HDFS-11170-07.patch Address firebug issue > Add create API in filesystem public class to supp

[jira] [Updated] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11170: - Attachment: HDFS-11170-06.patch > Add create API in filesystem public class to support assign parameter th

[jira] [Commented] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15937788#comment-15937788 ] SammiChen commented on HDFS-11170: -- Thanks Andrew for the comments. I will upload a new

[jira] [Updated] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11170: - Attachment: (was: HDFS-11170-05.patch) > Add create API in filesystem public class to support assign p

[jira] [Commented] (HDFS-11541) Call RawErasureEncoder and RawErasureDecoder release() methods

[ https://issues.apache.org/jira/browse/HDFS-11541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15934030#comment-15934030 ] SammiChen commented on HDFS-11541: -- Hi Nagy, thanks for report this! If you don't mind I

[jira] [Commented] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15932564#comment-15932564 ] SammiChen commented on HDFS-11170: -- Hi [~andrew.wang], do you mind take a look at the new

[jira] [Updated] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11170: - Attachment: HDFS-11170-04.patch > Add create API in filesystem public class to support assign parameter th

[jira] [Commented] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15929647#comment-15929647 ] SammiChen commented on HDFS-11170: -- Thanks [~andrew.wang], [~xiaobingo] and stack for you

[jira] [Commented] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15925466#comment-15925466 ] SammiChen commented on HDFS-11170: -- A new patch uploaded. Javadoc issue and two failed un

[jira] [Updated] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11170: - Attachment: HDFS-11170-03.patch > Add create API in filesystem public class to support assign parameter th

[jira] [Comment Edited] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15925405#comment-15925405 ] SammiChen edited comment on HDFS-9705 at 3/15/17 2:43 AM: -- Thanks

[jira] [Commented] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15925405#comment-15925405 ] SammiChen commented on HDFS-9705: - Thanks Andrew for review and commit the patch! As for b

[jira] [Updated] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11170: - Attachment: HDFS-11170-02.patch > Add create API in filesystem public class to support assign parameter th

[jira] [Commented] (HDFS-11170) Add create API in filesystem public class to support assign parameter through builder

[ https://issues.apache.org/jira/browse/HDFS-11170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15923376#comment-15923376 ] SammiChen commented on HDFS-11170: -- I will pick it up and continue the work. > Add crea

[jira] [Commented] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906784#comment-15906784 ] SammiChen commented on HDFS-9705: - Thanks [~andrew.wang] for trigger the build. I have doub

[jira] [Commented] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15904824#comment-15904824 ] SammiChen commented on HDFS-9705: - Hi [~andrew.wang], would you please help to trigger a Je

[jira] [Updated] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-9705: Attachment: (was: HDFS-9705-v7.patch) > Refine the behaviour of getFileChecksum when length = 0 > ---

[jira] [Updated] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-9705: Attachment: HDFS-9705-v7.patch re-upload the patch to trigger the Jenkins build > Refine the behaviour of ge

[jira] [Commented] (HDFS-11152) Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors

[ https://issues.apache.org/jira/browse/HDFS-11152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15901148#comment-15901148 ] SammiChen commented on HDFS-11152: -- Thanks [~jojochuang] for the feedback. I uploaded a n

[jira] [Updated] (HDFS-11152) Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors

[ https://issues.apache.org/jira/browse/HDFS-11152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11152: - Attachment: HDFS-11152-v4.patch > Start erasure coding policy ID number from 1 instead of 0 to void potent

[jira] [Commented] (HDFS-11183) Document XOR policy XOR-2-1-64k support in HDFS

[ https://issues.apache.org/jira/browse/HDFS-11183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898856#comment-15898856 ] SammiChen commented on HDFS-11183: -- Hi, [~andrew.wang], I see you have mentioned XOR-2-1-

[jira] [Updated] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-9705: Attachment: HDFS-9705-v7.patch The previous comment is kind of misleading. When the crcType is "NULL" which

[jira] [Comment Edited] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898838#comment-15898838 ] SammiChen edited comment on HDFS-9705 at 3/7/17 6:45 AM: - The previ

[jira] [Comment Edited] (HDFS-11152) Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors

[ https://issues.apache.org/jira/browse/HDFS-11152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15897120#comment-15897120 ] SammiChen edited comment on HDFS-11152 at 3/6/17 11:30 AM: --- Hi [

[jira] [Commented] (HDFS-11152) Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors

[ https://issues.apache.org/jira/browse/HDFS-11152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15897120#comment-15897120 ] SammiChen commented on HDFS-11152: -- Hi [Wei-Chiu Chuang], thanks for review the patch!

[jira] [Updated] (HDFS-11152) Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors

[ https://issues.apache.org/jira/browse/HDFS-11152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11152: - Attachment: HDFS-11152-v3.patch > Start erasure coding policy ID number from 1 instead of 0 to void potent

[jira] [Commented] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896823#comment-15896823 ] SammiChen commented on HDFS-9705: - Hi [~andrew.wang], I uploaded a new patch to add the che

[jira] [Updated] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-9705: Attachment: HDFS-9705-v6.patch > Refine the behaviour of getFileChecksum when length = 0 > --

[jira] [Updated] (HDFS-11152) Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors

[ https://issues.apache.org/jira/browse/HDFS-11152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11152: - Attachment: HDFS-11152-v2.patch 1. Add EC policy ID check when loading file from fsImage 2. Add EC policy

[jira] [Commented] (HDFS-11268) Correctly reconstruct erasure coding file from FSImage

[ https://issues.apache.org/jira/browse/HDFS-11268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15831073#comment-15831073 ] SammiChen commented on HDFS-11268: -- Thanks Andrew! > Correctly reconstruct erasure codin

[jira] [Commented] (HDFS-11152) Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors

[ https://issues.apache.org/jira/browse/HDFS-11152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15829676#comment-15829676 ] SammiChen commented on HDFS-11152: -- Hi [~andrew.wang]] I did some investigation. It seems

[jira] [Comment Edited] (HDFS-11268) Correctly reconstruct erasure coding file from FSImage

[ https://issues.apache.org/jira/browse/HDFS-11268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15829394#comment-15829394 ] SammiChen edited comment on HDFS-11268 at 1/19/17 6:31 AM: --- Hi [

[jira] [Updated] (HDFS-11268) Correctly reconstruct erasure coding file from FSImage

[ https://issues.apache.org/jira/browse/HDFS-11268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11268: - Attachment: HDFS-11268-002.patch Hi [~andrew.wang]], thanks for reviewing the patch! I rebased it. > Cor

[jira] [Commented] (HDFS-11268) Correctly reconstruct erasure coding file from FSImage

[ https://issues.apache.org/jira/browse/HDFS-11268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15823810#comment-15823810 ] SammiChen commented on HDFS-11268: -- Hi [~jojochuang]], you're right, EC policy ID is stor

[jira] [Updated] (HDFS-11268) Correctly reconstruct erasure coding file from FSImage

[ https://issues.apache.org/jira/browse/HDFS-11268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11268: - Status: Patch Available (was: Open) > Correctly reconstruct erasure coding file from FSImage > --

[jira] [Updated] (HDFS-11268) Correctly reconstruct erasure coding file from FSImage

[ https://issues.apache.org/jira/browse/HDFS-11268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11268: - Attachment: HDFS-11268-001.patch Initial patch > Correctly reconstruct erasure coding file from FSImage >

[jira] [Updated] (HDFS-11268) Correctly reconstruct erasure coding file from FSImage

[ https://issues.apache.org/jira/browse/HDFS-11268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11268: - Description: Currently, FSImageFormatProtoBuf has the information about whether the file is striped or not

[jira] [Updated] (HDFS-11268) Correctly reconstruct erasure coding file from FSImage

[ https://issues.apache.org/jira/browse/HDFS-11268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11268: - Summary: Correctly reconstruct erasure coding file from FSImage (was: Persist erasure coding policy ID in

[jira] [Commented] (HDFS-11314) Validate client-provided EC schema on the NameNode

[ https://issues.apache.org/jira/browse/HDFS-11314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15823012#comment-15823012 ] SammiChen commented on HDFS-11314: -- So if a user sets an EC policy on a directory/file, N

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816856#comment-15816856 ] SammiChen commented on HDFS-11072: -- Thanks Andrew, for all the reviewing efforts and comm

[jira] [Commented] (HDFS-11268) Persist erasure coding policy ID in FSImage

[ https://issues.apache.org/jira/browse/HDFS-11268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816774#comment-15816774 ] SammiChen commented on HDFS-11268: -- Hi [~andrew.wang], I'am working on it. Will give an u

[jira] [Comment Edited] (HDFS-11072) Add ability to unset and change directory EC policy

[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15814020#comment-15814020 ] SammiChen edited comment on HDFS-11072 at 1/10/17 6:08 AM: --- Than

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15814020#comment-15814020 ] SammiChen commented on HDFS-11072: -- Thanks [~andrew.wang] ! I agree with the general com

[jira] [Updated] (HDFS-11072) Add ability to unset and change directory EC policy

[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11072: - Attachment: HDFS-11072-v7.patch > Add ability to unset and change directory EC policy > --

[jira] [Updated] (HDFS-11072) Add ability to unset and change directory EC policy

[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11072: - Attachment: HDFS-11072-v6.patch > Add ability to unset and change directory EC policy > --

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15810573#comment-15810573 ] SammiChen commented on HDFS-11072: -- Thanks [~andrew.wang] for the comments. I will upload

[jira] [Updated] (HDFS-11072) Add ability to unset and change directory EC policy

[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11072: - Attachment: (was: HDFS-11072-v6.patch) > Add ability to unset and change directory EC policy > ---

[jira] [Updated] (HDFS-11072) Add ability to unset and change directory EC policy

[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11072: - Attachment: HDFS-11072-v6.patch > Add ability to unset and change directory EC policy > --

<    1   2   3   4   5   6   7   >