[ 
https://issues.apache.org/jira/browse/HADOOP-12017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622016#comment-14622016
 ] 

Bibin A Chundatt commented on HADOOP-12017:
-------------------------------------------

Hi [~szetszwo] and [~vinayrpet] thnks for review comments.

The below are my understanding 
# In Har filesystem for index and master we are currently using harcoded value 
5.
# For Part files the replication value will be default 3 always rt?

Wanted to make replication for {{part,index,masterindex}} to be 
configurable.The only parameter available 
for replication  was {{-r}}. The same parameter used for {{srcfiles}}. I didn't 
want to add one more parameters.
Thts the reason have used the same parameter for index and master.

*To implement patch* 

{{option 1}} could be define a new parameter.
For part,master and index new parameter {{-hr}} short for har replication??

[~vinayrpet] sorry missed part files earlier will set replication for that 
too.About not setting replication for {{srcfiles}}
But for source file and output files(part,index,master) if someone want to set 
different replication values?

{{option 2}} could be user defined replication {{-r}} for {{master,index,part}}
and parameter {{-sr}} for source file replication . Default value for both set 
as 3.

[~szetszwo] and [~vinayrpet] Does this sound good ?? Please correct me if i am 
wrong.
My choice {{option 2}}

> Hadoop archives command should use configurable replication factor when 
> closing
> -------------------------------------------------------------------------------
>
>                 Key: HADOOP-12017
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12017
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 2.7.0
>            Reporter: Zhe Zhang
>            Assignee: Bibin A Chundatt
>         Attachments: 0002-HADOOP-12017.patch, 0003-HADOOP-12017.patch, 
> 0003-HADOOP-12017.patch, 0004-HADOOP-12017.patch
>
>
> {{HadoopArchives#HArchivesReducer#close}} uses hard-coded replication factor. 
> It should use {{repl}} instead, which is parsed from command line parameters.
> {code}
>       // try increasing the replication 
>       fs.setReplication(index, (short) 5);
>       fs.setReplication(masterIndex, (short) 5);
>     }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to