Re: Problem of installing HDFS-385 and the usage

2014-03-18 Thread Eric Chiu
Hi Stanley,

Thanks for your response, but I still have some problems.  Could you gave
me further instructions?
I am now using hadoop 1.0.3. Does that mean I have to upgrade to 1.2.0? or
I can directly override the original code with what command?

Another question is that you said I can refer to HDFS-3601 but what
version? I notice that there are 6 versions and v1,v2 modified the same
file and v3,v4,v5,v6 modified another file but v3,v4 shows some connection
and v5,v6 shows another connection. That confused me. And there is also a
file branch 2. It confused me again.

The last problem is that how do I start reading the code to know what
policy one use? If I want to control the block placement then I have to
write codes rather than type shell commands? The codes are so big so that I
do not know where to start. Could you give me some hint?

Since I am a new user, I am sorry if I asked stupid question. But I really
did not mean to.

Thanks,

Eric

2014-03-18 13:43 GMT+08:00 Stanley Shi s...@gopivotal.com:

 This JIRA is included in Apache code since version 
 0.21.0https://issues.apache.org/jira/browse/HDFS/fixforversion/12314046
 , 1.2.0https://issues.apache.org/jira/browse/HDFS/fixforversion/12321657
 , 1-winhttps://issues.apache.org/jira/browse/HDFS/fixforversion/12320362
 ;
 If you want to use it, you need to write your own policy, please see this
 JIRA for example: https://issues.apache.org/jira/browse/HDFS-3601


 Regards,
 *Stanley Shi,*



 On Mon, Mar 17, 2014 at 11:31 AM, Eric Chiu ericchiu0...@gmail.comwrote:

 HI all,

 Could anyone tell me How to install and use this hadoop plug-in?

 https://issues.apache.org/jira/browse/HDFS-385

 I read the code but do not know where to install and use what command to
 install them all.

 Another problem is that there are .txt and .patch files, which one should
 be applied?

 Some of the .patch files have  -win , does that mean that file is for
 windows hadoop user? (I am using ubuntu)

 Thank you very much.





Re: Problem of installing HDFS-385 and the usage

2014-03-18 Thread Stanley Shi
HI Eric,

Are you running an prod environment on Hadoop 1.0.3? If yes, then you have
to upgrade to Hadoop1.2.0 or Hadoop2.2.0.
If you don't want to change to other Hadoop version, you need to backport
the patch to your code base ( I'm not sure the patch provided in HDFS-385
can be applied to Hadoop 1.0.3 smoothly, if not, you have to resolve the
conflicts by yourself).
The HDFS-3601 is not a good example for you, it's on hadoop2.x.
You can read the implementation of this class:
https://github.com/apache/hadoop-common/blob/release-1.2.0/src/hdfs/org/apache/hadoop/hdfs/server/namenode/BlockPlacementPolicyWithNodeGroup.java

--If I want to control the block placement then I have to write codes
rather than type shell commands?
if you want to implement your own logic on block placement, you have to
write code.

Regards,
*Stanley Shi,*



On Wed, Mar 19, 2014 at 3:07 AM, Eric Chiu ericchiu0...@gmail.com wrote:


 Hi Stanley,

 Thanks for your response, but I still have some problems.  Could you gave
 me further instructions?
 I am now using hadoop 1.0.3. Does that mean I have to upgrade to 1.2.0? or
 I can directly override the original code with what command?

 Another question is that you said I can refer to HDFS-3601 but what
 version? I notice that there are 6 versions and v1,v2 modified the same
 file and v3,v4,v5,v6 modified another file but v3,v4 shows some connection
 and v5,v6 shows another connection. That confused me. And there is also a
 file branch 2. It confused me again.

 The last problem is that how do I start reading the code to know what
 policy one use? If I want to control the block placement then I have to
 write codes rather than type shell commands? The codes are so big so that I
 do not know where to start. Could you give me some hint?

 Since I am a new user, I am sorry if I asked stupid question. But I really
 did not mean to.

 Thanks,

 Eric

 2014-03-18 13:43 GMT+08:00 Stanley Shi s...@gopivotal.com:

 This JIRA is included in Apache code since version 
 0.21.0https://issues.apache.org/jira/browse/HDFS/fixforversion/12314046
 , 1.2.0https://issues.apache.org/jira/browse/HDFS/fixforversion/12321657
 , 1-winhttps://issues.apache.org/jira/browse/HDFS/fixforversion/12320362
 ;
 If you want to use it, you need to write your own policy, please see this
 JIRA for example: https://issues.apache.org/jira/browse/HDFS-3601


 Regards,
 *Stanley Shi,*



 On Mon, Mar 17, 2014 at 11:31 AM, Eric Chiu ericchiu0...@gmail.comwrote:

 HI all,

 Could anyone tell me How to install and use this hadoop plug-in?

 https://issues.apache.org/jira/browse/HDFS-385

 I read the code but do not know where to install and use what command to
 install them all.

 Another problem is that there are .txt and .patch files, which one
 should be applied?

 Some of the .patch files have  -win , does that mean that file is for
 windows hadoop user? (I am using ubuntu)

 Thank you very much.






Re: Problem of installing HDFS-385 and the usage

2014-03-17 Thread Stanley Shi
This JIRA is included in Apache code since version
0.21.0https://issues.apache.org/jira/browse/HDFS/fixforversion/12314046
, 1.2.0 https://issues.apache.org/jira/browse/HDFS/fixforversion/12321657
, 1-win https://issues.apache.org/jira/browse/HDFS/fixforversion/12320362
;
If you want to use it, you need to write your own policy, please see this
JIRA for example: https://issues.apache.org/jira/browse/HDFS-3601


Regards,
*Stanley Shi,*



On Mon, Mar 17, 2014 at 11:31 AM, Eric Chiu ericchiu0...@gmail.com wrote:

 HI all,

 Could anyone tell me How to install and use this hadoop plug-in?

 https://issues.apache.org/jira/browse/HDFS-385

 I read the code but do not know where to install and use what command to
 install them all.

 Another problem is that there are .txt and .patch files, which one should
 be applied?

 Some of the .patch files have  -win , does that mean that file is for
 windows hadoop user? (I am using ubuntu)

 Thank you very much.