Thank you so much, Jakob.

Could you please explain the fault injection running procedure in details?

My goal is running HDFS in a cluster (with a namenode and several datanode),
and see how fault injection techniques affect HDFS behavior's. Also, I would
like to define some new aspects/fault to test the system.

What I did was:
1) I checked out the hadoop-common-trunk, but this package doesn't contain
HDFS classes. I finally noticed that FI framework is currently integrated
with HDFS only.

2) So, I checked out the hdfs-trunk. The build.xml contain injectfaults
target and several other related things. I was able to build those targets
(injectfaults, run-test-hdfs-fault-inject, etc). Up to this point, I stucked
because I found no scripted that help me to start-dfs, stop-dfs...
I copied the bin folder from common/core to HDFS project folder and ran the
script:

*bin/start-dfs.sh*

but there is exception:

*Exception in thread
main"Java.lang.NoClassDefFoundError
: org/apache/commons/logging/LogFactory
*
I guess the reason is I ran HDFS without any common class. How I get around
this?

3) I also tried the third way, by download the hadoop release (contain
everything: core, hdfs, mapred), and used Eclipse to create project from
existing code. I was able to build this project. The bin scripts worked well
but I found know FI related classes. What I did was apply the patch
(HADOOP-6003.patch) using Eclipse patch command (Team | apply patch), but I
failed the patching procedure.

In summary, I would like to run a real HDFS with fault injection. I am not
very familiar with ant. Could you please show me some more details, so that
I could get around this?

On Thu, Oct 8, 2009 at 12:19 AM, Jakob Homan <[email protected]> wrote:

> Thanh-
> If you would like the run execute the tests that have been instrumented to
> use the fault injection framework the ant target is
> run-test-hdfs-fault-inject.  These were used extensively in the recent
> append work and there are quite a few append-related tests.  Was there
> something more specific you were looking for?
>
> Thanks,
> Jakob
> Hadoop at Yahoo!
>
>
> Thanh Do wrote:
>
>> Hi everyone,
>>
>> Could any body so me how to run the fault injection framework mentioned in
>> the following links?:
>>
>> http://issues.apache.org/jira/browse/HDFS-435
>>
>> and
>>
>> https://issues.apache.org/jira/browse/HDFS-436
>>
>> Thanks,
>> Thanh
>>
>>
>>
>


-- 
T

Reply via email to