The fabric-hadoop module uses OSGi managed services to create the
hadoop services so you need to add a file
etc/org.fusesource.fabric.hadoop.cfg with the following parameters for
example:
fs.default.name=hdfs\://localhost\:9000
dfs.replication=1
mapred.job.tracker=localhost\:9001
dfs.name.dir=${karaf.data}/hadoop/dfs/name
dfs.http.address=localhost\:9002
dfs.data.dir=${karaf.data}/hadoop/dfs/data
dfs.name.edits.dir=${karaf.data}/hadoop/dfs/name
nameNode=true
dataNode=true
You should then have an hdfs file system ready to use.
If you want map reduce, you can add
jobTracker=true
taskTracker=true
Note that hadoop is designed to have nameNode / dataNode / jobTracker
/ taskTracker on different servers ...
On Thu, Jun 28, 2012 at 11:50 AM, somya singhal
<[email protected]> wrote:
> Hello Guillaume
>
> Yes i tried your link.I downloaded the fabric-hadoop folder.I deployed it by
> giving the command mvn clean deploy.And after that i started the karaf root
> shell by starting karaf.bat file inside ..\fusesource\bin\karaf.bat.Thats
> it.Now i have wordcount example with me.I have exported it to jar file.But i
> am unable to find what to do afterwards.How to take output of wordcount
> example to help my osgi service?
>
>
>
>
> On Wed, Jun 27, 2012 at 11:12 PM, ramesh chandra <[email protected]>
> wrote:
>>
>> On 06/27/2012 12:22 PM, Jean-Baptiste Onofré wrote:
>>
>> Hi Somya,
>>
>> I'm still working on the patches. However, if you want, I can deploy the
>> bundles on my repo (http://maven.nanthrax.net) if you want to test.
>>
>> Regards
>> JB
>>
>> On 06/27/2012 10:58 AM, somya singhal wrote:
>>
>> Hello
>>
>> I have recently coma across a link -:
>>
>>
>> http://search-hadoop.com/m/7TZE59pm6v&subj=Re+PROPOSAL+Hadoop+OSGi+compliant+and+Apache+Karaf+features
>>
>> I am trying to install hadoop bundle in osgi for quite a few days.But i
>> am unable to do so.Anyone can please suggest me as it is written in the
>> link,from where can i get Hadoop modules (common, annotations, hdfs,
>> mapreduce, etc)???
>>
>> Somya Singhal
>> Btech(4th year,csi)
>> IIT ROORKEE
>>
>>
>> Hello Somya,
>>
>> You can follow the headers as it is the best way to find missing
>> dependencies. And you can also
>> wrap all the dependencies , common, annotations, hdfs etc and any other
>> external dependency that is missing and install as osgi.
>>
>> osgi:install wrap:mvn:Groupid/Artifactid/versoion
>>
>> Hopefully this approach might help
>>
>> regards.
>> Ramesh
>
>
--
------------------------
Guillaume Nodet
------------------------
Blog: http://gnodet.blogspot.com/
------------------------
FuseSource, Integration everywhere
http://fusesource.com
