Please see below,
Pradeep Fernando wrote:
hello devs,
I'm a newbie to hadoop world and still in the process of reading
documentation in order to get a better understanding on hadoop.
But still i m really interested on this project and community. Im willing to
contribute to this project as a developer in the future.
welcome
I saw that the hadoop can be set up in a single node. My concern is, do you
need to have a special kind of infrastructure in order
to contribute to hadoop (since this is dealing with clustering environment).
if it needs a environment with more than one node to successfully
carry out the development is there a work around?
Actually you can run hadoop in local mode, distributed mode, or
pseudo-distributed mode. In local mode mapred jobs run in LocalJobRunner
and the tasks run sequentially. In pseudo-distributed mode, you run
NN,JT,DN and TTs in the same machine so the jobs run as they are in the
distributed mode. Most of the mapred test cases run with this
configuration. You can check MiniDFSCluster and MiniMRCluster classes as
as reference.
can you devs enlighten me on this plz.
Thanks in advance,
Pradeep Fernando.
