Dear Wiki user, You have subscribed to a wiki page or wiki category on "Hama Wiki" for change notification.
The "GettingStartedYARN" page has been changed by edwardyoon: https://wiki.apache.org/hama/GettingStartedYARN?action=diff&rev1=5&rev2=6 This tutorial requires Hadoop 2.x already correctly installed. If you haven't done this yet, please follow the official documentation https://hadoop.apache.org/docs/stable/ - == How to run the Hama-YARN example == - - TODO this must be revised once the example has moved the jar. - - {{{ - bin/hama jar hama-yarn-0.7.0-SNAPSHOT.jar org.apache.hama.bsp.YarnSerializePrinting - }}} - - Once running, you should see in the spawned application master log that it is launching containers. - When the containers launched, you can see in the logs that there is a little "Hello World" from the other tasks. - == How to write a Hama-YARN job == The [[BSPModel]] hasn't changed, but the way to submit a job has. @@ -35, +24 @@ {{{ HamaConfiguration conf = new HamaConfiguration(); - conf.set("yarn.resourcemanager.address", "0.0.0.0:8040"); + YARNBSPJob job = new YARNBSPJob(conf); - YARNBSPJob job = new YARNBSPJob(conf); job.setBspClass(HelloBSP.class); job.setJarByClass(HelloBSP.class); job.setJobName("Serialize Printing"); @@ -58, +46 @@ There are some configuration values that the job needs to have in order to submit sucessfully to YARN infrastructure. - The importantest configuration is the {{{yarn.resourcemanager.address}}}. This should point to the address (hostname+port) where your ResourceManager runs, for example {{{localhost:8040}}}. + The importantest configurations are the {{{yarn.resourcemanager.address}}} and {{{fs.default.name}}}. This should point to the address (hostname+port) where your ResourceManager and HDFS Namonode runs, for example {{{localhost:8040}}}, {{{hdfs://localhost:9000}}}. Another important configuration value is the amount of memory used by the BSPApplicationMaster. You can configure a base amount of memory for the application master with this configuration key {{{ @@ -123, +111 @@ to submit a Hama job. You can just change the {{{BSPJob}}} to {{{YARNBSPJob}}}. + == Hama-YARN example == + + TODO this must be revised once the example has moved the jar. + + {{{ + bin/hama jar hama-yarn-0.7.0-SNAPSHOT.jar org.apache.hama.bsp.YarnSerializePrinting + }}} + + Once running, you should see in the spawned application master log that it is launching containers. + When the containers launched, you can see in the logs that there is a little "Hello World" from the other tasks. +
