Thanks a lot everyone, I have fixed hadoop-problem :)
2014-07-18 4:10 GMT+07:00 Dat Tran <[email protected]>: > Thank Sergey and Matthew, > > Matt, i follow the this instructions. Details step by step installation, > configuration anh create cluster at: > > https://docs.google.com/document/d/1r1aYEQ-fugY8h3vbG5Wvk0FfVRUk_oDmaRDtpUiyK-0/edit > > When ssh to instance-master run: sudo su hadoop; cd ~; hadoop jar > /usr/share/hadoop/hadoop-examples-1.2.1.jar pi 10 100 > Seems it worked. But it's still error: > > Caused by: java.lang.OutOfMemoryError: Java heap space > at > org.apache.hadoop.mapred.MapTask$MapOutputBuffer.<init>(MapTask.java:954) > ... > 14/07/17 19:37:25 INFO mapred.JobClient: map 0% reduce 0% > 14/07/17 19:37:26 INFO mapred.JobClient: Job complete: > job_local1818916530_0001 > 14/07/17 19:37:26 INFO mapred.JobClient: Counters: 0 > 14/07/17 19:37:26 INFO mapred.JobClient: Job Failed: NA > java.io.IOException: Job failed! > at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1357) > ... > > (details log at: > https://docs.google.com/document/d/1El-kvPJumN6GOw9FTnh8CeM4RVXtS-57PlBzn3fXUI4/edit > ) > > > First, i set flavor for a node group template is 1GB Ram and 10GB Disk. > Then i set 2GB Ram and 20GB Disk. But still this error. > Note: > - The current, i'm setting disable Swift and MySQL. > - I set default HDFS, MapReduce,.... > > I see: > - Service hadoop-* (hadoop-namenode) still "not running" > - Show UI Sahara: HDFS, MapReduce: No Configuratiions ( > http://prntscr.com/43os8r) > > > 2014-07-17 1:13 GMT+07:00 Matthew Farrellee <[email protected]>: > > sergey, sahara specs? >> >> dat, >> >> did you follow the instructions in the current docs >> >> http://docs.openstack.org/developer/sahara/userdoc/ >> installation.guide.html >> >> ? >> >> if they're in the google doc, please include them in your next email. >> >> best, >> >> >> matt >> >> >> On 07/15/2014 09:05 AM, Sergey Lukjanov wrote: >> >>> I've CC'ed Matt Farrellee, he's the initial author of sahara specs. >>> >>> On Tue, Jul 15, 2014 at 10:28 AM, Dat Tran <[email protected]> wrote: >>> >>>> I install openstack icehouse, then install sahara. I create cluster, it >>>> worked! >>>> But when i login master-instance, test. Run `hadoop jar >>>> hadoop-examples-1.2.1.jar pi 10 100` ==> Message error: >>>> `java.io.IOException: Cannot create input directory >>>> PiEstimator_TMP_3_141592654/in...` >>>> >>>> I check service hadoop-namenode, it's not working. Message: >>>> `start-stop-daemon: unable to set gid to 201 (Operation not >>>> permitted)`. All >>>> service hadoop-* not working, too. >>>> >>>> Go back, i check log, have warning. Summarize: >>>> >>>> WARNING sahara.service.engine [-] Can't start cluster '_unknown_' >>>> (reason: 'NoneType' object has no attribute 'node_groups') >>>> WARNING sahara.service.engine [-] Presumably the operation failed >>>> because the cluster wasdeleted by a user during the process. >>>> ERROR root [-] Original exception being dropped: ['Traceback (most >>>> recent call last):\n', ' File >>>> "/home/bkcloud/sahara-venv/local/lib/python2.7/site- >>>> packages/sahara/service/direct_engine.py", >>>> line 65, in create_cluster\n volumes.attach(cluster)\n', ' File >>>> "/home/bkcloud/sahara-venv/local/lib/python2.7/site- >>>> packages/sahara/service/volumes.py", >>>> line 31, in attach\n for node_group in cluster.node_groups:\n', >>>> "AttributeError: 'NoneType' object has no attribute 'node_groups'\n"] >>>> RROR sahara.context [-] Thread >>>> 'cluster-creating-91420b4b-9e89-44ff-8ce4-6cd5740e7bdc' fails with >>>> exception: 'Cluster id 'None' not found!' >>>> >>>> >>>> I use: >>>> >>>> - Plugin Vanilla 1.2.1 >>>> - Hadoop version 1.2.1 >>>> - Image: sahara-icehouse-vanilla-1.2.1-ubuntu-13.10.qcow2 >>>> - Download image at: >>>> http://sahara-files.mirantis.com/sahara-icehouse-vanilla-1. >>>> 2.1-ubuntu-13.10.qcow2 >>>> >>>> Details steps i created cluster: >>>> https://docs.google.com/document/d/1nwAP7FJQMjzOTg1w6UGfk55hvKzbT >>>> 0OBYHMBGSgNwxU/edit >>>> >>>> I think: I failed step config sahara or create node template? Because >>>> service sahara not running, so hadoop not worked :( >>>> Can you help me? Thanks! >>>> >>>> >>>> _______________________________________________ >>>> Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/ >>>> openstack >>>> Post to : [email protected] >>>> Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/ >>>> openstack >>>> >>>> >>> >>> >>> >> >
_______________________________________________ Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Post to : [email protected] Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
