I think there's a problem in your configuration. Please check whether Pi example works well.
>> >>> I even changed the according variables from hama-default.xml but nothing >> >>> seems to be working. The number of BSPTasks remain to 17. In 0.6 release, task number is defined as a number of blocks by default. If you want to force it to 1, please use the TRUNK version. On Mon, Mar 11, 2013 at 6:39 PM, andronat_asf <[email protected]> wrote: > Hello again, > > I am running Hama v0.6.0 with Hadoop v1.0.4. > > I checked groom logs, but groom didn't writing any logs. Also no task logs > exists due to the fact that my job is failing too early. I tried to change > the log level (in hama-daemon.sh export HAMA_ROOT_LOGGER="INFO,DRFA" to > DEBUG) but nothing useful came up. > > When I was playing around, I changed in conf/hama-default.xml the > bsp.tasks.maximum to 20 (I know that I'm suppose to overwrite variables to > hama-site.xml). And everything start working. > > Is this expected to work like this? As far as I understand, for some reason I > can't overwrite the configuration through my code. Also, what about the guide > (http://wiki.apache.org/hama/WriteHamaGraphFile) is it suppose to work with 1 > task? > > Thanks again, > Anastasis > > P.S. > I noticed that, when I was trying to change the debug level of Hama through > log4j.properties, nothing happened. Is that ok too? Or is something wrong > with my installation? > > On 10 Μαρ 2013, at 12:46 π.μ., Edward J. Yoon <[email protected]> wrote: > >> What version of Hama? and you need to check the groom-server logs and task >> logs. >> >> On Sun, Mar 10, 2013 at 3:27 AM, andronat_asf <[email protected]> >> wrote: >>> Hello everyone, >>> >>> I was reading the tutorial for Google Web dataset (local mode, pseudo >>> distributed cluser) at http://wiki.apache.org/hama/WriteHamaGraphFile. >>> >>> I downloaded a Graph (~1GB) and uploaded it to hdfs. The file was splitted >>> in 17 hdfs chunks. (I remind that I am trying to run in pseudo distributed >>> mode, I have everything in my laptop). >>> >>> ls -l /tmp/hadoop/dfs/data/current/ | grep -v 'meta' | wc -l >>> 17 >>> >>> Then I tried to run a code I wrote based on the example but: >>> >>> # tail -f hama-my-bspmaster-my.local.log >>> >>> 2013-03-09 20:09:47,060 INFO org.apache.hama.bsp.JobInProgress: num >>> BSPTasks: 17 >>> 2013-03-09 20:09:47,100 INFO org.apache.hama.bsp.JobInProgress: Job is >>> initialized. >>> 2013-03-09 20:09:47,103 ERROR org.apache.hama.bsp.SimpleTaskScheduler: >>> Could not schedule all tasks! >>> 2013-03-09 20:09:47,103 ERROR org.apache.hama.bsp.SimpleTaskScheduler: >>> Scheduling of job Hama Graph Loader could not be done successfully. Killing >>> it! >>> >>> My configuration is: >>> >>> HamaConfiguration conf = new HamaConfiguration(new Configuration()); >>> conf.set("bsp.local.tasks.maximum", "1"); >>> >>> GraphJob graphJob = new GraphJob(conf, HamaGraphLoader.class); >>> graphJob.setNumBspTask(1); >>> >>> I also tried to change the values of: >>> >>> conf.set("bsp.tasks.maximum", "1"); >>> conf.set("bsp.max.tasks.per.job", "1"); >>> conf.set("mapred.map.tasks", "1"); >>> conf.set("mapred.min.split.size", String.valueOf(Long.MAX_VALUE)); >>> >>> I even changed the according variables from hama-default.xml but nothing >>> seems to be working. The number of BSPTasks remain to 17. >>> >>> I attach my full configuration just in case. >>> >>> Thank you in advance, >>> Anastasis >>> >> >> >> >> -- >> Best Regards, Edward J. Yoon >> @eddieyoon >> > -- Best Regards, Edward J. Yoon @eddieyoon
