Hello, I have been trying to generate 10M rows on 10 nodes and 4G of memory on each. Below my stdout and the last error prior shell disconnect (working through vpn).
Job is successful! It took 2655 seconds. Skimming users 2011-10-14 05:25:01,377 [main] INFO org.apache.pig.Main - Logging error message s to: /mnt/disk1/home/kouaknine/hapache/pig/test/utils/pigmix/scripts/pig_131858 4301370.log *Write failed: Software caused connection abort* There is no log file to look into (pig_1318584301370.log non existent) Looking into stdout of 1M rows, the next expected step should be: 2011-10-13 18:33:52,105 [main] INFO org.apache.pig.backend.hadoop.executionengi ne.HExecutionEngine - Connecting to hadoop file system at: hdfs:// 10.239.24.12:5 4310 I cant connect to 54310, but my namenode is alive. What do you reckon? Thanks, Keren -- Keren Ouaknine Cell: +972 54 2565404 Web: www.kereno.com
