Hi Vinod,
Thanks for your help regarding this. I checked the task logs, this is what it is giving as output. 2013-11-06 06:40:05,541 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201311060636_0001_m_1100862588 2013-11-06 06:40:05,553 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner jvm_201311060636_0001_m_1100862588 spawned. 2013-11-06 06:40:05,650 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201311060636_0001_m_-1960039766 2013-11-06 06:40:05,651 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner jvm_201311060636_0001_m_-1960039766 spawned. 2013-11-06 06:40:07,496 INFO org.apache.hadoop.mapred.TaskTracker: JVM with ID: jvm_201311060636_0001_m_1100862588 given task: attempt_201311060 636_0001_m_000001_3 2013-11-06 06:40:07,618 INFO org.apache.hadoop.mapred.TaskTracker: JVM with ID: jvm_201311060636_0001_m_-1960039766 given task: attempt_20131106 0636_0001_m_000000_3 2013-11-06 06:40:08,013 INFO org.apache.hadoop.mapred.TaskTracker: running on gpu xx from status: false 2013-11-06 06:40:08,014 INFO org.apache.hadoop.mapred.TaskTracker: running on gpu xx from task: false 2013-11-06 06:40:08,015 INFO org.apache.hadoop.mapred.TaskTracker: running on gpu xx from status: false 2013-11-06 06:40:08,015 INFO org.apache.hadoop.mapred.TaskTracker: running on gpu xx from task: false 2013-11-06 06:40:09,361 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311060636_0001_m_000001_3 0.0% 2013-11-06 06:40:09,735 INFO org.apache.hadoop.mapred.TaskTracker: attempt_201311060636_0001_m_000000_3 0.0% 2013-11-06 06:40:10,018 INFO org.apache.hadoop.mapred.JvmManager: JVM : jvm_201311060636_0001_m_1100862588 exited. Number of tasks it ran: 0 2013-11-06 06:40:11,021 INFO org.apache.hadoop.mapred.JvmManager: JVM : jvm_201311060636_0001_m_-1960039766 exited. Number of tasks it ran: 0 2013-11-06 06:40:11,442 INFO org.apache.hadoop.mapred.TaskTracker: running on gpu xx from status: false 2013-11-06 06:40:11,442 INFO org.apache.hadoop.mapred.TaskTracker: running on gpu xx from task: false 2013-11-06 06:40:11,443 INFO org.apache.hadoop.mapred.TaskTracker: running on gpu xx from status: false 2013-11-06 06:40:11,443 INFO org.apache.hadoop.mapred.TaskTracker: running on gpu xx from task: false 2013-11-06 06:40:13,021 INFO org.apache.hadoop.mapred.TaskRunner: attempt_201311060636_0001_m_000001_3 done; removing files. 2013-11-06 06:40:13,037 INFO org.apache.hadoop.mapred.TaskTracker: addCPUFreeSlot : current free slots : 3 2013-11-06 06:40:14,025 INFO org.apache.hadoop.mapred.TaskRunner: attempt_201311060636_0001_m_000000_3 done; removing files. 2013-11-06 06:40:14,028 INFO org.apache.hadoop.mapred.TaskTracker: addCPUFreeSlot : current free slots : 4 2013-11-06 06:40:14,476 INFO org.apache.hadoop.mapred.TaskTracker: running on gpu xx from status: false 2013-11-06 06:40:14,477 INFO org.apache.hadoop.mapred.TaskTracker: running on gpu xx from task: false 2013-11-06 06:40:14,477 INFO org.apache.hadoop.mapred.TaskTracker: running on gpu xx from status: false 2013-11-06 06:40:14,477 INFO org.apache.hadoop.mapred.TaskTracker: running on gpu xx from task: false 2013-11-06 06:40:14,894 INFO org.apache.hadoop.mapred.TaskTracker: running on gpu : false 2013-11-06 06:40:14,900 INFO org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask): attempt_201311060636_0001_m_000002_0 task's state:UNASSIGNED 2013-11-06 06:40:14,902 INFO org.apache.hadoop.mapred.TaskTracker: Trying to launch : attempt_201311060636_0001_m_000002_0 on CPU 2013-11-06 06:40:14,904 INFO org.apache.hadoop.mapred.TaskTracker: In TaskLauncher, current free CPU slots : 4 and trying to launch attempt_2013 11060636_0001_m_000002_0 2013-11-06 06:40:14,909 INFO org.apache.hadoop.mapred.TaskTracker: Received KillTaskAction for task: attempt_201311060636_0001_m_000000_3 2013-11-06 06:40:14,920 INFO org.apache.hadoop.mapred.TaskTracker: Received KillTaskAction for task: attempt_201311060636_0001_m_000001_3 2013-11-06 06:40:15,161 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201311060636_0001_m_164532908 2013-11-06 06:40:15,162 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner jvm_201311060636_0001_m_164532908 spawned. 2013-11-06 06:40:17,216 INFO org.apache.hadoop.mapred.TaskTracker: JVM with ID: jvm_201311060636_0001_m_164532908 given task: attempt_2013110606 36_0001_m_000002_0 Regards, Indrashish On Tue, 5 Nov 2013 10:09:36 -0800, Vinod Kumar Vavilapalli wrote: > It seems like your pipes mapper is exiting before consuming all the input. Did you check the task-logs on the web UI? > > Thanks, > +Vinod > > On Nov 5, 2013, at 7:25 AM, Basu,Indrashish wrote: > >> Hi, >> >> Can anyone kindly assist on this ? >> >> Regards, >> Indrashish >> >> On Mon, 04 Nov 2013 10:23:23 -0500, Basu,Indrashish wrote: >> >>> Hi All, >> >>> Any update on the below post ? >> solution as " The *nopipe* example needs more documentation. It src/test/org/apache/*hadoop >> >>> d; margin-left:5px; width:100%">*WordCountInputF >> which has a very specific input split probably be recoded *to* use libhdfs *too*, >> ore C++ example is using local file reads, it will only work on a cl >> >>> ft:5px; width:100%">if you have nfs or something working across the >> lockquote> I would need some more light on the above exp >> >>> x solid; margin-left:5px; width:100%">could elaborate a bit >> e as what needs to be done exactly. using Hadoop. . >> ff 2px solid; margin-left:5px; width:100%">Regards, On Thu, 31 Oct 2013 >> 0, Basu,Indrashish wrote: quote> >> solid; margin-left:5px; width:100%"> I am tryi >> ample Hadoop GPU source code (kmeans algorithm) on an ARM processor and getting the below er >> ne please throw some light on this ? px solid; m >> x; width:100%">13/10/31 13:43:12 WARN mapred.JobClient: No job jar file set. User h:100%"> >> #1010ff 2px solid; margin-left:5px; width:100%">classes may not be found. See JobConf(Class) or >> >>> 5px; width:100%"> J >> (String). >> >>> >> 3:12 INFO mapred.FileInputFormat: Total input paths to ockquote> >> x solid; margin-left:5px; width:100%">13/10/31 13:43:13 INFO mapred.JobClient: Running job: job_201310311320 >> >>> olid; margin-left:5px; width:100%"> 13/10/31 13:43:14 INFO mapred.JobClient:   >> e 0% 13/10/31 13:43:39 INFO mapred.JobClie >> >>> ff 2px solid; margin-left:5px; width:100%"> >> 310311320_0001_m_000000_0, Status : FAILED >> ption org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapR >> 3) & >> >>> lockquote type="cite" style="padding-left:5px; border-left:#1010ff 2px solid; margin-left:5px; width:100%"> >> d; margin-left:5px; width:100%"> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307) at org.apache.hadoop.mapred.Child.main(Child.java:170) >> " style="padding-left:5px; border-left:#1010ff 2px solid; margin-left:5px; width:100%"> at java.net.SocketOutputStream.socketWrite0(Native Method) at java.net.SocketOutputStre >> e(SocketOutputStream.java:113) at >> >>> "cite" style="padding-left:5px; border-left:#1010ff 2px solid; margin-left:5px; width:100%"> >> ; at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) %"> at java.io.BufferedOutputStream.write(BufferedOutputStrea >> blockquote> :5px; width:100%">org.apache.hadoop.mapred.pipes.BinaryProtocol.writeObject(BinaryProtocol.java:333) >> 1010ff 2px solid; margin-left:5px; width:100%"> at org.apache.hadoop.mapred.pipes.BinaryProtocol.mapItem(BinaryProtocol.java:286) >> pe="cite" style="padding-left:5px; border-left:#1010ff 2px solid; margin-left:5px; width:100%"> org.apache.hadoop.mapred.pipe >> ner.run(PipesMapRunner.java:92) ... 3 more >> :#1010ff 2px solid; margin-left:5px; width:100%"> '/app/hadoop/tmp/mapred/local/taskTracker/archive/10.227.56.195bin/cpu-kmeans2D/cpu-kmeans2D' e type="cite" style="padding-left:5px; border-left:#1010ff 2px solid; margin-left:5px; width:100%">'0' < /dev/null 1>> >> r-left:#1010ff 2px solid; margin-left:5px; width:100%"> /usr/local/hadoop/hadoop-gpu-0.20.1/bin/../logs/userlogs/attempt_201310311320_0001_m_000000_0/stdout idth:100%"> 2>> /usr/local/hadoop/hadoop-gpu-0.20.1/bin/../logs/userlogs/ >> te> Regards, >>> -- >>> Indrashish Basu >>> Graduate Student >>> Department of Electrical and C >> eering >> University of Florida >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> > > CONFIDENTIALITY NOTICE > NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- Indrashish Basu Graduate Student Department of Electrical and Computer Engineering University of Florida
