Hi Jarcec, Are you referring to task logs ? in below screen. When I click on "All" or "Last 4KB" or "Last 8KB', the page times out :-( Not sure why
task_201301072354_0114_m_000000 attempts for 0114_1357651667175_saachhra<http://sl73caeq02.visa.com:50030/jobdetailshistory.jsp?logFile=file:/hadoop1/logs/hadoop/history/done/sl73caeq02.visa.com_1357602885590_/2013/00/08/000000/job_201301072354_0114_1357651667175_saachhra_optqc5d.TQC_ELIG_TRAN_HIST.jar> Task IdStart TimeFinish Time HostErrorTask Logs Counters attempt_201301072354_0114_m_000000_0 8/01 13:27:538/01 13:27:58 (5sec) /default/host Last 4KB<http://sl73caeq03.visa.com:50060/tasklog?attemptid=attempt_201301072354_0114_m_000000_0&start=-4097> Last 8KB<http://sl73caeq03.visa.com:50060/tasklog?attemptid=attempt_201301072354_0114_m_000000_0&start=-8193> All<http://sl73caeq03.visa.com:50060/tasklog?attemptid=attempt_201301072354_0114_m_000000_0&all=true> 18<http://sl73caeq02.visa.com:50030/taskstatshistory.jsp?attemptid=attempt_201301072354_0114_m_000000_0&logFile=file:/hadoop1/logs/hadoop/history/done/sl73caeq02.visa.com_1357602885590_/2013/00/08/000000/job_201301072354_0114_1357651667175_saachhra_optqc5d.TQC_ELIG_TRAN_HIST.jar> However I got the location on linux here it was trying to look. I am afraid I wont be able to attach file or put full contents in this email :-( Is this what you were looking for (See below) ? - <property> <name>mapred.compress.map.output</name> <value>true</value> <source>mapred-site.xml</source> <source>/data/mapred/jt/jobTracker/job_201301072354_0114.xml</source> </property> - <property> <name>io.seqfile.lazydecompress</name> <value>true</value> <source>core-default.xml</source> <source>/data/mapred/jt/jobTracker/job_201301072354_0114.xml</source> </property> - <property> <name>io.compression.codecs</name> <value>org.apache.hadoop.io.compress.DefaultCodec,org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.BZip2Codec,org.apache.hadoop.io.compress.DeflateCodec,org.apache.hadoop.io.compress.SnappyCodec</value> <source>core-site.xml</source> <source>/data/mapred/jt/jobTracker/job_201301072354_0114.xml</source> </property> - <property> <name>mapred.output.compression.type</name> <value>BLOCK</value> <source>mapred-site.xml</source> <source>/data/mapred/jt/jobTracker/job_201301072354_0114.xml</source> </property> - <property> <name>mapred.output.compression.codec</name> <value>org.apache.hadoop.io.compress.GzipCodec</value> <source>programatically</source> <source>/data/mapred/jt/jobTracker/job_201301072354_0114.xml</source> </property> - <property> <name>mapred.map.output.compression.codec</name> <value>org.apache.hadoop.io.compress.SnappyCodec</value> <source>mapred-site.xml</source> <source>/data/mapred/jt/jobTracker/job_201301072354_0114.xml</source> </property> - <property> <name>io.seqfile.compress.blocksize</name> <value>1000000</value> <source>core-default.xml</source> <source>/data/mapred/jt/jobTracker/job_201301072354_0114.xml</source> </property> - <property> <name>dfs.image.compress</name> <value>false</value> <source>hdfs-default.xml</source> <source>/data/mapred/jt/jobTracker/job_201301072354_0114.xml</source> </property> - <property> <name>dfs.image.compression.codec</name> <value>org.apache.hadoop.io.compress.DefaultCodec</value> <source>hdfs-default.xml</source> <source>/data/mapred/jt/jobTracker/job_201301072354_0114.xml</source> </property> Good wishes,always ! Santosh On Thu, Jan 10, 2013 at 5:40 PM, Jarek Jarcec Cecho <[email protected]>wrote: > Hi Santosh, > almost :-). When you click on this page on the "map" link you should get > page with map tasks. When you click on one arbitrary task you should get > table with all corresponding task attempts. On this page you should see > link to log. > > Jarcec > > On Wed, Jan 09, 2013 at 07:45:44PM +0800, Santosh Achhra wrote: > > Hi Jarcec, > > > > Hopefully this is log which you had requested. > > > > all MAP task list for 0035_1357731518922_saachhra > > > > Task Id Start Time Finish Time > > Error > > task_201301081859_0035_m_000000 9/01 11:38:46 9/01 11:38:52 (6sec) > > > > > > After I click on "all MAP task list for 0035_1357731518922_saachhra", > this > > is what I get > > > > Hadoop Job 0114_1357651667175_saachhra on History Viewer > > > > User: saachhra > > JobName: TABLE.jar > > JobConf: > > hdfs://host:8020/user/saachhra/.staging/job_201301072354_0114/job.xml > > Job-ACLs: All users are allowed > > Submitted At: 8-Jan-2013 13:27:47 > > Launched At: 8-Jan-2013 13:27:47 (0sec) > > Finished At: 8-Jan-2013 13:28:00 (12sec) > > Status: SUCCESS > > Analyse This Job > > Kind Total Tasks(successful+failed+killed) Successful tasks Failed tasks > Killed > > tasks Start Time Finish Time > > Setup 1 1 0 0 8-Jan-2013 13:27:50 8-Jan-2013 13:27:52 (1sec) > > Map 1 1 0 0 8-Jan-2013 13:27:53 8-Jan-2013 13:27:58 (5sec) > > Reduce 0 0 0 0 > > Cleanup 1 1 0 0 8-Jan-2013 13:27:58 8-Jan-2013 13:28:00 (2sec) > > > > > > > > Counter Map Reduce Total > > File System Counters FILE: Number of bytes read 0 0 0 > > FILE: Number of bytes written 0 0 170,459 > > FILE: Number of read operations 0 0 0 > > FILE: Number of large read operations 0 0 0 > > FILE: Number of write operations 0 0 0 > > HDFS: Number of bytes read 0 0 87 > > HDFS: Number of bytes written 0 0 7,863,800 > > HDFS: Number of read operations 0 0 1 > > HDFS: Number of large read operations 0 0 0 > > HDFS: Number of write operations 0 0 1 > > Job Counters Launched map tasks 0 0 1 > > Total time spent by all maps in occupied slots (ms) 0 0 9,118 > > Total time spent by all reduces in occupied slots (ms) 0 0 0 > > Total time spent by all maps waiting after reserving slots (ms) 0 0 0 > > Total time spent by all reduces waiting after reserving slots (ms) 0 0 0 > > Map-Reduce Framework Map input records 0 0 14,363 > > Map output records 0 0 14,363 > > Input split bytes 0 0 87 > > Spilled Records 0 0 0 > > CPU time spent (ms) 0 0 4,530 > > Physical memory (bytes) snapshot 0 0 303,534,080 > > Virtual memory (bytes) snapshot 0 0 1,868,890,112 > > Total committed heap usage (bytes) 0 0 757,792,768 > > > > Good wishes,always ! > > Santosh > > > > > > On Wed, Jan 9, 2013 at 6:01 PM, Jarek Jarcec Cecho <[email protected] > >wrote: > > > > > your JobTracker web ui, you will see running/failed/history jobs. If > you > > > will follow the id link, you'll get to job page summary where you > lastly > > > got the job XML file >
