Hi,
2009/7/22 Mathias De Maré <mathias.dem...@gmail.com>
>
> I managed to solve the issue (at least temporarily).
> The "build.log.dir" property was not being set, so I added a line before
> the MiniMRCluster constructor:
> System.setProperty("hadoop.log.dir", "build/test/logs");
>
> Mathias
>
Never mind this part, it seems like I am experiencing some new (and strange)
problems.
I wrote some example code to show the problem:
TestMapper:
import java.io.IOException;
import org.apache.hadoop.io.IntWritable;
import org.apache.hadoop.io.Text;
import org.apache.hadoop.mapreduce.Mapper;
public class TestMapper extends Mapper<IntWritable, Text, IntWritable, Text>
{
public TestMapper() {
super();
}
@Override
protected void map(IntWritable key, Text value, Context context)
throws IOException, InterruptedException {
System.out.println("MAP!!!");
}
@Override
protected void setup(Context context) throws IOException,
InterruptedException {
System.out.println("SETUP!!!");
}
@Override
protected void cleanup(Context context) throws IOException,
InterruptedException {
System.out.println("CLEANUP!!!");
}
}
MapperTest:
import java.io.BufferedWriter;
import java.io.File;
import java.io.FileWriter;
import java.io.IOException;
import junit.framework.TestCase;
import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.fs.FileSystem;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.hdfs.MiniDFSCluster;
import org.apache.hadoop.io.IntWritable;
import org.apache.hadoop.io.Text;
import org.apache.hadoop.mapred.MiniMRCluster;
import org.apache.hadoop.mapreduce.Job;
import org.apache.hadoop.mapreduce.lib.input.FileInputFormat;
import org.apache.hadoop.mapreduce.lib.output.FileOutputFormat;
import org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputFormat;
import org.junit.Before;
import org.junit.Test;
import org.junit.Assert;
public class MapperTest extends TestCase {
MiniDFSCluster dfs;
FileSystem fs;
MiniMRCluster testCluster;
Configuration conf;
@Before
@Override
public void setUp() throws IOException {
//Prepare cluster
dfs = new MiniDFSCluster(new Configuration(), 1, true, null);
dfs.waitClusterUp();
fs = dfs.getFileSystem();
System.setProperty("hadoop.log.dir", "build/test/logs");
testCluster = new MiniMRCluster(54547, 6541, 1,
fs.getUri().toString(), 1);
testCluster.waitUntilIdle();
conf = testCluster.createJobConf();
System.out.println("I'm alive!");
//Write new File to run our tests on
File localFile = new File("build/test/localfile");
localFile.delete();
localFile.createNewFile();
BufferedWriter br = new BufferedWriter(new FileWriter(localFile));
br.write("Test!");
br.newLine();
br.write("Test!");
fs.mkdirs(new Path("input"));
fs.copyFromLocalFile(new Path("build/test/localfile"), new
Path("input"));
}
@Test
public void testStuff() throws IOException, InterruptedException,
ClassNotFoundException {
Job job = new Job(conf, "test");
job.setJarByClass(this.getClass());
job.setMapperClass(TestMapper.class);
job.setNumReduceTasks(0);
job.setOutputValueClass(Text.class);
job.setOutputKeyClass(IntWritable.class);
job.setOutputFormatClass(SequenceFileOutputFormat.class);
FileInputFormat.addInputPath(job, new Path("input"));
FileOutputFormat.setOutputPath(job, new Path("output"));
job.waitForCompletion(true);
Assert.assertTrue(job.isSuccessful());
}
}
The job always manages to fail. More importantly, I never get any output
from the Mapper.
Standard output is as follows (note no 'map' is ever called):
------------- Standard Output ---------------
Starting DataNode 0 with dfs.data.dir:
build/test/data/dfs/data/data1,build/test/data/dfs/data/data2
Generating rack names for tasktrackers
Generating host names for tasktrackers
I'm alive!
attempt_200907271047_0001_m_000000_0: SETUP!!!
attempt_200907271047_0001_m_000000_0: CLEANUP!!!
I have no idea why map never gets called, but suggestions would certainly be
welcome.
The full output:
Testsuite: MapperTest
09/07/27 10:47:17 INFO namenode.FSNamesystem:
fsOwner=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
09/07/27 10:47:17 INFO namenode.FSNamesystem: supergroup=supergroup
09/07/27 10:47:17 INFO namenode.FSNamesystem: isPermissionEnabled=true
09/07/27 10:47:17 INFO common.Storage: Image file of size 97 saved in 0
seconds.
09/07/27 10:47:17 INFO common.Storage: Storage directory
build/test/data/dfs/name1 has been successfully formatted.
09/07/27 10:47:17 INFO common.Storage: Image file of size 97 saved in 0
seconds.
09/07/27 10:47:17 INFO common.Storage: Storage directory
build/test/data/dfs/name2 has been successfully formatted.
09/07/27 10:47:17 INFO metrics.RpcMetrics: Initializing RPC Metrics with
hostName=NameNode, port=55781
09/07/27 10:47:17 INFO namenode.NameNode: Namenode up at: localhost/
127.0.0.1:55781
09/07/27 10:47:17 INFO jvm.JvmMetrics: Initializing JVM Metrics with
processName=NameNode, sessionId=null
09/07/27 10:47:17 INFO metrics.NameNodeMetrics: Initializing
NameNodeMeterics using context
object:org.apache.hadoop.metrics.spi.NullContext
09/07/27 10:47:17 INFO namenode.FSNamesystem:
fsOwner=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
09/07/27 10:47:17 INFO namenode.FSNamesystem: supergroup=supergroup
09/07/27 10:47:17 INFO namenode.FSNamesystem: isPermissionEnabled=true
09/07/27 10:47:17 INFO metrics.FSNamesystemMetrics: Initializing
FSNamesystemMetrics using context
object:org.apache.hadoop.metrics.spi.NullContext
09/07/27 10:47:17 INFO namenode.FSNamesystem: Registered
FSNamesystemStatusMBean
09/07/27 10:47:17 INFO common.Storage: Number of files = 1
09/07/27 10:47:17 INFO common.Storage: Number of files under construction =
0
09/07/27 10:47:17 INFO common.Storage: Image file of size 97 loaded in 0
seconds.
09/07/27 10:47:17 INFO common.Storage: Edits file
build/test/data/dfs/name1/current/edits of size 4 edits # 0 loaded in 0
seconds.
09/07/27 10:47:17 INFO common.Storage: Image file of size 97 saved in 0
seconds.
09/07/27 10:47:17 INFO common.Storage: Image file of size 97 saved in 0
seconds.
09/07/27 10:47:17 INFO namenode.FSNamesystem: Finished loading FSImage in 88
msecs
09/07/27 10:47:17 INFO namenode.FSNamesystem: Total number of blocks = 0
09/07/27 10:47:17 INFO namenode.FSNamesystem: Number of invalid blocks = 0
09/07/27 10:47:17 INFO namenode.FSNamesystem: Number of under-replicated
blocks = 0
09/07/27 10:47:17 INFO namenode.FSNamesystem: Number of over-replicated
blocks = 0
09/07/27 10:47:17 INFO hdfs.StateChange: STATE* Leaving safe mode after 0
secs.
09/07/27 10:47:17 INFO hdfs.StateChange: STATE* Network topology has 0 racks
and 0 datanodes
09/07/27 10:47:17 INFO hdfs.StateChange: STATE* UnderReplicatedBlocks has 0
blocks
09/07/27 10:47:18 INFO mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
09/07/27 10:47:18 INFO http.HttpServer: Jetty bound to port 51879
09/07/27 10:47:18 INFO mortbay.log: jetty-6.1.14
09/07/27 10:47:18 INFO mortbay.log: Extract
jar:file:/home/mathias/Stage/hadoop/hadoop-0.20.0/hadoop-0.20.0-core.jar!/webapps/hdfs
to /tmp/Jetty_localhost_51879_hdfs____9j1odk/webapp
09/07/27 10:47:18 INFO mortbay.log: Started selectchannelconnec...@localhost
:51879
09/07/27 10:47:18 INFO namenode.NameNode: Web-server up at: localhost:51879
09/07/27 10:47:18 INFO ipc.Server: IPC Server Responder: starting
09/07/27 10:47:18 INFO ipc.Server: IPC Server listener on 55781: starting
09/07/27 10:47:18 INFO ipc.Server: IPC Server handler 0 on 55781: starting
09/07/27 10:47:18 INFO ipc.Server: IPC Server handler 1 on 55781: starting
09/07/27 10:47:18 INFO ipc.Server: IPC Server handler 2 on 55781: starting
09/07/27 10:47:18 INFO ipc.Server: IPC Server handler 3 on 55781: starting
09/07/27 10:47:18 INFO ipc.Server: IPC Server handler 4 on 55781: starting
09/07/27 10:47:18 INFO ipc.Server: IPC Server handler 5 on 55781: starting
09/07/27 10:47:18 INFO ipc.Server: IPC Server handler 6 on 55781: starting
09/07/27 10:47:18 INFO ipc.Server: IPC Server handler 7 on 55781: starting
09/07/27 10:47:18 INFO ipc.Server: IPC Server handler 8 on 55781: starting
09/07/27 10:47:18 INFO ipc.Server: IPC Server handler 9 on 55781: starting
Starting DataNode 0 with dfs.data.dir:
build/test/data/dfs/data/data1,build/test/data/dfs/data/data2
09/07/27 10:47:18 INFO common.Storage: Storage directory
build/test/data/dfs/data/data1 is not formatted.
09/07/27 10:47:18 INFO common.Storage: Formatting ...
09/07/27 10:47:18 INFO common.Storage: Storage directory
build/test/data/dfs/data/data2 is not formatted.
09/07/27 10:47:18 INFO common.Storage: Formatting ...
09/07/27 10:47:18 INFO datanode.DataNode: Registered FSDatasetStatusMBean
09/07/27 10:47:18 INFO datanode.DataNode: Opened info server at 43379
09/07/27 10:47:18 INFO datanode.DataNode: Balancing bandwith is 1048576
bytes/s
09/07/27 10:47:18 INFO http.HttpServer: Jetty bound to port 33496
09/07/27 10:47:18 INFO mortbay.log: jetty-6.1.14
09/07/27 10:47:18 INFO mortbay.log: Extract
jar:file:/home/mathias/Stage/hadoop/hadoop-0.20.0/hadoop-0.20.0-core.jar!/webapps/datanode
to /tmp/Jetty_localhost_33496_datanode____vtouhk/webapp
09/07/27 10:47:19 INFO mortbay.log: Started selectchannelconnec...@localhost
:33496
09/07/27 10:47:19 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with
processName=DataNode, sessionId=null - already initialized
09/07/27 10:47:19 INFO metrics.RpcMetrics: Initializing RPC Metrics with
hostName=DataNode, port=45264
09/07/27 10:47:19 INFO ipc.Server: IPC Server Responder: starting
09/07/27 10:47:19 INFO ipc.Server: IPC Server listener on 45264: starting
09/07/27 10:47:19 INFO ipc.Server: IPC Server handler 0 on 45264: starting
09/07/27 10:47:19 INFO ipc.Server: IPC Server handler 1 on 45264: starting
09/07/27 10:47:19 INFO ipc.Server: IPC Server handler 2 on 45264: starting
09/07/27 10:47:19 INFO datanode.DataNode: dnRegistration =
DatanodeRegistration(mathias-desktop:43379, storageID=, infoPort=33496,
ipcPort=45264)
09/07/27 10:47:19 INFO hdfs.StateChange: BLOCK* NameSystem.registerDatanode:
node registration from 127.0.0.1:43379 storage
DS-1003702889-127.0.1.1-43379-1248684439122
09/07/27 10:47:19 INFO net.NetworkTopology: Adding a new node:
/default-rack/127.0.0.1:43379
09/07/27 10:47:19 INFO datanode.DataNode: New storage id
DS-1003702889-127.0.1.1-43379-1248684439122 is assigned to data-node
127.0.0.1:43379
09/07/27 10:47:19 INFO datanode.DataNode: DatanodeRegistration(
127.0.0.1:43379, storageID=DS-1003702889-127.0.1.1-43379-1248684439122,
infoPort=33496, ipcPort=45264)In DataNode.run, data =
FSDataset{dirpath='/home/mathias/Stage/hadoop_testing/crawler/svn/Crawler/build/test/data/dfs/data/data1/current,/home/mathias/Stage/hadoop_testing/crawler/svn/Crawler/build/test/data/dfs/data/data2/current'}
09/07/27 10:47:19 INFO datanode.DataNode: using BLOCKREPORT_INTERVAL of
3600000msec Initial delay: 0msec
Waiting for the Mini HDFS Cluster to start...
09/07/27 10:47:19 INFO datanode.DataNode: BlockReport of 0 blocks got
processed in 3 msecs
09/07/27 10:47:19 INFO datanode.DataNode: Starting Periodic block scanner.
Generating rack names for tasktrackers
Generating host names for tasktrackers
09/07/27 10:47:20 INFO metrics.RpcMetrics: Initializing RPC Metrics with
hostName=JobTracker, port=54547
09/07/27 10:47:20 INFO http.HttpServer: Jetty bound to port 51708
09/07/27 10:47:20 INFO mortbay.log: jetty-6.1.14
09/07/27 10:47:20 INFO mortbay.log: Extract
jar:file:/home/mathias/Stage/hadoop/hadoop-0.20.0/hadoop-0.20.0-core.jar!/webapps/job
to /tmp/Jetty_localhost_51708_job____.yvirzp/webapp
09/07/27 10:47:20 INFO mortbay.log: Started selectchannelconnec...@localhost
:51708
09/07/27 10:47:20 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with
processName=JobTracker, sessionId= - already initialized
09/07/27 10:47:20 INFO mapred.JobTracker: JobTracker up at: 54547
09/07/27 10:47:20 INFO mapred.JobTracker: JobTracker webserver: 51708
09/07/27 10:47:20 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=listStatus
src=/tmp/hadoop-mathias/mapred/system dst=null perm=null
09/07/27 10:47:20 INFO mapred.JobTracker: Cleaning up the system directory
09/07/27 10:47:20 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=mkdirs
src=/tmp/hadoop-mathias/mapred/system dst=null
perm=mathias:supergroup:rwxr-xr-x
09/07/27 10:47:20 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=setPermission
src=/tmp/hadoop-mathias/mapred/system dst=null
perm=mathias:supergroup:rwx-wx-wx
09/07/27 10:47:20 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=create
src=/tmp/hadoop-mathias/mapred/system/jobtracker.info dst=null
perm=mathias:supergroup:rw-r--r--
09/07/27 10:47:20 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=setPermission
src=/tmp/hadoop-mathias/mapred/system/jobtracker.info dst=null
perm=mathias:supergroup:rw-------
09/07/27 10:47:20 INFO hdfs.StateChange: BLOCK* NameSystem.allocateBlock:
/tmp/hadoop-mathias/mapred/system/jobtracker.info.
blk_-8281480607865986172_1001
09/07/27 10:47:20 INFO datanode.DataNode: Receiving block
blk_-8281480607865986172_1001 src: /127.0.0.1:54832 dest: /127.0.0.1:43379
09/07/27 10:47:20 INFO DataNode.clienttrace: src: /127.0.0.1:54832, dest: /
127.0.0.1:43379, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_171314401,
srvID: DS-1003702889-127.0.1.1-43379-1248684439122, blockid:
blk_-8281480607865986172_1001
09/07/27 10:47:20 INFO hdfs.StateChange: BLOCK* NameSystem.addStoredBlock:
blockMap updated: 127.0.0.1:43379 is added to blk_-8281480607865986172_1001
size 4
09/07/27 10:47:20 INFO datanode.DataNode: PacketResponder 0 for block
blk_-8281480607865986172_1001 terminating
09/07/27 10:47:20 INFO ipc.Server: IPC Server Responder: starting
09/07/27 10:47:20 INFO ipc.Server: IPC Server listener on 54547: starting
09/07/27 10:47:20 INFO ipc.Server: IPC Server handler 1 on 54547: starting
09/07/27 10:47:20 INFO ipc.Server: IPC Server handler 0 on 54547: starting
09/07/27 10:47:20 INFO ipc.Server: IPC Server handler 2 on 54547: starting
09/07/27 10:47:20 INFO ipc.Server: IPC Server handler 3 on 54547: starting
09/07/27 10:47:20 INFO ipc.Server: IPC Server handler 4 on 54547: starting
09/07/27 10:47:20 INFO ipc.Server: IPC Server handler 5 on 54547: starting
09/07/27 10:47:20 INFO ipc.Server: IPC Server handler 6 on 54547: starting
09/07/27 10:47:20 INFO ipc.Server: IPC Server handler 7 on 54547: starting
09/07/27 10:47:20 INFO ipc.Server: IPC Server handler 8 on 54547: starting
09/07/27 10:47:20 INFO ipc.Server: IPC Server handler 9 on 54547: starting
09/07/27 10:47:20 INFO mapred.JobTracker: Starting RUNNING
09/07/27 10:47:21 INFO mapred.MiniMRCluster: mapred.local.dir is
/tmp/hadoop-mathias/mapred/local/0_0
09/07/27 10:47:26 INFO http.HttpServer: Jetty bound to port 46073
09/07/27 10:47:26 INFO mortbay.log: jetty-6.1.14
09/07/27 10:47:26 INFO mortbay.log: Extract
jar:file:/home/mathias/Stage/hadoop/hadoop-0.20.0/hadoop-0.20.0-core.jar!/webapps/task
to /tmp/Jetty_0_0_0_0_46073_task____.73rsm0/webapp
09/07/27 10:47:26 INFO mortbay.log: Started
selectchannelconnec...@0.0.0.0:46073
09/07/27 10:47:26 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with
processName=TaskTracker, sessionId= - already initialized
09/07/27 10:47:26 INFO metrics.RpcMetrics: Initializing RPC Metrics with
hostName=TaskTracker, port=6541
09/07/27 10:47:26 INFO ipc.Server: IPC Server Responder: starting
09/07/27 10:47:26 INFO ipc.Server: IPC Server handler 0 on 6541: starting
09/07/27 10:47:26 INFO ipc.Server: IPC Server listener on 6541: starting
09/07/27 10:47:26 INFO ipc.Server: IPC Server handler 1 on 6541: starting
09/07/27 10:47:26 INFO ipc.Server: IPC Server handler 2 on 6541: starting
09/07/27 10:47:26 INFO ipc.Server: IPC Server handler 3 on 6541: starting
09/07/27 10:47:26 INFO mapred.TaskTracker: TaskTracker up at: localhost/
127.0.0.1:6541
09/07/27 10:47:26 INFO mapred.TaskTracker: Starting tracker
tracker_host0.foo.com:localhost/127.0.0.1:6541
09/07/27 10:47:26 INFO mapred.TaskTracker: Starting thread: Map-events
fetcher for all reduce tasks on tracker_host0.foo.com:localhost/
127.0.0.1:6541
09/07/27 10:47:26 INFO mapred.TaskTracker: Using MemoryCalculatorPlugin :
org.apache.hadoop.util.linuxmemorycalculatorplu...@5374a6e2
09/07/27 10:47:26 WARN mapred.TaskTracker: TaskTracker's reservedVmem is not
configured.
TaskTracker's defaultMaxVmPerTask is not configured.
TaskTracker's limitMaxVmPerTask is not configured.
TaskMemoryManager is disabled.
09/07/27 10:47:26 INFO mapred.IndexCache: IndexCache created with max memory
= 10485760
09/07/27 10:47:26 INFO net.NetworkTopology: Adding a new node:
/default-rack/host0.foo.com
I'm alive!
09/07/27 10:47:26 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=mkdirs src=/user/mathias/input
dst=null perm=mathias:supergroup:rwxr-xr-x
09/07/27 10:47:26 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=create
src=/user/mathias/input/localfile dst=null
perm=mathias:supergroup:rw-r--r--
09/07/27 10:47:26 WARN mapred.JobClient: Use GenericOptionsParser for
parsing the arguments. Applications should implement Tool for the same.
09/07/27 10:47:26 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=mkdirs
src=/tmp/hadoop-mathias/mapred/system/job_200907271047_0001
dst=null perm=mathias:supergroup:rwxr-xr-x
09/07/27 10:47:26 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=setPermission
src=/tmp/hadoop-mathias/mapred/system/job_200907271047_0001
dst=null perm=mathias:supergroup:rwxrwxrwx
09/07/27 10:47:26 WARN mapred.JobClient: No job jar file set. User classes
may not be found. See JobConf(Class) or JobConf#setJar(String).
09/07/27 10:47:26 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=listStatus src=/user/mathias/input
dst=null perm=null
09/07/27 10:47:26 INFO input.FileInputFormat: Total input paths to process :
1
09/07/27 10:47:26 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=open
src=/user/mathias/input/localfile dst=null perm=null
09/07/27 10:47:26 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=create
src=/tmp/hadoop-mathias/mapred/system/job_200907271047_0001/job.split
dst=null perm=mathias:supergroup:rw-r--r--
09/07/27 10:47:26 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=setPermission
src=/tmp/hadoop-mathias/mapred/system/job_200907271047_0001/job.split
dst=null perm=mathias:supergroup:rw-r--r--
09/07/27 10:47:26 INFO hdfs.StateChange: BLOCK* NameSystem.allocateBlock:
/tmp/hadoop-mathias/mapred/system/job_200907271047_0001/job.split.
blk_-9173994587095237857_1003
09/07/27 10:47:26 INFO datanode.DataNode: Receiving block
blk_-9173994587095237857_1003 src: /127.0.0.1:54836 dest: /127.0.0.1:43379
09/07/27 10:47:26 INFO DataNode.clienttrace: src: /127.0.0.1:54836, dest: /
127.0.0.1:43379, bytes: 134, op: HDFS_WRITE, cliID: DFSClient_171314401,
srvID: DS-1003702889-127.0.1.1-43379-1248684439122, blockid:
blk_-9173994587095237857_1003
09/07/27 10:47:26 INFO hdfs.StateChange: BLOCK* NameSystem.addStoredBlock:
blockMap updated: 127.0.0.1:43379 is added to blk_-9173994587095237857_1003
size 134
09/07/27 10:47:26 INFO datanode.DataNode: PacketResponder 0 for block
blk_-9173994587095237857_1003 terminating
09/07/27 10:47:26 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=create
src=/tmp/hadoop-mathias/mapred/system/job_200907271047_0001/job.xml
dst=null perm=mathias:supergroup:rw-r--r--
09/07/27 10:47:26 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=setPermission
src=/tmp/hadoop-mathias/mapred/system/job_200907271047_0001/job.xml
dst=null perm=mathias:supergroup:rw-r--r--
09/07/27 10:47:26 INFO hdfs.StateChange: BLOCK* NameSystem.allocateBlock:
/tmp/hadoop-mathias/mapred/system/job_200907271047_0001/job.xml.
blk_7076292327417902154_1004
09/07/27 10:47:26 INFO datanode.DataNode: Receiving block
blk_7076292327417902154_1004 src: /127.0.0.1:54837 dest: /127.0.0.1:43379
09/07/27 10:47:26 INFO DataNode.clienttrace: src: /127.0.0.1:54837, dest: /
127.0.0.1:43379, bytes: 16812, op: HDFS_WRITE, cliID: DFSClient_171314401,
srvID: DS-1003702889-127.0.1.1-43379-1248684439122, blockid:
blk_7076292327417902154_1004
09/07/27 10:47:26 INFO datanode.DataNode: PacketResponder 0 for block
blk_7076292327417902154_1004 terminating
09/07/27 10:47:26 INFO hdfs.StateChange: BLOCK* NameSystem.addStoredBlock:
blockMap updated: 127.0.0.1:43379 is added to blk_7076292327417902154_1004
size 16812
09/07/27 10:47:26 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=open
src=/tmp/hadoop-mathias/mapred/system/job_200907271047_0001/job.xml
dst=null perm=null
09/07/27 10:47:26 INFO DataNode.clienttrace: src: /127.0.0.1:43379, dest: /
127.0.0.1:54838, bytes: 16944, op: HDFS_READ, cliID: DFSClient_171314401,
srvID: DS-1003702889-127.0.1.1-43379-1248684439122, blockid:
blk_7076292327417902154_1004
09/07/27 10:47:26 INFO mapred.EagerTaskInitializationListener: Initializing
job_200907271047_0001
09/07/27 10:47:26 INFO mapred.JobClient: Running job: job_200907271047_0001
09/07/27 10:47:26 INFO mapred.JobHistory: Nothing to recover! Generating a
new filename localhost_1248684440260_job_200907271047_0001_mathias_test for
job job_200907271047_0001
09/07/27 10:47:26 INFO mapred.JobHistory:
localhost_1248684440260_job_200907271047_0001_mathias_test doesnt exist!
Using localhost_1248684440260_job_200907271047_0001_mathias_test.recover for
recovery.
09/07/27 10:47:26 INFO mapred.JobHistory:
localhost_1248684440260_job_200907271047_0001_mathias_test doesnt exist!
Using localhost_1248684440260_job_200907271047_0001_mathias_test.recover as
the master history file for user.
09/07/27 10:47:26 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=create
src=/user/mathias/output/_logs/history/localhost_1248684440260_job_200907271047_0001_mathias_test
dst=null perm=mathias:supergroup:rw-r--r--
09/07/27 10:47:27 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=create
src=/user/mathias/output/_logs/history/localhost_1248684440260_job_200907271047_0001_conf.xml
dst=null perm=mathias:supergroup:rw-r--r--
09/07/27 10:47:27 INFO hdfs.StateChange: BLOCK* NameSystem.allocateBlock:
/user/mathias/output/_logs/history/localhost_1248684440260_job_200907271047_0001_conf.xml.
blk_6213472500370645493_1006
09/07/27 10:47:27 INFO datanode.DataNode: Receiving block
blk_6213472500370645493_1006 src: /127.0.0.1:54839 dest: /127.0.0.1:43379
09/07/27 10:47:27 INFO DataNode.clienttrace: src: /127.0.0.1:54839, dest: /
127.0.0.1:43379, bytes: 16812, op: HDFS_WRITE, cliID: DFSClient_171314401,
srvID: DS-1003702889-127.0.1.1-43379-1248684439122, blockid:
blk_6213472500370645493_1006
09/07/27 10:47:27 INFO datanode.DataNode: PacketResponder 0 for block
blk_6213472500370645493_1006 terminating
09/07/27 10:47:27 INFO hdfs.StateChange: BLOCK* NameSystem.addStoredBlock:
blockMap updated: 127.0.0.1:43379 is added to blk_6213472500370645493_1006
size 16812
09/07/27 10:47:27 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=open
src=/tmp/hadoop-mathias/mapred/system/job_200907271047_0001/job.split
dst=null perm=null
09/07/27 10:47:27 INFO DataNode.clienttrace: src: /127.0.0.1:43379, dest: /
127.0.0.1:54840, bytes: 138, op: HDFS_READ, cliID: DFSClient_171314401,
srvID: DS-1003702889-127.0.1.1-43379-1248684439122, blockid:
blk_-9173994587095237857_1003
09/07/27 10:47:27 INFO mapred.JobInProgress: Input size for job
job_200907271047_0001 = 0
09/07/27 10:47:27 INFO mapred.JobInProgress: Split info for
job:job_200907271047_0001 with 1 splits:
09/07/27 10:47:27 INFO mapred.JobClient: map 0% reduce 0%
09/07/27 10:47:29 INFO mapred.JobTracker: Adding task
'attempt_200907271047_0001_m_000002_0' to tip
task_200907271047_0001_m_000002, for tracker 'tracker_host0.foo.com:
localhost/127.0.0.1:6541'
09/07/27 10:47:29 INFO mapred.TaskTracker: LaunchTaskAction (registerTask):
attempt_200907271047_0001_m_000002_0 task's state:UNASSIGNED
09/07/27 10:47:29 INFO mapred.TaskTracker: Trying to launch :
attempt_200907271047_0001_m_000002_0
09/07/27 10:47:29 INFO mapred.TaskTracker: In TaskLauncher, current free
slots : 2 and trying to launch attempt_200907271047_0001_m_000002_0
09/07/27 10:47:29 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=open
src=/tmp/hadoop-mathias/mapred/system/job_200907271047_0001/job.xml
dst=null perm=null
09/07/27 10:47:29 INFO DataNode.clienttrace: src: /127.0.0.1:43379, dest: /
127.0.0.1:54841, bytes: 16944, op: HDFS_READ, cliID: DFSClient_171314401,
srvID: DS-1003702889-127.0.1.1-43379-1248684439122, blockid:
blk_7076292327417902154_1004
09/07/27 10:47:29 INFO mapred.JvmManager: In JvmRunner constructed JVM ID:
jvm_200907271047_0001_m_419903604
09/07/27 10:47:29 INFO mapred.JvmManager: JVM Runner
jvm_200907271047_0001_m_419903604 spawned.
09/07/27 10:47:30 INFO mapred.TaskTracker: JVM with ID:
jvm_200907271047_0001_m_419903604 given task:
attempt_200907271047_0001_m_000002_0
09/07/27 10:47:30 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=mkdirs
src=/user/mathias/output/_temporary dst=null
perm=mathias:supergroup:rwxr-xr-x
09/07/27 10:47:30 INFO mapred.TaskTracker:
attempt_200907271047_0001_m_000002_0 0.0% setup
09/07/27 10:47:30 INFO mapred.TaskTracker: Task
attempt_200907271047_0001_m_000002_0 is done.
09/07/27 10:47:30 INFO mapred.TaskTracker: reported output size for
attempt_200907271047_0001_m_000002_0 was 0
09/07/27 10:47:30 INFO mapred.TaskTracker: addFreeSlot : current free slots
: 2
09/07/27 10:47:30 INFO mapred.JvmManager: JVM :
jvm_200907271047_0001_m_419903604 exited. Number of tasks it ran: 1
09/07/27 10:47:32 INFO mapred.TaskTracker:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
taskTracker/jobcache/job_200907271047_0001/attempt_200907271047_0001_m_000002_0/output/file.out
in any of the configured local directories
09/07/27 10:47:32 INFO mapred.JobInProgress: Task
'attempt_200907271047_0001_m_000002_0' has completed
task_200907271047_0001_m_000002 successfully.
09/07/27 10:47:32 INFO mapred.JobInProgress: Choosing a non-local task
task_200907271047_0001_m_000000
09/07/27 10:47:32 INFO mapred.JobTracker: Adding task
'attempt_200907271047_0001_m_000000_0' to tip
task_200907271047_0001_m_000000, for tracker 'tracker_host0.foo.com:
localhost/127.0.0.1:6541'
09/07/27 10:47:32 INFO mapred.TaskTracker: LaunchTaskAction (registerTask):
attempt_200907271047_0001_m_000000_0 task's state:UNASSIGNED
09/07/27 10:47:32 INFO mapred.TaskTracker: Trying to launch :
attempt_200907271047_0001_m_000000_0
09/07/27 10:47:32 INFO mapred.TaskTracker: Received KillTaskAction for task:
attempt_200907271047_0001_m_000002_0
09/07/27 10:47:32 INFO mapred.TaskTracker: In TaskLauncher, current free
slots : 2 and trying to launch attempt_200907271047_0001_m_000000_0
09/07/27 10:47:32 INFO mapred.TaskTracker: About to purge task:
attempt_200907271047_0001_m_000002_0
09/07/27 10:47:32 INFO mapred.TaskRunner:
attempt_200907271047_0001_m_000002_0 done; removing files.
09/07/27 10:47:32 INFO mapred.IndexCache: Map ID
attempt_200907271047_0001_m_000002_0 not found in cache
09/07/27 10:47:32 INFO mapred.JvmManager: In JvmRunner constructed JVM ID:
jvm_200907271047_0001_m_-1049881261
09/07/27 10:47:32 INFO mapred.JvmManager: JVM Runner
jvm_200907271047_0001_m_-1049881261 spawned.
09/07/27 10:47:32 INFO mapred.JobClient: Task Id :
attempt_200907271047_0001_m_000002_0, Status : SUCCEEDED
09/07/27 10:47:33 INFO mapred.TaskTracker: JVM with ID:
jvm_200907271047_0001_m_-1049881261 given task:
attempt_200907271047_0001_m_000000_0
09/07/27 10:47:33 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=create
src=/user/mathias/output/_temporary/_attempt_200907271047_0001_m_000000_0/part-m-00000
dst=null perm=mathias:supergroup:rw-r--r--
09/07/27 10:47:33 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=open
src=/user/mathias/input/localfile dst=null perm=null
09/07/27 10:47:33 INFO hdfs.StateChange: BLOCK* NameSystem.allocateBlock:
/user/mathias/output/_temporary/_attempt_200907271047_0001_m_000000_0/part-m-00000.
blk_2892422037976398919_1007
09/07/27 10:47:33 INFO datanode.DataNode: Receiving block
blk_2892422037976398919_1007 src: /127.0.0.1:54853 dest: /127.0.0.1:43379
09/07/27 10:47:33 INFO DataNode.clienttrace: src: /127.0.0.1:54853, dest: /
127.0.0.1:43379, bytes: 85, op: HDFS_WRITE, cliID:
DFSClient_attempt_200907271047_0001_m_000000_0, srvID:
DS-1003702889-127.0.1.1-43379-1248684439122, blockid:
blk_2892422037976398919_1007
09/07/27 10:47:33 INFO hdfs.StateChange: BLOCK* NameSystem.addStoredBlock:
blockMap updated: 127.0.0.1:43379 is added to blk_2892422037976398919_1007
size 85
09/07/27 10:47:33 INFO datanode.DataNode: PacketResponder 0 for block
blk_2892422037976398919_1007 terminating
09/07/27 10:47:33 INFO mapred.TaskTracker: Task
attempt_200907271047_0001_m_000000_0 is in commit-pending, task
state:COMMIT_PENDING
09/07/27 10:47:33 INFO mapred.TaskTracker:
attempt_200907271047_0001_m_000000_0 0.0%
09/07/27 10:47:35 INFO mapred.TaskTracker: Received commit task action for
attempt_200907271047_0001_m_000000_0
09/07/27 10:47:35 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=listStatus
src=/user/mathias/output/_temporary/_attempt_200907271047_0001_m_000000_0
dst=null perm=null
09/07/27 10:47:35 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=mkdirs src=/user/mathias/output
dst=null perm=mathias:supergroup:rwxr-xr-x
09/07/27 10:47:35 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=rename
src=/user/mathias/output/_temporary/_attempt_200907271047_0001_m_000000_0/part-m-00000
dst=/user/mathias/output/part-m-00000
perm=mathias:supergroup:rw-r--r--
09/07/27 10:47:35 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=delete
src=/user/mathias/output/_temporary/_attempt_200907271047_0001_m_000000_0
dst=null perm=null
09/07/27 10:47:35 INFO mapred.TaskTracker:
attempt_200907271047_0001_m_000000_0 0.0%
09/07/27 10:47:35 INFO mapred.TaskTracker: Task
attempt_200907271047_0001_m_000000_0 is done.
09/07/27 10:47:35 INFO mapred.TaskTracker: reported output size for
attempt_200907271047_0001_m_000000_0 was 0
09/07/27 10:47:35 INFO mapred.TaskTracker: addFreeSlot : current free slots
: 2
09/07/27 10:47:35 INFO mapred.JvmManager: JVM :
jvm_200907271047_0001_m_-1049881261 exited. Number of tasks it ran: 1
09/07/27 10:47:38 INFO mapred.TaskTracker:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
taskTracker/jobcache/job_200907271047_0001/attempt_200907271047_0001_m_000000_0/output/file.out
in any of the configured local directories
09/07/27 10:47:38 INFO mapred.JobInProgress: Task
'attempt_200907271047_0001_m_000000_0' has completed
task_200907271047_0001_m_000000 successfully.
09/07/27 10:47:38 INFO mapred.JobTracker: Adding task
'attempt_200907271047_0001_m_000001_0' to tip
task_200907271047_0001_m_000001, for tracker 'tracker_host0.foo.com:
localhost/127.0.0.1:6541'
09/07/27 10:47:38 INFO mapred.TaskTracker: LaunchTaskAction (registerTask):
attempt_200907271047_0001_m_000001_0 task's state:UNASSIGNED
09/07/27 10:47:38 INFO mapred.TaskTracker: Trying to launch :
attempt_200907271047_0001_m_000001_0
09/07/27 10:47:38 INFO mapred.TaskTracker: In TaskLauncher, current free
slots : 2 and trying to launch attempt_200907271047_0001_m_000001_0
09/07/27 10:47:38 INFO mapred.JvmManager: In JvmRunner constructed JVM ID:
jvm_200907271047_0001_m_-1525315512
09/07/27 10:47:38 INFO mapred.JvmManager: JVM Runner
jvm_200907271047_0001_m_-1525315512 spawned.
09/07/27 10:47:39 INFO mapred.JobClient: Task Id :
attempt_200907271047_0001_m_000000_0, Status : SUCCEEDED
attempt_200907271047_0001_m_000000_0: SETUP!!!
attempt_200907271047_0001_m_000000_0: CLEANUP!!!
09/07/27 10:47:39 INFO mapred.TaskTracker: JVM with ID:
jvm_200907271047_0001_m_-1525315512 given task:
attempt_200907271047_0001_m_000001_0
09/07/27 10:47:39 INFO mapred.TaskTracker:
attempt_200907271047_0001_m_000001_0 0.0%
09/07/27 10:47:39 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=delete
src=/user/mathias/output/_temporary dst=null perm=null
09/07/27 10:47:39 INFO mapred.TaskTracker:
attempt_200907271047_0001_m_000001_0 0.0% cleanup
09/07/27 10:47:39 INFO mapred.TaskTracker: Task
attempt_200907271047_0001_m_000001_0 is done.
09/07/27 10:47:39 INFO mapred.TaskTracker: reported output size for
attempt_200907271047_0001_m_000001_0 was 0
09/07/27 10:47:39 INFO mapred.TaskTracker: addFreeSlot : current free slots
: 2
09/07/27 10:47:39 INFO mapred.JvmManager: JVM :
jvm_200907271047_0001_m_-1525315512 exited. Number of tasks it ran: 1
09/07/27 10:47:40 INFO mapred.JobClient: map 100% reduce 0%
09/07/27 10:47:41 INFO mapred.TaskTracker:
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
taskTracker/jobcache/job_200907271047_0001/attempt_200907271047_0001_m_000001_0/output/file.out
in any of the configured local directories
09/07/27 10:47:41 INFO mapred.JobInProgress: Task
'attempt_200907271047_0001_m_000001_0' has completed
task_200907271047_0001_m_000001 successfully.
09/07/27 10:47:41 INFO mapred.JobInProgress: Job job_200907271047_0001 has
completed successfully.
09/07/27 10:47:41 INFO hdfs.StateChange: BLOCK* NameSystem.allocateBlock:
/user/mathias/output/_logs/history/localhost_1248684440260_job_200907271047_0001_mathias_test.
blk_926531236934191337_1007
09/07/27 10:47:41 INFO datanode.DataNode: Receiving block
blk_926531236934191337_1007 src: /127.0.0.1:54860 dest: /127.0.0.1:43379
09/07/27 10:47:41 INFO DataNode.clienttrace: src: /127.0.0.1:54860, dest: /
127.0.0.1:43379, bytes: 4021, op: HDFS_WRITE, cliID: DFSClient_171314401,
srvID: DS-1003702889-127.0.1.1-43379-1248684439122, blockid:
blk_926531236934191337_1007
09/07/27 10:47:41 INFO datanode.DataNode: PacketResponder 0 for block
blk_926531236934191337_1007 terminating
09/07/27 10:47:41 INFO hdfs.StateChange: BLOCK* NameSystem.addStoredBlock:
blockMap updated: 127.0.0.1:43379 is added to blk_926531236934191337_1007
size 4021
09/07/27 10:47:41 INFO mapred.JobHistory: Recovered job history filename for
job job_200907271047_0001 is
localhost_1248684440260_job_200907271047_0001_mathias_test
09/07/27 10:47:41 INFO mapred.JobTracker: Removed completed task
'attempt_200907271047_0001_m_000000_0' from 'tracker_host0.foo.com:
localhost/127.0.0.1:6541'
09/07/27 10:47:41 INFO mapred.JobTracker: Removed completed task
'attempt_200907271047_0001_m_000001_0' from 'tracker_host0.foo.com:
localhost/127.0.0.1:6541'
09/07/27 10:47:41 INFO mapred.JobTracker: Removed completed task
'attempt_200907271047_0001_m_000002_0' from 'tracker_host0.foo.com:
localhost/127.0.0.1:6541'
09/07/27 10:47:41 INFO mapred.TaskTracker: Received 'KillJobAction' for job:
job_200907271047_0001
09/07/27 10:47:41 INFO mapred.TaskRunner:
attempt_200907271047_0001_m_000001_0 done; removing files.
09/07/27 10:47:41 INFO hdfs.StateChange: BLOCK* NameSystem.addToInvalidates:
blk_-9173994587095237857 is added to invalidSet of 127.0.0.1:43379
09/07/27 10:47:41 INFO hdfs.StateChange: BLOCK* NameSystem.addToInvalidates:
blk_7076292327417902154 is added to invalidSet of 127.0.0.1:43379
09/07/27 10:47:41 INFO mapred.IndexCache: Map ID
attempt_200907271047_0001_m_000001_0 not found in cache
09/07/27 10:47:41 INFO mapred.TaskRunner:
attempt_200907271047_0001_m_000000_0 done; removing files.
09/07/27 10:47:41 INFO FSNamesystem.audit:
ugi=mathias,mathias,adm,dialout,cdrom,floppy,audio,dip,video,plugdev,fuse,lpadmin,admin,vboxusers,sambashare,usbuser
ip=/127.0.0.1 cmd=delete
src=/tmp/hadoop-mathias/mapred/system/job_200907271047_0001
dst=null perm=null
09/07/27 10:47:41 INFO mapred.IndexCache: Map ID
attempt_200907271047_0001_m_000000_0 not found in cache
09/07/27 10:47:41 INFO hdfs.StateChange: BLOCK* ask 127.0.0.1:43379 to
delete blk_7076292327417902154_1004 blk_-9173994587095237857_1003
09/07/27 10:47:42 INFO mapred.JobClient: Task Id :
attempt_200907271047_0001_m_000001_0, Status : SUCCEEDED
09/07/27 10:47:42 INFO mapred.JobClient: Job complete: job_200907271047_0001
09/07/27 10:47:42 INFO mapred.JobClient: Counters: 4
09/07/27 10:47:42 INFO mapred.JobClient: Job Counters
09/07/27 10:47:42 INFO mapred.JobClient: Launched map tasks=1
09/07/27 10:47:42 INFO mapred.JobClient: FileSystemCounters
09/07/27 10:47:42 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=85
09/07/27 10:47:42 INFO mapred.JobClient: Map-Reduce Framework
09/07/27 10:47:42 INFO mapred.JobClient: Map input records=0
09/07/27 10:47:42 INFO mapred.JobClient: Spilled Records=0
Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 24,91 sec
