Exception in thread "main" java.io.FileNotFoundException: File does
not exist: hdfs:///test-batchEventLog/metrics/data
at
org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:457)
at
org.apache.hadoop.mapreduce.lib.input.SequenceFileInputFormat.listStatus(SequenceFileInputFormat.java:63)
at
org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:241)
at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
at
org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
at reporting.HDFSMapReduceQuery.execute(HDFSMetricsQuery.scala:60)
My job config contains the following:
println("using input path: " + inPath)
println("using output path: " + outPath)
FileInputFormat.setInputPaths(job, inPath);
FileOutputFormat.setOutputPath(job, outPath)
with input & output paths printed out as:
using input path: hdfs:/test-batchEventLog
using output path:
hdfs:/test-batchEventLog/out/03d24392-9bd9-4b23-8240-aceb54b3473c
Any ideas why this would be occurring?
Thanks,
Kris