Hi,
I want to list files in the HDFS using the |FileUtil.listFiles| but all
I get is IOException errors. The code, error and the output is below.
How I list files in HDFS?
|Exception in thread "main" java.io.IOException: Invalid directory or I/O error
occurred for dir: /outputmp
|
I have this code
| try{
File[] mapOutputFiles = FileUtil.listFiles(new
File("webhdfs://hadoop-coc-1/outputmp/"));
System.out.println("1 success: " + mapOutputFiles.length);
} catch (Exception e) {
System.out.println("1 failed");
}
try {
File[] mapOutputFiles2 = FileUtil.listFiles(new
File("webhdfs://hadoop-coc-1/outputmp"));
System.out.println("2 success: " + mapOutputFiles2.length);
} catch (Exception e) {
System.out.println("2 failed");
}
try {
File[] mapOutputFiles3 = FileUtil.listFiles(new File("/outputmp"));
System.out.println("3 success: " + mapOutputFiles3.length);
} catch (Exception e) {
System.out.println("3 failed");
}
try {
File[] mapOutputFiles4 = FileUtil.listFiles(new File("/outputmp/"));
System.out.println("4 success: " + mapOutputFiles4.length);
} catch (Exception e) {
System.out.println("4 failed");
}
|
The output
|1 failed
2 failed
3 failed
4 failed
|
The output exists
|vagrant@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -ls /outputmp
Found 2 items
-rw-r--r-- 2 vagrant supergroup 0 2015-02-05 15:50 /outputmp/_SUCCESS
-rw-r--r-- 2 vagrant supergroup 12 2015-02-05 15:50
/outputmp/part-m-00000
vagrant@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -ls
webhdfs://hadoop-coc-1/outputmp
Found 2 items
-rw-r--r-- 2 vagrant supergroup 0 2015-02-05 15:50
webhdfs://hadoop-coc-1/outputmp/_SUCCESS
-rw-r--r-- 2 vagrant supergroup 12 2015-02-05 15:50
webhdfs://hadoop-coc-1/outputmp/part-m-00000
vagrant@hadoop-coc-1:~/Programs/hadoop$
|
