Hi Xeon!
Can you try using the FileContext or FileSystem API?
HTH
Ravi
On Thursday, February 5, 2015 8:13 AM, xeonmailinglist
<[email protected]> wrote:
Hi,
I want to list files in the HDFS using the FileUtil.listFiles but all I get
is IOException errors. The code, error and the output is below. How I list
files in HDFS?
Exception in thread "main" java.io.IOException: Invalid directory or I/O
error occurred for dir: /outputmp
I have this code try{
File[] mapOutputFiles = FileUtil.listFiles(new
File("webhdfs://hadoop-coc-1/outputmp/"));
System.out.println("1 success: " + mapOutputFiles.length);
} catch (Exception e) {
System.out.println("1 failed");
}
try {
File[] mapOutputFiles2 = FileUtil.listFiles(new
File("webhdfs://hadoop-coc-1/outputmp"));
System.out.println("2 success: " + mapOutputFiles2.length);
} catch (Exception e) {
System.out.println("2 failed");
}
try {
File[] mapOutputFiles3 = FileUtil.listFiles(new File("/outputmp"));
System.out.println("3 success: " + mapOutputFiles3.length);
} catch (Exception e) {
System.out.println("3 failed");
}
try {
File[] mapOutputFiles4 = FileUtil.listFiles(new File("/outputmp/"));
System.out.println("4 success: " + mapOutputFiles4.length);
} catch (Exception e) {
System.out.println("4 failed");
}
The output 1 failed
2 failed
3 failed
4 failed
The output exists vagrant@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -ls
/outputmp
Found 2 items
-rw-r--r-- 2 vagrant supergroup 0 2015-02-05 15:50 /outputmp/_SUCCESS
-rw-r--r-- 2 vagrant supergroup 12 2015-02-05 15:50
/outputmp/part-m-00000
vagrant@hadoop-coc-1:~/Programs/hadoop$ hdfs dfs -ls
webhdfs://hadoop-coc-1/outputmp
Found 2 items
-rw-r--r-- 2 vagrant supergroup 0 2015-02-05 15:50
webhdfs://hadoop-coc-1/outputmp/_SUCCESS
-rw-r--r-- 2 vagrant supergroup 12 2015-02-05 15:50
webhdfs://hadoop-coc-1/outputmp/part-m-00000
vagrant@hadoop-coc-1:~/Programs/hadoop$
