I tried running the hdfs_test from a machine which is not part of the Hadoop
cluster. Could someone please tell me what I am doing wrong (error shown
below)?
I get the following error :
07/06/20 20:16:43 DEBUG conf.Configuration: java.io.IOException: config()
at org.apache.hadoop.conf.Configuration.<init>(Configuration.java
:93)
at org.apache.hadoop.dfs.FSConstants.<clinit>(FSConstants.java:120)
at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.<init>(
DFSClient.java:1039)
at org.apache.hadoop.dfs.DFSClient.create(DFSClient.java:318)
at
org.apache.hadoop.dfs.DistributedFileSystem$RawDistributedFileSystem.create(
DistributedFileSystem.java:143)
at org.apache.hadoop.fs.ChecksumFileSystem$FSOutputSummer.<init>(
ChecksumFileSystem.java:374)
at org.apache.hadoop.fs.ChecksumFileSystem.create(
ChecksumFileSystem.java:449)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:360)
Exception in thread "main" java.io.IOException: No valid local directories
in property: dfs.client.buffer.dir
at org.apache.hadoop.conf.Configuration.getFile(Configuration.java
:410)
at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.newBackupFile(
DFSClient.java:1100)
at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.<init>(
DFSClient.java:1067)
at org.apache.hadoop.dfs.DFSClient.create(DFSClient.java:318)
at
org.apache.hadoop.dfs.DistributedFileSystem$RawDistributedFileSystem.create(
DistributedFileSystem.java:143)
at org.apache.hadoop.fs.ChecksumFileSystem$FSOutputSummer.<init>(
ChecksumFileSystem.java:374)
at org.apache.hadoop.fs.ChecksumFileSystem.create(
ChecksumFileSystem.java:449)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:360)
Call to
org.apache.hadoop.fs.FileSystem::create((Lorg/apache/hadoop/fs/Path;ZISJ)Lorg/apache/hadoop/fs/FSDataOutputStream;)
failed!
Failed to open /tmp/testfile.txt for writing!
