Hello,
Using the code-block shown below, I could write ORC-files to "webhdfs"
filesystem, when security is not enabled for "hadoop system".
=================================================================
conf = new Configuration();
URI hdfsuri = new URI("webhdfs://isodvm132.in.ibm.com:50070") ;
FileSystem fs = FileSystem.get(hdfsuri,conf,"dsadm");
ObjectInspector ObjInspector = new
OrcRowInspector(fldlist.toArray(new StructField[cnt])) ;
// Delete the file, if it already exists
fs.delete(new Path(path),false) ;
writer = OrcFile.createWriter(new Path(path),
OrcFile.writerOptions(conf)
.fileSystem(fs)
.inspector(ObjInspector)
.stripeSize(100000)
.bufferSize(10000)
.compress(CompressionKind.ZLIB)
.version(OrcFile.Version.V_0_12));
.................................................................................................................................
.................................................................................................................................
=================================================================
However, when the hadoop-system is configured with "kerberos", I am
getting an error: "Authentication required". I do not see anything about
"kerberos" in the class methods for "Configuration" or "FileSystem". In
this context, I am trying to understand, how to connect to "webhdfs"
system, that is configured with "kerberos". If you have any info. in this
regard, could you please let me know.
Thanks,
Ravi
