Hi!

From a java program, I can get access to secure HDFS from a task by use of the HDFS delegation tokens. They are available in a file which is pointed to by the HADOOP_TOKEN_FILE_LOCATION environment variable, and there's a Java API for reading this file and get the token.

However, if I have a streaming job and that job needs to do something to HDFS - in my case reading a configuration file, how can I retrieve the token? The file is a java-serialized binary one, so it's not as simple as just reading the file from say python.

Writing a small java program that reads the file and outputs the token as json is one option. Are there any other options?

Regards,
\EF

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to