[
https://issues.apache.org/jira/browse/NIFI-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bryan Rosander updated NIFI-2435:
---------------------------------
Description:
Hadoop Kerberos has a way of accessing things as an authenticated user
UserGroupInformation.doAs
NIFI is doing that to get access to the filesystem in order to basically tell
hadoop to use the correct credentials so our processor does that correctly and
then passes the results into the sequence reader unfortunately, the sequence
reader then throws away our authenticated filesystem and creates its own
without wrapping in a UGI.doAs
More context:
The constructor used for org.apache.hadoop.io.SequenceFile.Reader in both
KeyValueReader and ValueReader is deprecated and has been turned into a
callthrough that only uses the passed in FileSystem to get the qualified path.
I've modified those classes to do that logic and then wrapped the callsite in
the processor in a UGI.doAs if it is configured to use a UGI
was:
Hadoop Kerberos has a way of accessing things as an authenticated user
UserGroupInformation.doAs
NIFI is doing that to get access to the filesystem in order to basically tell
hadoop to use the correct credentials so our processor does that correctly and
then passes the results into the sequence reader unfortunately, the sequence
reader then throws away our authenticated filesystem and creates its own
without wrapping in a UGI.doAs
> GetHDFSSequenceFile sequence reader throwing away authenticated filesystem
> and creating its own
> -----------------------------------------------------------------------------------------------
>
> Key: NIFI-2435
> URL: https://issues.apache.org/jira/browse/NIFI-2435
> Project: Apache NiFi
> Issue Type: Bug
> Components: Core Framework
> Affects Versions: 0.6.1
> Environment: Kerberos HDFS
> Reporter: Juan Sequeiros
> Assignee: Bryan Rosander
> Labels: hdfs, kerberos
>
> Hadoop Kerberos has a way of accessing things as an authenticated user
> UserGroupInformation.doAs
> NIFI is doing that to get access to the filesystem in order to basically
> tell hadoop to use the correct credentials so our processor does that
> correctly and then passes the results into the sequence reader unfortunately,
> the sequence reader then throws away our authenticated filesystem and creates
> its own without wrapping in a UGI.doAs
> More context:
> The constructor used for org.apache.hadoop.io.SequenceFile.Reader in both
> KeyValueReader and ValueReader is deprecated and has been turned into a
> callthrough that only uses the passed in FileSystem to get the qualified
> path. I've modified those classes to do that logic and then wrapped the
> callsite in the processor in a UGI.doAs if it is configured to use a UGI
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
