[
https://issues.apache.org/jira/browse/OOZIE-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17044266#comment-17044266
]
Andras Salamon commented on OOZIE-3586:
---------------------------------------
Thanks for the patch [~jmakai]. Could you please address the issues reported by
the precommit. Also please be sure that use {{assertEquals(message, expected,
actual)}} and not {{assertEquals(message, actual, expected)}}.
> Oozie spark actions using --keytab fail due to duplicate dist. cache
> --------------------------------------------------------------------
>
> Key: OOZIE-3586
> URL: https://issues.apache.org/jira/browse/OOZIE-3586
> Project: Oozie
> Issue Type: Bug
> Reporter: Janos Makai
> Assignee: Janos Makai
> Priority: Major
> Attachments: OOZIE-3586-001.patch
>
>
> In CDH 6.x, on the Hadoop 3 rebase, it is now a failure if items are added
> multiple times to the distributed cache. In CDH5, this was a warning. This is
> not an issue for most uses, as adding multiple times typically is user error,
> but this completely breaks Spark actions with keytabs (--keytab).
> Oozie spark actions add everything in the distributed cache of the launcher
> job to the distributed cache of the spark job, meaning the keytab is already
> there, then the --keytab argument tries to add it again causing the failure
> [0].
> [0]
> Caused by: java.lang.IllegalArgumentException: Attempt to add
> (.../filename.keytab#filename.keytab) multiple times to the distributed cache.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
