[ https://issues.apache.org/jira/browse/OOZIE-2797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15870493#comment-15870493 ]
Andras Piros commented on OOZIE-2797: ------------------------------------- [~rohini] thanks for clarifying this! Will file a follow-up on OOZIE-1770 to create a framework similar to {{CredentialsProvider}} in the new {{LauncherAM}}. [~satishsaley] +1 (non-binding) > Add a framework for cancellation of Delegation Tokens in Oozie AM > ----------------------------------------------------------------- > > Key: OOZIE-2797 > URL: https://issues.apache.org/jira/browse/OOZIE-2797 > Project: Oozie > Issue Type: Bug > Reporter: Satish Subhashrao Saley > Assignee: Satish Subhashrao Saley > Fix For: 5.0.0 > > Attachments: OOZIE-2797-reference.patch > > > Pig and hive clients when run from command line take care of canceling > HCatalog delegation tokens. But they do not get cancelled when run via Oozie. > RM only supports cancellation of hdfs and yarn tokens on job completion. So > when running with Oozie, it is left to the HCatalog server to remove the > token after the expiry. When there are too many jobs, the number of unexpired > tokens can overwhelm the hcat server and cause outages. Oozie should take > care of canceling these tokens after the job is done to avoid that. > We should add a token cancellation framework in the new Oozie AM to support > implementations for token cancellation for different credential types similar > to CredentialsProvider. > Attaching a reference patch that we used internally for directly canceling > hcat tokens for just pig and hive actions that could be used by anyone who > needs it till OOZIE-1770 is done and the new token cancellation framework is > added by this jira. -- This message was sent by Atlassian JIRA (v6.3.15#6346)