[ https://issues.apache.org/jira/browse/OOZIE-2797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15868253#comment-15868253 ]
Rohini Palaniswamy commented on OOZIE-2797: ------------------------------------------- [~andras.piros], The uploaded patch is just something we used internally to fix issue when hcat server had issues because of too many tokens and [~satishsaley] uploaded just it for reference. The hcat credentials are used in Spark actions (Spark SQL), java and mapreduce actions (users using HCatInputFormat/HCatOutputFormat directly) as well. Adding code for canceling specific type of tokens in PigMain/HiveMain or any other action is not clean. Once OOZIE-1770 goes in, we should create a framework similar to CredentialsProvider in the new AM, which allows cancellation of different types of token with different implementation based on the credential type. > Cancellation of Delegation Tokens > --------------------------------- > > Key: OOZIE-2797 > URL: https://issues.apache.org/jira/browse/OOZIE-2797 > Project: Oozie > Issue Type: Bug > Reporter: Satish Subhashrao Saley > Assignee: Satish Subhashrao Saley > Fix For: 5.0.0 > > Attachments: OOZIE-2797-1.patch > > > HCat delegation token does not get cancelled unless HCat cancels the token on > its own after several days (i.e. depending on its configuration). > Hive Action and Pig Action should cancel delegation token after completion. > Currently, we can fix it by cancelling the tokens in finally block for Hive > and Pig Action. I am putting patch for this. > But, a cleaner solution would be to have a class specifying APIs for > cancellation and for each type of token, there would be a separate > implementation. We can do it for Oozie 5.0.0. -- This message was sent by Atlassian JIRA (v6.3.15#6346)