dingshun created HIVE-24702: ------------------------------- Summary: HiveServer2 local task leaves token crc file never gets deleted Key: HIVE-24702 URL: https://issues.apache.org/jira/browse/HIVE-24702 Project: Hive Issue Type: Bug Components: HiveServer2 Reporter: dingshun Attachments: 0001-update.patch
in secure clusters, hiveserver2 creates a large number of /tmp/.hive_hadoop_delegation_token*.tmp.crc files, which related the Delegation Token and never gets deleted, when executes local tasks. {code:java} root@hostname:~ # ls -l /tmp/.hive_hadoop_delegation_token99*.tmp.crc -rw-r--r-- 1 hive hadoop 12 Jun 28 2020 /tmp/.hive_hadoop_delegation_token990009534922436653.tmp.crc -rw-r--r-- 1 hive hadoop 16 Nov 13 19:08 /tmp/.hive_hadoop_delegation_token990009600555210260.tmp.crc -rw-r--r-- 1 hive hadoop 16 Jan 11 11:07 /tmp/.hive_hadoop_delegation_token99002199141550942.tmp.crc -rw-r--r-- 1 hive hadoop 16 Jan 28 05:50 /tmp/.hive_hadoop_delegation_token990029730478148481.tmp.crc {code} {code:java} root@hostname:~ # ls -l /tmp/.hive_hadoop_delegation_token99*.tmp.crc|wc -l 4880 root@hostname:~ # ls -l /tmp/.hive_hadoop_delegation_token*.tmp.crc|wc -l -bash: /bin/ls: Argument list too long {code} It's created by SecureCmdDoAs when the local task is executed [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/SecureCmdDoAs.java#L67] never gets deleted [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/SecureCmdDoAs.java#L80] -- This message was sent by Atlassian Jira (v8.3.4#803005)