[jira] [Created] (HIVE-24702) HiveServer2 local task leaves token crc file never gets deleted
dingshun created HIVE-24702:
---
Summary: HiveServer2 local task leaves token crc file never gets
deleted
Key: HIVE-24702
URL: https://issues.apache.org/jira/browse/HIVE-24702
Project: Hive
Issue Type: Bug
Components: HiveServer2
Reporter: dingshun
Attachments: 0001-update.patch
in secure clusters, hiveserver2 creates a large number of
/tmp/.hive_hadoop_delegation_token*.tmp.crc files, which related the
Delegation Token and never gets deleted, when executes local tasks.
{code:java}
root@hostname:~ # ls -l /tmp/.hive_hadoop_delegation_token99*.tmp.crc
-rw-r--r-- 1 hive hadoop 12 Jun 28 2020
/tmp/.hive_hadoop_delegation_token990009534922436653.tmp.crc
-rw-r--r-- 1 hive hadoop 16 Nov 13 19:08
/tmp/.hive_hadoop_delegation_token990009600555210260.tmp.crc
-rw-r--r-- 1 hive hadoop 16 Jan 11 11:07
/tmp/.hive_hadoop_delegation_token99002199141550942.tmp.crc
-rw-r--r-- 1 hive hadoop 16 Jan 28 05:50
/tmp/.hive_hadoop_delegation_token990029730478148481.tmp.crc
{code}
{code:java}
root@hostname:~ # ls -l /tmp/.hive_hadoop_delegation_token99*.tmp.crc|wc -l
4880
root@hostname:~ # ls -l /tmp/.hive_hadoop_delegation_token*.tmp.crc|wc -l
-bash: /bin/ls: Argument list too long
{code}
It's created by SecureCmdDoAs when the local task is executed
[https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/SecureCmdDoAs.java#L67]
never gets deleted
[https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/SecureCmdDoAs.java#L80]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
Re: Need help to create 2.3.9 release in Hive JIRA
Bump this, also cc Owen who helped me last time (sorry for directly emailing you). On Tue, Jan 19, 2021 at 4:07 PM Chao Sun wrote: > Hi, > > Can someone help me to create 2.3.9 release in Hive JIRA so that we can > use that as fixed or targeted version? Thanks. > > Best, > Chao >
[jira] [Created] (HIVE-24701) Remove String Manipulation from Date Parsing TimestampTZUtil
David Mollitor created HIVE-24701:
-
Summary: Remove String Manipulation from Date Parsing
TimestampTZUtil
Key: HIVE-24701
URL: https://issues.apache.org/jira/browse/HIVE-24701
Project: Hive
Issue Type: Improvement
Reporter: David Mollitor
Assignee: David Mollitor
This operation is pretty slow:
{code:java}
// Converts Date to TimestampTZ.
public static TimestampTZ convert(Date date, ZoneId defaultTimeZone) {
return parse(date.toString(), defaultTimeZone);
}
{code}
To convert from Date to TimestampTZ, it creates a string, then parses it.
Should be able to just look at the epoch time and do the conversion without all
the string manipulation/parsing.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HIVE-24700) Run Mssql integration tests during precommit
Zoltan Haindrich created HIVE-24700: --- Summary: Run Mssql integration tests during precommit Key: HIVE-24700 URL: https://issues.apache.org/jira/browse/HIVE-24700 Project: Hive Issue Type: Sub-task Reporter: Zoltan Haindrich add mssql to the jenkinsfile and run our metastore schema tests on it -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24699) Run Oracle integration tests during precommit
Zoltan Haindrich created HIVE-24699: --- Summary: Run Oracle integration tests during precommit Key: HIVE-24699 URL: https://issues.apache.org/jira/browse/HIVE-24699 Project: Hive Issue Type: Sub-task Reporter: Zoltan Haindrich this will need a working oracle docker image - and possibly some smaller changes to make sure that the tests could run reliable -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24698) Sync ACL's for the table directory during external table replication.
Ayush Saxena created HIVE-24698: --- Summary: Sync ACL's for the table directory during external table replication. Key: HIVE-24698 URL: https://issues.apache.org/jira/browse/HIVE-24698 Project: Hive Issue Type: Bug Reporter: Ayush Saxena Assignee: Ayush Saxena Set similar ACL's to destination table directory in case the source has ACL's enabled or set. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24697) DbNotificationListener Cleaner thread dies with NoSuchMethodError
Pravin Sinha created HIVE-24697:
---
Summary: DbNotificationListener Cleaner thread dies with
NoSuchMethodError
Key: HIVE-24697
URL: https://issues.apache.org/jira/browse/HIVE-24697
Project: Hive
Issue Type: Bug
Reporter: Pravin Sinha
Assignee: Pravin Sinha
{code:java}
java.lang.NoSuchMethodError: javax.jdo.Query.close()V
at
org.apache.hadoop.hive.metastore.ObjectStore.doCleanNotificationEvents(ObjectStore.java:11025)
at
org.apache.hadoop.hive.metastore.ObjectStore.cleanNotificationEvents(ObjectStore.java:10965)
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HIVE-24696) Drop procedure and drop package syntax for HPLSQL
Attila Magyar created HIVE-24696: Summary: Drop procedure and drop package syntax for HPLSQL Key: HIVE-24696 URL: https://issues.apache.org/jira/browse/HIVE-24696 Project: Hive Issue Type: Sub-task Components: hpl/sql Reporter: Attila Magyar -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24695) Clean up session resources, if TezSession is unable to start
Rajesh Balamohan created HIVE-24695: --- Summary: Clean up session resources, if TezSession is unable to start Key: HIVE-24695 URL: https://issues.apache.org/jira/browse/HIVE-24695 Project: Hive Issue Type: Improvement Reporter: Rajesh Balamohan There are cases when TezSessionState would not be able to start. (e.g resource constraints on YARN queues). However by this time, session directories & certain resources are localized. (e.g, hive-exec jars are stored in hdfs:///tmp/hive/hive/_tez_session_dir/*/hive-exec*.jar). When tezClient is not started, it does not clear up the resources. This leaks ~100MB data in HDFS per failure. -- This message was sent by Atlassian Jira (v8.3.4#803005)
