[jira] [Created] (HIVE-24863) Wrong property value in UDAF percentile_cont/disc description
Krisztian Kasa created HIVE-24863: - Summary: Wrong property value in UDAF percentile_cont/disc description Key: HIVE-24863 URL: https://issues.apache.org/jira/browse/HIVE-24863 Project: Hive Issue Type: Bug Reporter: Krisztian Kasa -- This message was sent by Atlassian Jira (v8.3.4#803005)
Re: [EXTERNAL] [Announce] New committer : Panos Garefalakis
Congrats Panos. :) ~Rajesh.B On Tue, Mar 9, 2021 at 9:55 AM Prasanth Jayachandran wrote: > Congratulations Panos! > > Thanks > > Prasanth > > > > From: Sankar Hariappan > Sent: Tuesday, March 9, 2021 9:12:27 AM > To: dev@hive.apache.org > Subject: RE: [EXTERNAL] [Announce] New committer : Panos Garefalakis > > Congrats Panos! Welcome to Hive Committers club! > > Thanks, > Sankar > > -Original Message- > From: Ashutosh Chauhan > Sent: 09 March 2021 01:00 > To: dev@hive.apache.org > Subject: [EXTERNAL] [Announce] New committer : Panos Garefalakis > > Apache Hive's Project Management Committee (PMC) has invited Panos > Garefalakis to become a committer, and we are pleased to announce that he > has accepted. > > Panos welcome, thank you for your contributions, and we look forward to > your further interactions with the community! > > Thanks, > Ashutosh >
Re: [EXTERNAL] [Announce] New committer : Naresh PR
Congrats Naresh. :) ~Rajesh.B On Tue, Mar 9, 2021 at 9:55 AM Prasanth Jayachandran wrote: > Congratulations Naresh! > > Thanks > > Prasanth > > > > From: Sankar Hariappan > Sent: Tuesday, March 9, 2021 9:11:11 AM > To: dev@hive.apache.org > Subject: RE: [EXTERNAL] [Announce] New committer : Naresh PR > > Congrats Naresh! Welcome to Hive Committers club! > > Thanks, > Sankar > > -Original Message- > From: Ashutosh Chauhan > Sent: 09 March 2021 01:01 > To: dev@hive.apache.org > Subject: [EXTERNAL] [Announce] New committer : Naresh PR > > Apache Hive's Project Management Committee (PMC) has invited Naresh PR to > become a committer, and we are pleased to announce that he has accepted. > > Naresh welcome, thank you for your contributions, and we look forward to > your further interactions with the community! > > Thanks, > Ashutosh >
Re: [EXTERNAL] [Announce] New committer : Panos Garefalakis
Congratulations Panos! Thanks Prasanth From: Sankar Hariappan Sent: Tuesday, March 9, 2021 9:12:27 AM To: dev@hive.apache.org Subject: RE: [EXTERNAL] [Announce] New committer : Panos Garefalakis Congrats Panos! Welcome to Hive Committers club! Thanks, Sankar -Original Message- From: Ashutosh Chauhan Sent: 09 March 2021 01:00 To: dev@hive.apache.org Subject: [EXTERNAL] [Announce] New committer : Panos Garefalakis Apache Hive's Project Management Committee (PMC) has invited Panos Garefalakis to become a committer, and we are pleased to announce that he has accepted. Panos welcome, thank you for your contributions, and we look forward to your further interactions with the community! Thanks, Ashutosh
Re: [EXTERNAL] [Announce] New committer : Naresh PR
Congratulations Naresh! Thanks Prasanth From: Sankar Hariappan Sent: Tuesday, March 9, 2021 9:11:11 AM To: dev@hive.apache.org Subject: RE: [EXTERNAL] [Announce] New committer : Naresh PR Congrats Naresh! Welcome to Hive Committers club! Thanks, Sankar -Original Message- From: Ashutosh Chauhan Sent: 09 March 2021 01:01 To: dev@hive.apache.org Subject: [EXTERNAL] [Announce] New committer : Naresh PR Apache Hive's Project Management Committee (PMC) has invited Naresh PR to become a committer, and we are pleased to announce that he has accepted. Naresh welcome, thank you for your contributions, and we look forward to your further interactions with the community! Thanks, Ashutosh
[jira] [Created] (HIVE-24862) Fix race condition causing NPE during dynamic partition loading
Rajesh Balamohan created HIVE-24862:
---
Summary: Fix race condition causing NPE during dynamic partition
loading
Key: HIVE-24862
URL: https://issues.apache.org/jira/browse/HIVE-24862
Project: Hive
Issue Type: Improvement
Reporter: Rajesh Balamohan
Following properties default to 15 threads.
{noformat}
hive.load.dynamic.partitions.thread
hive.mv.files.thread
{noformat}
During loadDynamicPartitions, it ends ups initializing {{newFiles}} without
synchronization (HIVE-20661, HIVE-24738).
[https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java#L2871]
This causes race condition when dynamic partition thread internally makes use
of {{hive.mv.files.threads}} in copyFiles/replaceFiles.
This causes "NPE" during retrieval in {{addInsertFileInformation()}}.
e.g stacktrace
{noformat}
Caused by: java.lang.NullPointerException
at org.apache.hadoop.fs.FileSystem.fixRelativePart(FileSystem.java:2734)
at
org.apache.hadoop.hdfs.DistributedFileSystem.fixRelativePart(DistributedFileSystem.java:3396)
at
org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1740)
at org.apache.hadoop.fs.FileSystem.isDirectory(FileSystem.java:1740)
at
org.apache.hadoop.hive.ql.metadata.Hive.addInsertFileInformation(Hive.java:3566)
at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:3540)
at
org.apache.hadoop.hive.ql.metadata.Hive.loadPartitionInternal(Hive.java:2414)
at
org.apache.hadoop.hive.ql.metadata.Hive.lambda$loadDynamicPartitions$4(Hive.java:2909)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
RE: [EXTERNAL] [Announce] New committer : Panos Garefalakis
Congrats Panos! Welcome to Hive Committers club! Thanks, Sankar -Original Message- From: Ashutosh Chauhan Sent: 09 March 2021 01:00 To: dev@hive.apache.org Subject: [EXTERNAL] [Announce] New committer : Panos Garefalakis Apache Hive's Project Management Committee (PMC) has invited Panos Garefalakis to become a committer, and we are pleased to announce that he has accepted. Panos welcome, thank you for your contributions, and we look forward to your further interactions with the community! Thanks, Ashutosh
RE: [EXTERNAL] [Announce] New committer : Naresh PR
Congrats Naresh! Welcome to Hive Committers club! Thanks, Sankar -Original Message- From: Ashutosh Chauhan Sent: 09 March 2021 01:01 To: dev@hive.apache.org Subject: [EXTERNAL] [Announce] New committer : Naresh PR Apache Hive's Project Management Committee (PMC) has invited Naresh PR to become a committer, and we are pleased to announce that he has accepted. Naresh welcome, thank you for your contributions, and we look forward to your further interactions with the community! Thanks, Ashutosh
[Announce] New committer : Naresh PR
Apache Hive's Project Management Committee (PMC) has invited Naresh PR to become a committer, and we are pleased to announce that he has accepted. Naresh welcome, thank you for your contributions, and we look forward to your further interactions with the community! Thanks, Ashutosh
[Announce] New committer : Panos Garefalakis
Apache Hive's Project Management Committee (PMC) has invited Panos Garefalakis to become a committer, and we are pleased to announce that he has accepted. Panos welcome, thank you for your contributions, and we look forward to your further interactions with the community! Thanks, Ashutosh
[jira] [Created] (HIVE-24861) Hive JDBC driver doesn't consider the value of 'hasMoreRows'
Zoltán Borók-Nagy created HIVE-24861: Summary: Hive JDBC driver doesn't consider the value of 'hasMoreRows' Key: HIVE-24861 URL: https://issues.apache.org/jira/browse/HIVE-24861 Project: Hive Issue Type: Bug Components: JDBC Reporter: Zoltán Borók-Nagy TCLIService's FetchResults might return an empty result set, but with hasMoreRows=true. In that case the driver ignores the flag hasMoreRows and thinks it is the end of the result stream, causing data loss. I've seen this when the Hive JDBC driver was used to connect to Impala. IMPALA-7312 introduced a timeout on FetchResults(). If Impala cannot produce rows in the given timeout then it returns an empty result set, but setting hasMoreRows=true. However, the Hive JDBC driver interprets it as the end of the result stream and closes the operation. I think if hasMoreRows=true then the Hive JDBC driver should issue FetchResults() again. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24860) DbTxnManager$HeartbeaterThread thread leak
Karen Coppage created HIVE-24860: Summary: DbTxnManager$HeartbeaterThread thread leak Key: HIVE-24860 URL: https://issues.apache.org/jira/browse/HIVE-24860 Project: Hive Issue Type: Bug Reporter: Karen Coppage Assignee: Karen Coppage -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24859) TestZookeeperLockManager#testMetrics fails intermittently
Krisztian Kasa created HIVE-24859: - Summary: TestZookeeperLockManager#testMetrics fails intermittently Key: HIVE-24859 URL: https://issues.apache.org/jira/browse/HIVE-24859 Project: Hive Issue Type: Bug Reporter: Krisztian Kasa http://ci.hive.apache.org/job/hive-flaky-check/198/ -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24858) UDFClassLoader leak in session HiveConf
Karen Coppage created HIVE-24858:
Summary: UDFClassLoader leak in session HiveConf
Key: HIVE-24858
URL: https://issues.apache.org/jira/browse/HIVE-24858
Project: Hive
Issue Type: Bug
Reporter: Karen Coppage
Assignee: Karen Coppage
If a UDF jar has been registered in a session and a temporary function created
from it, when the session is closed its UDFClassLoader is not GC'd as it has
been leaked to the session's HiveConf object's cache. Since the ClassLoader is
not GC'd, the UDF jar's classes aren't GC'd from Metaspace. This can
potentially lead to Metaspace OOM.
Path to GC root is:
{code:java}
Class Name
| Shallow Heap | Retained
Heap
---
contextClassLoader org.apache.hive.service.server.ThreadWithGarbageCleanup @
0x7164deb50 HiveServer2-Handler-Pool: Thread-72 Thread| 128 |
79,072
referent java.util.WeakHashMap$Entry @ 0x7164e67d0
| 40 |
824
'- [6] java.util.WeakHashMap$Entry[16] @ 0x71581aac0
| 80 |
5,056
'- table java.util.WeakHashMap @ 0x71580f510
| 48 |
6,920
'- CACHE_CLASSES class org.apache.hadoop.conf.Configuration @ 0x71580f3d8
| 64 |
74,528
---
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HIVE-24857) Trigger Tez output commit after close operation
Marton Bod created HIVE-24857: - Summary: Trigger Tez output commit after close operation Key: HIVE-24857 URL: https://issues.apache.org/jira/browse/HIVE-24857 Project: Hive Issue Type: Improvement Reporter: Marton Bod Assignee: Marton Bod Currently Tez triggers the OutputCommitter.commit() operation between the proc.run() and proc.close() operations in TezProcessor. However, when writing out data, calling the proc.close() operation may still produce some extra records, which would be missed by the output committer. -- This message was sent by Atlassian Jira (v8.3.4#803005)
