[jira] [Created] (HIVE-25432) Support Join reordering for null safe equality operator.

2021-08-05 Thread mahesh kumar behera (Jira)
mahesh kumar behera created HIVE-25432:
--

 Summary: Support Join reordering for null safe equality operator.
 Key: HIVE-25432
 URL: https://issues.apache.org/jira/browse/HIVE-25432
 Project: Hive
  Issue Type: Sub-task
  Components: Hive, HiveServer2
Reporter: mahesh kumar behera


Support Join reordering for null safe equality operator.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-25431) Enable CBO for null safe equality operator.

2021-08-05 Thread mahesh kumar behera (Jira)
mahesh kumar behera created HIVE-25431:
--

 Summary: Enable CBO for null safe equality operator.
 Key: HIVE-25431
 URL: https://issues.apache.org/jira/browse/HIVE-25431
 Project: Hive
  Issue Type: Bug
  Components: Hive, HiveServer2
Reporter: mahesh kumar behera
Assignee: mahesh kumar behera


The CBO is disabled for null safe equality (<=>)  operator. This is causing the 
sub optimal join execution  for some queries. As null safe equality is 
supported by joins, the CBO can be enabled for it. There will be issues with 
join reordering as Hive does not support join reordering for null safe equality 
operator. But with CBO enabled the join plan will be better.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Re: Welcome Marta to Hive PMC

2021-08-05 Thread Naresh P R
Congrats Marta.
---
Regards,
Naresh P R

On Mon, Aug 2, 2021 at 9:51 PM Ashutosh Chauhan 
wrote:

> Hi all,
>
> It's an honor to announce that Apache Hive PMC has recently voted to invite
> Marta Kuczora as a new Hive PMC member. Marta is a long time Hive
> contributor and committer, and has made significant contributions in Hive.
> Please join me in congratulating her and looking forward to a bigger role
> that she will play in the Apache Hive project.
>
> Thanks,
> Ashutosh
>


[jira] [Created] (HIVE-25430) compactor.Worker.markFailed should catch and log any kind of exception

2021-08-05 Thread Karen Coppage (Jira)
Karen Coppage created HIVE-25430:


 Summary: compactor.Worker.markFailed should catch and log any kind 
of exception
 Key: HIVE-25430
 URL: https://issues.apache.org/jira/browse/HIVE-25430
 Project: Hive
  Issue Type: Bug
Reporter: Karen Coppage
Assignee: Karen Coppage






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Re: [EXTERNAL] Re: Welcome Marta to Hive PMC

2021-08-05 Thread Stamatis Zampetakis
Kudos Marta! Well deserved ;)

On Wed, Aug 4, 2021 at 11:26 AM Marta Kuczora 
wrote:

> Thanks a lot, I am really honored.
>
> On Tue, Aug 3, 2021 at 11:31 AM Sankar Hariappan
>  wrote:
>
> > Congrats Marta!
> >
> > Thanks,
> > Sankar
> >
> > -Original Message-
> > From: Peter Vary 
> > Sent: 03 August 2021 14:26
> > To: dev@hive.apache.org
> > Subject: [EXTERNAL] Re: Welcome Marta to Hive PMC
> >
> > Congratulations Marta!
> >
> > > On Aug 3, 2021, at 10:01, Karen Coppage 
> wrote:
> > >
> > > Congratulations!!  
> > >
> > > Karen
> > >
> > >> On 2021. Aug 3., at 6:50, Ashutosh Chauhan 
> > wrote:
> > >>
> > >> Hi all,
> > >>
> > >> It's an honor to announce that Apache Hive PMC has recently voted to
> > >> invite Marta Kuczora as a new Hive PMC member. Marta is a long time
> > >> Hive contributor and committer, and has made significant contributions
> > in Hive.
> > >> Please join me in congratulating her and looking forward to a bigger
> > >> role that she will play in the Apache Hive project.
> > >>
> > >> Thanks,
> > >> Ashutosh
> > >
> >
> >
>


[jira] [Created] (HIVE-25429) Delta metrics collection may cause number of tez counters to exceed tez.counters.max limit

2021-08-05 Thread Karen Coppage (Jira)
Karen Coppage created HIVE-25429:


 Summary: Delta metrics collection may cause number of tez counters 
to exceed tez.counters.max limit
 Key: HIVE-25429
 URL: https://issues.apache.org/jira/browse/HIVE-25429
 Project: Hive
  Issue Type: Sub-task
  Components: Hive
Affects Versions: 4.0.0
Reporter: Karen Coppage
Assignee: Karen Coppage


There's a limit to the number of tez counters allowed (tez.counters.max). Delta 
metrics collection (i.e. DeltaFileMetricsReporter) was creating 3 counters for 
each partition touched by a given query, which can result in a huge number of 
counters, which is unnecessary because we're only interested in n number of 
partitions with the most deltas. This change limits the number of counters 
created to hive.txn.acid.metrics.max.cache.size*3.

Also when tez.counters.max is reached a LimitExceededException is thrown but 
isn't caught on the Hive side and causes the query to fail. We should catch 
this and skip delta metrics collection in this case.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)