[jira] [Created] (HIVE-25178) Reduce number of getPartition calls during loadDynamicPartitions

2021-05-28 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-25178:
---

 Summary: Reduce number of getPartition calls during 
loadDynamicPartitions
 Key: HIVE-25178
 URL: https://issues.apache.org/jira/browse/HIVE-25178
 Project: Hive
  Issue Type: Improvement
  Components: Hive
Reporter: Rajesh Balamohan


When dynamic partitions are loaded, Hive::loadDynamicPartition loads all 
partitions from HMS causing heavy load on it. This becomes worse when large 
number of partitions are present in tables.

Only relevant partitions being loaded in dynamic partitions can be queried from 
HMS for partition existence.

[https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java#L2958]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-25177) Add Additional Debugging Help for HBase Reader

2021-05-28 Thread David Mollitor (Jira)
David Mollitor created HIVE-25177:
-

 Summary: Add Additional Debugging Help for HBase Reader
 Key: HIVE-25177
 URL: https://issues.apache.org/jira/browse/HIVE-25177
 Project: Hive
  Issue Type: Improvement
Reporter: David Mollitor
Assignee: David Mollitor






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-25176) Print DAG ID to Console

2021-05-28 Thread David Mollitor (Jira)
David Mollitor created HIVE-25176:
-

 Summary: Print DAG ID to Console
 Key: HIVE-25176
 URL: https://issues.apache.org/jira/browse/HIVE-25176
 Project: Hive
  Issue Type: Improvement
Reporter: David Mollitor
Assignee: David Mollitor






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-25175) Aggregate Function on partitioned column return wrong result when there is an empty partition

2021-05-28 Thread libo (Jira)
libo created HIVE-25175:
---

 Summary: Aggregate Function on partitioned column return wrong 
result when there is an empty partition
 Key: HIVE-25175
 URL: https://issues.apache.org/jira/browse/HIVE-25175
 Project: Hive
  Issue Type: Bug
  Components: Query Processor
Affects Versions: 2.0.1
Reporter: libo


hive2.0.1
create table testmax(id int) partitioned by (dt int);
insert into table testmax partition(dt=11) values(1);
alter table testmax add partition(dt=22);
select max(dt) from testmax;
The result is:
22
expected result is:
11

when use hive2.3.3 ,the result is right , but I can not find out which issue 
fixed this



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-25174) HiveMetastoreAuthorizer didn't check URI permission for AlterTableEvent

2021-05-28 Thread Janus Chow (Jira)
Janus Chow created HIVE-25174:
-

 Summary: HiveMetastoreAuthorizer didn't check URI permission for 
AlterTableEvent
 Key: HIVE-25174
 URL: https://issues.apache.org/jira/browse/HIVE-25174
 Project: Hive
  Issue Type: Improvement
Reporter: Janus Chow


When Using Ranger on Hive MetaStore, we met an issue that users without 
permission to table's HDFS path succeeded in running "msck repair table 
TABLENAME".

This command is not authorized when we use `StorageBasedAuthorizer`, after 
checking the code, we found `StorageBasedAuthorizer` would check the permission 
of table's HDFS path, while `HiveMetastoreAuthorizer` used by Ranger won't when 
dealing with the event of `AlterTableEvent`.

This ticket is to add the URI permission check on AlterTableEvent for 
`HiveMetastoreAuthorizer`.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)