[jira] [Created] (HIVE-24271) Create managed table relies on hive.create.as.acid settings.

2020-10-13 Thread Naveen Gangam (Jira)
Naveen Gangam created HIVE-24271:


 Summary: Create managed table relies on hive.create.as.acid 
settings.
 Key: HIVE-24271
 URL: https://issues.apache.org/jira/browse/HIVE-24271
 Project: Hive
  Issue Type: Sub-task
  Components: HiveServer2
Affects Versions: 4.0.0
Reporter: Naveen Gangam
Assignee: Naveen Gangam


0: jdbc:hive2://ngangam-3.ngangam.root.hwx.si> set hive.create.as.acid;
++
|set |
++
| hive.create.as.acid=false  |
++
1 row selected (0.018 seconds)
0: jdbc:hive2://ngangam-3.ngangam.root.hwx.si> set hive.create.as.insert.only;
+---+
|set|
+---+
| hive.create.as.insert.only=false  |
+---+
1 row selected (0.013 seconds)
0: jdbc:hive2://ngangam-3.ngangam.root.hwx.si> create managed table mgd_table(a 
int);
INFO  : Compiling 
command(queryId=hive_20201014053526_9ba1ffa3-3aa2-47c3-8514-1fe58fe4f140): 
create managed table mgd_table(a int)
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:null, properties:null)
INFO  : Completed compiling 
command(queryId=hive_20201014053526_9ba1ffa3-3aa2-47c3-8514-1fe58fe4f140); Time 
taken: 0.021 seconds
INFO  : Executing 
command(queryId=hive_20201014053526_9ba1ffa3-3aa2-47c3-8514-1fe58fe4f140): 
create managed table mgd_table(a int)
INFO  : Starting task [Stage-0:DDL] in serial mode
INFO  : Completed executing 
command(queryId=hive_20201014053526_9ba1ffa3-3aa2-47c3-8514-1fe58fe4f140); Time 
taken: 0.048 seconds
INFO  : OK
No rows affected (0.107 seconds)
0: jdbc:hive2://ngangam-3.ngangam.root.hwx.si> describe formatted mgd_table;
INFO  : Compiling 
command(queryId=hive_20201014053533_8919be7d-41b0-41e5-b9eb-847801a9d8c5): 
describe formatted mgd_table
INFO  : Semantic Analysis Completed (retrial = false)
INFO  : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:col_name, 
type:string, comment:from deserializer), FieldSchema(name:data_type, 
type:string, comment:from deserializer), FieldSchema(name:comment, type:string, 
comment:from deserializer)], properties:null)
INFO  : Completed compiling 
command(queryId=hive_20201014053533_8919be7d-41b0-41e5-b9eb-847801a9d8c5); Time 
taken: 0.037 seconds
INFO  : Executing 
command(queryId=hive_20201014053533_8919be7d-41b0-41e5-b9eb-847801a9d8c5): 
describe formatted mgd_table
INFO  : Starting task [Stage-0:DDL] in serial mode
INFO  : Completed executing 
command(queryId=hive_20201014053533_8919be7d-41b0-41e5-b9eb-847801a9d8c5); Time 
taken: 0.03 seconds
INFO  : OK
+---+++
|   col_name| data_type 
 |  comment   |
+---+++
| a | int   
 ||
|   | NULL  
 | NULL   |
| # Detailed Table Information  | NULL  
 | NULL   |
| Database: | bothfalseonhs2
 | NULL   |
| OwnerType:| USER  
 | NULL   |
| Owner:| hive  
 | NULL   |
| CreateTime:   | Wed Oct 14 05:35:26 UTC 2020  
 | NULL   |
| LastAccessTime:   | UNKNOWN   
 | NULL   |
| Retention:| 0 
 | NULL   |
| Location: | 
hdfs://ngangam-3.ngangam.root.hwx.site:8020/warehouse/tablespace/external/hive/bothfalseonhs2.db/mgd_table
 | NULL   |
| Table Type:   | EXTERNAL_TABLE
 | NULL   |
| Table Parameters: | NULL  
 | NULL   |
|   

[jira] [Created] (HIVE-24270) Move scratchdir cleanup to background

2020-10-13 Thread Mustafa Iman (Jira)
Mustafa Iman created HIVE-24270:
---

 Summary: Move scratchdir cleanup to background
 Key: HIVE-24270
 URL: https://issues.apache.org/jira/browse/HIVE-24270
 Project: Hive
  Issue Type: Improvement
Reporter: Mustafa Iman
Assignee: Mustafa Iman


In cloud environment, scratchdir cleaning at the end of the query may take long 
time. This causes client to hang up to 1 minute even after the results were 
streamed back. During this time client just waits for cleanup to finish. 
Cleanup can take place in the background in HiveServer.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-24269) In SharedWorkOptimizer run simplification after merging TS filter expressions

2020-10-13 Thread Zoltan Haindrich (Jira)
Zoltan Haindrich created HIVE-24269:
---

 Summary: In SharedWorkOptimizer run simplification after merging 
TS filter expressions
 Key: HIVE-24269
 URL: https://issues.apache.org/jira/browse/HIVE-24269
 Project: Hive
  Issue Type: Improvement
Reporter: Zoltan Haindrich
Assignee: Zoltan Haindrich






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-24268) Investigate srcpart scans in dynamic_partition_pruning test

2020-10-13 Thread Zoltan Haindrich (Jira)
Zoltan Haindrich created HIVE-24268:
---

 Summary: Investigate srcpart scans in dynamic_partition_pruning 
test
 Key: HIVE-24268
 URL: https://issues.apache.org/jira/browse/HIVE-24268
 Project: Hive
  Issue Type: Improvement
Reporter: Zoltan Haindrich
Assignee: Zoltan Haindrich


there seems to be some opportunities missed by shared work optimizer

see srcpart scans around 
[here|https://github.com/apache/hive/pull/1553/files/31ddb97bf412a2679489a5a0d45d335d2708005c#diff-cb6322e933f130f318d462f2c3af839dac60f8acca2074b2685f1847066e3565R4313]





--
This message was sent by Atlassian Jira
(v8.3.4#803005)