[jira] [Created] (HIVE-25660) File Format (ORC/AVRO/TextFile...) available in information schema for bulk query

2021-10-28 Thread Simon AUBERT (Jira)
Simon AUBERT created HIVE-25660:
---

 Summary: File Format (ORC/AVRO/TextFile...) available in 
information schema for bulk query
 Key: HIVE-25660
 URL: https://issues.apache.org/jira/browse/HIVE-25660
 Project: Hive
  Issue Type: Improvement
  Components: File Formats, Metastore
Reporter: Simon AUBERT


Hello all,

As of today, when you want to know the file format of every table, you have, as 
far I know, two solutions :
-a loop in shell
-a loop in the tool you use for HQL queries, and then parse the answer, etc..

I think this is way too complicated for such a very basic need. So a 
table_file_format (or partion_file_format, I don't know) in the 
information_schema would be a very precious help for monitoring.

Best regards,

Simon



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-25659) Divide IN/(NOT IN) queries based on number of max parameters SQL engine can support

2021-10-28 Thread Nikhil Gupta (Jira)
Nikhil Gupta created HIVE-25659:
---

 Summary: Divide IN/(NOT IN) queries based on number of max 
parameters SQL engine can support
 Key: HIVE-25659
 URL: https://issues.apache.org/jira/browse/HIVE-25659
 Project: Hive
  Issue Type: Bug
  Components: Standalone Metastore
Affects Versions: 3.1.0, 4.0.0
Reporter: Nikhil Gupta
 Fix For: 4.0.0


 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-25658) Fix regex for masking totalSize table properties in Iceberg q-tests

2021-10-28 Thread Marton Bod (Jira)
Marton Bod created HIVE-25658:
-

 Summary: Fix regex for masking totalSize table properties in 
Iceberg q-tests
 Key: HIVE-25658
 URL: https://issues.apache.org/jira/browse/HIVE-25658
 Project: Hive
  Issue Type: Improvement
Reporter: Marton Bod
Assignee: Marton Bod


HIVE-25607 introduced a text replace regex for masking out the totalSize table 
property values in Iceberg q.out files. The regex however did not cover all of 
the props in the q.out files, so here is the fix for the regex.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-25657) Bug is highly severe

2021-10-28 Thread ALI MAZLOUM (Jira)
ALI MAZLOUM created HIVE-25657:
--

 Summary: Bug is highly severe 
 Key: HIVE-25657
 URL: https://issues.apache.org/jira/browse/HIVE-25657
 Project: Hive
  Issue Type: Bug
  Components: Accumulo Storage Handler
Affects Versions: All Versions
Reporter: ALI MAZLOUM
 Fix For: All Versions






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-25656) Get materialized view state based on number of affected rows by transactions

2021-10-28 Thread Krisztian Kasa (Jira)
Krisztian Kasa created HIVE-25656:
-

 Summary: Get materialized view state based on number of affected 
rows by transactions
 Key: HIVE-25656
 URL: https://issues.apache.org/jira/browse/HIVE-25656
 Project: Hive
  Issue Type: Improvement
  Components: Materialized views, Transactions
Reporter: Krisztian Kasa
Assignee: Krisztian Kasa
 Fix For: 4.0.0


To enable the faster incremental rebuild of materialized views presence of 
update/delete operations on the source tables of the view since the last 
rebuild must be checked. Based on the outcome different plan is generated for 
scenarios in presence of update/delete and insert only operations.

Currently this is done by querying the COMPLETED_TXN_COMPONENTS table however 
the records from this table is cleaned when MV source tables are compacted. 
This reduces the chances of incremental MV rebuild.

The goal of this patch is to find an alternative way to store and retrieve this 
information.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)