[jira] [Created] (HIVE-24648) Clean up FetchTask and related classes
Miklos Gergely created HIVE-24648: - Summary: Clean up FetchTask and related classes Key: HIVE-24648 URL: https://issues.apache.org/jira/browse/HIVE-24648 Project: Hive Issue Type: Bug Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely FetchTask is FetchOperator and FetchWork are messy, containing a lot off unused codes too. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24611) Remove unnecessary parameter from AbstractAlterTableOperation
Miklos Gergely created HIVE-24611: - Summary: Remove unnecessary parameter from AbstractAlterTableOperation Key: HIVE-24611 URL: https://issues.apache.org/jira/browse/HIVE-24611 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Assignee: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24610) Remove superfluous throws IOException from Context
Miklos Gergely created HIVE-24610: - Summary: Remove superfluous throws IOException from Context Key: HIVE-24610 URL: https://issues.apache.org/jira/browse/HIVE-24610 Project: Hive Issue Type: Improvement Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24593) Clean up checkstyle violations in ddl
Miklos Gergely created HIVE-24593: - Summary: Clean up checkstyle violations in ddl Key: HIVE-24593 URL: https://issues.apache.org/jira/browse/HIVE-24593 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Assignee: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24509) Move show specific codes under DDL and cut MetaDataFormatter classes to pieces
Miklos Gergely created HIVE-24509: - Summary: Move show specific codes under DDL and cut MetaDataFormatter classes to pieces Key: HIVE-24509 URL: https://issues.apache.org/jira/browse/HIVE-24509 Project: Hive Issue Type: Sub-task Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely Lot of show ... specific codes are under the org.apache.hadoop.hive.ql.metadata.formatting package which are used only by these commands. Also the two MetaDataFormatters (JsonMetaDataFormatter, TextMetaDataFormatter) are trying to do everything, while they contain a lot of code duplications. Their functionalities should be put under the directories of the appropriate show commands. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24333) Cut long methods in Driver to smaller, more manageable pieces
Miklos Gergely created HIVE-24333: - Summary: Cut long methods in Driver to smaller, more manageable pieces Key: HIVE-24333 URL: https://issues.apache.org/jira/browse/HIVE-24333 Project: Hive Issue Type: Sub-task Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely Some methods in Driver are too long to be easily understandable. They should be cut into pieces to make them easier to understand. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24184) Re-order methods in Driver
Miklos Gergely created HIVE-24184: - Summary: Re-order methods in Driver Key: HIVE-24184 URL: https://issues.apache.org/jira/browse/HIVE-24184 Project: Hive Issue Type: Sub-task Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely Driver is still a huge class, with a lot of methods. They are not representing the order of the process done by the Driver (compilation, execution, result providing, closing). Also the constructors are not at the beginning of the class. All of these make the class harder to read. By re-ordering them it would be easier. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23864) Extract Create Materialized View analyzer from SemanticAnalyzer
Miklos Gergely created HIVE-23864: - Summary: Extract Create Materialized View analyzer from SemanticAnalyzer Key: HIVE-23864 URL: https://issues.apache.org/jira/browse/HIVE-23864 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Assignee: Miklos Gergely Create Materialized View commands are not queries, but commands which have queries as a part of them. Therefore a separate CreateMaterializedViewAnalyzer is needed which uses SemanticAnalyer to analyze it's query. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23857) Fix HiveParser "code too large" problem
Miklos Gergely created HIVE-23857: - Summary: Fix HiveParser "code too large" problem Key: HIVE-23857 URL: https://issues.apache.org/jira/browse/HIVE-23857 Project: Hive Issue Type: Bug Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely HivePasrser.g can not be extended anymore as adding any more tokens leads to a "code too large" problem, because the compiled code size would exceed 65536 bytes. The real solution would be to introduce anltr4, in the meantime it can be fixed be moving the tokenNames variable into a separate file. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23814) Clean up Driver
Miklos Gergely created HIVE-23814: - Summary: Clean up Driver Key: HIVE-23814 URL: https://issues.apache.org/jira/browse/HIVE-23814 Project: Hive Issue Type: Sub-task Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely Driver is now cut down to it's minimal size by extracting all of it's sub tasks to separate classes. The rest should be cleaned up by * moving out some smaller parts of the code to sub task and utility classes wherever it is still possible * cut large functions to meaningful and manageable parts * re-order the functions to follow the order of processing * fix checkstyle issues -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23789) Merge ValidTxnManager into DriverTxnHandler
Miklos Gergely created HIVE-23789: - Summary: Merge ValidTxnManager into DriverTxnHandler Key: HIVE-23789 URL: https://issues.apache.org/jira/browse/HIVE-23789 Project: Hive Issue Type: Sub-task Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23718) Extract transaction handling from Driver
Miklos Gergely created HIVE-23718: - Summary: Extract transaction handling from Driver Key: HIVE-23718 URL: https://issues.apache.org/jira/browse/HIVE-23718 Project: Hive Issue Type: Sub-task Components: HiveServer2 Reporter: Miklos Gergely Assignee: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23547) Enforce testconfiguration.properties file format and alphabetical order
Miklos Gergely created HIVE-23547: - Summary: Enforce testconfiguration.properties file format and alphabetical order Key: HIVE-23547 URL: https://issues.apache.org/jira/browse/HIVE-23547 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23513) Fix Json output for SHOW TABLES and SHOW MATERIALIZED VIEWS
Miklos Gergely created HIVE-23513: - Summary: Fix Json output for SHOW TABLES and SHOW MATERIALIZED VIEWS Key: HIVE-23513 URL: https://issues.apache.org/jira/browse/HIVE-23513 Project: Hive Issue Type: Bug Reporter: Miklos Gergely Assignee: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23510) TestMiniLLA
Miklos Gergely created HIVE-23510: - Summary: TestMiniLLA Key: HIVE-23510 URL: https://issues.apache.org/jira/browse/HIVE-23510 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23508) Do not show parameters column for non-extended desc database
Miklos Gergely created HIVE-23508: - Summary: Do not show parameters column for non-extended desc database Key: HIVE-23508 URL: https://issues.apache.org/jira/browse/HIVE-23508 Project: Hive Issue Type: Bug Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely The "parameters" column for desc database is only filled if the request is "EXTENDED", no point of showing the column otherwise. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23504) Propagate query cancellations to druid when a hive query is cancelled
Miklos Gergely created HIVE-23504:
-
Summary: Propagate query cancellations to druid when a hive query
is cancelled
Key: HIVE-23504
URL: https://issues.apache.org/jira/browse/HIVE-23504
Project: Hive
Issue Type: Bug
Components: Druid integration, Hive
Reporter: Miklos Gergely
Assignee: Miklos Gergely
See Query cancellation here -
[https://druid.apache.org/docs/latest/querying/querying.html]
Queries can be cancelled explicitly using their unique identifier. If the query
identifier is set at the time of query, or is otherwise known, the following
endpoint can be used on the Broker or Router to cancel the query.
{{DELETE /druid/v2/{queryId}}}
Copy
For example, if the query ID is {{abc123}}, the query can be cancelled as
follows:
{{curl -X DELETE "http://host:port/druid/v2/abc123"}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HIVE-23484) Ensure result order for special_character_in_tabnames_1.q
Miklos Gergely created HIVE-23484: - Summary: Ensure result order for special_character_in_tabnames_1.q Key: HIVE-23484 URL: https://issues.apache.org/jira/browse/HIVE-23484 Project: Hive Issue Type: Bug Reporter: Miklos Gergely Assignee: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23470) Move TestCliDriver tests to TestMiniTezCliDriver if they are failing with TestMiniLlapLocalCliDriver
Miklos Gergely created HIVE-23470: - Summary: Move TestCliDriver tests to TestMiniTezCliDriver if they are failing with TestMiniLlapLocalCliDriver Key: HIVE-23470 URL: https://issues.apache.org/jira/browse/HIVE-23470 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Assignee: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23465) Investigate why uniquejoin.q is not producing the proper results
Miklos Gergely created HIVE-23465: - Summary: Investigate why uniquejoin.q is not producing the proper results Key: HIVE-23465 URL: https://issues.apache.org/jira/browse/HIVE-23465 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Check [https://reviews.apache.org/r/72491/] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23464) Investigate why udaf_percentile_approx_23.q output has changed
Miklos Gergely created HIVE-23464: - Summary: Investigate why udaf_percentile_approx_23.q output has changed Key: HIVE-23464 URL: https://issues.apache.org/jira/browse/HIVE-23464 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Check [https://reviews.apache.org/r/72491/] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23463) Investigate why the results have changed at udf_mask_show_last_n.q, udf_mask_show_first_n.q, udf_mask_last_n.q, udf_mask_first_n.q, udf_mask.q
Miklos Gergely created HIVE-23463: - Summary: Investigate why the results have changed at udf_mask_show_last_n.q, udf_mask_show_first_n.q, udf_mask_last_n.q, udf_mask_first_n.q, udf_mask.q Key: HIVE-23463 URL: https://issues.apache.org/jira/browse/HIVE-23463 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23440) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 4
Miklos Gergely created HIVE-23440: - Summary: Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 4 Key: HIVE-23440 URL: https://issues.apache.org/jira/browse/HIVE-23440 Project: Hive Issue Type: Sub-task Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23428) Investigate why skew join is not used at skewjoinopt*
Miklos Gergely created HIVE-23428: - Summary: Investigate why skew join is not used at skewjoinopt* Key: HIVE-23428 URL: https://issues.apache.org/jira/browse/HIVE-23428 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Check [https://reviews.apache.org/r/72485/] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23427) Investigate why SMB join is not used in smb_mapjoin* and sort_merge_join_desc*
Miklos Gergely created HIVE-23427: - Summary: Investigate why SMB join is not used in smb_mapjoin* and sort_merge_join_desc* Key: HIVE-23427 URL: https://issues.apache.org/jira/browse/HIVE-23427 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Check [https://reviews.apache.org/r/72485/] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23422) Investigate why skewjoin_mapjoin11.q result set has changed
Miklos Gergely created HIVE-23422: - Summary: Investigate why skewjoin_mapjoin11.q result set has changed Key: HIVE-23422 URL: https://issues.apache.org/jira/browse/HIVE-23422 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Check [https://reviews.apache.org/r/72485/] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23420) Investigate why data has changed in parquet_timestamp_staging_2.q
Miklos Gergely created HIVE-23420: - Summary: Investigate why data has changed in parquet_timestamp_staging_2.q Key: HIVE-23420 URL: https://issues.apache.org/jira/browse/HIVE-23420 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Check [https://reviews.apache.org/r/72485] for detals. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23419) Find out how to test CLUSTER BY, DISTRIBUTE BY, SORT BY in q files like parenthesis_star_by.q without having an indeterministic output
Miklos Gergely created HIVE-23419: - Summary: Find out how to test CLUSTER BY, DISTRIBUTE BY, SORT BY in q files like parenthesis_star_by.q without having an indeterministic output Key: HIVE-23419 URL: https://issues.apache.org/jira/browse/HIVE-23419 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Check [https://reviews.apache.org/r/72485/] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23418) Investigate why msck command found different partitions at repair.q
Miklos Gergely created HIVE-23418: - Summary: Investigate why msck command found different partitions at repair.q Key: HIVE-23418 URL: https://issues.apache.org/jira/browse/HIVE-23418 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23417) Investigate why statistics for double type columns were modified at reduceSinkDeDuplication_pRS_key_empty.q
Miklos Gergely created HIVE-23417: - Summary: Investigate why statistics for double type columns were modified at reduceSinkDeDuplication_pRS_key_empty.q Key: HIVE-23417 URL: https://issues.apache.org/jira/browse/HIVE-23417 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Check [https://reviews.apache.org/r/72485/#comment309242] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23416) Investigate why predicate modified at quotedid_skew.q
Miklos Gergely created HIVE-23416: - Summary: Investigate why predicate modified at quotedid_skew.q Key: HIVE-23416 URL: https://issues.apache.org/jira/browse/HIVE-23416 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Check [https://reviews.apache.org/r/72485/#comment309242] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23415) Investigate why vectorization is not used in query_result_fileformat.q
Miklos Gergely created HIVE-23415: - Summary: Investigate why vectorization is not used in query_result_fileformat.q Key: HIVE-23415 URL: https://issues.apache.org/jira/browse/HIVE-23415 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Check [https://reviews.apache.org/r/72485/#comment309242] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23403) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3
Miklos Gergely created HIVE-23403: - Summary: Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 3 Key: HIVE-23403 URL: https://issues.apache.org/jira/browse/HIVE-23403 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Assignee: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23386) Investigate why "properties:insideView TRUE" disappears at masking_2.q
Miklos Gergely created HIVE-23386: - Summary: Investigate why "properties:insideView TRUE" disappears at masking_2.q Key: HIVE-23386 URL: https://issues.apache.org/jira/browse/HIVE-23386 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Check [https://reviews.apache.org/r/72466/#comment309102] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23385) Investigate why bucketinVersion dissapeared from louter_join_ppr.q
Miklos Gergely created HIVE-23385: - Summary: Investigate why bucketinVersion dissapeared from louter_join_ppr.q Key: HIVE-23385 URL: https://issues.apache.org/jira/browse/HIVE-23385 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Check [https://reviews.apache.org/r/72466/#comment309102] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23384) Investigate why filterExpression wasn't simplified at merge_join_1.q
Miklos Gergely created HIVE-23384: - Summary: Investigate why filterExpression wasn't simplified at merge_join_1.q Key: HIVE-23384 URL: https://issues.apache.org/jira/browse/HIVE-23384 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Check [https://reviews.apache.org/r/72466/#comment309162] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23383) Investgate why the number of files went down for 1 to 0 at groupby_sort_6.q
Miklos Gergely created HIVE-23383: - Summary: Investgate why the number of files went down for 1 to 0 at groupby_sort_6.q Key: HIVE-23383 URL: https://issues.apache.org/jira/browse/HIVE-23383 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Check [https://reviews.apache.org/r/72466/#comment309109] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23381) Investigate why the column stats are gone for groupby_sort_1_23.q
Miklos Gergely created HIVE-23381: - Summary: Investigate why the column stats are gone for groupby_sort_1_23.q Key: HIVE-23381 URL: https://issues.apache.org/jira/browse/HIVE-23381 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Check [https://reviews.apache.org/r/72466/#comment309109] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23382) Investigate why the results have changed for groupby_sort_1_23.q
Miklos Gergely created HIVE-23382: - Summary: Investigate why the results have changed for groupby_sort_1_23.q Key: HIVE-23382 URL: https://issues.apache.org/jira/browse/HIVE-23382 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23380) Investigate why the bucketing at infer_bucket_sort_merge.q changed
Miklos Gergely created HIVE-23380: - Summary: Investigate why the bucketing at infer_bucket_sort_merge.q changed Key: HIVE-23380 URL: https://issues.apache.org/jira/browse/HIVE-23380 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Check [https://reviews.apache.org/r/72466/#comment309093] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23379) Cut groupby_sort_skew_1_23.q to smaller pieces
Miklos Gergely created HIVE-23379: - Summary: Cut groupby_sort_skew_1_23.q to smaller pieces Key: HIVE-23379 URL: https://issues.apache.org/jira/browse/HIVE-23379 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely groupby_sort_skew_1_23.q is huge, it should be cut into pieces in order to be more manageable. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23378) Investigate why join_cond_pushdown_unqual5.q why CASE was modified
Miklos Gergely created HIVE-23378: - Summary: Investigate why join_cond_pushdown_unqual5.q why CASE was modified Key: HIVE-23378 URL: https://issues.apache.org/jira/browse/HIVE-23378 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely See [https://reviews.apache.org/r/72466/#comment309087] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23377) Investigate why join_1to1.q output has been modified
Miklos Gergely created HIVE-23377: - Summary: Investigate why join_1to1.q output has been modified Key: HIVE-23377 URL: https://issues.apache.org/jira/browse/HIVE-23377 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely See [https://reviews.apache.org/r/72466/#comment309087] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23337) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 2
Miklos Gergely created HIVE-23337: - Summary: Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 2 Key: HIVE-23337 URL: https://issues.apache.org/jira/browse/HIVE-23337 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Assignee: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23335) Investigate why the results have changed for distinct_windowing_no_cbo.q
Miklos Gergely created HIVE-23335: - Summary: Investigate why the results have changed for distinct_windowing_no_cbo.q Key: HIVE-23335 URL: https://issues.apache.org/jira/browse/HIVE-23335 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Find out why the result set is different for columnstats_partlvl_dp.q after moving to TestMiniLlapLocalCliDriver. Check [https://reviews.apache.org/r/72421/#comment308875|https://reviews.apache.org/r/72421/#comment308835] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23334) Investigate why the results have changed for columnstats_partlvl_dp.q
Miklos Gergely created HIVE-23334: - Summary: Investigate why the results have changed for columnstats_partlvl_dp.q Key: HIVE-23334 URL: https://issues.apache.org/jira/browse/HIVE-23334 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Find out why the result set is different for char_udf1.q after moving to TestMiniLlapLocalCliDriver. Check [https://reviews.apache.org/r/72421/#comment308875|https://reviews.apache.org/r/72421/#comment308835] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23333) Investigate why the results have changed for char_udf1.q
Miklos Gergely created HIVE-2: - Summary: Investigate why the results have changed for char_udf1.q Key: HIVE-2 URL: https://issues.apache.org/jira/browse/HIVE-2 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Find out why the result set is different for cbo_rp_udaf_percentile_approx_23.q after moving to TestMiniLlapLocalCliDriver. Check [https://reviews.apache.org/r/72421/#comment308875|https://reviews.apache.org/r/72421/#comment308835] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23332) Investigate why the results have changed for cbo_rp_udaf_percentile_approx_23.q
Miklos Gergely created HIVE-23332: - Summary: Investigate why the results have changed for cbo_rp_udaf_percentile_approx_23.q Key: HIVE-23332 URL: https://issues.apache.org/jira/browse/HIVE-23332 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Find out why the result set is different for authorization_9.q after moving to TestMiniLlapLocalCliDriver. Check [https://reviews.apache.org/r/72421/#comment308838|https://reviews.apache.org/r/72421/#comment308835] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23331) Investigate why the results have changed for authorization_9.q
Miklos Gergely created HIVE-23331: - Summary: Investigate why the results have changed for authorization_9.q Key: HIVE-23331 URL: https://issues.apache.org/jira/browse/HIVE-23331 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Find out why the result set is different for decimal_udf.q after moving to TestMiniLlapLocalCliDriver. Check [https://reviews.apache.org/r/72421/#comment308835] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23330) Investigate why the results have changed for decimal_udf.q
Miklos Gergely created HIVE-23330: - Summary: Investigate why the results have changed for decimal_udf.q Key: HIVE-23330 URL: https://issues.apache.org/jira/browse/HIVE-23330 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Find out why the result set is different for correlationoptimizer14.q after moving to TestMiniLlapLocalCliDriver. Check [https://reviews.apache.org/r/72421/#comment308835] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23329) Investigate why the results have changed for correlationoptimizer14.q
Miklos Gergely created HIVE-23329: - Summary: Investigate why the results have changed for correlationoptimizer14.q Key: HIVE-23329 URL: https://issues.apache.org/jira/browse/HIVE-23329 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Find out why the result set is different for correlationoptimizer14.q after moving to TestMiniLlapLocalCliDriver. Check [https://reviews.apache.org/r/72421/#comment308835] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23328) Investigate why ReducesinkDedup was not applied for correlationoptimizer11.q
Miklos Gergely created HIVE-23328: - Summary: Investigate why ReducesinkDedup was not applied for correlationoptimizer11.q Key: HIVE-23328 URL: https://issues.apache.org/jira/browse/HIVE-23328 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely After moving to TestMiniLlapLocalCliDriver ReducesinkDedup wasnát applied for correlationoptimizer11.q. Find out why, check [https://reviews.apache.org/r/72421/#comment308835] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23327) Investigate why the file size has changed at acid_stats2.q
Miklos Gergely created HIVE-23327: - Summary: Investigate why the file size has changed at acid_stats2.q Key: HIVE-23327 URL: https://issues.apache.org/jira/browse/HIVE-23327 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely The file size was modified at acid_stats2.q, find out why. See [https://reviews.apache.org/r/72421/#comment308835] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23326) Investigate minReductionHashAggr modifications
Miklos Gergely created HIVE-23326: - Summary: Investigate minReductionHashAggr modifications Key: HIVE-23326 URL: https://issues.apache.org/jira/browse/HIVE-23326 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely At some q tests the minReductionHashAggr was modified in the output after moving to TestMiniLlapLocalCliDriver, for example acid_nullscan.q, correlationoptimizer9.q. Check [https://reviews.apache.org/r/72421/#comment308835] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23316) Add tests to cover database managed location related DDL and fix minor issues
Miklos Gergely created HIVE-23316: - Summary: Add tests to cover database managed location related DDL and fix minor issues Key: HIVE-23316 URL: https://issues.apache.org/jira/browse/HIVE-23316 Project: Hive Issue Type: Bug Reporter: Miklos Gergely Assignee: Miklos Gergely Database managed location was recently introduced, but no tests were added to cover it. also the following issues were fixed: * ALTER DATABASE ... SET MANAGEDLOCATION ... commands were not handled in a separate path as it should, as in DDL each command type have their own Analyzer, Desc, and Operation class * in case of setting the LOCATION or the MANAGEDLOCATION the location was not getting qualified as in the CREATE DATABASE command * in case of setting the LOCATION or the MANAGEDLOCATION it was not checked if this modification makes the two the same * some minor checkstyle issues were fixed as well -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23315) Remove empty line from the end of SHOW EXTENDED TABLES and SHOW MATERIALIZED VIEWS
Miklos Gergely created HIVE-23315:
-
Summary: Remove empty line from the end of SHOW EXTENDED TABLES
and SHOW MATERIALIZED VIEWS
Key: HIVE-23315
URL: https://issues.apache.org/jira/browse/HIVE-23315
Project: Hive
Issue Type: Bug
Components: Hive
Reporter: Miklos Gergely
Assignee: Miklos Gergely
At the end of each SHOW EXTENDED TABLES; and SHOW MATERIALIZED VIEWS; command
there is an empty line like this:
{code:java}
+++
| tab_name | table_type |
+++
| sample_07 | MANAGED_TABLE |
| sample_08 | MANAGED_TABLE |
| web_logs | MANAGED_TABLE |
| | NULL |
+++
{code}
It should be removed.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HIVE-23274) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 1
Miklos Gergely created HIVE-23274: - Summary: Move q tests to TestMiniLlapLocal from TestCliDriver where the output is different, batch 1 Key: HIVE-23274 URL: https://issues.apache.org/jira/browse/HIVE-23274 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Assignee: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23273) Add fix order to cbo_limit.q queries + improve readability
Miklos Gergely created HIVE-23273: - Summary: Add fix order to cbo_limit.q queries + improve readability Key: HIVE-23273 URL: https://issues.apache.org/jira/browse/HIVE-23273 Project: Hive Issue Type: Bug Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely Fix For: 4.0.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23264) Make partition_wise_fileformat12.q deterministic with order by clauses
Miklos Gergely created HIVE-23264: - Summary: Make partition_wise_fileformat12.q deterministic with order by clauses Key: HIVE-23264 URL: https://issues.apache.org/jira/browse/HIVE-23264 Project: Hive Issue Type: Bug Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23263) Add fix order to cbo_rp_limit.q queries + improve readability
Miklos Gergely created HIVE-23263: - Summary: Add fix order to cbo_rp_limit.q queries + improve readability Key: HIVE-23263 URL: https://issues.apache.org/jira/browse/HIVE-23263 Project: Hive Issue Type: Bug Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely Fix For: 4.0.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23257) Fix flaky test TestMiniLlapLocalCliDriver[schema_evol_par_vec_table_non_dictionary_encoding.q]
Miklos Gergely created HIVE-23257: - Summary: Fix flaky test TestMiniLlapLocalCliDriver[schema_evol_par_vec_table_non_dictionary_encoding.q] Key: HIVE-23257 URL: https://issues.apache.org/jira/browse/HIVE-23257 Project: Hive Issue Type: Bug Components: HiveServer2 Reporter: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23256) Fix flaky test TestMiniLlapLocalCliDriver[schema_evol_par_vec_table_dictionary_encoding.q]
Miklos Gergely created HIVE-23256: - Summary: Fix flaky test TestMiniLlapLocalCliDriver[schema_evol_par_vec_table_dictionary_encoding.q] Key: HIVE-23256 URL: https://issues.apache.org/jira/browse/HIVE-23256 Project: Hive Issue Type: Bug Components: HiveServer2 Reporter: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23255) Fix flaky test TestMiniLlapLocalCliDriver[temp_table_multi_insert_partitioned.q]
Miklos Gergely created HIVE-23255: - Summary: Fix flaky test TestMiniLlapLocalCliDriver[temp_table_multi_insert_partitioned.q] Key: HIVE-23255 URL: https://issues.apache.org/jira/browse/HIVE-23255 Project: Hive Issue Type: Bug Components: HiveServer2 Reporter: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23245) Ensure result order for partition_date.q partition_timestamp.q queries
Miklos Gergely created HIVE-23245: - Summary: Ensure result order for partition_date.q partition_timestamp.q queries Key: HIVE-23245 URL: https://issues.apache.org/jira/browse/HIVE-23245 Project: Hive Issue Type: Bug Reporter: Miklos Gergely Assignee: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23244) Extract Create View analyzer from SemanticAnalyzer
Miklos Gergely created HIVE-23244: - Summary: Extract Create View analyzer from SemanticAnalyzer Key: HIVE-23244 URL: https://issues.apache.org/jira/browse/HIVE-23244 Project: Hive Issue Type: Sub-task Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely Create View commands are not queries, but commands which have queries as a part of them. Therefore a separate CreateViewAnalyzer is needed which uses SemanticAnalyer to analyze it's query. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23243) Accept SQL type like pattern for Show Databases
Miklos Gergely created HIVE-23243: - Summary: Accept SQL type like pattern for Show Databases Key: HIVE-23243 URL: https://issues.apache.org/jira/browse/HIVE-23243 Project: Hive Issue Type: Bug Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely Show Databases pattern accepts java like pattern with * and ., use SQL like instead with % and _. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23242) Fix flaky tests testHouseKeepingThreadExistence in TestMetastoreHousekeepingLeaderEmptyConfig and TestMetastoreHousekeepingLeader
Miklos Gergely created HIVE-23242: - Summary: Fix flaky tests testHouseKeepingThreadExistence in TestMetastoreHousekeepingLeaderEmptyConfig and TestMetastoreHousekeepingLeader Key: HIVE-23242 URL: https://issues.apache.org/jira/browse/HIVE-23242 Project: Hive Issue Type: Bug Components: Hive Reporter: Miklos Gergely Tests were ignored, see https://issues.apache.org/jira/browse/HIVE-23221 for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23221) Ignore flaky test testHouseKeepingThreadExistence in TestMetastoreHousekeepingLeaderEmptyConfig and TestMetastoreHousekeepingLeader
Miklos Gergely created HIVE-23221: - Summary: Ignore flaky test testHouseKeepingThreadExistence in TestMetastoreHousekeepingLeaderEmptyConfig and TestMetastoreHousekeepingLeader Key: HIVE-23221 URL: https://issues.apache.org/jira/browse/HIVE-23221 Project: Hive Issue Type: Bug Reporter: Miklos Gergely Assignee: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23217) Move q tests to TestMiniLlapLocal from TestCliDriver where the output is unchanged
Miklos Gergely created HIVE-23217: - Summary: Move q tests to TestMiniLlapLocal from TestCliDriver where the output is unchanged Key: HIVE-23217 URL: https://issues.apache.org/jira/browse/HIVE-23217 Project: Hive Issue Type: Sub-task Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23205) Do not run q tests with TestCliDriver if they are also set up for any other driver
Miklos Gergely created HIVE-23205: - Summary: Do not run q tests with TestCliDriver if they are also set up for any other driver Key: HIVE-23205 URL: https://issues.apache.org/jira/browse/HIVE-23205 Project: Hive Issue Type: Sub-task Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23203) Dummy jira for modifying ptest configuration - before the actual patch
Miklos Gergely created HIVE-23203: - Summary: Dummy jira for modifying ptest configuration - before the actual patch Key: HIVE-23203 URL: https://issues.apache.org/jira/browse/HIVE-23203 Project: Hive Issue Type: Test Components: Hive Reporter: Miklos Gergely If the ptest configuration is required to be modified, then the server must be restarted, which causes the actually processed patch to fail. In order not to cause trouble to others, this dummy Jira can be used by queueing this first, then the actual modification, finally the pair of this Jira. When the patch for this one is is processed, the ptest configuration can be modified, and the server can be restarted, thus this dummy jira's patch processing will fail. Then the actual modification comes, which will result in some way or the other. Then the other dummy Jira comes, and the ptest modifications can be reverted, and the server can be restarted again. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23204) Dummy jira for modifying ptest configuration - after the actual patch
Miklos Gergely created HIVE-23204: - Summary: Dummy jira for modifying ptest configuration - after the actual patch Key: HIVE-23204 URL: https://issues.apache.org/jira/browse/HIVE-23204 Project: Hive Issue Type: Test Components: Hive Reporter: Miklos Gergely If the ptest configuration is required to be modified, then the server must be restarted, which causes the actually processed patch to fail. In order not to cause trouble to others, this dummy Jira can be used by queueing this first, then the actual modification, finally the pair of this Jira. When the patch for this one is is processed, the ptest configuration can be modified, and the server can be restarted, thus this dummy jira's patch processing will fail. Then the actual modification comes, which will result in some way or the other. Then the other dummy Jira comes, and the ptest modifications can be reverted, and the server can be restarted again. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23202) Remove unused q.out files, where the q file no longer exists
Miklos Gergely created HIVE-23202: - Summary: Remove unused q.out files, where the q file no longer exists Key: HIVE-23202 URL: https://issues.apache.org/jira/browse/HIVE-23202 Project: Hive Issue Type: Improvement Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23200) Remove semijoin_reddedup without '.q' from testconfiguration.properties
Miklos Gergely created HIVE-23200: - Summary: Remove semijoin_reddedup without '.q' from testconfiguration.properties Key: HIVE-23200 URL: https://issues.apache.org/jira/browse/HIVE-23200 Project: Hive Issue Type: Improvement Reporter: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23141) Improve q test running
Miklos Gergely created HIVE-23141: - Summary: Improve q test running Key: HIVE-23141 URL: https://issues.apache.org/jira/browse/HIVE-23141 Project: Hive Issue Type: Improvement Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely q tests are running slow, they should be improved. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23139) Improve q test result masking
Miklos Gergely created HIVE-23139: - Summary: Improve q test result masking Key: HIVE-23139 URL: https://issues.apache.org/jira/browse/HIVE-23139 Project: Hive Issue Type: Improvement Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely Q Test result masking can take a long time, in extreme cases up to 5 times as much as the test itself, because it is inefficient. Use contains, startsWith instead of patterns for masking lines containing or starting with specified strings. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23138) Run q test with TestMiniLlapLocalCliDriver by default
Miklos Gergely created HIVE-23138: - Summary: Run q test with TestMiniLlapLocalCliDriver by default Key: HIVE-23138 URL: https://issues.apache.org/jira/browse/HIVE-23138 Project: Hive Issue Type: Improvement Reporter: Miklos Gergely Assignee: Miklos Gergely TestCliDriver, the current default driver for q tests is running tests on MR, which is getting less and less used. Instead we should test everything by default using TestMiniLlapLocalCliDriver. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23137) Disable spark tests at precommit
Miklos Gergely created HIVE-23137: - Summary: Disable spark tests at precommit Key: HIVE-23137 URL: https://issues.apache.org/jira/browse/HIVE-23137 Project: Hive Issue Type: Task Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely Spark is getting less and less widely supported and actively developed execution engine mode by the community. Therefore running the tests for it in every precommit is not reasonable. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23136) Do not compare q test result if test.output.overwrite is specified
Miklos Gergely created HIVE-23136: - Summary: Do not compare q test result if test.output.overwrite is specified Key: HIVE-23136 URL: https://issues.apache.org/jira/browse/HIVE-23136 Project: Hive Issue Type: Improvement Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23131) Remove ql/src/test/results/clientnegative/orc_type_promotion3_acid.q
Miklos Gergely created HIVE-23131: - Summary: Remove ql/src/test/results/clientnegative/orc_type_promotion3_acid.q Key: HIVE-23131 URL: https://issues.apache.org/jira/browse/HIVE-23131 Project: Hive Issue Type: Improvement Reporter: Miklos Gergely Assignee: Miklos Gergely ql/src/test/results/clientnegative/orc_type_promotion3_acid.q is a q file in the results directory, got there by accident. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23123) Export/Import of views and materialized views
Miklos Gergely created HIVE-23123:
-
Summary: Export/Import of views and materialized views
Key: HIVE-23123
URL: https://issues.apache.org/jira/browse/HIVE-23123
Project: Hive
Issue Type: Bug
Components: Hive
Reporter: Miklos Gergely
Assignee: Miklos Gergely
According to
https://cwiki.apache.org/confluence/display/Hive/LanguageManual+ImportExport
import and export can be done by using the
{code:java}
export table ...
import table ...
{code}
commands. The document doesn't mention views or materialized views at all, and
in fact we don't support commands like
{code:java}
export view ...
import view ...
export materialized view ...
import materialized view ...
{code}
they can not be parsed at all. The word table is often used though in a broader
sense, when it means all table like entities, including views and materialized
views. For example the various Table classes may represent any of these as well.
If I try to export a view with the export table ... command, it goes fine. A
_metadata file will be created, but no data directory, which is what we'd
expect. If I try to import it back, an exception is thrown due to the lack of
the data dir:
{code:java}
java.lang.AssertionError: null==getPath() for exim_view
at org.apache.hadoop.hive.ql.metadata.Hive.loadTable(Hive.java:3088)
at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:419)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:213)
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:105)
at org.apache.hadoop.hive.ql.Executor.launchTask(Executor.java:364)
at org.apache.hadoop.hive.ql.Executor.launchTasks(Executor.java:335)
at org.apache.hadoop.hive.ql.Executor.runTasks(Executor.java:246)
at org.apache.hadoop.hive.ql.Executor.execute(Executor.java:109)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:722)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:491)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:485)
{code}
Still the view gets imported successfully, as data movement wasn't even
necessary.
If we try to export a materialized view which is transactional, then this
exception occurs:
{code:java}
org.apache.hadoop.hive.ql.parse.SemanticException:
org.apache.hadoop.hive.ql.metadata.InvalidTableException: Table not found
exim_materialized_view_da21d41a_9fe4_4446_9c72_d251496abf9d
at
org.apache.hadoop.hive.ql.parse.AcidExportSemanticAnalyzer.analyzeAcidExport(AcidExportSemanticAnalyzer.java:163)
at
org.apache.hadoop.hive.ql.parse.AcidExportSemanticAnalyzer.analyze(AcidExportSemanticAnalyzer.java:71)
at
org.apache.hadoop.hive.ql.parse.RewriteSemanticAnalyzer.analyzeInternal(RewriteSemanticAnalyzer.java:72)
at
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:289)
at org.apache.hadoop.hive.ql.Compiler.analyze(Compiler.java:220)
at org.apache.hadoop.hive.ql.Compiler.compile(Compiler.java:104)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:183)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:601)
at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:547)
at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:541)
{code}
So the export process can not handle it, as the temporary table is not getting
created.
The import command handling have a lot of codes dedicated to importing views
and materialized views, which suggests that we support the importing (and thus
also suggests implicitly that we support the exporting) of views and
materialiezed views.
So the conclusion is that we have to decide if we support exporting/importing
of views and materialized views.
# If we decide not to support them then:
- export process should throw an exception if a view or materialized view is
the subject
- the codes specific to view imports should be removed
# If we decide to support them, then:
- the commands mentioned above above should be introduced
- exception should be thrown if not the proper command used (e.g. export view
on a table)
- the exceptions mentioned above should be fixed
I prefer #1, I don't think we should support the exporting / importing of
views. The point of exporting / importing is the transfer of data, not DDL, it
causes more issues than it solves. Our current documentation also suggests that
it is only supported for tables.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HIVE-23110) Prevent NPE in ReExecDriver if the processing is aborted
Miklos Gergely created HIVE-23110: - Summary: Prevent NPE in ReExecDriver if the processing is aborted Key: HIVE-23110 URL: https://issues.apache.org/jira/browse/HIVE-23110 Project: Hive Issue Type: Bug Components: HiveServer2 Reporter: Miklos Gergely Assignee: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23063) Use the same PerfLogger all over Compiler
Miklos Gergely created HIVE-23063: - Summary: Use the same PerfLogger all over Compiler Key: HIVE-23063 URL: https://issues.apache.org/jira/browse/HIVE-23063 Project: Hive Issue Type: Sub-task Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely Compiler gets it's PerfLogger again and again from SessionState, relying on the fact that it is returned from the same ThreadLocal. As this may change in the future it'd be better to use the same instance, obtained only once. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23059) In constraint name uniqueness query use the MTable instead of it's id
Miklos Gergely created HIVE-23059: - Summary: In constraint name uniqueness query use the MTable instead of it's id Key: HIVE-23059 URL: https://issues.apache.org/jira/browse/HIVE-23059 Project: Hive Issue Type: Bug Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely The constraint name uniqueness query uses the MTable instead of it's id. This will solve the immediate problem of not being able to create the sys db in Oracle, but not solve the same problem about the rest of the queries with integer number parameters (Long, Integer, etc). -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23049) Modify constraint name uniqueness query to run with Oracle19 as well
Miklos Gergely created HIVE-23049: - Summary: Modify constraint name uniqueness query to run with Oracle19 as well Key: HIVE-23049 URL: https://issues.apache.org/jira/browse/HIVE-23049 Project: Hive Issue Type: Bug Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely For some reason the current unique constraint name check query is not working with Oracle19. We should use another API call. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23024) Execute ptest batches in a more cost efficient order
Miklos Gergely created HIVE-23024: - Summary: Execute ptest batches in a more cost efficient order Key: HIVE-23024 URL: https://issues.apache.org/jira/browse/HIVE-23024 Project: Hive Issue Type: Bug Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely ptest batches are executed in an order that may lead to a situation when long tests are executed around the end, thus some nodes are going to run them still while all others are done. This elongates the total run time. Instead let's run long tests first, and short tests later, to get a more balanced workload. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-23013) Fix UnitTestPropertiesParser log message
Miklos Gergely created HIVE-23013: - Summary: Fix UnitTestPropertiesParser log message Key: HIVE-23013 URL: https://issues.apache.org/jira/browse/HIVE-23013 Project: Hive Issue Type: Bug Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely UnitTestPropertiesParser has a bug preventing from logging it's creation info appropriately. Instead of string concatenation ( + ) it has a ( , ), thus the end of the message is considered as the first argument, making a mess. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22972) Allow table id to be set for table creation requests
Miklos Gergely created HIVE-22972: - Summary: Allow table id to be set for table creation requests Key: HIVE-22972 URL: https://issues.apache.org/jira/browse/HIVE-22972 Project: Hive Issue Type: Bug Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely Fix For: 4.0.0 Hive Metastore should accept requests for table creation where the id is set, ignoring it. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22956) Fix checking if a table is used by a materialized view before dropping
Miklos Gergely created HIVE-22956: - Summary: Fix checking if a table is used by a materialized view before dropping Key: HIVE-22956 URL: https://issues.apache.org/jira/browse/HIVE-22956 Project: Hive Issue Type: Bug Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely Fix For: 4.0.0 Currently when a table is dropped we are deriving if it was used by any materialized views from the error message got from the Metastore. Instead of this we should check it in advance, from the HiveMaterializedViewsRegistry. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22907) Break up DDLSemanticAnalyzer - extract rest of the alter Table analyzers
Miklos Gergely created HIVE-22907: - Summary: Break up DDLSemanticAnalyzer - extract rest of the alter Table analyzers Key: HIVE-22907 URL: https://issues.apache.org/jira/browse/HIVE-22907 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Assignee: Miklos Gergely DDLSemanticAnalyzer is a huge class, more than 4000 lines long. The goal is to refactor it in order to have everything cut into more handleable classes under the package org.apache.hadoop.hive.ql.exec.ddl: * have a separate class for each analyzers * have a package for each operation, containing an analyzer, a description, and an operation, so the amount of classes under a package is more manageable Step #14: extract the table storage related analyzers from DDLSemanticAnalyzer, and move them under the new package. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22897) Remove enforcing of package-info.java files from the rest of the checkstyle files
Miklos Gergely created HIVE-22897:
-
Summary: Remove enforcing of package-info.java files from the rest
of the checkstyle files
Key: HIVE-22897
URL: https://issues.apache.org/jira/browse/HIVE-22897
Project: Hive
Issue Type: Improvement
Reporter: Miklos Gergely
Assignee: Miklos Gergely
Follow-up Jira of HIVE-22876, enforcing is also present at:
{code:java}
./storage-api/checkstyle/checkstyle.xml
./standalone-metastore/checkstyle/checkstyle.xml
{code}
Remove those too.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HIVE-22895) Break up DDLSemanticAnalyzer - extract Table storage analyzers
Miklos Gergely created HIVE-22895: - Summary: Break up DDLSemanticAnalyzer - extract Table storage analyzers Key: HIVE-22895 URL: https://issues.apache.org/jira/browse/HIVE-22895 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Assignee: Miklos Gergely DDLSemanticAnalyzer is a huge class, more than 4000 lines long. The goal is to refactor it in order to have everything cut into more handleable classes under the package org.apache.hadoop.hive.ql.exec.ddl: * have a separate class for each analyzers * have a package for each operation, containing an analyzer, a description, and an operation, so the amount of classes under a package is more manageable Step #13: extract the table info and lock related analyzers from DDLSemanticAnalyzer, and move them under the new package. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22876) Do not enforce package-info.java files by checkstyle
Miklos Gergely created HIVE-22876: - Summary: Do not enforce package-info.java files by checkstyle Key: HIVE-22876 URL: https://issues.apache.org/jira/browse/HIVE-22876 Project: Hive Issue Type: Improvement Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely Fix For: 4.0.0 Currently checkstyle enforces every pacakge to have a package-info.java file. This is not really followed by anyone, so it can be removed. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22868) Extract ValidTxnManager
Miklos Gergely created HIVE-22868: - Summary: Extract ValidTxnManager Key: HIVE-22868 URL: https://issues.apache.org/jira/browse/HIVE-22868 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Assignee: Miklos Gergely ~250 lines in driver are dedicated for the specific task of validating the transaction id list, and writing the valid write ids to the configuration. These should be put into a separate class. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22864) Add option to DatabaseRule to run the Schema Tool in verbose mode for tests
Miklos Gergely created HIVE-22864: - Summary: Add option to DatabaseRule to run the Schema Tool in verbose mode for tests Key: HIVE-22864 URL: https://issues.apache.org/jira/browse/HIVE-22864 Project: Hive Issue Type: Bug Reporter: Miklos Gergely Assignee: Miklos Gergely Fix For: 4.0.0 Running the database schema tests in the metastore is always in non-verbose mode, which can be helpful in case there is an error. Let's introduce a new maven argument for the tests (-Dverbose.schematool) with which the output of the Schema Tool is in verbose mode. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22835) Extract Executor from Driver
Miklos Gergely created HIVE-22835: - Summary: Extract Executor from Driver Key: HIVE-22835 URL: https://issues.apache.org/jira/browse/HIVE-22835 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Assignee: Miklos Gergely Fix For: 4.0.0 The Driver class contains ~600 lines of code responsible for executing the command. That means that from the Query Plan as input the appropriate tasks should be executed. This is a thing done by the execute function, which is ~300 lines long, and also has some sub functions to help this task. All these codes should be put into a separate class, where it can do it's job without getting mixed with the other codes in the Driver. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22748) Remove disabling of IdentityProjectRemover transformation for Return Path
Miklos Gergely created HIVE-22748: - Summary: Remove disabling of IdentityProjectRemover transformation for Return Path Key: HIVE-22748 URL: https://issues.apache.org/jira/browse/HIVE-22748 Project: Hive Issue Type: Sub-task Components: Hive Reporter: Miklos Gergely Assignee: Miklos Gergely Fix For: 4.0.0 For some reason IdentityProjectRemover transformation was not enabled for Return Path. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22747) Break up DDLSemanticAnalyzer - extract Table info and lock analyzers
Miklos Gergely created HIVE-22747: - Summary: Break up DDLSemanticAnalyzer - extract Table info and lock analyzers Key: HIVE-22747 URL: https://issues.apache.org/jira/browse/HIVE-22747 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Assignee: Miklos Gergely DDLSemanticAnalyzer is a huge class, more than 4000 lines long. The goal is to refactor it in order to have everything cut into more handleable classes under the package org.apache.hadoop.hive.ql.exec.ddl: * have a separate class for each analyzers * have a package for each operation, containing an analyzer, a description, and an operation, so the amount of classes under a package is more manageable Step #12: extract the table partition related analyzers from DDLSemanticAnalyzer, and move them under the new package. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22740) Test failing tests with return path
Miklos Gergely created HIVE-22740: - Summary: Test failing tests with return path Key: HIVE-22740 URL: https://issues.apache.org/jira/browse/HIVE-22740 Project: Hive Issue Type: Bug Reporter: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22696) Break up DDLSemanticAnalyzer - extract Table partition analyzers
Miklos Gergely created HIVE-22696: - Summary: Break up DDLSemanticAnalyzer - extract Table partition analyzers Key: HIVE-22696 URL: https://issues.apache.org/jira/browse/HIVE-22696 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Assignee: Miklos Gergely DDLSemanticAnalyzer is a huge class, more than 4000 lines long. The goal is to refactor it in order to have everything cut into more handleable classes under the package org.apache.hadoop.hive.ql.exec.ddl: * have a separate class for each analyzers * have a package for each operation, containing an analyzer, a description, and an operation, so the amount of classes under a package is more manageable Step #11: extract the table column related analyzers from DDLSemanticAnalyzer, and move them under the new package. -- This message was sent by Atlassian Jira (v8.3.4#803005)
