[jira] [Created] (HIVE-27216) Upgrade postgresql to 42.5.1 from 9.x
Aman Raj created HIVE-27216: --- Summary: Upgrade postgresql to 42.5.1 from 9.x Key: HIVE-27216 URL: https://issues.apache.org/jira/browse/HIVE-27216 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj This ticket involves partial cherry pick of #HIVE-23965 and complete cherry picks of HIVE-26253 and HIVE-26914 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27207) Backport of HIVE-26530: HS2 OOM-OperationManager.queryIdOperation does not properly clean up multiple queryIds
Aman Raj created HIVE-27207: --- Summary: Backport of HIVE-26530: HS2 OOM-OperationManager.queryIdOperation does not properly clean up multiple queryIds Key: HIVE-27207 URL: https://issues.apache.org/jira/browse/HIVE-27207 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj HIVE-26530 was already part of Hive-3.1.3 release so it should be backported to branch-3 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27206) Backport of HIVE-20179
Aman Raj created HIVE-27206: --- Summary: Backport of HIVE-20179 Key: HIVE-27206 URL: https://issues.apache.org/jira/browse/HIVE-27206 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj HIVE-20179 was already part of Hive 3.1.3 release so it makes sense to backport this to branch-3 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27204) Upgrade jettison to 1.5.2 to fix CVE-2022-45685
Aman Raj created HIVE-27204: --- Summary: Upgrade jettison to 1.5.2 to fix CVE-2022-45685 Key: HIVE-27204 URL: https://issues.apache.org/jira/browse/HIVE-27204 Project: Hive Issue Type: Bug Reporter: Aman Raj Assignee: Aman Raj Upgrade jettison to 1.5.2 to fix CVE-2022-45685 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27178) Backport of HIVE-23321 to branch-3
Aman Raj created HIVE-27178: --- Summary: Backport of HIVE-23321 to branch-3 Key: HIVE-27178 URL: https://issues.apache.org/jira/browse/HIVE-27178 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj Current branch-3 fails with the diff in select count(*) from skewed_string_list and select count(*) from skewed_string_list_values. Jenkins run : [jenkins / hive-precommit / PR-4156 / #1 (apache.org)|http://ci.hive.apache.org/blue/organizations/jenkins/hive-precommit/detail/PR-4156/1/tests/] Diff : Client Execution succeeded but contained differences (error code = 1) after executing sysdb.q 3740d3739 < hdfs://### HDFS PATH ### default public ROLE 4036c4035 < 3 --- > 6 4045c4044 < 3 --- > 6 This ticket tries to fix this diff. Please read the description of this ticket for the exact reason. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27174) Disable sysdb.q test
Aman Raj created HIVE-27174: --- Summary: Disable sysdb.q test Key: HIVE-27174 URL: https://issues.apache.org/jira/browse/HIVE-27174 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj h3. What changes were proposed in this pull request? Disabled sysdb.q test. The test is failing because of diff in BASIC_COLUMN_STATS json string. Client Execution succeeded but contained differences (error code = 1) after executing sysdb.q 3803,3807c3803,3807 < COLUMN_STATS_ACCURATE org.apache.derby.impl.jdbc.EmbedClob@125b285b < COLUMN_STATS_ACCURATE org.apache.derby.impl.jdbc.EmbedClob@471246f3 < COLUMN_STATS_ACCURATE org.apache.derby.impl.jdbc.EmbedClob@57c013 < COLUMN_STATS_ACCURATE org.apache.derby.impl.jdbc.EmbedClob@59f1d7ac < COLUMN_STATS_ACCURATE org.apache.derby.impl.jdbc.EmbedClob@71a0 — {quote}COLUMN_STATS_ACCURATE \{"BASIC_STATS":"true","COLUMN_STATS":{"c_boolean":"true","c_float":"true","c_int":"true","key":"true","value":"true"}} COLUMN_STATS_ACCURATE \{"BASIC_STATS":"true","COLUMN_STATS":{"c_boolean":"true","c_float":"true","c_int":"true","key":"true","value":"true"}} COLUMN_STATS_ACCURATE \{"BASIC_STATS":"true","COLUMN_STATS":{"key":"true","value":"true"}} COLUMN_STATS_ACCURATE \{"BASIC_STATS":"true","COLUMN_STATS":{"key":"true","value":"true"}} COLUMN_STATS_ACCURATE {"BASIC_STATS":"true","COLUMN_STATS": {quote} h3. Why are the changes needed? There is no issue in the test. The current code prints the COL_STATS as an Object instead of a json string. Not sure why is this case. Tried a lot of ways but seems like this is not fixable at the moment. So, disabling it for now. Note that, in Hive 3.1.3 release this test was disabled so there should not be any issue in disabling it here. Created a followup ticket to fix this test that can be taken up later - -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27153) Revert "HIVE-20182: Backport HIVE-20067 to branch-3"
Aman Raj created HIVE-27153: --- Summary: Revert "HIVE-20182: Backport HIVE-20067 to branch-3" Key: HIVE-27153 URL: https://issues.apache.org/jira/browse/HIVE-27153 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj The mm_all.q test is failing because of this commit. This commit was not validated before committing. There is no stack trace for this exception. Link to the exception : [http://ci.hive.apache.org/blue/organizations/jenkins/hive-precommit/detail/PR-4126/2/tests] {code:java} java.lang.AssertionError: Client execution failed with error code = 1 running "insert into table part_mm_n0 partition(key_mm=455) select key from intermediate_n0" fname=mm_all.q See ./ql/target/tmp/log/hive.log or ./itests/qtest/target/tmp/log/hive.log, or check ./ql/target/surefire-reports or ./itests/qtest/target/surefire-reports/ for specific test cases logs.at org.junit.Assert.fail(Assert.java:88)at org.apache.hadoop.hive.ql.QTestUtil.failed(QTestUtil.java:2232) at org.apache.hadoop.hive.cli.control.CoreCliDriver.runTest(CoreCliDriver.java:180) at org.apache.hadoop.hive.cli.control.CliAdapter.runTest(CliAdapter.java:104) at org.apache.hadoop.hive.cli.split1.TestMiniLlapCliDriver.testCliDriver(TestMiniLlapCliDriver.java:62) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27152) Revert "Constant UDF is not pushed to JDBCStorage Handler"
Aman Raj created HIVE-27152: --- Summary: Revert "Constant UDF is not pushed to JDBCStorage Handler" Key: HIVE-27152 URL: https://issues.apache.org/jira/browse/HIVE-27152 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj current_date_timestamp.q - This change was committed in HIVE-21388 without validation. The failure is because again Hive is not able to parse explain cbo select current_timestamp() from alltypesorc Exception stack trace : {code:java} 2023-03-16 04:06:17 Completed running task attempt: attempt_1678964507586_0001_175_01_00_02023-03-16 04:06:17 Completed Dag: dag_1678964507586_0001_175TRACE StatusLogger Log4jLoggerFactory.getContext() found anchor class org.apache.hadoop.hive.ql.exec.OperatorTRACE StatusLogger Log4jLoggerFactory.getContext() found anchor class org.apache.hadoop.hive.ql.stats.fs.FSStatsPublisherTRACE StatusLogger Log4jLoggerFactory.getContext() found anchor class org.apache.hadoop.hive.ql.stats.fs.FSStatsAggregatorNoViableAltException(24@[]) at org.apache.hadoop.hive.ql.parse.HiveParser.explainStatement(HiveParser.java:1512) at org.apache.hadoop.hive.ql.parse.HiveParser.statement(HiveParser.java:1407) at org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:230) at org.apache.hadoop.hive.ql.parse.ParseUtils.parse(ParseUtils.java:79) at org.apache.hadoop.hive.ql.parse.ParseUtils.parse(ParseUtils.java:72) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:617)at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1854) at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1801) at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1796) at org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:126) at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:214) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:239) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:188) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:402) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:335) at org.apache.hadoop.hive.ql.QTestUtil.executeClientInternal(QTestUtil.java:1474) at org.apache.hadoop.hive.ql.QTestUtil.executeClient(QTestUtil.java:1448) at org.apache.hadoop.hive.cli.control.CoreCliDriver.runTest(CoreCliDriver.java:177) at org.apache.hadoop.hive.cli.control.CliAdapter.runTest(CliAdapter.java:104) at org.apache.hadoop.hive.cli.split12.TestMiniLlapLocalCliDriver.testCliDriver(TestMiniLlapLocalCliDriver.java:62) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.apache.hadoop.hive.cli.control.CliAdapter$2$1.evaluate(CliAdapter.java:92) at org.junit.rules.RunRules.evaluate(RunRules.java:20) Attachments {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27151) Revert "HIVE-21685 Wrong simplification in query with multiple IN clauses"
Aman Raj created HIVE-27151: --- Summary: Revert "HIVE-21685 Wrong simplification in query with multiple IN clauses" Key: HIVE-27151 URL: https://issues.apache.org/jira/browse/HIVE-27151 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj The multi_in_clause.q fails because Hive is not able to parse explain cbo select * from very_simple_table_for_in_test where name IN('g','r') AND name IN('a','b') If we want this to work, I am able to do it in my local. We have 2 options : a. Either revert HIVE-21685 since this scenario was not validated back then before adding this test. b. This fix was present in https://issues.apache.org/jira/browse/HIVE-20718 but to cherry pick this we need to cherry pick https://issues.apache.org/jira/browse/HIVE-17040 since HIVE-20718 has a lot of merge conflicts with HIVE-17040. But after cherry picking these we have other failures to fix. I am reverting this ticket for now. Exception stacktrace : {code:java} 2023-03-16 12:33:11 Completed running task attempt: attempt_1678994907903_0001_185_01_00_02023-03-16 12:33:11 Completed Dag: dag_1678994907903_0001_185TRACE StatusLogger Log4jLoggerFactory.getContext() found anchor class org.apache.hadoop.hive.ql.exec.OperatorTRACE StatusLogger Log4jLoggerFactory.getContext() found anchor class org.apache.hadoop.hive.ql.stats.fs.FSStatsPublisherTRACE StatusLogger Log4jLoggerFactory.getContext() found anchor class org.apache.hadoop.hive.ql.stats.fs.FSStatsAggregatorNoViableAltException(24@[]) at org.apache.hadoop.hive.ql.parse.HiveParser.explainStatement(HiveParser.java:1512) at org.apache.hadoop.hive.ql.parse.HiveParser.statement(HiveParser.java:1407) at org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:230) at org.apache.hadoop.hive.ql.parse.ParseUtils.parse(ParseUtils.java:79) at org.apache.hadoop.hive.ql.parse.ParseUtils.parse(ParseUtils.java:72) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:617)at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1854) at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1801) at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1796) at org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:126) at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:214) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:239) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:188) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:402) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:335) at org.apache.hadoop.hive.ql.QTestUtil.executeClientInternal(QTestUtil.java:1474) at org.apache.hadoop.hive.ql.QTestUtil.executeClient(QTestUtil.java:1448) at org.apache.hadoop.hive.cli.control.CoreCliDriver.runTest(CoreCliDriver.java:177) at org.apache.hadoop.hive.cli.control.CliAdapter.runTest(CliAdapter.java:104) at org.apache.hadoop.hive.cli.split12.TestMiniLlapLocalCliDriver.testCliDriver(TestMiniLlapLocalCliDriver.java:62) {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27096) Fix test dbtxnmgr_showlocks.q
Aman Raj created HIVE-27096: --- Summary: Fix test dbtxnmgr_showlocks.q Key: HIVE-27096 URL: https://issues.apache.org/jira/browse/HIVE-27096 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj The test fails due to the following Assertion ERROR : Client Execution succeeded but contained differences (error code = 1) after executing dbtxnmgr_showlocks.q 73c73 < 5 default partitioned_acid_table p=abc MINOR initiated --- --- --- --- --- > 1 default partitioned_acid_table p=abc MINOR initiated --- --- --- --- It expects a Compaction ID 1 but gets 5. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27090) Test fix for external_jdbc_auth.q
Aman Raj created HIVE-27090: --- Summary: Test fix for external_jdbc_auth.q Key: HIVE-27090 URL: https://issues.apache.org/jira/browse/HIVE-27090 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj The external_jdbc_auth.q test fails due to the following errors : java.lang.AssertionError: Client Execution succeeded but contained differences (error code = 1) after executing external_jdbc_auth.q 220,221c220,221 < 20 20 20.0 20.0 < 20 20 20.0 20.0 --- > 20 20 20.0 20.0 20 > 20 20 20.0 20.0 20 This test was newly added in https://issues.apache.org/jira/browse/HIVE-20651 but the test has continuously failed on branch-3. Needs a fix. No other change had been committed to this test after this ticket. Since the ticket was merged in branch-3 without validating the test, fixing it now. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27089) Fix orc_merge*.q test failures
Aman Raj created HIVE-27089: --- Summary: Fix orc_merge*.q test failures Key: HIVE-27089 URL: https://issues.apache.org/jira/browse/HIVE-27089 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj The orc_merge1,2,3,4,10 .q tests fails with the following errors : < -rw-rw-rw- 3 ### USER ### ### GROUP ### 349 ### HDFS DATE ### hdfs://### HDFS PATH ### --- > -rw-r--r-- 3 ### USER ### ### GROUP ### 349 ### HDFS DATE ### hdfs://### HDFS > PATH ### -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27086) Backport of HIVE-17040: Join elimination in the presence of FK relationship
Aman Raj created HIVE-27086: --- Summary: Backport of HIVE-17040: Join elimination in the presence of FK relationship Key: HIVE-27086 URL: https://issues.apache.org/jira/browse/HIVE-27086 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27057) Revert "HIVE-19166: TestMiniLlapLocalCliDriver sysdb failure"
Aman Raj created HIVE-27057: --- Summary: Revert "HIVE-19166: TestMiniLlapLocalCliDriver sysdb failure" Key: HIVE-27057 URL: https://issues.apache.org/jira/browse/HIVE-27057 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj The sysdb test fails after this commit was added on branch-3 so reverting it. Before this commit sysdb works fine on branch-3. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27033) Backport of HIVE-23044: Make sure Cleaner doesn't delete delta directories for running queries
Aman Raj created HIVE-27033: --- Summary: Backport of HIVE-23044: Make sure Cleaner doesn't delete delta directories for running queries Key: HIVE-27033 URL: https://issues.apache.org/jira/browse/HIVE-27033 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27030) Upgrade Hive to Hadoop 3.3.4 (Latest release)
Aman Raj created HIVE-27030: --- Summary: Upgrade Hive to Hadoop 3.3.4 (Latest release) Key: HIVE-27030 URL: https://issues.apache.org/jira/browse/HIVE-27030 Project: Hive Issue Type: Task Components: Hive Reporter: Aman Raj Assignee: Aman Raj Upgrading HIVE to latest Hadoop 3.3.4 release -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27028) Backport of HIVE-18874 JDBC: HiveConnection shades log4j interfaces
Aman Raj created HIVE-27028: --- Summary: Backport of HIVE-18874 JDBC: HiveConnection shades log4j interfaces Key: HIVE-27028 URL: https://issues.apache.org/jira/browse/HIVE-27028 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27026) Backport of HIVE-22593 Dynamically partitioned MM (insert-only ACID) tables don't compact automatically
Aman Raj created HIVE-27026: --- Summary: Backport of HIVE-22593 Dynamically partitioned MM (insert-only ACID) tables don't compact automatically Key: HIVE-27026 URL: https://issues.apache.org/jira/browse/HIVE-27026 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27025) Test fix for sharedwork.q
Aman Raj created HIVE-27025: --- Summary: Test fix for sharedwork.q Key: HIVE-27025 URL: https://issues.apache.org/jira/browse/HIVE-27025 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj sharedwork.q fails with the following error because of differences : {code:java} java.lang.AssertionError: Client Execution succeeded but contained differences (error code = 1) after executing sharedwork.q 126c126< predicate: ((col_20) IN ('part1', 'part2', 'part3') and CAST( col_3 AS DATE) BETWEEN DATE'2018-07-01' AND DATE'2019-01-23') (type: boolean)---> predicate: ((col_20) IN ('part1', 'part2', 'part3') and (col_7 is not null or col_7 is null) and CAST( col_3 AS DATE) BETWEEN DATE'2018-07-01' AND DATE'2019-01-23') (type: boolean) {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27008) Backport of HIVE-20718 : Add perf cli driver with constraints
Aman Raj created HIVE-27008: --- Summary: Backport of HIVE-20718 : Add perf cli driver with constraints Key: HIVE-27008 URL: https://issues.apache.org/jira/browse/HIVE-27008 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26973) Backport of HIVE-25028 : Select query with IS operator producing unexpected result
Aman Raj created HIVE-26973: --- Summary: Backport of HIVE-25028 : Select query with IS operator producing unexpected result Key: HIVE-26973 URL: https://issues.apache.org/jira/browse/HIVE-26973 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj There are test failures in subquery_subquery_chain.q and sharedwork.q. Link to the test failues : http://ci.hive.apache.org/blue/organizations/jenkins/hive-precommit/detail/PR-3929/4/tests/ -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26972) Test failing due to wring directory structure being commited in HIVE-26819
Aman Raj created HIVE-26972: --- Summary: Test failing due to wring directory structure being commited in HIVE-26819 Key: HIVE-26972 URL: https://issues.apache.org/jira/browse/HIVE-26972 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj orc_map_key_repeating.q tries to do a diff between the test output and ql/src/test/results/clientpositive/orc_map_key_repeating.q.out but this q.out file does not exist. This was committed in HIVE-26819. This is because there is change in directory structure from oss/master and oss/branch-3. Moving this file to the right directory. Tests failing due to this : diff: /home/jenkins/agent/workspace/hive-precommit_PR-3929/ql/src/test/results/clientpositive/orc_map_key_repeating.q.out: No such file or directory -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26971) Test fixes caused due to CALCITE-1413
Aman Raj created HIVE-26971: --- Summary: Test fixes caused due to CALCITE-1413 Key: HIVE-26971 URL: https://issues.apache.org/jira/browse/HIVE-26971 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj There are test failures due to CALCITE-1413 as follows : h4. Stacktrace java.lang.AssertionError: Client Execution succeeded but contained differences (error code = 1) after executing load_data_using_job.q 3031,3032d3030 < PREHOOK: Input: default@orc_test_txn__temp_table_for_load_data__ < PREHOOK: Output: default@orc_test_txn 3035d3032 < POSTHOOK: Input: default@orc_test_txn__temp_table_for_load_data__ -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26970) Fixes for some test failures with LLAP Driver
Aman Raj created HIVE-26970: --- Summary: Fixes for some test failures with LLAP Driver Key: HIVE-26970 URL: https://issues.apache.org/jira/browse/HIVE-26970 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj These fixes already went into branch-3.1 from where Hive-3.1.3 was taken. Please use this commit ID to track the changes in branch-3.1 - a9dc9368 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26969) Backport of HIVE-20074 Disable TestTriggersWorkloadManager as it is unstable again
Aman Raj created HIVE-26969: --- Summary: Backport of HIVE-20074 Disable TestTriggersWorkloadManager as it is unstable again Key: HIVE-26969 URL: https://issues.apache.org/jira/browse/HIVE-26969 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26945) Test fixes for query*.q files
Aman Raj created HIVE-26945: --- Summary: Test fixes for query*.q files Key: HIVE-26945 URL: https://issues.apache.org/jira/browse/HIVE-26945 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj The tests has outdated q.out files which need to be updated. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26940) Backport of HIVE-19882 : Fix QTestUtil session lifecycle
Aman Raj created HIVE-26940: --- Summary: Backport of HIVE-19882 : Fix QTestUtil session lifecycle Key: HIVE-26940 URL: https://issues.apache.org/jira/browse/HIVE-26940 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj A lot of tests on branch-3 are failing with the following errors : {code:java} java.lang.AssertionError: Failed during createSources processLine with code=1 at org.junit.Assert.fail(Assert.java:88)at org.apache.hadoop.hive.ql.QTestUtil.initFromScript(QTestUtil.java:1219) at org.apache.hadoop.hive.ql.QTestUtil.createSources(QTestUtil.java:1201) at org.apache.hadoop.hive.ql.QTestUtil.createSources(QTestUtil.java:1188) at org.apache.hadoop.hive.cli.control.CoreCliDriver$3.invokeInternal(CoreCliDriver.java:83) at org.apache.hadoop.hive.cli.control.CoreCliDriver$3.invokeInternal(CoreCliDriver.java:80) at org.apache.hadoop.hive.util.ElapsedTimeLoggingWrapper.invoke(ElapsedTimeLoggingWrapper.java:33) at org.apache.hadoop.hive.cli.control.CoreCliDriver.beforeClass(CoreCliDriver.java:86) at org.apache.hadoop.hive.cli.control.CliAdapter$1$1.evaluate(CliAdapter.java:71) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.run(ParentRunner.java:309)at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:379) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:340) at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:125) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:413) {code} This is because hive.test.shutdown.phase is not set to true before the cleanup happens thereby invoking EnforceReadOnlyTables which prevents it from dropping tables while running tests. Below is the stack trace : {code:java} FAILED: Hive Internal Error: org.apache.hadoop.hive.ql.metadata.HiveException(Error while invoking PreHook. hooks: java.lang.RuntimeException: Cannot overwrite read-only table: srcat org.apache.hadoop.hive.ql.hooks.EnforceReadOnlyTables.run(EnforceReadOnlyTables.java:64) at org.apache.hadoop.hive.ql.hooks.EnforceReadOnlyTables.run(EnforceReadOnlyTables.java:44) at org.apache.hadoop.hive.ql.HookRunner.invokeGeneralHook(HookRunner.java:296) at org.apache.hadoop.hive.ql.HookRunner.runPreHooks(HookRunner.java:273)at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:2304) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:2039) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1737) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1731) at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:157) at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:218) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:239) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:188) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:402) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:335) at org.apache.hadoop.hive.ql.QTestUtil.cleanupFromFile(QTestUtil.java:1155) at org.apache.hadoop.hive.ql.QTestUtil.cleanUp(QTestUtil.java:1128) at org.apache.hadoop.hive.ql.QTestUtil.cleanUp(QTestUtil.java:1112) at org.apache.hadoop.hive.cli.control.CoreCliDriver$2.invokeInternal(CoreCliDriver.java:75) at org.apache.hadoop.hive.cli.control.CoreCliDriver$2.invokeInternal(CoreCliDriver.java:72) at org.apache.hadoop.hive.util.ElapsedTimeLoggingWrapper.invoke(ElapsedTimeLoggingWrapper.java:33) at org.apache.hadoop.hive.cli.control.CoreCliDriver.beforeClass(CoreCliDriver.java:78) at org.apache.hadoop.hive.cli.control.CliAdapter$1$1.evaluate(CliAdapter.java:71) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.run(ParentRunner.java:309)at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:379) at
[jira] [Created] (HIVE-26939) Hive LLAP Application Master fails to come up with Hadoop 3.3.4
Aman Raj created HIVE-26939: --- Summary: Hive LLAP Application Master fails to come up with Hadoop 3.3.4 Key: HIVE-26939 URL: https://issues.apache.org/jira/browse/HIVE-26939 Project: Hive Issue Type: Bug Components: Hive Reporter: Aman Raj Assignee: Aman Raj When current oss master hive tries to bring up the LLAP Application Master, it fails with this issue : {code:java} Executing the launch command\nINFO client.ServiceClient: Loading service definition from local FS: /var/lib/ambari-agent/tmp/llap-yarn-service_2023-01-10_07-56-46/Yarnfile\nERROR utils.JsonSerDeser: Exception while parsing json input stream\ncom.fasterxml.jackson.databind.exc.InvalidFormatException: Cannot deserialize value of type `org.apache.hadoop.yarn.service.api.records.PlacementScope` from String \"NODE\": not one of the values accepted for Enum class: [node, rack]\n at [Source: (org.apache.hadoop.fs.ChecksumFileSystem$FSDataBoundedInputStream); line: 31, column: 22] (through reference chain: org.apache.hadoop.yarn.service.api.records.Service[\"components\"]->java.util.ArrayList[0]->org.apache.hadoop.yarn.service.api.records.Component[\"placement_policy\"]->org.apache.hadoop.yarn.service.api.records.PlacementPolicy[\"constraints\"]->java.util.ArrayList[0]->org.apache.hadoop.yarn.service.api.records.PlacementConstraint[\"scope\"])\n\tat com.fasterxml.jackson.databind.exc.InvalidFormatException.from(InvalidFormatException.java:67) ~[jackson-databind-2.12.7.jar:2.12.7]\n\tat com.fasterxml.jackson.databind.DeserializationContext.weirdStringException(DeserializationContext.java:1851) ~[jackson-databind-2.12.7.jar:2.12.7]\n\tat com.fasterxml.jackson.databind.DeserializationContext.handleWeirdStringValue(DeserializationContext.java:1079) ~[jackson-databind-2.12.7.jar:2.12.7]\n\tat com.fasterxml.jackson.databind.deser.std.EnumDeserializer._deserializeAltString(EnumDeserializer.java:339) ~[jackson-databind-2.12.7.jar:2.12.7]\n\tat com.fasterxml.jackson.databind.deser.std.EnumDeserializer._fromString(EnumDeserializer.java:214) ~[jackson-databind-2.12.7.jar:2.12.7]\n\tat com.fasterxml.jackson.databind.deser.std.EnumDeserializer.deserialize(EnumDeserializer.java:188) ~[jackson-databind-2.12.7.jar:2.12.7]\n\tat com.fasterxml.jackson.databind.deser.impl.MethodProperty.deserializeAndSet(MethodProperty.java:129) ~[jackson-databind-2.12.7.jar:2.12.7]\n\tat com.fasterxml.jackson.databind.deser.BeanDeserializer.vanillaDeserialize(BeanDeserializer.java:324) ~[jackson-databind-2.12.7.jar:2.12.7]\n\tat com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:187) ~[jackson-databind-2.12.7.jar:2.12.7]\n\tat com.fasterxml.jackson.databind.deser.std.CollectionDeserializer._deserializeFromArray(CollectionDeserializer.java:355) ~[jackson-databind-2.12.7.jar:2.12.7]\n\tat com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:244) ~[jackson-databind-2.12.7.jar:2.12.7]\n\tat com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:28) ~[jackson-databind-2.12.7.jar:2.12.7]\n\tat com.fasterxml.jackson.databind.deser.impl.MethodProperty.deserializeAndSet(MethodProperty.java:129) ~[jackson-databind-2.12.7.jar:2.12.7]\n\tat com.fasterxml.jackson.databind.deser.BeanDeserializer.vanillaDeserialize(BeanDeserializer.java:324) ~[jackson-databind-2.12.7.jar:2.12.7]\n\tat com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:187) ~[jackson-databind-2.12.7.jar:2.12.7]\n\tat com.fasterxml.jackson.databind.deser.impl.MethodProperty.deserializeAndSet(MethodProperty.java:129) ~[jackson-databind-2.12.7.jar:2.12.7]\n\tat com.fasterxml.jackson.databind.deser.BeanDeserializer.vanillaDeserialize(BeanDeserializer.java:324) ~[jackson-databind-2.12.7.jar:2.12.7]\n\tat com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:187) ~[jackson-databind-2.12.7.jar:2.12.7]\n\tat com.fasterxml.jackson.databind.deser.std.CollectionDeserializer._deserializeFromArray(CollectionDeserializer.java:355) ~[jackson-databind-2.12.7.jar:2.12.7]\n\tat com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:244) ~[jackson-databind-2.12.7.jar:2.12.7]\n\tat com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:28) ~[jackson-databind-2.12.7.jar:2.12.7]\n\tat com.fasterxml.jackson.databind.deser.impl.MethodProperty.deserializeAndSet(MethodProperty.java:129) ~[jackson-databind-2.12.7.jar:2.12.7]\n\tat com.fasterxml.jackson.databind.deser.BeanDeserializer.vanillaDeserialize(BeanDeserializer.java:324) ~[jackson-databind-2.12.7.jar:2.12.7]\n\tat com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:187)
[jira] [Created] (HIVE-26916) Disable TestJdbcGenericUDTFGetSplits (Done as part of HIVE-22942)
Aman Raj created HIVE-26916: --- Summary: Disable TestJdbcGenericUDTFGetSplits (Done as part of HIVE-22942) Key: HIVE-26916 URL: https://issues.apache.org/jira/browse/HIVE-26916 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26915) Backport of HIVE-23692 TestCodahaleMetrics.testFileReporting is flaky
Aman Raj created HIVE-26915: --- Summary: Backport of HIVE-23692 TestCodahaleMetrics.testFileReporting is flaky Key: HIVE-26915 URL: https://issues.apache.org/jira/browse/HIVE-26915 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26909) Backport of HIVE-20715: Disable test: udaf_histogram_numeric
Aman Raj created HIVE-26909: --- Summary: Backport of HIVE-20715: Disable test: udaf_histogram_numeric Key: HIVE-26909 URL: https://issues.apache.org/jira/browse/HIVE-26909 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26907) Backport of HIVE-20741: Disable udaf_context_ngrams.q and udaf_corr.q tests
Aman Raj created HIVE-26907: --- Summary: Backport of HIVE-20741: Disable udaf_context_ngrams.q and udaf_corr.q tests Key: HIVE-26907 URL: https://issues.apache.org/jira/browse/HIVE-26907 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26906) Backport of HIVE-19313 to branch-3 : TestJdbcWithDBTokenStoreNoDoAs tests are failing
Aman Raj created HIVE-26906: --- Summary: Backport of HIVE-19313 to branch-3 : TestJdbcWithDBTokenStoreNoDoAs tests are failing Key: HIVE-26906 URL: https://issues.apache.org/jira/browse/HIVE-26906 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj # org.apache.hive.minikdc.TestJdbcWithDBTokenStoreNoDoAs ERROR : {{Error Could not open client transport with JDBC Uri: jdbc:hive2://localhost:42959/default;auth=delegationToken: Peer indicated failure: DIGEST-MD5: IO error acquiring password Stacktrace java.sql.SQLException: Could not open client transport with JDBC Uri: jdbc:hive2://localhost:42959/default;auth=delegationToken: Peer indicated failure: DIGEST-MD5: IO error acquiring password at org.apache.hive.jdbc.HiveConnection.(HiveConnection.java:269) at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:107) at java.sql.DriverManager.getConnection(DriverManager.java:664) at java.sql.DriverManager.getConnection(DriverManager.java:270) at org.apache.hive.minikdc.TestJdbcWithMiniKdc.testTokenAuth(TestJdbcWithMiniKdc.java:172) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)}} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26899) Upgrade arrow to 0.11.0 in branch-3
Aman Raj created HIVE-26899: --- Summary: Upgrade arrow to 0.11.0 in branch-3 Key: HIVE-26899 URL: https://issues.apache.org/jira/browse/HIVE-26899 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26896) Backport of Test fixes for lineage3.q and load_static_ptn_into_bucketed_table.q
Aman Raj created HIVE-26896: --- Summary: Backport of Test fixes for lineage3.q and load_static_ptn_into_bucketed_table.q Key: HIVE-26896 URL: https://issues.apache.org/jira/browse/HIVE-26896 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj These tests were fixed in branch-3.1 so backporting them to branch-3 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26895) Backport of HIVE-22899: Make sure qtests clean up copied files from test directories
Aman Raj created HIVE-26895: --- Summary: Backport of HIVE-22899: Make sure qtests clean up copied files from test directories Key: HIVE-26895 URL: https://issues.apache.org/jira/browse/HIVE-26895 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj Tests (like avrotblsjoin.q) are failing due to the following errors: {code:java} Begin query: avrotblsjoin.qTRACE StatusLogger Log4jLoggerFactory.getContext() found anchor class org.apache.hadoop.hive.cli.CliDriverTRACE StatusLogger Log4jLoggerFactory.getContext() found anchor class org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzerTRACE StatusLogger Log4jLoggerFactory.getContext() found anchor class org.apache.curator.RetryLoopTRACE StatusLogger Log4jLoggerFactory.getContext() found anchor class org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzercp: `/home/jenkins/agent/workspace/hive-precommit_PR-3859/itests/qtest/target/tmp/table1.avsc': File existsDone query avrotblsjoin.q. succeeded=false, skipped=false. ElapsedTime(ms)=41TRACE StatusLogger Log4jLoggerFactory.getContext() found anchor class org.apache.curator.RetryLoop {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26890) Disable TestSSL (Done as part of HIVE-21456 in oss/master)
Aman Raj created HIVE-26890: --- Summary: Disable TestSSL (Done as part of HIVE-21456 in oss/master) Key: HIVE-26890 URL: https://issues.apache.org/jira/browse/HIVE-26890 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj TestSSL fails with the following error (this happens in the Hive-3.1.3 release also, so disabling this test) : {code:java} [ERROR] Tests run: 10, Failures: 1, Errors: 0, Skipped: 2, Time elapsed: 23.143 s <<< FAILURE! - in org.apache.hive.jdbc.TestSSL [ERROR] testConnectionWrongCertCN(org.apache.hive.jdbc.TestSSL) Time elapsed: 0.64 s <<< FAILURE! java.lang.AssertionError at org.junit.Assert.fail(Assert.java:86) at org.junit.Assert.assertTrue(Assert.java:41) at org.junit.Assert.assertTrue(Assert.java:52) at org.apache.hive.jdbc.TestSSL.testConnectionWrongCertCN(TestSSL.java:408) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:379) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:340) at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:125) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:413) {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26886) Backport of HIVE-HIVE-23621 Enforce ASF headers on source files
Aman Raj created HIVE-26886: --- Summary: Backport of HIVE-HIVE-23621 Enforce ASF headers on source files Key: HIVE-26886 URL: https://issues.apache.org/jira/browse/HIVE-26886 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj Cherry pick this commit to branch-3 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26883) Revert "HIVE-21872 Bucketed tables that load data from data/files/auto_sortmerge_join should be tagged as 'bucketing_version'='1'"
Aman Raj created HIVE-26883: --- Summary: Revert "HIVE-21872 Bucketed tables that load data from data/files/auto_sortmerge_join should be tagged as 'bucketing_version'='1'" Key: HIVE-26883 URL: https://issues.apache.org/jira/browse/HIVE-26883 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj Tests are failing with the following errors: Client Execution succeeded but contained differences (error code = 1) after executing auto_sortmerge_join_12.q 3d2 < TBLPROPERTIES('bucketing_version'='1') 9d7 < TBLPROPERTIES('bucketing_version'='1') 31d28 < TBLPROPERTIES('bucketing_version'='1') 36d32 < TBLPROPERTIES('bucketing_version'='1') 108d103 < TBLPROPERTIES('bucketing_version'='1') 114d108 < TBLPROPERTIES('bucketing_version'='1') 249c243 < bucketing_version 1 --- > bucketing_version 2 299c293 < bucketing_version 1 --- > bucketing_version 2 378c372 < bucketing_version 1 --- > bucketing_version 2 456c450 < bucketing_version 1 --- > bucketing_version 2 Since this commit was already reverted in branch-3.1 we can revert this in branch-3 to make it 3.1 compatible. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26879) Backport of HIVE-23323 Add qsplits profile
Aman Raj created HIVE-26879: --- Summary: Backport of HIVE-23323 Add qsplits profile Key: HIVE-26879 URL: https://issues.apache.org/jira/browse/HIVE-26879 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26878) Disable TestJdbcWithMiniLlapVectorArrow in branch-3
Aman Raj created HIVE-26878: --- Summary: Disable TestJdbcWithMiniLlapVectorArrow in branch-3 Key: HIVE-26878 URL: https://issues.apache.org/jira/browse/HIVE-26878 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj The following issue comes while running the test : h4. Error Failed during createSources processLine with code=1 h4. Stacktrace java.lang.AssertionError: Failed during createSources processLine with code=1 at org.junit.Assert.fail(Assert.java:88) at org.apache.hadoop.hive.ql.QTestUtil.initFromScript(QTestUtil.java:1210) at org.apache.hadoop.hive.ql.QTestUtil.createSources(QTestUtil.java:1192) at org.apache.hadoop.hive.ql.QTestUtil.createSources(QTestUtil.java:1179) at org.apache.hadoop.hive.cli.control.CoreCliDriver$3.invokeInternal(CoreCliDriver.java:83) at org.apache.hadoop.hive.cli.control.CoreCliDriver$3.invokeInternal(CoreCliDriver.java:80) at org.apache.hadoop.hive.util.ElapsedTimeLoggingWrapper.invoke(ElapsedTimeLoggingWrapper.java:33) at org.apache.hadoop.hive.cli.control.CoreCliDriver.beforeClass(CoreCliDriver.java:86) at org.apache.hadoop.hive.cli.control.CliAdapter$1$1.evaluate(CliAdapter.java:71) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:379) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:340) at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:125) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:413) This test is ignored in Hive master so backporting the same fix. Commit ID : 77187b3e -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26876) Backport of BUG-108109 Disable flaky Spark Tests in branch-3
Aman Raj created HIVE-26876: --- Summary: Backport of BUG-108109 Disable flaky Spark Tests in branch-3 Key: HIVE-26876 URL: https://issues.apache.org/jira/browse/HIVE-26876 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj BUG-108109 : Disable flaky spark Tests Change-Id: I3adf35d6b4d1ee64ad79fe418a8cc57a6b9a4e6c Commit Id : 2b578be2 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26870) Backport of HIVE-25266: Fix TestWarehouseExternalDir
Aman Raj created HIVE-26870: --- Summary: Backport of HIVE-25266: Fix TestWarehouseExternalDir Key: HIVE-26870 URL: https://issues.apache.org/jira/browse/HIVE-26870 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26869) Backport of HIVE-25250 Branch-3: Fix TestHS2ImpersonationWithRemoteMS.testImpersonation
Aman Raj created HIVE-26869: --- Summary: Backport of HIVE-25250 Branch-3: Fix TestHS2ImpersonationWithRemoteMS.testImpersonation Key: HIVE-26869 URL: https://issues.apache.org/jira/browse/HIVE-26869 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26867) Backport of HIVE-24816
Aman Raj created HIVE-26867: --- Summary: Backport of HIVE-24816 Key: HIVE-26867 URL: https://issues.apache.org/jira/browse/HIVE-26867 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj This commit is needed for upgrading Jackson version and also fixed flaky tests -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26866) Fix TestOperationLoggingLayout test failures in branch-3
Aman Raj created HIVE-26866: --- Summary: Fix TestOperationLoggingLayout test failures in branch-3 Key: HIVE-26866 URL: https://issues.apache.org/jira/browse/HIVE-26866 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj The tests are failing due to the following error : h4. Error appenders h4. Stacktrace java.lang.NoSuchFieldException: appenders at java.lang.Class.getDeclaredField(Class.java:2070) at org.apache.hive.service.cli.operation.TestOperationLoggingLayout.checkAppenderState(TestOperationLoggingLayout.java:191) at org.apache.hive.service.cli.operation.TestOperationLoggingLayout.testHushableRandomAccessFileAppender(TestOperationLoggingLayout.java:167) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:379) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:340) at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:125) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:413) -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26865) Fix TestSQL11ReservedKeyWordsNegative test in branch-3
Aman Raj created HIVE-26865: --- Summary: Fix TestSQL11ReservedKeyWordsNegative test in branch-3 Key: HIVE-26865 URL: https://issues.apache.org/jira/browse/HIVE-26865 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj Due to [HIVE-21293] Fix ambiguity in grammar warnings at compilation time (II) - ASF JIRA (apache.org), the test cases are failing with the following error : java.lang.AssertionError: Expected ParseException at org.junit.Assert.fail(Assert.java:88) at org.apache.hadoop.hive.ql.parse.TestSQL11ReservedKeyWordsNegative$TestSQL11ReservedKeyWordsNegativeParametrized.testNegative(TestSQL11ReservedKeyWordsNegative.java:105) at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.junit.runners.Suite.runChild(Suite.java:127) at org.junit.runners.Suite.runChild(Suite.java:26) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.junit.runners.Suite.runChild(Suite.java:127) at org.junit.runners.Suite.runChild(Suite.java:26) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:379) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:340) at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:125) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:413) -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26840) Backport of HIVE-23073 Shade netty and upgrade to netty 4.1.48.Final
Aman Raj created HIVE-26840: --- Summary: Backport of HIVE-23073 Shade netty and upgrade to netty 4.1.48.Final Key: HIVE-26840 URL: https://issues.apache.org/jira/browse/HIVE-26840 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26836) Ensure Green Build for Branch-3
Aman Raj created HIVE-26836: --- Summary: Ensure Green Build for Branch-3 Key: HIVE-26836 URL: https://issues.apache.org/jira/browse/HIVE-26836 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26816) Add Jenkins file for branch-3
Aman Raj created HIVE-26816: --- Summary: Add Jenkins file for branch-3 Key: HIVE-26816 URL: https://issues.apache.org/jira/browse/HIVE-26816 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj We should add Jenkinsfile for branch-3 so that people can file PR against it. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26800) Backport HIVE-21755 : Backport HIVE-21462 to branch-3: Upgrading SQL server backed metastore when changing
Aman Raj created HIVE-26800: --- Summary: Backport HIVE-21755 : Backport HIVE-21462 to branch-3: Upgrading SQL server backed metastore when changing Key: HIVE-26800 URL: https://issues.apache.org/jira/browse/HIVE-26800 Project: Hive Issue Type: Sub-task Reporter: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26763) Upgrade Zookeeper to latest 3.6.3
Aman Raj created HIVE-26763: --- Summary: Upgrade Zookeeper to latest 3.6.3 Key: HIVE-26763 URL: https://issues.apache.org/jira/browse/HIVE-26763 Project: Hive Issue Type: Improvement Components: Hive Reporter: Aman Raj Assignee: Aman Raj Upgrade Zookeeper to latest version 3.6.3. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26752) Difference between branch-3 and Hive-3.1.3
Aman Raj created HIVE-26752: --- Summary: Difference between branch-3 and Hive-3.1.3 Key: HIVE-26752 URL: https://issues.apache.org/jira/browse/HIVE-26752 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj Fix For: 3.2.0 Created a subtask to track the difference between current branch-3 and Hive-3.1.3 release. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26751) Bug Fixes and Improvements for 3.2.0 release
Aman Raj created HIVE-26751: --- Summary: Bug Fixes and Improvements for 3.2.0 release Key: HIVE-26751 URL: https://issues.apache.org/jira/browse/HIVE-26751 Project: Hive Issue Type: Sub-task Affects Versions: 3.2.0 Reporter: Aman Raj Assignee: Aman Raj Creating subtask to track the bug fixes that will go as part of 3.2.0 release. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26750) Component Upgrades for 3.2.0 release
Aman Raj created HIVE-26750: --- Summary: Component Upgrades for 3.2.0 release Key: HIVE-26750 URL: https://issues.apache.org/jira/browse/HIVE-26750 Project: Hive Issue Type: Sub-task Affects Versions: 3.2.0 Reporter: Aman Raj Assignee: Aman Raj Creating subtask for upgrading major component versions -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26749) CVE Upgrades for 3.2.0 release
Aman Raj created HIVE-26749: --- Summary: CVE Upgrades for 3.2.0 release Key: HIVE-26749 URL: https://issues.apache.org/jira/browse/HIVE-26749 Project: Hive Issue Type: Sub-task Affects Versions: 3.2.0 Reporter: Aman Raj Assignee: Aman Raj Creating subtask for upgrading vulnerabilities in the 3.2.0 release -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26748) Prepare for Hive 3.2.0 Release
Aman Raj created HIVE-26748: --- Summary: Prepare for Hive 3.2.0 Release Key: HIVE-26748 URL: https://issues.apache.org/jira/browse/HIVE-26748 Project: Hive Issue Type: Task Components: Hive Affects Versions: 3.2.0 Reporter: Aman Raj Assignee: Aman Raj This is the Umbrella Jira to track all the commits that would go on top of current branch-3 in this new 3.2.0 Hive release. I will add all the JIRAs that will be cherry picked as part of this commit by defining subtasks or linking the JIRAs. *Please note that this is an Open forum and I welcome all responses for the same from the community with regards to any new bug fixes that should be cherry picked.* -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26391) [CVE-2020-36518] Upgrade com.fasterxml.jackson.core:jackson-databind from 2.13.0 to 2.13.2.1 to fix the vulnerability.
Aman Raj created HIVE-26391: --- Summary: [CVE-2020-36518] Upgrade com.fasterxml.jackson.core:jackson-databind from 2.13.0 to 2.13.2.1 to fix the vulnerability. Key: HIVE-26391 URL: https://issues.apache.org/jira/browse/HIVE-26391 Project: Hive Issue Type: Bug Components: Hive Reporter: Aman Raj jackson-databind is a data-binding package for the Jackson Data Processor. jackson-databind allows a Java stack overflow exception and denial of service via a large depth of nested objects. Upgrade com.fasterxml.jackson.core:jackson-databind from 2.13.0 to 2.13.2.1 to fix the vulnerability. -- This message was sent by Atlassian Jira (v8.20.10#820010)