[jira] [Updated] (HIVE-27842) Backport HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID
[ https://issues.apache.org/jira/browse/HIVE-27842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sruthi Mooriyathvariam updated HIVE-27842: -- https://github.com/apache/hive/pull/4848 > Backport HIVE-21866: LLAP status service driver may get stuck with wrong Yarn > app ID > > > Key: HIVE-27842 > URL: https://issues.apache.org/jira/browse/HIVE-27842 > Project: Hive > Issue Type: Sub-task >Reporter: Sruthi Mooriyathvariam >Assignee: Sruthi Mooriyathvariam >Priority: Major > Fix For: 3.2.0 > > > HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID > (Adam Szita).This requires backport of HIVE-20807: Refactor > LlapStatusServiceDriver and HIVE-20752: In case of LLAP start failure add > info how to find YARN logs > h1. > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Work started] (HIVE-27842) Backport HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID
[ https://issues.apache.org/jira/browse/HIVE-27842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-27842 started by Sruthi Mooriyathvariam. - > Backport HIVE-21866: LLAP status service driver may get stuck with wrong Yarn > app ID > > > Key: HIVE-27842 > URL: https://issues.apache.org/jira/browse/HIVE-27842 > Project: Hive > Issue Type: Sub-task >Reporter: Sruthi Mooriyathvariam >Assignee: Sruthi Mooriyathvariam >Priority: Major > Fix For: 3.2.0 > > > HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID > (Adam Szita).This requires backport of HIVE-20807: Refactor > LlapStatusServiceDriver and HIVE-20752: In case of LLAP start failure add > info how to find YARN logs > h1. > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27845) Upgrade protobuf to 3.24.4 to fix CVEs
Akshat Mathur created HIVE-27845: Summary: Upgrade protobuf to 3.24.4 to fix CVEs Key: HIVE-27845 URL: https://issues.apache.org/jira/browse/HIVE-27845 Project: Hive Issue Type: Improvement Reporter: Akshat Mathur Assignee: Akshat Mathur Current protobuf-java(3.21.3) has the following CVE Direct vulnerabilities: [CVE-2022-3510|https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2022-3510] [CVE-2022-3509|https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2022-3509] [CVE-2022-3171|https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2022-3171] Vulnerabilities from dependencies: [CVE-2023-2976|https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2023-2976] [CVE-2020-8908|https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2020-8908] -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27844) Multi destination queries giving error for Not in operators
Diksha created HIVE-27844: - Summary: Multi destination queries giving error for Not in operators Key: HIVE-27844 URL: https://issues.apache.org/jira/browse/HIVE-27844 Project: Hive Issue Type: Bug Reporter: Diksha When a filter operator is added to resolve the Not in bug for when cbo is disabled, multi insert queries like : from t3 b * INSERT OVERWRITE TABLE t4 * select * * where b.age not in * (select a.age * from t3 a * ) * order by age * INSERT OVERWRITE TABLE t5 * select * * where b.age in * (select c.age * from t3 c * ); give a runtime error. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27843) Add QueryOperation to Hive proto logger for post execution hook information
Ramesh Kumar Thangarajan created HIVE-27843: --- Summary: Add QueryOperation to Hive proto logger for post execution hook information Key: HIVE-27843 URL: https://issues.apache.org/jira/browse/HIVE-27843 Project: Hive Issue Type: Task Reporter: Ramesh Kumar Thangarajan Assignee: Ramesh Kumar Thangarajan Currently the query operation type is missing in the proto logger Add QueryOperation to Hive proto logger for post execution hook information -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-22390) Remove Dependency on JODA Time Library
[ https://issues.apache.org/jira/browse/HIVE-22390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-22390: -- Labels: pull-request-available (was: ) > Remove Dependency on JODA Time Library > -- > > Key: HIVE-22390 > URL: https://issues.apache.org/jira/browse/HIVE-22390 > Project: Hive > Issue Type: Sub-task >Reporter: David Mollitor >Assignee: David Mollitor >Priority: Major > Labels: pull-request-available > > Hive uses Joda time library. > {quote} > Joda-Time is the de facto standard date and time library for Java prior to > Java SE 8. Users are now asked to migrate to java.time (JSR-310). > https://www.joda.org/joda-time/ > {quote} > Remove this dependency from classes, POM files, and licence files. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-21866) LLAP status service driver may get stuck with wrong Yarn app ID
[ https://issues.apache.org/jira/browse/HIVE-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-21866: -- Labels: pull-request-available (was: ) > LLAP status service driver may get stuck with wrong Yarn app ID > --- > > Key: HIVE-21866 > URL: https://issues.apache.org/jira/browse/HIVE-21866 > Project: Hive > Issue Type: Bug >Reporter: Ádám Szita >Assignee: Ádám Szita >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0-alpha-1 > > Attachments: HIVE-21866.0.patch > > > LLAPStatusDriver might get stuck polling status from Yarn if the following > happen in this order: > * there was a running LLAP Yarn app previously which is now finished / killed > * Yarn was restarted > * LLAPStatusDriver is invoked before any new LLAP app gets kicked off > * LLAPStatusDriver receives the old app ID, which is then cached in the Yarn > serviceClient object (no evicition) > * In the meantime if any new LLAP app gets kicked off, LLAPStatusDriver will > not see it, as it constantly retries fetching info about the wrong, old app > ID (this is because we don't create new serviceClient objects) > {code:java} > ERROR status.LlapStatusServiceDriver: FAILED: 20: Failed to get Yarn AppReport > org.apache.hadoop.hive.llap.cli.status.LlapStatusCliException: 20: Failed to > get Yarn AppReport > at > org.apache.hadoop.hive.llap.cli.status.LlapStatusServiceDriver.getAppReport(LlapStatusServiceDriver.java:292) > [hive-llap-server-3.1.0.7.0.0.0-112.jar:3.1.0.7.0.0.0-134] > at > org.apache.hadoop.hive.llap.cli.status.LlapStatusServiceDriver.run(LlapStatusServiceDriver.java:209) > [hive-llap-server-3.1.0.7.0.0.0-112.jar:3.1.0.7.0.0.0-134] > at > org.apache.hadoop.hive.llap.cli.status.LlapStatusServiceDriver.main(LlapStatusServiceDriver.java:537) > [hive-llap-server-3.1.0.7.0.0.0-112.jar:3.1.0.7.0.0.0-134]{code} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (HIVE-27842) Backport HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID
[ https://issues.apache.org/jira/browse/HIVE-27842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sruthi Mooriyathvariam reassigned HIVE-27842: - Assignee: Sruthi Mooriyathvariam > Backport HIVE-21866: LLAP status service driver may get stuck with wrong Yarn > app ID > > > Key: HIVE-27842 > URL: https://issues.apache.org/jira/browse/HIVE-27842 > Project: Hive > Issue Type: Sub-task >Reporter: Sruthi Mooriyathvariam >Assignee: Sruthi Mooriyathvariam >Priority: Major > Fix For: 3.2.0 > > > HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID > (Adam Szita).This requires backport of HIVE-20807: Refactor > LlapStatusServiceDriver and HIVE-20752: In case of LLAP start failure add > info how to find YARN logs > h1. > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27842) Backport HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID
Sruthi Mooriyathvariam created HIVE-27842: - Summary: Backport HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID Key: HIVE-27842 URL: https://issues.apache.org/jira/browse/HIVE-27842 Project: Hive Issue Type: Sub-task Reporter: Sruthi Mooriyathvariam Fix For: 3.2.0 HIVE-21866: LLAP status service driver may get stuck with wrong Yarn app ID (Adam Szita).This requires backport of HIVE-20807: Refactor LlapStatusServiceDriver and HIVE-20752: In case of LLAP start failure add info how to find YARN logs h1. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27841) Backport of HIVE-21862: ORC ppd produces wrong result with timestamp
[ https://issues.apache.org/jira/browse/HIVE-27841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27841: -- Labels: pull-request-available (was: ) > Backport of HIVE-21862: ORC ppd produces wrong result with timestamp > > > Key: HIVE-27841 > URL: https://issues.apache.org/jira/browse/HIVE-27841 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Labels: pull-request-available > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (HIVE-27841) Backport of HIVE-21862: ORC ppd produces wrong result with timestamp
[ https://issues.apache.org/jira/browse/HIVE-27841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shefali Singh reassigned HIVE-27841: Assignee: Shefali Singh > Backport of HIVE-21862: ORC ppd produces wrong result with timestamp > > > Key: HIVE-27841 > URL: https://issues.apache.org/jira/browse/HIVE-27841 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27841) Backport of HIVE-21862: ORC ppd produces wrong result with timestamp
Shefali Singh created HIVE-27841: Summary: Backport of HIVE-21862: ORC ppd produces wrong result with timestamp Key: HIVE-27841 URL: https://issues.apache.org/jira/browse/HIVE-27841 Project: Hive Issue Type: Sub-task Reporter: Shefali Singh Fix For: 3.2.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27840) Backport of HIVE-21729: Arrow serializer sometimes shifts timestamp by one second
[ https://issues.apache.org/jira/browse/HIVE-27840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27840: -- Labels: pull-request-available (was: ) > Backport of HIVE-21729: Arrow serializer sometimes shifts timestamp by one > second > - > > Key: HIVE-27840 > URL: https://issues.apache.org/jira/browse/HIVE-27840 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Labels: pull-request-available > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27840) Backport of HIVE-21729: Arrow serializer sometimes shifts timestamp by one second
Shefali Singh created HIVE-27840: Summary: Backport of HIVE-21729: Arrow serializer sometimes shifts timestamp by one second Key: HIVE-27840 URL: https://issues.apache.org/jira/browse/HIVE-27840 Project: Hive Issue Type: Sub-task Reporter: Shefali Singh Fix For: 3.2.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (HIVE-27840) Backport of HIVE-21729: Arrow serializer sometimes shifts timestamp by one second
[ https://issues.apache.org/jira/browse/HIVE-27840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shefali Singh reassigned HIVE-27840: Assignee: Shefali Singh > Backport of HIVE-21729: Arrow serializer sometimes shifts timestamp by one > second > - > > Key: HIVE-27840 > URL: https://issues.apache.org/jira/browse/HIVE-27840 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27839) Backport of HIVE-20437: Handle schema evolution from Float, Double and Decimal.
[ https://issues.apache.org/jira/browse/HIVE-27839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27839: -- Labels: pull-request-available (was: ) > Backport of HIVE-20437: Handle schema evolution from Float, Double and > Decimal. > --- > > Key: HIVE-27839 > URL: https://issues.apache.org/jira/browse/HIVE-27839 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Labels: pull-request-available > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27839) Backport of HIVE-20437: Handle schema evolution from Float, Double and Decimal.
Shefali Singh created HIVE-27839: Summary: Backport of HIVE-20437: Handle schema evolution from Float, Double and Decimal. Key: HIVE-27839 URL: https://issues.apache.org/jira/browse/HIVE-27839 Project: Hive Issue Type: Sub-task Reporter: Shefali Singh Fix For: 3.2.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (HIVE-27839) Backport of HIVE-20437: Handle schema evolution from Float, Double and Decimal.
[ https://issues.apache.org/jira/browse/HIVE-27839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shefali Singh reassigned HIVE-27839: Assignee: Shefali Singh > Backport of HIVE-20437: Handle schema evolution from Float, Double and > Decimal. > --- > > Key: HIVE-27839 > URL: https://issues.apache.org/jira/browse/HIVE-27839 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Comment Edited] (HIVE-27835) java.lang.NoClassDefFoundError: net/jpountz/lz4/LZ4Factory for DruidStorageHandler
[ https://issues.apache.org/jira/browse/HIVE-27835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17781745#comment-17781745 ] Basapuram Kumar edited comment on HIVE-27835 at 11/1/23 2:17 PM: - Adding the {color:#00875a}lz4-java-1.7.1.jar{color} into the {color:#0747a6}HIVE_AUX_JARS_PATH{color} from {color:#0747a6}hive-env{color} would help to fix this issue/ {code:java} export HIVE_AUX_JARS_PATH=${HIVE_AUX_JARS_PATH}:/usr/odp/3.2.2.0-1/hive/lib/lz4-java-1.7.1.jar {code} Followed by restart the hive. And from beeline, we see that this change got reflected. {code:java} 0: jdbc:hive2://odp01.ubuntu.ad.ce:2181,odp02> set hive.aux.jars.path; ++ | set | ++ | hive.aux.jars.path=file:///usr/odp/current/hive-webhcat/share/hcatalog/hive-hcatalog-core.jar,file:///usr/odp/3.2.2.0-1/hive/lib/lz4-java-1.7.1.jar | {code} was (Author: JIRAUSER295887): Adding the {color:#00875a}lz4-java-1.7.1.jar{color} into the {color:#0747a6}HIVE_AUX_JARS_PATH{color} from {color:#0747a6}hive-env{color} would help to fix this issue/ {code:java} export HIVE_AUX_JARS_PATH=${HIVE_AUX_JARS_PATH}:/usr/odp/3.2.2.0-1/hive/lib/lz4-java-1.7.1.jar {code} > java.lang.NoClassDefFoundError: net/jpountz/lz4/LZ4Factory for > DruidStorageHandler > -- > > Key: HIVE-27835 > URL: https://issues.apache.org/jira/browse/HIVE-27835 > Project: Hive > Issue Type: Task > Components: Hive >Affects Versions: 4.0.0-alpha-1 > Environment: hive-4-alpha-1 > Druid-27.0.0 >Reporter: Basapuram Kumar >Assignee: Basapuram Kumar >Priority: Major > > Hello Team, > I am trying to use Druid storage handler to create a table. > Steps to repro > Create table > > {code:java} > CREATE TABLE emp_zlib_3110_2038 ( > `__time` TIMESTAMP, > id int, > name string, > age int, > gender string) > STORED AS ORC > TBLPROPERTIES ('transactional'='true',"orc.compress"="ZLIB"); > {code} > insert data > {code:java} > insert into emp_zlib_3110_2038 values(CURRENT_TIMESTAMP(),10,'basa',30,'M'); > {code} > Create a DruidStorageHandler table > {code:java} > CREATE TABLE druid_hive_table_3110_2038_02 > STORED BY 'org.apache.hadoop.hive.druid.DruidStorageHandler' > TBLPROPERTIES ("druid.datasource" = "druid_hive_table_3110_2038_02") > AS > select `__time`, id,name,age,gender from emp_zlib_3110_2038 ; {code} > Error: > {code:java} > INFO : Status: Running (Executing on YARN cluster with App id > application_1698753624381_0021) > -- > > VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED > KILLED > -- > Map 1 .. container SUCCEEDED 1 1 0 0 > 0 0 > Reducer 2 ... container RUNNING 2 1 0 1 > 4 0 > -- > VERTICES: 01/02 [=>>-] 66% ELAPSED TIME: 37.91 s > -- > ERROR : Status: FailedERROR : Vertex failed, vertexName=Reducer 2, > vertexId=vertex_1698753624381_0021_3_01, diagnostics=[Task failed, > taskId=task_1698753624381_0021_3_01_00, diagnostics=[TaskAttempt 0 > failed, info=[Error: Error while running task ( failure ) : > attempt_1698753624381_0021_3_01_00_0:java.lang.RuntimeException: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing row > at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:348) > > at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:276) > at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:381) > > at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82) > > at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69) > > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762) > > at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69) > > at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Call
[jira] (HIVE-27835) java.lang.NoClassDefFoundError: net/jpountz/lz4/LZ4Factory for DruidStorageHandler
[ https://issues.apache.org/jira/browse/HIVE-27835 ] Basapuram Kumar deleted comment on HIVE-27835: was (Author: JIRAUSER295887): Adding the {color:#00875a}lz4-java-1.7.1.jar{color} into the {color:#0747a6}HIVE_AUX_JARS_PATH{color} from {color:#0747a6}hive-env{color} would help to fix this issue/ {code:java} export HIVE_AUX_JARS_PATH=${HIVE_AUX_JARS_PATH}:/usr/odp/3.2.2.0-1/hive/lib/lz4-java-1.7.1.jar {code} > java.lang.NoClassDefFoundError: net/jpountz/lz4/LZ4Factory for > DruidStorageHandler > -- > > Key: HIVE-27835 > URL: https://issues.apache.org/jira/browse/HIVE-27835 > Project: Hive > Issue Type: Task > Components: Hive >Affects Versions: 4.0.0-alpha-1 > Environment: hive-4-alpha-1 > Druid-27.0.0 >Reporter: Basapuram Kumar >Assignee: Basapuram Kumar >Priority: Major > > Hello Team, > I am trying to use Druid storage handler to create a table. > Steps to repro > Create table > > {code:java} > CREATE TABLE emp_zlib_3110_2038 ( > `__time` TIMESTAMP, > id int, > name string, > age int, > gender string) > STORED AS ORC > TBLPROPERTIES ('transactional'='true',"orc.compress"="ZLIB"); > {code} > insert data > {code:java} > insert into emp_zlib_3110_2038 values(CURRENT_TIMESTAMP(),10,'basa',30,'M'); > {code} > Create a DruidStorageHandler table > {code:java} > CREATE TABLE druid_hive_table_3110_2038_02 > STORED BY 'org.apache.hadoop.hive.druid.DruidStorageHandler' > TBLPROPERTIES ("druid.datasource" = "druid_hive_table_3110_2038_02") > AS > select `__time`, id,name,age,gender from emp_zlib_3110_2038 ; {code} > Error: > {code:java} > INFO : Status: Running (Executing on YARN cluster with App id > application_1698753624381_0021) > -- > > VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED > KILLED > -- > Map 1 .. container SUCCEEDED 1 1 0 0 > 0 0 > Reducer 2 ... container RUNNING 2 1 0 1 > 4 0 > -- > VERTICES: 01/02 [=>>-] 66% ELAPSED TIME: 37.91 s > -- > ERROR : Status: FailedERROR : Vertex failed, vertexName=Reducer 2, > vertexId=vertex_1698753624381_0021_3_01, diagnostics=[Task failed, > taskId=task_1698753624381_0021_3_01_00, diagnostics=[TaskAttempt 0 > failed, info=[Error: Error while running task ( failure ) : > attempt_1698753624381_0021_3_01_00_0:java.lang.RuntimeException: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing row > at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:348) > > at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:276) > at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:381) > > at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82) > > at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69) > > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762) > > at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69) > > at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39) > > at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) > at > com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125) > > at > com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57) > > at > com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78) > > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > > at java.lang.Thread.run(Thread.java:750)Caused by: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing row > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecor
[jira] [Resolved] (HIVE-27835) java.lang.NoClassDefFoundError: net/jpountz/lz4/LZ4Factory for DruidStorageHandler
[ https://issues.apache.org/jira/browse/HIVE-27835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Basapuram Kumar resolved HIVE-27835. Resolution: Workaround Adding the {color:#00875a}lz4-java-1.7.1.jar{color} into the {color:#0747a6}HIVE_AUX_JARS_PATH{color} from {color:#0747a6}hive-env{color} would help to fix this issue/ {code:java} export HIVE_AUX_JARS_PATH=${HIVE_AUX_JARS_PATH}:/usr/odp/3.2.2.0-1/hive/lib/lz4-java-1.7.1.jar {code} > java.lang.NoClassDefFoundError: net/jpountz/lz4/LZ4Factory for > DruidStorageHandler > -- > > Key: HIVE-27835 > URL: https://issues.apache.org/jira/browse/HIVE-27835 > Project: Hive > Issue Type: Task > Components: Hive >Affects Versions: 4.0.0-alpha-1 > Environment: hive-4-alpha-1 > Druid-27.0.0 >Reporter: Basapuram Kumar >Assignee: Basapuram Kumar >Priority: Major > > Hello Team, > I am trying to use Druid storage handler to create a table. > Steps to repro > Create table > > {code:java} > CREATE TABLE emp_zlib_3110_2038 ( > `__time` TIMESTAMP, > id int, > name string, > age int, > gender string) > STORED AS ORC > TBLPROPERTIES ('transactional'='true',"orc.compress"="ZLIB"); > {code} > insert data > {code:java} > insert into emp_zlib_3110_2038 values(CURRENT_TIMESTAMP(),10,'basa',30,'M'); > {code} > Create a DruidStorageHandler table > {code:java} > CREATE TABLE druid_hive_table_3110_2038_02 > STORED BY 'org.apache.hadoop.hive.druid.DruidStorageHandler' > TBLPROPERTIES ("druid.datasource" = "druid_hive_table_3110_2038_02") > AS > select `__time`, id,name,age,gender from emp_zlib_3110_2038 ; {code} > Error: > {code:java} > INFO : Status: Running (Executing on YARN cluster with App id > application_1698753624381_0021) > -- > > VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED > KILLED > -- > Map 1 .. container SUCCEEDED 1 1 0 0 > 0 0 > Reducer 2 ... container RUNNING 2 1 0 1 > 4 0 > -- > VERTICES: 01/02 [=>>-] 66% ELAPSED TIME: 37.91 s > -- > ERROR : Status: FailedERROR : Vertex failed, vertexName=Reducer 2, > vertexId=vertex_1698753624381_0021_3_01, diagnostics=[Task failed, > taskId=task_1698753624381_0021_3_01_00, diagnostics=[TaskAttempt 0 > failed, info=[Error: Error while running task ( failure ) : > attempt_1698753624381_0021_3_01_00_0:java.lang.RuntimeException: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing row > at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:348) > > at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:276) > at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:381) > > at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82) > > at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69) > > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762) > > at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69) > > at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39) > > at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) > at > com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125) > > at > com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57) > > at > com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78) > > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > > at java.lang.Thread.run(Thread.java:750)Caused by: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing row > at > org.apache.hadoop.hive.ql.exec.te
[jira] [Assigned] (HIVE-27835) java.lang.NoClassDefFoundError: net/jpountz/lz4/LZ4Factory for DruidStorageHandler
[ https://issues.apache.org/jira/browse/HIVE-27835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Basapuram Kumar reassigned HIVE-27835: -- Assignee: Basapuram Kumar > java.lang.NoClassDefFoundError: net/jpountz/lz4/LZ4Factory for > DruidStorageHandler > -- > > Key: HIVE-27835 > URL: https://issues.apache.org/jira/browse/HIVE-27835 > Project: Hive > Issue Type: Task > Components: Hive >Affects Versions: 4.0.0-alpha-1 > Environment: hive-4-alpha-1 > Druid-27.0.0 >Reporter: Basapuram Kumar >Assignee: Basapuram Kumar >Priority: Major > > Hello Team, > I am trying to use Druid storage handler to create a table. > Steps to repro > Create table > > {code:java} > CREATE TABLE emp_zlib_3110_2038 ( > `__time` TIMESTAMP, > id int, > name string, > age int, > gender string) > STORED AS ORC > TBLPROPERTIES ('transactional'='true',"orc.compress"="ZLIB"); > {code} > insert data > {code:java} > insert into emp_zlib_3110_2038 values(CURRENT_TIMESTAMP(),10,'basa',30,'M'); > {code} > Create a DruidStorageHandler table > {code:java} > CREATE TABLE druid_hive_table_3110_2038_02 > STORED BY 'org.apache.hadoop.hive.druid.DruidStorageHandler' > TBLPROPERTIES ("druid.datasource" = "druid_hive_table_3110_2038_02") > AS > select `__time`, id,name,age,gender from emp_zlib_3110_2038 ; {code} > Error: > {code:java} > INFO : Status: Running (Executing on YARN cluster with App id > application_1698753624381_0021) > -- > > VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED > KILLED > -- > Map 1 .. container SUCCEEDED 1 1 0 0 > 0 0 > Reducer 2 ... container RUNNING 2 1 0 1 > 4 0 > -- > VERTICES: 01/02 [=>>-] 66% ELAPSED TIME: 37.91 s > -- > ERROR : Status: FailedERROR : Vertex failed, vertexName=Reducer 2, > vertexId=vertex_1698753624381_0021_3_01, diagnostics=[Task failed, > taskId=task_1698753624381_0021_3_01_00, diagnostics=[TaskAttempt 0 > failed, info=[Error: Error while running task ( failure ) : > attempt_1698753624381_0021_3_01_00_0:java.lang.RuntimeException: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing row > at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:348) > > at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:276) > at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:381) > > at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82) > > at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69) > > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762) > > at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69) > > at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39) > > at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) > at > com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125) > > at > com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57) > > at > com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78) > > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > > at java.lang.Thread.run(Thread.java:750)Caused by: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing row > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:311) > > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:291) > > at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.jav
[jira] [Commented] (HIVE-27835) java.lang.NoClassDefFoundError: net/jpountz/lz4/LZ4Factory for DruidStorageHandler
[ https://issues.apache.org/jira/browse/HIVE-27835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17781744#comment-17781744 ] Basapuram Kumar commented on HIVE-27835: Adding the {color:#00875a}lz4-java-1.7.1.jar{color} into the {color:#0747a6}HIVE_AUX_JARS_PATH{color} from {color:#0747a6}hive-env{color} would help to fix this issue/ {code:java} export HIVE_AUX_JARS_PATH=${HIVE_AUX_JARS_PATH}:/usr/odp/3.2.2.0-1/hive/lib/lz4-java-1.7.1.jar {code} > java.lang.NoClassDefFoundError: net/jpountz/lz4/LZ4Factory for > DruidStorageHandler > -- > > Key: HIVE-27835 > URL: https://issues.apache.org/jira/browse/HIVE-27835 > Project: Hive > Issue Type: Task > Components: Hive >Affects Versions: 4.0.0-alpha-1 > Environment: hive-4-alpha-1 > Druid-27.0.0 >Reporter: Basapuram Kumar >Priority: Major > > Hello Team, > I am trying to use Druid storage handler to create a table. > Steps to repro > Create table > > {code:java} > CREATE TABLE emp_zlib_3110_2038 ( > `__time` TIMESTAMP, > id int, > name string, > age int, > gender string) > STORED AS ORC > TBLPROPERTIES ('transactional'='true',"orc.compress"="ZLIB"); > {code} > insert data > {code:java} > insert into emp_zlib_3110_2038 values(CURRENT_TIMESTAMP(),10,'basa',30,'M'); > {code} > Create a DruidStorageHandler table > {code:java} > CREATE TABLE druid_hive_table_3110_2038_02 > STORED BY 'org.apache.hadoop.hive.druid.DruidStorageHandler' > TBLPROPERTIES ("druid.datasource" = "druid_hive_table_3110_2038_02") > AS > select `__time`, id,name,age,gender from emp_zlib_3110_2038 ; {code} > Error: > {code:java} > INFO : Status: Running (Executing on YARN cluster with App id > application_1698753624381_0021) > -- > > VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED > KILLED > -- > Map 1 .. container SUCCEEDED 1 1 0 0 > 0 0 > Reducer 2 ... container RUNNING 2 1 0 1 > 4 0 > -- > VERTICES: 01/02 [=>>-] 66% ELAPSED TIME: 37.91 s > -- > ERROR : Status: FailedERROR : Vertex failed, vertexName=Reducer 2, > vertexId=vertex_1698753624381_0021_3_01, diagnostics=[Task failed, > taskId=task_1698753624381_0021_3_01_00, diagnostics=[TaskAttempt 0 > failed, info=[Error: Error while running task ( failure ) : > attempt_1698753624381_0021_3_01_00_0:java.lang.RuntimeException: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing row > at > org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:348) > > at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:276) > at > org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:381) > > at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82) > > at > org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69) > > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762) > > at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69) > > at > org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39) > > at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) > at > com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125) > > at > com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57) > > at > com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78) > > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > > at java.lang.Thread.run(Thread.java:750)Caused by: > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: > Hive Runtime Error while processing row > at > org.apache.hadoop.hive.ql.exec.tez.ReduceRec
[jira] [Commented] (HIVE-27161) MetaException when executing CTAS query in Druid storage handler
[ https://issues.apache.org/jira/browse/HIVE-27161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17781743#comment-17781743 ] Basapuram Kumar commented on HIVE-27161: I am facing this issue in hive-4.0.0-alpha-1 too. Here are the steps to repro. {code:java} 1. CREATE TABLE emp_zlib_3110_2038 ( `__time` TIMESTAMP, id int, name string, age int, gender string) STORED AS ORC TBLPROPERTIES ('transactional'='true',"orc.compress"="ZLIB"); 2. insert into emp_zlib_3110_2038 values(CURRENT_TIMESTAMP(),10,'basa',30,'M'); 3. CREATE EXTERNAL TABLE druid_table_0111 STORED BY 'org.apache.hadoop.hive.druid.DruidStorageHandler' TBLPROPERTIES ("druid.datasource" = "basa_druid_table_01112023","orc.compress"="ZLIB") AS select `__time`, id,name,age,gender from emp_zlib_3110_2038; {code} Error as follwed. {code:java} INFO : Status: Running (Executing on YARN cluster with App id application_1698753624381_0028) -- VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED -- Map 1 .. container SUCCEEDED 1 1 0 0 0 0 Reducer 2 .. container SUCCEEDED 2 2 0 0 0 0 -- VERTICES: 02/02 [==>>] 100% ELAPSED TIME: 18.13 s -- INFO : Starting task [Stage-4:DDL] in serial modeERROR : Failedorg.apache.hadoop.hive.ql.metadata.HiveException: MetaException(message:LOCATION may not be specified for Druid) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:1313) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:1318) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.ddl.table.create.CreateTableOperation.createTableNonReplaceMode(CreateTableOperation.java:140) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.ddl.table.create.CreateTableOperation.execute(CreateTableOperation.java:98) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.ddl.DDLTask.execute(DDLTask.java:84) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:212) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:105) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.Executor.launchTask(Executor.java:361) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.Executor.launchTasks(Executor.java:334) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.Executor.runTasks(Executor.java:245) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.Executor.execute(Executor.java:106) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:348) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:204) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.Driver.run(Driver.java:153) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.Driver.run(Driver.java:148) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:185) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:233) ~[hive-service-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hive.service.cli.operation.SQLOperation.access$500(SQLOperation.java:88) ~[hive-service-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:336) ~[hive-service-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_382] at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_382] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762) ~[hadoop-common-3.2.3.3.2.2.0-1.jar:?] at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:356) ~[hive-service-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_382] at java.util.concu
[jira] [Comment Edited] (HIVE-27161) MetaException when executing CTAS query in Druid storage handler
[ https://issues.apache.org/jira/browse/HIVE-27161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17781743#comment-17781743 ] Basapuram Kumar edited comment on HIVE-27161 at 11/1/23 2:07 PM: - I am facing this issue in hive-4.0.0-alpha-1 too. Here are the steps to repro. {code:java} 1. CREATE TABLE emp_zlib_3110_2038 ( `__time` TIMESTAMP, id int, name string, age int, gender string) STORED AS ORC TBLPROPERTIES ('transactional'='true',"orc.compress"="ZLIB"); 2. insert into emp_zlib_3110_2038 values(CURRENT_TIMESTAMP(),10,'basa',30,'M'); 3. CREATE EXTERNAL TABLE druid_table_0111 STORED BY 'org.apache.hadoop.hive.druid.DruidStorageHandler' TBLPROPERTIES ("druid.datasource" = "basa_druid_table_01112023","orc.compress"="ZLIB") AS select `__time`, id,name,age,gender from emp_zlib_3110_2038; {code} Error as followed. {code:java} INFO : Status: Running (Executing on YARN cluster with App id application_1698753624381_0028) -- VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED -- Map 1 .. container SUCCEEDED 1 1 0 0 0 0 Reducer 2 .. container SUCCEEDED 2 2 0 0 0 0 -- VERTICES: 02/02 [==>>] 100% ELAPSED TIME: 18.13 s -- INFO : Starting task [Stage-4:DDL] in serial modeERROR : Failedorg.apache.hadoop.hive.ql.metadata.HiveException: MetaException(message:LOCATION may not be specified for Druid) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:1313) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:1318) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.ddl.table.create.CreateTableOperation.createTableNonReplaceMode(CreateTableOperation.java:140) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.ddl.table.create.CreateTableOperation.execute(CreateTableOperation.java:98) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.ddl.DDLTask.execute(DDLTask.java:84) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:212) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:105) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.Executor.launchTask(Executor.java:361) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.Executor.launchTasks(Executor.java:334) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.Executor.runTasks(Executor.java:245) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.Executor.execute(Executor.java:106) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:348) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:204) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.Driver.run(Driver.java:153) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.Driver.run(Driver.java:148) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:185) ~[hive-exec-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:233) ~[hive-service-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hive.service.cli.operation.SQLOperation.access$500(SQLOperation.java:88) ~[hive-service-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:336) ~[hive-service-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_382] at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_382] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762) ~[hadoop-common-3.2.3.3.2.2.0-1.jar:?] at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:356) ~[hive-service-3.1.4.3.2.2.0-1.jar:3.1.4.3.2.2.0-1] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[jira] [Updated] (HIVE-27838) Backport of HIVE-22840: Race condition in formatters of TimestampColumnVector and DateColumnVector
[ https://issues.apache.org/jira/browse/HIVE-27838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27838: -- Labels: pull-request-available (was: ) > Backport of HIVE-22840: Race condition in formatters of TimestampColumnVector > and DateColumnVector > -- > > Key: HIVE-27838 > URL: https://issues.apache.org/jira/browse/HIVE-27838 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Labels: pull-request-available > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (HIVE-27838) Backport of HIVE-22840: Race condition in formatters of TimestampColumnVector and DateColumnVector
[ https://issues.apache.org/jira/browse/HIVE-27838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shefali Singh reassigned HIVE-27838: Assignee: Shefali Singh > Backport of HIVE-22840: Race condition in formatters of TimestampColumnVector > and DateColumnVector > -- > > Key: HIVE-27838 > URL: https://issues.apache.org/jira/browse/HIVE-27838 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27838) Backport of HIVE-22840: Race condition in formatters of TimestampColumnVector and DateColumnVector
Shefali Singh created HIVE-27838: Summary: Backport of HIVE-22840: Race condition in formatters of TimestampColumnVector and DateColumnVector Key: HIVE-27838 URL: https://issues.apache.org/jira/browse/HIVE-27838 Project: Hive Issue Type: Sub-task Reporter: Shefali Singh Fix For: 3.2.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27837) Backport of HIVE-25093 and HIVE-25268
[ https://issues.apache.org/jira/browse/HIVE-27837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shefali Singh updated HIVE-27837: - Summary: Backport of HIVE-25093 and HIVE-25268 (was: Backport of HIVE-25093: date_format() UDF is returning output in UTC time zone only) > Backport of HIVE-25093 and HIVE-25268 > - > > Key: HIVE-27837 > URL: https://issues.apache.org/jira/browse/HIVE-27837 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Labels: pull-request-available > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27837) Backport of HIVE-25093: date_format() UDF is returning output in UTC time zone only
[ https://issues.apache.org/jira/browse/HIVE-27837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27837: -- Labels: pull-request-available (was: ) > Backport of HIVE-25093: date_format() UDF is returning output in UTC time > zone only > --- > > Key: HIVE-27837 > URL: https://issues.apache.org/jira/browse/HIVE-27837 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Labels: pull-request-available > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (HIVE-27837) Backport of HIVE-25093: date_format() UDF is returning output in UTC time zone only
[ https://issues.apache.org/jira/browse/HIVE-27837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shefali Singh reassigned HIVE-27837: Assignee: Shefali Singh > Backport of HIVE-25093: date_format() UDF is returning output in UTC time > zone only > --- > > Key: HIVE-27837 > URL: https://issues.apache.org/jira/browse/HIVE-27837 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27837) Backport of HIVE-25093: date_format() UDF is returning output in UTC time zone only
Shefali Singh created HIVE-27837: Summary: Backport of HIVE-25093: date_format() UDF is returning output in UTC time zone only Key: HIVE-27837 URL: https://issues.apache.org/jira/browse/HIVE-27837 Project: Hive Issue Type: Sub-task Reporter: Shefali Singh Fix For: 3.2.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27836) Backport HIVE-25250: Fix TestHS2ImpersonationWithRemoteMS.testImpersonation
[ https://issues.apache.org/jira/browse/HIVE-27836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27836: -- Labels: pull-request-available (was: ) > Backport HIVE-25250: Fix TestHS2ImpersonationWithRemoteMS.testImpersonation > --- > > Key: HIVE-27836 > URL: https://issues.apache.org/jira/browse/HIVE-27836 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Labels: pull-request-available > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (HIVE-27836) Backport HIVE-25250: Fix TestHS2ImpersonationWithRemoteMS.testImpersonation
[ https://issues.apache.org/jira/browse/HIVE-27836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shefali Singh reassigned HIVE-27836: Assignee: Shefali Singh > Backport HIVE-25250: Fix TestHS2ImpersonationWithRemoteMS.testImpersonation > --- > > Key: HIVE-27836 > URL: https://issues.apache.org/jira/browse/HIVE-27836 > Project: Hive > Issue Type: Sub-task >Reporter: Shefali Singh >Assignee: Shefali Singh >Priority: Major > Fix For: 3.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27836) Backport HIVE-25250: Fix TestHS2ImpersonationWithRemoteMS.testImpersonation
Shefali Singh created HIVE-27836: Summary: Backport HIVE-25250: Fix TestHS2ImpersonationWithRemoteMS.testImpersonation Key: HIVE-27836 URL: https://issues.apache.org/jira/browse/HIVE-27836 Project: Hive Issue Type: Sub-task Reporter: Shefali Singh Fix For: 3.2.0 -- This message was sent by Atlassian Jira (v8.20.10#820010)