Re: [ANNOUNCE] New PMC Member: Ayush Saxena
Congratulations Ayush. On Wed, 21 Dec 2022 at 12:15 AM, Chris Nauroth wrote: > Congratulations, Ayush! > > Chris Nauroth > > > On Tue, Dec 20, 2022 at 10:02 AM Sai Hemanth Gantasala < > saihema...@cloudera.com> wrote: > > > Congratulations Ayush, Very well deserved!!. > > > > On Mon, Dec 19, 2022 at 5:12 PM Naveen Gangam > > wrote: > > > >> Hello Hive Community, > >> Apache Hive PMC is pleased to announce that Ayush Saxena has accepted > the > >> Apache Hive PMC's invitation to become PMC Member, and is now our newest > >> PMC member. Many thanks to Ayush for all the contributions he has made > and > >> looking forward to many more future contributions in the expanded role. > >> > >> Please join me in congratulating Ayush !!! > >> > >> Cheers, > >> Naveen (on behalf of Hive PMC) > >> > >> > > >
[jira] [Created] (HIVE-26881) tblproperties are not cleaned from jobConf for TezTask
Yi Zhang created HIVE-26881: --- Summary: tblproperties are not cleaned from jobConf for TezTask Key: HIVE-26881 URL: https://issues.apache.org/jira/browse/HIVE-26881 Project: Hive Issue Type: Bug Components: Hive Affects Versions: 3.1.3 Reporter: Yi Zhang Users uses xmlserde to read xml files, when user create table they specify tblproperties and it uses jobConf [https://github.com/VenkataNU/hivexmlserde/blob/main/src/main/java/com/ibm/spss/hive/serde2/xml/XmlInputFormat.java#L72] in Tez mode, after 1st query run, those tblproperties are part of Driver.conf, so then next query runs, the jobConf of the tez job contains the tblproperties from last run. This is cause wrong results since the next query should not use last query's tblproperties. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26880) Upgrade Apache Directory Server to 1.5.7 for release 3.2.
Chris Nauroth created HIVE-26880: Summary: Upgrade Apache Directory Server to 1.5.7 for release 3.2. Key: HIVE-26880 URL: https://issues.apache.org/jira/browse/HIVE-26880 Project: Hive Issue Type: Improvement Components: Test Reporter: Chris Nauroth Assignee: Chris Nauroth branch-3 uses Apache Directory Server in some tests. It currently uses version 1.5.6. This version has a transitive dependency to a SNAPSHOT, making it awkward to build and release. We can upgrade to 1.5.7 to remove the SNAPSHOT dependency. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26879) Backport of HIVE-23323 Add qsplits profile
Aman Raj created HIVE-26879: --- Summary: Backport of HIVE-23323 Add qsplits profile Key: HIVE-26879 URL: https://issues.apache.org/jira/browse/HIVE-26879 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
Re: [ANNOUNCE] New PMC Member: Ayush Saxena
Congratulations, Ayush! Chris Nauroth On Tue, Dec 20, 2022 at 10:02 AM Sai Hemanth Gantasala < saihema...@cloudera.com> wrote: > Congratulations Ayush, Very well deserved!!. > > On Mon, Dec 19, 2022 at 5:12 PM Naveen Gangam > wrote: > >> Hello Hive Community, >> Apache Hive PMC is pleased to announce that Ayush Saxena has accepted the >> Apache Hive PMC's invitation to become PMC Member, and is now our newest >> PMC member. Many thanks to Ayush for all the contributions he has made and >> looking forward to many more future contributions in the expanded role. >> >> Please join me in congratulating Ayush !!! >> >> Cheers, >> Naveen (on behalf of Hive PMC) >> >> >
Re: [ANNOUNCE] New PMC Member: Ayush Saxena
Congratulations Ayush, Very well deserved!!. On Mon, Dec 19, 2022 at 5:12 PM Naveen Gangam wrote: > Hello Hive Community, > Apache Hive PMC is pleased to announce that Ayush Saxena has accepted the > Apache Hive PMC's invitation to become PMC Member, and is now our newest > PMC member. Many thanks to Ayush for all the contributions he has made and > looking forward to many more future contributions in the expanded role. > > Please join me in congratulating Ayush !!! > > Cheers, > Naveen (on behalf of Hive PMC) > >
[jira] [Created] (HIVE-26878) Disable TestJdbcWithMiniLlapVectorArrow in branch-3
Aman Raj created HIVE-26878: --- Summary: Disable TestJdbcWithMiniLlapVectorArrow in branch-3 Key: HIVE-26878 URL: https://issues.apache.org/jira/browse/HIVE-26878 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj The following issue comes while running the test : h4. Error Failed during createSources processLine with code=1 h4. Stacktrace java.lang.AssertionError: Failed during createSources processLine with code=1 at org.junit.Assert.fail(Assert.java:88) at org.apache.hadoop.hive.ql.QTestUtil.initFromScript(QTestUtil.java:1210) at org.apache.hadoop.hive.ql.QTestUtil.createSources(QTestUtil.java:1192) at org.apache.hadoop.hive.ql.QTestUtil.createSources(QTestUtil.java:1179) at org.apache.hadoop.hive.cli.control.CoreCliDriver$3.invokeInternal(CoreCliDriver.java:83) at org.apache.hadoop.hive.cli.control.CoreCliDriver$3.invokeInternal(CoreCliDriver.java:80) at org.apache.hadoop.hive.util.ElapsedTimeLoggingWrapper.invoke(ElapsedTimeLoggingWrapper.java:33) at org.apache.hadoop.hive.cli.control.CoreCliDriver.beforeClass(CoreCliDriver.java:86) at org.apache.hadoop.hive.cli.control.CliAdapter$1$1.evaluate(CliAdapter.java:71) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:379) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:340) at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:125) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:413) This test is ignored in Hive master so backporting the same fix. Commit ID : 77187b3e -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-26877) Parquet CTAS with JOIN on decimals with different precision/scale fail
Stamatis Zampetakis created HIVE-26877:
--
Summary: Parquet CTAS with JOIN on decimals with different
precision/scale fail
Key: HIVE-26877
URL: https://issues.apache.org/jira/browse/HIVE-26877
Project: Hive
Issue Type: Bug
Components: HiveServer2
Affects Versions: 4.0.0-alpha-2
Reporter: Stamatis Zampetakis
Assignee: Stamatis Zampetakis
Attachments: ctas_parquet_join.q
Creating a Parquet table using CREATE TABLE AS SELECT syntax (CTAS) leads to
runtime error when the SELECT statement joins columns with different
precision/scale.
Steps to reproduce:
{code:sql}
CREATE TABLE table_a (col_dec decimal(5,0));
CREATE TABLE table_b(col_dec decimal(38,10));
INSERT INTO table_a VALUES (1);
INSERT INTO table_b VALUES (1.00);
set hive.default.fileformat=parquet;
create table target as
select table_a.col_dec
from table_a
left outer join table_b on
table_a.col_dec = table_b.col_dec;
{code}
Stacktrace:
{noformat}
2022-12-20T07:02:52,237 INFO [2dfbd95a-7553-467b-b9d0-629100785502 Listener at
0.0.0.0/46609] reexec.ReExecuteLostAMQueryPlugin: Got exception message: Vertex
failed, vertexName=Reducer 2, vertexId=vertex_1671548565336_0001_3_02,
diagnostics=[Task failed, taskId=task_1671548565336_0001_3_02_00,
diagnostics=[TaskAttempt 0 failed, info=[Error: Error while running task (
failure ) :
attempt_1671548565336_0001_3_02_00_0:java.lang.RuntimeException:
java.lang.RuntimeException: Hive Runtime Error while closing operators: Fixed
Binary size 16 does not match field type length 3
at
org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:348)
at
org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:276)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:381)
at
org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:82)
at
org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878)
at
org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:69)
at
org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:39)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at
org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:118)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: Hive Runtime Error while closing
operators: Fixed Binary size 16 does not match field type length 3
at
org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.close(ReduceRecordProcessor.java:379)
at
org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:310)
... 15 more
Caused by: java.lang.IllegalArgumentException: Fixed Binary size 16 does not
match field type length 3
at
org.apache.parquet.column.values.plain.FixedLenByteArrayPlainValuesWriter.writeBytes(FixedLenByteArrayPlainValuesWriter.java:56)
at
org.apache.parquet.column.impl.ColumnWriterBase.write(ColumnWriterBase.java:174)
at
org.apache.parquet.io.MessageColumnIO$MessageColumnIORecordConsumer.addBinary(MessageColumnIO.java:476)
at
org.apache.parquet.io.RecordConsumerLoggingWrapper.addBinary(RecordConsumerLoggingWrapper.java:116)
at
org.apache.hadoop.hive.ql.io.parquet.write.DataWritableWriter$DecimalDataWriter.write(DataWritableWriter.java:571)
at
org.apache.hadoop.hive.ql.io.parquet.write.DataWritableWriter$GroupDataWriter.write(DataWritableWriter.java:228)
at
org.apache.hadoop.hive.ql.io.parquet.write.DataWritableWriter$MessageDataWriter.write(DataWritableWriter.java:251)
at
org.apache.hadoop.hive.ql.io.parquet.write.DataWritableWriter.write(DataWritableWriter.java:115)
at
org.apache.hadoop.hive.ql.io.parquet.write.DataWritableWriteSupport.write(DataWritableWriteSupport.java:76)
at
org.apache.hadoop.hive.ql.io.parquet.write.DataWritableWriteSupport.write(DataWritableWriteSupport.java:35)
at
org.apache.parquet.hadoop.InternalParquetRecordWriter.write(InternalParquetRecordWriter.java:128)
at
org.apache.parquet.hadoop.ParquetRecordWriter.write(ParquetRecordWriter.java:182)
Re: [EXTERNAL] Re: [ANNOUNCE] New PMC Member: Ayush Saxena
this is super cool and super very well deserved! :) nowadays, in case of a changing/evolving/whatever community like Hive it's crucial to have folks actively contributing, being responsive on the mailing list, etc...Ayush is an example to be followed, congratulations !! Butao Zhang ezt írta (időpont: 2022. dec. 20., K, 11:54): > Congratulations Ayush ! > > > Replied Message > | From | Jan Fili | > | Date | 12/20/2022 18:38 | > | To | | > | Subject | Re: [EXTERNAL] Re: [ANNOUNCE] New PMC Member: Ayush Saxena | > gratz! > > Am Di., 20. Dez. 2022 um 11:09 Uhr schrieb Aasha < > aasha.medhi2...@gmail.com>: > > Congratulations Ayush. Very well deserved > > On 20-Dec-2022, at 3:36 PM, Pau Tallada wrote: > > > Congratulations! > > Missatge de Mayank Singh del dia dt., 20 de des. > 2022 a les 9:01: > > Congratulations Ayush 🎉🥳 > > On Tue, 20 Dec, 2022, 1:19 pm Stamatis Zampetakis, > wrote: > > Congrats Ayush! Very well deserved! > > Thanks for all the hard work that you are putting for the project and > always being there when people ask for help. > > Best, > Stamatis > > On Tue, Dec 20, 2022 at 7:51 AM Sankar Hariappan via user < > u...@hive.apache.org> wrote: > > Congrats Ayush! > > > > Thanks, > > Sankar > > > > From: Simhadri G > Sent: Tuesday, December 20, 2022 12:16 PM > To: u...@hive.apache.org > Cc: dev ; ayushsax...@apache.org > Subject: [EXTERNAL] Re: [ANNOUNCE] New PMC Member: Ayush Saxena > > > > Congratulations Ayush > > > > On Tue, 20 Dec 2022, 06:42 Naveen Gangam, wrote: > > Hello Hive Community, > > Apache Hive PMC is pleased to announce that Ayush Saxena has accepted the > Apache Hive PMC's invitation to become PMC Member, and is now our newest > PMC member. Many thanks to Ayush for all the contributions he has made and > looking forward to many more future contributions in the expanded role. > > > > Please join me in congratulating Ayush !!! > > > > Cheers, > > Naveen (on behalf of Hive PMC) > > > > > > -- > -- > Pau Tallada Crespí > Departament de Serveis > Port d'Informació Científica (PIC) > Tel: +34 93 170 2729 > -- > >
Re: [EXTERNAL] Re: [ANNOUNCE] New PMC Member: Ayush Saxena
Congratulations Ayush ! Replied Message | From | Jan Fili | | Date | 12/20/2022 18:38 | | To | | | Subject | Re: [EXTERNAL] Re: [ANNOUNCE] New PMC Member: Ayush Saxena | gratz! Am Di., 20. Dez. 2022 um 11:09 Uhr schrieb Aasha : Congratulations Ayush. Very well deserved On 20-Dec-2022, at 3:36 PM, Pau Tallada wrote: Congratulations! Missatge de Mayank Singh del dia dt., 20 de des. 2022 a les 9:01: Congratulations Ayush 🎉🥳 On Tue, 20 Dec, 2022, 1:19 pm Stamatis Zampetakis, wrote: Congrats Ayush! Very well deserved! Thanks for all the hard work that you are putting for the project and always being there when people ask for help. Best, Stamatis On Tue, Dec 20, 2022 at 7:51 AM Sankar Hariappan via user wrote: Congrats Ayush! Thanks, Sankar From: Simhadri G Sent: Tuesday, December 20, 2022 12:16 PM To: u...@hive.apache.org Cc: dev ; ayushsax...@apache.org Subject: [EXTERNAL] Re: [ANNOUNCE] New PMC Member: Ayush Saxena Congratulations Ayush On Tue, 20 Dec 2022, 06:42 Naveen Gangam, wrote: Hello Hive Community, Apache Hive PMC is pleased to announce that Ayush Saxena has accepted the Apache Hive PMC's invitation to become PMC Member, and is now our newest PMC member. Many thanks to Ayush for all the contributions he has made and looking forward to many more future contributions in the expanded role. Please join me in congratulating Ayush !!! Cheers, Naveen (on behalf of Hive PMC) -- -- Pau Tallada Crespí Departament de Serveis Port d'Informació Científica (PIC) Tel: +34 93 170 2729 --
Re: [EXTERNAL] Re: [ANNOUNCE] New PMC Member: Ayush Saxena
Congratulations Ayush 🎉🥳 On Tue, 20 Dec, 2022, 1:19 pm Stamatis Zampetakis, wrote: > Congrats Ayush! Very well deserved! > > Thanks for all the hard work that you are putting for the project and > always being there when people ask for help. > > Best, > Stamatis > > On Tue, Dec 20, 2022 at 7:51 AM Sankar Hariappan via user < > u...@hive.apache.org> wrote: > >> Congrats Ayush! >> >> >> >> Thanks, >> >> Sankar >> >> >> >> *From:* Simhadri G >> *Sent:* Tuesday, December 20, 2022 12:16 PM >> *To:* u...@hive.apache.org >> *Cc:* dev ; ayushsax...@apache.org >> *Subject:* [EXTERNAL] Re: [ANNOUNCE] New PMC Member: Ayush Saxena >> >> >> >> Congratulations Ayush >> >> >> >> On Tue, 20 Dec 2022, 06:42 Naveen Gangam, wrote: >> >> Hello Hive Community, >> >> Apache Hive PMC is pleased to announce that Ayush Saxena has accepted the >> Apache Hive PMC's invitation to become PMC Member, and is now our newest >> PMC member. Many thanks to Ayush for all the contributions he has made and >> looking forward to many more future contributions in the expanded role. >> >> >> >> Please join me in congratulating Ayush !!! >> >> >> >> Cheers, >> >> Naveen (on behalf of Hive PMC) >> >> >> >>
