[jira] [Created] (HIVE-24597) Replication with timestamp type partition failing in HA case with same NS
Arko Sharma created HIVE-24597: -- Summary: Replication with timestamp type partition failing in HA case with same NS Key: HIVE-24597 URL: https://issues.apache.org/jira/browse/HIVE-24597 Project: Hive Issue Type: Bug Reporter: Arko Sharma Assignee: Arko Sharma -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24596) Explain ddl for debugging
Rajesh Balamohan created HIVE-24596: --- Summary: Explain ddl for debugging Key: HIVE-24596 URL: https://issues.apache.org/jira/browse/HIVE-24596 Project: Hive Issue Type: Improvement Reporter: Rajesh Balamohan For debugging query issues, basic details like table schema, statistics, partition details, query plans are needed. It would be good to have "explain ddl" support, which can generate these details. This can help in recreating the schema and planner issues without sample data. -- This message was sent by Atlassian Jira (v8.3.4#803005)
Re: [VOTE] Apache Hive 2.3.8 Release Candidate 2
cc Alan Gates who's the last release manager for this branch. On Wed, Jan 6, 2021 at 12:16 PM Chao Sun wrote: > Sorry just saw your message Yuming. I built the dist following this doc: > https://cwiki.apache.org/confluence/display/Hive/HowToRelease#HowToRelease-HiveRelease, > with command: > > mvn install -Pdist -DskipTests -Dmaven.javadoc.skip=true -DcreateChecksum=true > > > and when I do the same for Hive 2.3.7, the result jars match mostly. > However the downloaded 2.3.7 distribution from > https://downloads.apache.org/hive/hive-2.3.7/ seems to be missing jars > such as spark/scala (which I assume is from Hive on Spark). I also checked > Hive 2.3.6 and it doesn't have those either. > > Anyone knows whether the packaging process has changed from the above doc? > > > > On Wed, Dec 16, 2020 at 4:26 PM Wang, Yuming > wrote: > >> >> Hive 2.3.8 has more jars than Hive 2.3.7. Is this we expected? >> >> diff --git a/2.3.7.jars b/2.3.8.jars >> index d40ebb932b..d18191bc98 100644 >> --- a/2.3.7.jars >> +++ b/2.3.8.jars >> @@ -22,17 +22,17 @@ asm-commons-3.1.jar >> asm-tree-3.1.jar >> avatica-1.8.0.jar >> avatica-metrics-1.8.0.jar >> -avro-1.7.7.jar >> +avro-1.8.2.jar >> +avro-ipc-1.8.2.jar >> +avro-mapred-1.8.2-hadoop2.jar >> bonecp-0.8.0.RELEASE.jar >> bytebuffer-collections-0.2.5.jar >> -calcite-core-1.10.0.jar >> -calcite-druid-1.10.0.jar >> -calcite-linq4j-1.10.0.jar >> +chill_2.11-0.8.0.jar >> +chill-java-0.8.0.jar >> classmate-1.0.0.jar >> commons-cli-1.2.jar >> commons-codec-1.4.jar >> commons-collections-3.2.2.jar >> -commons-compiler-2.7.6.jar >> commons-compress-1.9.jar >> commons-dbcp-1.4.jar >> commons-dbcp2-2.0.1.jar >> @@ -67,7 +67,6 @@ druid-console-0.0.2.jar >> druid-hdfs-storage-0.9.2.jar >> druid-processing-0.9.2.jar >> druid-server-0.9.2.jar >> -eigenbase-properties-1.1.5.jar >> emitter-0.3.6.jar >> extendedset-1.3.10.jar >> findbugs-annotations-1.3.9-1.jar >> @@ -94,36 +93,36 @@ hbase-protocol-1.1.1.jar >> hbase-server-1.1.1.jar >> hibernate-validator-5.1.3.Final.jar >> HikariCP-2.5.1.jar >> -hive-accumulo-handler-2.3.7.jar >> -hive-beeline-2.3.7.jar >> -hive-cli-2.3.7.jar >> -hive-common-2.3.7.jar >> -hive-contrib-2.3.7.jar >> -hive-druid-handler-2.3.7.jar >> -hive-exec-2.3.7.jar >> -hive-hbase-handler-2.3.7.jar >> -hive-hcatalog-core-2.3.7.jar >> -hive-hcatalog-server-extensions-2.3.7.jar >> -hive-hplsql-2.3.7.jar >> -hive-jdbc-2.3.7.jar >> -hive-jdbc-handler-2.3.7.jar >> -hive-llap-client-2.3.7.jar >> -hive-llap-common-2.3.7.jar >> -hive-llap-common-2.3.7-tests.jar >> -hive-llap-ext-client-2.3.7.jar >> -hive-llap-server-2.3.7.jar >> -hive-llap-tez-2.3.7.jar >> -hive-metastore-2.3.7.jar >> -hive-serde-2.3.7.jar >> -hive-service-2.3.7.jar >> -hive-service-rpc-2.3.7.jar >> -hive-shims-0.23-2.3.7.jar >> -hive-shims-2.3.7.jar >> -hive-shims-common-2.3.7.jar >> -hive-shims-scheduler-2.3.7.jar >> +hive-accumulo-handler-2.3.8.jar >> +hive-beeline-2.3.8.jar >> +hive-cli-2.3.8.jar >> +hive-common-2.3.8.jar >> +hive-contrib-2.3.8.jar >> +hive-druid-handler-2.3.8.jar >> +hive-exec-2.3.8.jar >> +hive-hbase-handler-2.3.8.jar >> +hive-hcatalog-core-2.3.8.jar >> +hive-hcatalog-server-extensions-2.3.8.jar >> +hive-hplsql-2.3.8.jar >> +hive-jdbc-2.3.8.jar >> +hive-jdbc-handler-2.3.8.jar >> +hive-llap-client-2.3.8.jar >> +hive-llap-common-2.3.8.jar >> +hive-llap-common-2.3.8-tests.jar >> +hive-llap-ext-client-2.3.8.jar >> +hive-llap-server-2.3.8.jar >> +hive-llap-tez-2.3.8.jar >> +hive-metastore-2.3.8.jar >> +hive-serde-2.3.8.jar >> +hive-service-2.3.8.jar >> +hive-service-rpc-2.3.8.jar >> +hive-shims-0.23-2.3.8.jar >> +hive-shims-2.3.8.jar >> +hive-shims-common-2.3.8.jar >> +hive-shims-scheduler-2.3.8.jar >> hive-storage-api-2.4.0.jar >> -hive-testutils-2.3.7.jar >> -hive-vector-code-gen-2.3.7.jar >> +hive-testutils-2.3.8.jar >> +hive-vector-code-gen-2.3.8.jar >> htrace-core-3.1.0-incubating.jar >> http-client-1.0.4.jar >> httpclient-4.4.jar >> @@ -133,6 +132,7 @@ irc-api-1.0-0014.jar >> ivy-2.4.0.jar >> jackson-annotations-2.6.0.jar >> jackson-core-2.6.5.jar >> +jackson-core-asl-1.9.13.jar >> jackson-databind-2.6.5.jar >> jackson-dataformat-smile-2.4.6.jar >> jackson-datatype-guava-2.4.6.jar >> @@ -141,12 +141,15 @@ jackson-jaxrs-1.9.13.jar >> jackson-jaxrs-base-2.4.6.jar >> jackson-jaxrs-json-provider-2.4.6.jar >> jackson-jaxrs-smile-provider-2.4.6.jar >> +jackson-mapper-asl-1.9.13.jar >> jackson-module-jaxb-annotations-2.4.6.jar >> +jackson-module-paranamer-2.6.5.jar >> +jackson-module-scala_2.11-2.6.5.jar >> jackson-xc-1.9.13.jar >> jamon-runtime-2.3.1.jar >> -janino-2.7.6.jar >> jasper-compiler-5.5.23.jar >> jasper-runtime-5.5.23.jar >> +JavaEWAH-0.3.2.jar >> java-util-0.27.10.jar >> javax.el-3.0.0.jar >> javax.el-api-3.0.0.jar >> @@ -180,10 +183,14 @@ jetty-util-6.1.26.jar >> jetty-util-9.2.5.v20141112.jar >> jline-2.12.jar >> joda-time-2.8.1.jar >> +jodd-core-3.5.2.jar >> jol-core-0.2.jar >> joni-2.1.2.jar >> jpam-1.1.jar >> json-1.8.jar >>
Re: [VOTE] Apache Hive 2.3.8 Release Candidate 2
Sorry just saw your message Yuming. I built the dist following this doc: https://cwiki.apache.org/confluence/display/Hive/HowToRelease#HowToRelease-HiveRelease, with command: mvn install -Pdist -DskipTests -Dmaven.javadoc.skip=true -DcreateChecksum=true and when I do the same for Hive 2.3.7, the result jars match mostly. However the downloaded 2.3.7 distribution from https://downloads.apache.org/hive/hive-2.3.7/ seems to be missing jars such as spark/scala (which I assume is from Hive on Spark). I also checked Hive 2.3.6 and it doesn't have those either. Anyone knows whether the packaging process has changed from the above doc? On Wed, Dec 16, 2020 at 4:26 PM Wang, Yuming wrote: > > Hive 2.3.8 has more jars than Hive 2.3.7. Is this we expected? > > diff --git a/2.3.7.jars b/2.3.8.jars > index d40ebb932b..d18191bc98 100644 > --- a/2.3.7.jars > +++ b/2.3.8.jars > @@ -22,17 +22,17 @@ asm-commons-3.1.jar > asm-tree-3.1.jar > avatica-1.8.0.jar > avatica-metrics-1.8.0.jar > -avro-1.7.7.jar > +avro-1.8.2.jar > +avro-ipc-1.8.2.jar > +avro-mapred-1.8.2-hadoop2.jar > bonecp-0.8.0.RELEASE.jar > bytebuffer-collections-0.2.5.jar > -calcite-core-1.10.0.jar > -calcite-druid-1.10.0.jar > -calcite-linq4j-1.10.0.jar > +chill_2.11-0.8.0.jar > +chill-java-0.8.0.jar > classmate-1.0.0.jar > commons-cli-1.2.jar > commons-codec-1.4.jar > commons-collections-3.2.2.jar > -commons-compiler-2.7.6.jar > commons-compress-1.9.jar > commons-dbcp-1.4.jar > commons-dbcp2-2.0.1.jar > @@ -67,7 +67,6 @@ druid-console-0.0.2.jar > druid-hdfs-storage-0.9.2.jar > druid-processing-0.9.2.jar > druid-server-0.9.2.jar > -eigenbase-properties-1.1.5.jar > emitter-0.3.6.jar > extendedset-1.3.10.jar > findbugs-annotations-1.3.9-1.jar > @@ -94,36 +93,36 @@ hbase-protocol-1.1.1.jar > hbase-server-1.1.1.jar > hibernate-validator-5.1.3.Final.jar > HikariCP-2.5.1.jar > -hive-accumulo-handler-2.3.7.jar > -hive-beeline-2.3.7.jar > -hive-cli-2.3.7.jar > -hive-common-2.3.7.jar > -hive-contrib-2.3.7.jar > -hive-druid-handler-2.3.7.jar > -hive-exec-2.3.7.jar > -hive-hbase-handler-2.3.7.jar > -hive-hcatalog-core-2.3.7.jar > -hive-hcatalog-server-extensions-2.3.7.jar > -hive-hplsql-2.3.7.jar > -hive-jdbc-2.3.7.jar > -hive-jdbc-handler-2.3.7.jar > -hive-llap-client-2.3.7.jar > -hive-llap-common-2.3.7.jar > -hive-llap-common-2.3.7-tests.jar > -hive-llap-ext-client-2.3.7.jar > -hive-llap-server-2.3.7.jar > -hive-llap-tez-2.3.7.jar > -hive-metastore-2.3.7.jar > -hive-serde-2.3.7.jar > -hive-service-2.3.7.jar > -hive-service-rpc-2.3.7.jar > -hive-shims-0.23-2.3.7.jar > -hive-shims-2.3.7.jar > -hive-shims-common-2.3.7.jar > -hive-shims-scheduler-2.3.7.jar > +hive-accumulo-handler-2.3.8.jar > +hive-beeline-2.3.8.jar > +hive-cli-2.3.8.jar > +hive-common-2.3.8.jar > +hive-contrib-2.3.8.jar > +hive-druid-handler-2.3.8.jar > +hive-exec-2.3.8.jar > +hive-hbase-handler-2.3.8.jar > +hive-hcatalog-core-2.3.8.jar > +hive-hcatalog-server-extensions-2.3.8.jar > +hive-hplsql-2.3.8.jar > +hive-jdbc-2.3.8.jar > +hive-jdbc-handler-2.3.8.jar > +hive-llap-client-2.3.8.jar > +hive-llap-common-2.3.8.jar > +hive-llap-common-2.3.8-tests.jar > +hive-llap-ext-client-2.3.8.jar > +hive-llap-server-2.3.8.jar > +hive-llap-tez-2.3.8.jar > +hive-metastore-2.3.8.jar > +hive-serde-2.3.8.jar > +hive-service-2.3.8.jar > +hive-service-rpc-2.3.8.jar > +hive-shims-0.23-2.3.8.jar > +hive-shims-2.3.8.jar > +hive-shims-common-2.3.8.jar > +hive-shims-scheduler-2.3.8.jar > hive-storage-api-2.4.0.jar > -hive-testutils-2.3.7.jar > -hive-vector-code-gen-2.3.7.jar > +hive-testutils-2.3.8.jar > +hive-vector-code-gen-2.3.8.jar > htrace-core-3.1.0-incubating.jar > http-client-1.0.4.jar > httpclient-4.4.jar > @@ -133,6 +132,7 @@ irc-api-1.0-0014.jar > ivy-2.4.0.jar > jackson-annotations-2.6.0.jar > jackson-core-2.6.5.jar > +jackson-core-asl-1.9.13.jar > jackson-databind-2.6.5.jar > jackson-dataformat-smile-2.4.6.jar > jackson-datatype-guava-2.4.6.jar > @@ -141,12 +141,15 @@ jackson-jaxrs-1.9.13.jar > jackson-jaxrs-base-2.4.6.jar > jackson-jaxrs-json-provider-2.4.6.jar > jackson-jaxrs-smile-provider-2.4.6.jar > +jackson-mapper-asl-1.9.13.jar > jackson-module-jaxb-annotations-2.4.6.jar > +jackson-module-paranamer-2.6.5.jar > +jackson-module-scala_2.11-2.6.5.jar > jackson-xc-1.9.13.jar > jamon-runtime-2.3.1.jar > -janino-2.7.6.jar > jasper-compiler-5.5.23.jar > jasper-runtime-5.5.23.jar > +JavaEWAH-0.3.2.jar > java-util-0.27.10.jar > javax.el-3.0.0.jar > javax.el-api-3.0.0.jar > @@ -180,10 +183,14 @@ jetty-util-6.1.26.jar > jetty-util-9.2.5.v20141112.jar > jline-2.12.jar > joda-time-2.8.1.jar > +jodd-core-3.5.2.jar > jol-core-0.2.jar > joni-2.1.2.jar > jpam-1.1.jar > json-1.8.jar > +json4s-ast_2.11-3.2.11.jar > +json4s-core_2.11-3.2.11.jar > +json4s-jackson_2.11-3.2.11.jar > json-path-2.1.0.jar > jsp-2.1-6.1.14.jar > jsp-api-2.0.jar > @@ -191,6 +198,7 @@ jsp-api-2.1-6.1.14.jar > jsp-api-2.1.jar > jsr305-3.0.0.jar > jta-1.1.jar > +kryo-shaded-3.0.3.jar >
[jira] [Created] (HIVE-24595) Vectorization causing incorrect results for scalar subquery
Vineet Garg created HIVE-24595:
--
Summary: Vectorization causing incorrect results for scalar
subquery
Key: HIVE-24595
URL: https://issues.apache.org/jira/browse/HIVE-24595
Project: Hive
Issue Type: Bug
Components: Vectorization
Affects Versions: 3.0.0
Reporter: Vineet Garg
*Repro*
{code:sql}
CREATE EXTERNAL TABLE `alltypessmall`(
`id` int,
`bool_col` boolean,
`tinyint_col` tinyint,
`smallint_col` smallint,
`int_col` int,
`bigint_col` bigint,
`float_col` float,
`double_col` double,
`date_string_col` string,
`string_col` string,
`timestamp_col` timestamp)
PARTITIONED BY (
`year` int,
`month` int)
ROW FORMAT SERDE
'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe'
WITH SERDEPROPERTIES (
'escape.delim'='\\',
'field.delim'=',',
'serialization.format'=',')
STORED AS INPUTFORMAT
'org.apache.hadoop.mapred.TextInputFormat'
OUTPUTFORMAT
'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat'
TBLPROPERTIES (
'DO_NOT_UPDATE_STATS'='true',
'OBJCAPABILITIES'='EXTREAD,EXTWRITE',
'STATS_GENERATED'='TASK',
'impala.lastComputeStatsTime'='1608312793',
'transient_lastDdlTime'='1608310442');
insert into alltypessmall partition(year=2002,month=1) values(1, true,
3,3,4,3434,5.4,44.3,'str1','str2', '01-01-2001');
insert into alltypessmall partition(year=2002,month=1) values(1, true,
3,3,4,3434,5.4,44.3,'str1','str2', '01-01-2001');
insert into alltypessmall partition(year=2002,month=1) values(1, true,
3,3,40,3434,5.4,44.3,'str1','str2', '01-01-2001');
{code}
Following query should fail but it succeeds
{code:sql}
SELECT id FROM alltypessmall
WHERE int_col =
(SELECT int_col
FROM alltypessmall)
ORDER BY id;
{code}
*Explain plan*
{code:java}
STAGE DEPENDENCIES:
Stage-1 is a root stage
Stage-0 depends on stages: Stage-1
STAGE PLANS:
Stage: Stage-1
Tez
DagId: vgarg_20210106115838_3fe73bf6-66c2-4281-92e8-fd75fd8ad400:17
Edges:
Map 1 <- Map 3 (BROADCAST_EDGE), Reducer 4 (BROADCAST_EDGE)
Reducer 2 <- Map 1 (SIMPLE_EDGE)
Reducer 4 <- Map 3 (CUSTOM_SIMPLE_EDGE)
DagName: vgarg_20210106115838_3fe73bf6-66c2-4281-92e8-fd75fd8ad400:17
Vertices:
Map 1
Map Operator Tree:
TableScan
alias: alltypessmall
filterExpr: int_col is not null (type: boolean)
Statistics: Num rows: 3 Data size: 24 Basic stats: COMPLETE
Column stats: COMPLETE
Filter Operator
predicate: int_col is not null (type: boolean)
Statistics: Num rows: 3 Data size: 24 Basic stats: COMPLETE
Column stats: COMPLETE
Select Operator
expressions: id (type: int), int_col (type: int)
outputColumnNames: _col0, _col1
Statistics: Num rows: 3 Data size: 24 Basic stats:
COMPLETE Column stats: COMPLETE
Map Join Operator
condition map:
Inner Join 0 to 1
keys:
0
1
outputColumnNames: _col0, _col1
input vertices:
1 Reducer 4
Statistics: Num rows: 3 Data size: 24 Basic stats:
COMPLETE Column stats: COMPLETE
Map Join Operator
condition map:
Inner Join 0 to 1
keys:
0 _col1 (type: int)
1 _col0 (type: int)
outputColumnNames: _col0
input vertices:
1 Map 3
Statistics: Num rows: 9 Data size: 36 Basic stats:
COMPLETE Column stats: COMPLETE
Reduce Output Operator
key expressions: _col0 (type: int)
null sort order: z
[jira] [Created] (HIVE-24594) results_cache_invalidation2.q is flaky
Vihang Karajgaonkar created HIVE-24594:
--
Summary: results_cache_invalidation2.q is flaky
Key: HIVE-24594
URL: https://issues.apache.org/jira/browse/HIVE-24594
Project: Hive
Issue Type: Test
Reporter: Vihang Karajgaonkar
Assignee: Vihang Karajgaonkar
results_cache_invalidation2.q failed for me couple of times on a unrelated PR.
Here is the error log.
{noformat}
---
Test set: org.apache.hadoop.hive.cli.split19.TestMiniLlapLocalCliDriver
---
Tests run: 90, Failures: 1, Errors: 0, Skipped: 6, Time elapsed: 450.54 s <<<
FAILURE! - in org.apache.hadoop.hive.cli.split19.TestMiniLlapLocalCliDriver
org.apache.hadoop.hive.cli.split19.TestMiniLlapLocalCliDriver.testCliDriver[results_cache_invalidation2]
Time elapsed: 15.087 s <<< FAILURE!
java.lang.AssertionError:
Client Execution succeeded but contained differences (error code = 1) after
executing results_cache_invalidation2.q ^M
266a267
> A masked pattern was here
271a273
> A masked pattern was here
273c275,276
< Stage-0 is a root stage
---
> Stage-1 is a root stage
> Stage-0 depends on stages: Stage-1
275a279,365
> Stage: Stage-1
> Tez
> A masked pattern was here
> Edges:
> Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 4 (SIMPLE_EDGE)
> Reducer 3 <- Reducer 2 (CUSTOM_SIMPLE_EDGE)
> A masked pattern was here
> Vertices:
> Map 1
> Map Operator Tree:
> TableScan
> alias: tab1
> filterExpr: key is not null (type: boolean)
> Statistics: Num rows: 1500 Data size: 130500 Basic stats:
> COMPLETE Column stats: COMPLETE
> Filter Operator
> predicate: key is not null (type: boolean)
> Statistics: Num rows: 1500 Data size: 130500 Basic stats:
> COMPLETE Column stats: COMPLETE
> Select Operator
> expressions: key (type: string)
> outputColumnNames: _col0
> Statistics: Num rows: 1500 Data size: 130500 Basic
> stats: COMPLETE Column stats: COMPLETE
> Reduce Output Operator
> key expressions: _col0 (type: string)
> null sort order: z
> sort order: +
> Map-reduce partition columns: _col0 (type: string)
> Statistics: Num rows: 1500 Data size: 130500 Basic
> stats: COMPLETE Column stats: COMPLETE
> Execution mode: vectorized, llap
> LLAP IO: all inputs
> Map 4
> Map Operator Tree:
> TableScan
> alias: tab2
> filterExpr: key is not null (type: boolean)
> Statistics: Num rows: 500 Data size: 43500 Basic stats:
> COMPLETE Column stats: COMPLETE
> Fil^M
{noformat}
The test works for me locally. In fact the same PR had a successful run of this
test in a previous commit. I think we should disable this and re-enable it
after fixing the flakiness.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HIVE-24593) Clean up checkstyle violations in ddl
Miklos Gergely created HIVE-24593: - Summary: Clean up checkstyle violations in ddl Key: HIVE-24593 URL: https://issues.apache.org/jira/browse/HIVE-24593 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Assignee: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24592) Revert Hive-24550
David Mollitor created HIVE-24592:
-
Summary: Revert Hive-24550
Key: HIVE-24592
URL: https://issues.apache.org/jira/browse/HIVE-24592
Project: Hive
Issue Type: Improvement
Reporter: David Mollitor
Assignee: David Mollitor
Broke the build.
{code:none}
[ERROR] COMPILATION ERROR :
[ERROR]
/home/travis/build/apache/hive/itests/hive-unit/src/test/java/org/apache/hive/jdbc/miniHS2/TestHiveServer2Acid.java:[23,44]
cannot find symbol
symbol: class TxnDbUtil
location: package org.apache.hadoop.hive.metastore.txn
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.8.1:testCompile
(default-testCompile) on project hive-it-unit: Compilation failure
[ERROR]
/home/travis/build/apache/hive/itests/hive-unit/src/test/java/org/apache/hive/jdbc/miniHS2/TestHiveServer2Acid.java:[23,44]
cannot find symbol
[ERROR] symbol: class TxnDbUtil
[ERROR] location: package org.apache.hadoop.hive.metastore.txn
[ERROR]
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HIVE-24591) Move Beeline To SLF4J Simple Logger
David Mollitor created HIVE-24591:
-
Summary: Move Beeline To SLF4J Simple Logger
Key: HIVE-24591
URL: https://issues.apache.org/jira/browse/HIVE-24591
Project: Hive
Issue Type: Improvement
Components: Beeline
Reporter: David Mollitor
Assignee: David Mollitor
To make beeline as simple as possible, move its SLF4J logger implementation to
SLFJ-Simple logger. This will allow users to change the logging level simply
on the command line. Currently uses must create a Log4J configuration file
which is way too advance/cumbersome for a data analyst that just wants to use
SQL (and do some minor troubleshooting)
{code:none}
beeline -Dorg.slf4j.simpleLogger.defaultLogLevel=debug ...
{code}
http://www.slf4j.org/api/org/slf4j/impl/SimpleLogger.html
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HIVE-24590) Operation Logging still leaks the log4j Appenders
Eugene Chung created HIVE-24590:
---
Summary: Operation Logging still leaks the log4j Appenders
Key: HIVE-24590
URL: https://issues.apache.org/jira/browse/HIVE-24590
Project: Hive
Issue Type: Bug
Components: Logging
Reporter: Eugene Chung
Attachments: Screen Shot 2021-01-06 at 18.42.05.png, Screen Shot
2021-01-06 at 18.42.24.png, Screen Shot 2021-01-06 at 18.42.55.png
I'm using Hive 3.1.2 with options below.
* hive.server2.logging.operation.enabled=true
* hive.server2.logging.operation.level=VERBOSE
* hive.async.log.enabled=false
I already know the ticket, https://issues.apache.org/jira/browse/HIVE-17128 but
it still leaks log4j RandomAccessFileManager.
!Screen Shot 2021-01-06 at 18.42.05.png|width=756,height=197!
I checked the operation log file which is not closed.
!Screen Shot 2021-01-06 at 18.42.24.png|width=603,height=272!
Then there's the log,
{code:java}
client.TezClient: Shutting down Tez Session, sessionName= {code}
!Screen Shot 2021-01-06 at 18.42.55.png|width=1372,height=26!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
