[jira] [Created] (HIVE-22149) Metastore: Unify codahale metrics.log json structure between hiveserver2 and metastore services
Laszlo Bodor created HIVE-22149: --- Summary: Metastore: Unify codahale metrics.log json structure between hiveserver2 and metastore services Key: HIVE-22149 URL: https://issues.apache.org/jira/browse/HIVE-22149 Project: Hive Issue Type: Bug Reporter: Laszlo Bodor -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (HIVE-22140) Metrics: unify codehale metric frequency unit and default
Laszlo Bodor created HIVE-22140: --- Summary: Metrics: unify codehale metric frequency unit and default Key: HIVE-22140 URL: https://issues.apache.org/jira/browse/HIVE-22140 Project: Hive Issue Type: Bug Components: Metastore Reporter: Laszlo Bodor -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Created] (HIVE-21954) QTest: support for running qtests on various metastore DBs
Laszlo Bodor created HIVE-21954: --- Summary: QTest: support for running qtests on various metastore DBs Key: HIVE-21954 URL: https://issues.apache.org/jira/browse/HIVE-21954 Project: Hive Issue Type: Bug Reporter: Laszlo Bodor -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-21942) Remove useless MetastoreType enum from AbstractCliConfig
Laszlo Bodor created HIVE-21942: --- Summary: Remove useless MetastoreType enum from AbstractCliConfig Key: HIVE-21942 URL: https://issues.apache.org/jira/browse/HIVE-21942 Project: Hive Issue Type: Bug Reporter: Laszlo Bodor -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-21940) Metastore: Postgres text <-> clob mismatch for PARTITION_PARAMS/PARAM_VALUE
Laszlo Bodor created HIVE-21940: --- Summary: Metastore: Postgres text <-> clob mismatch for PARTITION_PARAMS/PARAM_VALUE Key: HIVE-21940 URL: https://issues.apache.org/jira/browse/HIVE-21940 Project: Hive Issue Type: Bug Reporter: Laszlo Bodor -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-21738) TestReplAcidTablesBootstrapWithJsonMessage#testBootstrapAcidTablesDuringIncrementalWithConcurrentWrites is flaky
Laszlo Bodor created HIVE-21738: --- Summary: TestReplAcidTablesBootstrapWithJsonMessage#testBootstrapAcidTablesDuringIncrementalWithConcurrentWrites is flaky Key: HIVE-21738 URL: https://issues.apache.org/jira/browse/HIVE-21738 Project: Hive Issue Type: Bug Reporter: Laszlo Bodor -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-21662) Refactor some functionality from QTestUtil to separate classes
Laszlo Bodor created HIVE-21662: --- Summary: Refactor some functionality from QTestUtil to separate classes Key: HIVE-21662 URL: https://issues.apache.org/jira/browse/HIVE-21662 Project: Hive Issue Type: Bug Reporter: Laszlo Bodor -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-21629) Monitor qtest progress realtime on console
Laszlo Bodor created HIVE-21629: --- Summary: Monitor qtest progress realtime on console Key: HIVE-21629 URL: https://issues.apache.org/jira/browse/HIVE-21629 Project: Hive Issue Type: Bug Reporter: Laszlo Bodor -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-21604) preCommit job should not be triggered on non-patch attachments
Laszlo Bodor created HIVE-21604: --- Summary: preCommit job should not be triggered on non-patch attachments Key: HIVE-21604 URL: https://issues.apache.org/jira/browse/HIVE-21604 Project: Hive Issue Type: Bug Components: Testing Infrastructure Reporter: Laszlo Bodor -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-21553) Upgrade derby version in standalone-metastore
Laszlo Bodor created HIVE-21553: --- Summary: Upgrade derby version in standalone-metastore Key: HIVE-21553 URL: https://issues.apache.org/jira/browse/HIVE-21553 Project: Hive Issue Type: Bug Reporter: Laszlo Bodor -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-21550) TestObjectStore tests are flaky - A lock could not be obtained within the time requested
Laszlo Bodor created HIVE-21550: --- Summary: TestObjectStore tests are flaky - A lock could not be obtained within the time requested Key: HIVE-21550 URL: https://issues.apache.org/jira/browse/HIVE-21550 Project: Hive Issue Type: Bug Reporter: Laszlo Bodor -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-21549) Fix duplicated asf headers
Laszlo Bodor created HIVE-21549: --- Summary: Fix duplicated asf headers Key: HIVE-21549 URL: https://issues.apache.org/jira/browse/HIVE-21549 Project: Hive Issue Type: Bug Reporter: Laszlo Bodor -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-21541) Fix missing asf headers from HIVE-15406
Laszlo Bodor created HIVE-21541: --- Summary: Fix missing asf headers from HIVE-15406 Key: HIVE-21541 URL: https://issues.apache.org/jira/browse/HIVE-21541 Project: Hive Issue Type: Bug Reporter: Laszlo Bodor -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-21465) Introduce a base abstract VectorExpression to eliminate further code duplications
Laszlo Bodor created HIVE-21465: --- Summary: Introduce a base abstract VectorExpression to eliminate further code duplications Key: HIVE-21465 URL: https://issues.apache.org/jira/browse/HIVE-21465 Project: Hive Issue Type: Bug Reporter: Laszlo Bodor -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-21449) implement 'WITHIN GROUP' clause
Laszlo Bodor created HIVE-21449: --- Summary: implement 'WITHIN GROUP' clause Key: HIVE-21449 URL: https://issues.apache.org/jira/browse/HIVE-21449 Project: Hive Issue Type: Bug Reporter: Laszlo Bodor -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-21441) TestCliDriver#groupby_ppr fails
Laszlo Bodor created HIVE-21441: --- Summary: TestCliDriver#groupby_ppr fails Key: HIVE-21441 URL: https://issues.apache.org/jira/browse/HIVE-21441 Project: Hive Issue Type: Bug Reporter: Laszlo Bodor -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-21406) Add .factorypath files to .gitignore
Laszlo Bodor created HIVE-21406: --- Summary: Add .factorypath files to .gitignore Key: HIVE-21406 URL: https://issues.apache.org/jira/browse/HIVE-21406 Project: Hive Issue Type: Bug Reporter: Laszlo Bodor -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-21405) Let "unknown" keyword be a boolean constant + non-reserved keyword
Laszlo Bodor created HIVE-21405: --- Summary: Let "unknown" keyword be a boolean constant + non-reserved keyword Key: HIVE-21405 URL: https://issues.apache.org/jira/browse/HIVE-21405 Project: Hive Issue Type: Bug Reporter: Laszlo Bodor -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-21396) TestCliDriver#vector_groupby_reduce is flaky
Laszlo Bodor created HIVE-21396: --- Summary: TestCliDriver#vector_groupby_reduce is flaky Key: HIVE-21396 URL: https://issues.apache.org/jira/browse/HIVE-21396 Project: Hive Issue Type: Bug Reporter: Laszlo Bodor -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-21393) Refactor exception catching in HiveAccumuloTableInputFormat
Laszlo Bodor created HIVE-21393: --- Summary: Refactor exception catching in HiveAccumuloTableInputFormat Key: HIVE-21393 URL: https://issues.apache.org/jira/browse/HIVE-21393 Project: Hive Issue Type: Bug Reporter: Laszlo Bodor -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-21048) Remove needles org.mortbay.jetty from hadoop exclusions
Laszlo Bodor created HIVE-21048: --- Summary: Remove needles org.mortbay.jetty from hadoop exclusions Key: HIVE-21048 URL: https://issues.apache.org/jira/browse/HIVE-21048 Project: Hive Issue Type: Bug Reporter: Laszlo Bodor -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-21017) Throw proper exception in case of alter table add partition (old hashed files) to a murmur hashed bucketed table
Laszlo Bodor created HIVE-21017: --- Summary: Throw proper exception in case of alter table add partition (old hashed files) to a murmur hashed bucketed table Key: HIVE-21017 URL: https://issues.apache.org/jira/browse/HIVE-21017 Project: Hive Issue Type: Bug Reporter: Laszlo Bodor -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-20959) TestMiniLlapLocalCliDriver.testCliDriver[cbo_rp_limit] is flaky
Laszlo Bodor created HIVE-20959: --- Summary: TestMiniLlapLocalCliDriver.testCliDriver[cbo_rp_limit] is flaky Key: HIVE-20959 URL: https://issues.apache.org/jira/browse/HIVE-20959 Project: Hive Issue Type: Bug Reporter: Laszlo Bodor -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-20638) Upgrade version of Jetty to 9.3.25.v20180904
Laszlo Bodor created HIVE-20638: --- Summary: Upgrade version of Jetty to 9.3.25.v20180904 Key: HIVE-20638 URL: https://issues.apache.org/jira/browse/HIVE-20638 Project: Hive Issue Type: Bug Reporter: Laszlo Bodor -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-20373) Output of 'show compactions' displays double header
Laszlo Bodor created HIVE-20373:
---
Summary: Output of 'show compactions' displays double header
Key: HIVE-20373
URL: https://issues.apache.org/jira/browse/HIVE-20373
Project: Hive
Issue Type: Bug
Reporter: Laszlo Bodor
{code}
+---+---++++--++---+-+--+
| dbname | tabname | partname | type | state | workerid | starttime | duration
| hadoopjobid |
+---+---++++--++---+-+--+
| Database | Table | Partition | Type | State | Worker | Start Time |
Duration(ms) | HadoopJobId |
| default | student | --- | MAJOR | working |
ctr-e138-1518143905142-435940-01-03.hwx.site-61 | 1534156696000 | --- |
job_1534152461533_0030 |
| default | acid_partitioned | bkt=1 | MAJOR | initiated | --- | --- | --- |
--- |
| default | acid_partitioned | bkt=2 | MAJOR | initiated | --- | --- | --- |
--- |
+---+---++++--++---+-+–+
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (HIVE-20372) WRTIE_SET spelling in TxnHandler
Laszlo Bodor created HIVE-20372: --- Summary: WRTIE_SET spelling in TxnHandler Key: HIVE-20372 URL: https://issues.apache.org/jira/browse/HIVE-20372 Project: Hive Issue Type: Bug Reporter: Laszlo Bodor -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-20360) QTest: enable command line argument to force using a particular driver
Laszlo Bodor created HIVE-20360: --- Summary: QTest: enable command line argument to force using a particular driver Key: HIVE-20360 URL: https://issues.apache.org/jira/browse/HIVE-20360 Project: Hive Issue Type: Improvement Reporter: Laszlo Bodor -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-20089) CTAS doesn't work into nonexisting /tmp/... directory while CT works
Laszlo Bodor created HIVE-20089:
---
Summary: CTAS doesn't work into nonexisting /tmp/... directory
while CT works
Key: HIVE-20089
URL: https://issues.apache.org/jira/browse/HIVE-20089
Project: Hive
Issue Type: Bug
Affects Versions: 3.0.0
Reporter: Laszlo Bodor
While checking negative qtests I've found some strange behavior according to CT
and CTAS statements.
ct_noperm_loc.q
ctas_noperm_loc.q
The common part these tests are initialization:
{code}
set hive.test.authz.sstd.hs2.mode=true;
set
hive.security.authorization.manager=org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdHiveAuthorizerFactoryForTest;
set
hive.security.authenticator.manager=org.apache.hadoop.hive.ql.security.SessionStateConfigUserAuthenticator;
set hive.security.authorization.enabled=true;
set user.name=user1;
{code}
But while simple 'create table' works to a nonexisting dir...
{code}
create table foo0(id int) location 'hdfs:///tmp/ct_noperm_loc_foo0';
{code}
...'create table as select' doesn't work:
{code}
create table foo0 location 'hdfs:///tmp/ctas_noperm_loc_foo0' as select 1 as c1;
{code}
expected result is:
{code}
FAILED: HiveAccessControlException Permission denied: Principal [name=user1,
type=USER] does not have following privileges for operation
CREATETABLE_AS_SELECT [[INSERT, DELETE] on Object [type=DFS_URI,
name=hdfs://### HDFS PATH ###]]
{code}
Is it by design, am I missing something here?
{code}
mvn test -Dtest=TestNegativeMinimrCliDriver -Dqfile=ct_noperm_loc.q
-Pitests,hadoop-2 -pl itests/qtest
mvn test -Dtest=TestNegativeMinimrCliDriver -Dqfile=ctas_noperm_loc.q
-Pitests,hadoop-2 -pl itests/qtest
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (HIVE-19945) Beeline - run against a different sql engine
Laszlo Bodor created HIVE-19945: --- Summary: Beeline - run against a different sql engine Key: HIVE-19945 URL: https://issues.apache.org/jira/browse/HIVE-19945 Project: Hive Issue Type: Improvement Components: Beeline Affects Versions: 3.0.0 Reporter: Laszlo Bodor Fix For: 4.0.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19828) Rename UDFCurrentDB to GenericUDFCurrentDatabase
Laszlo Bodor created HIVE-19828: --- Summary: Rename UDFCurrentDB to GenericUDFCurrentDatabase Key: HIVE-19828 URL: https://issues.apache.org/jira/browse/HIVE-19828 Project: Hive Issue Type: Task Affects Versions: 3.0.0 Reporter: Laszlo Bodor Assignee: Laszlo Bodor Fix For: 4.0.0 Currently, UDFCurrentDB extends GenericUDF, so it should follow the naming convention: GenericUDFCurrentDB, or more accurate GenericUDFCurrentDatabase, as UDFs usually contains the whole keyword, not just an abbreviation. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-19524) pom.xml typo: "commmons-logging" groupId
Laszlo Bodor created HIVE-19524:
---
Summary: pom.xml typo: "commmons-logging" groupId
Key: HIVE-19524
URL: https://issues.apache.org/jira/browse/HIVE-19524
Project: Hive
Issue Type: Bug
Reporter: Laszlo Bodor
I found 153 occurences (in exclusions). Simple copy-paste issue.
{code}
grep -iRH "commmons-logging" *
accumulo-handler/pom.xml: commmons-logging
common/pom.xml: commmons-logging
common/pom.xml: commmons-logging
common/pom.xml: commmons-logging
druid-handler/pom.xml: commmons-logging
hbase-handler/pom.xml: commmons-logging
hbase-handler/pom.xml: commmons-logging
hbase-handler/pom.xml: commmons-logging
hbase-handler/pom.xml: commmons-logging
...
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (HIVE-19131) DecimalColumnStatsMergerTest comparison review
Laszlo Bodor created HIVE-19131:
---
Summary: DecimalColumnStatsMergerTest comparison review
Key: HIVE-19131
URL: https://issues.apache.org/jira/browse/HIVE-19131
Project: Hive
Issue Type: Bug
Reporter: Laszlo Bodor
DecimalColumnStatsMergerTest has a strange comparison logic, which needs to be
reviewed.
Regarding low and high values, it uses compareTo with the same direction, which
seems to be incorrect.
{code}
Decimal lowValue = aggregateData.getLowValue() != null &&
(aggregateData.getLowValue().compareTo(newData.getLowValue()) > 0) ?
aggregateData .getLowValue() : newData.getLowValue();
aggregateData.setLowValue(lowValue); Decimal highValue =
aggregateData.getHighValue() != null &&
(aggregateData.getHighValue().compareTo(newData.getHighValue()) > 0) ?
aggregateData .getHighValue() : newData.getHighValue();
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (HIVE-18862) qfiles: prepare .q files for using datasets - clientpositive
Laszlo Bodor created HIVE-18862: --- Summary: qfiles: prepare .q files for using datasets - clientpositive Key: HIVE-18862 URL: https://issues.apache.org/jira/browse/HIVE-18862 Project: Hive Issue Type: Sub-task Reporter: Laszlo Bodor -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-18823) Vectorization: introduce qtest for SUM (IF/WHEN) with vectorization for ORC
Laszlo Bodor created HIVE-18823:
---
Summary: Vectorization: introduce qtest for SUM (IF/WHEN) with
vectorization for ORC
Key: HIVE-18823
URL: https://issues.apache.org/jira/browse/HIVE-18823
Project: Hive
Issue Type: Test
Components: Hive
Affects Versions: 2.3.0
Reporter: Laszlo Bodor
HIVE-16110 introduced some issues when using SUM aggregations with WHEN clause.
As far as I can see, there is no separate qtests for validating that,
vectorized_case is quite close, but not the same.
The test case would be:
{code:java}
set hive.vectorized.execution.enabled=false;
drop table if exists vectorization_sum_if_when_a;
drop table if exists vectorization_sum_if_when_b;
create table vectorization_sum_if_when_a (x int) stored as orc;
insert into table vectorization_sum_if_when_a values (0), (1), (0), (NULL),
(NULL), (NULL), (NULL), (NULL), (NULL), (NULL);
create table vectorization_sum_if_when_b (x int) stored as orc;
insert into table vectorization_sum_if_when_b select least(t1.x + t2.x + t3.x +
t4.x, 1) from vectorization_sum_if_when_a t1, vectorization_sum_if_when_a t2,
vectorization_sum_if_when_a t3, vectorization_sum_if_when_a t4;
select count(*), x from vectorization_sum_if_when_b group by x;
select sum(IF(x is null, 1, 0)), count(1) from vectorization_sum_if_when_b;
select sum(IF(x=1, 1, 0)), count(1) from vectorization_sum_if_when_b;
select sum((case WHEN x = 1 THEN 1 else 0 end)) from
vectorization_sum_if_when_b;
select sum((case WHEN x = 1 THEN 1 else 0 end)), sum((case WHEN x = 1 THEN 1
when x is null then 0 else 0 end)) from vectorization_sum_if_when_b;
set hive.vectorized.execution.enabled=true;
select sum(IF(x is null, 1, 0)), count(1) from vectorization_sum_if_when_b;
select sum(IF(x=1, 1, 0)), count(1) from vectorization_sum_if_when_b;
select sum((case WHEN x = 1 THEN 1 else 0 end)) from
vectorization_sum_if_when_b;
select sum((case WHEN x = 1 THEN 1 else 0 end)), sum((case WHEN x = 1 THEN 1
when x is null then 0 else 0 end)) from vectorization_sum_if_when_b;
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (HIVE-18560) qtests: QTestUtil refactor/split
Laszlo Bodor created HIVE-18560: --- Summary: qtests: QTestUtil refactor/split Key: HIVE-18560 URL: https://issues.apache.org/jira/browse/HIVE-18560 Project: Hive Issue Type: Task Reporter: Laszlo Bodor Assignee: Laszlo Bodor QTestUtil needs some refactoring, as it has become a large, hard-to-maintain, hard-to-test class with a bunch of responsibilities: * running qtests * parsing/evaluating results * masking/processing results First, I would extract a processing class from it (e.g. QOutProcessor or something like that), which should be capable of being tested easily, and contains all the logic what's needed to make the final q.out results from the original q.out file. This processing class shall remain untouched in case the testing infrastructure (QTestUtil) is replaced or changed in some ways. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-18557) q.outs: fix issues caused by q.out_spark files
Laszlo Bodor created HIVE-18557: --- Summary: q.outs: fix issues caused by q.out_spark files Key: HIVE-18557 URL: https://issues.apache.org/jira/browse/HIVE-18557 Project: Hive Issue Type: Bug Reporter: Laszlo Bodor Assignee: Laszlo Bodor HIVE-18061 caused some issues in yetus check by introducing q.out_spark files. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-18445) qtests: auto_join25.q fails permanently
Laszlo Bodor created HIVE-18445: --- Summary: qtests: auto_join25.q fails permanently Key: HIVE-18445 URL: https://issues.apache.org/jira/browse/HIVE-18445 Project: Hive Issue Type: Bug Components: Tests Reporter: Laszlo Bodor Assignee: Laszlo Bodor org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_join25] (batchId=72) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
