[jira] [Created] (HIVE-24233) except subquery throws nullpointer with cbo disabled

2020-10-05 Thread Peter Varga (Jira)
Peter Varga created HIVE-24233:
--

 Summary: except subquery throws nullpointer with cbo disabled
 Key: HIVE-24233
 URL: https://issues.apache.org/jira/browse/HIVE-24233
 Project: Hive
  Issue Type: Bug
Reporter: Peter Varga
Assignee: Peter Varga


Except and intersect was only implemented with Calcite in HIVE-12764. If cbo is 
disabled it would just throw a nullpointer exception. We should at least throw 
a SemanticException stating this is not supported.

Repro:
set hive.cbo.enable=false;
create table test(id int);
insert into table test values(1);
select id from test except select id from test;



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-24232) Incorrect translation of rollup expression from Calcite

2020-10-05 Thread Jesus Camacho Rodriguez (Jira)
Jesus Camacho Rodriguez created HIVE-24232:
--

 Summary: Incorrect translation of rollup expression from Calcite
 Key: HIVE-24232
 URL: https://issues.apache.org/jira/browse/HIVE-24232
 Project: Hive
  Issue Type: Bug
  Components: CBO
Reporter: Jesus Camacho Rodriguez
Assignee: Jesus Camacho Rodriguez


In Calcite, it is not necessary that the columns in the group set are in the 
same order as the rollup. For instance, this is the Calcite representation of a 
rollup for a given query:
{code}
HiveAggregate(group=[{1, 6, 7}], groups=[[{1, 6, 7}, {1, 7}, {1}, {}]], 
agg#0=[sum($12)], agg#1=[count($12)], agg#2=[sum($4)], agg#3=[count($4)], 
agg#4=[sum($15)], agg#5=[count($15)])
{code}
When we generate the Hive plan from the Calcite operator, we make such 
assumption incorrectly.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-24231) Enhance shared work optimizer to merge scans with semijoin filters on both sides

2020-10-05 Thread Zoltan Haindrich (Jira)
Zoltan Haindrich created HIVE-24231:
---

 Summary: Enhance shared work optimizer to merge scans with 
semijoin filters on both sides
 Key: HIVE-24231
 URL: https://issues.apache.org/jira/browse/HIVE-24231
 Project: Hive
  Issue Type: Improvement
Reporter: Zoltan Haindrich
Assignee: Zoltan Haindrich






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-24230) Integrate HPL/SQL into HiveServer2

2020-10-05 Thread Attila Magyar (Jira)
Attila Magyar created HIVE-24230:


 Summary: Integrate HPL/SQL into HiveServer2
 Key: HIVE-24230
 URL: https://issues.apache.org/jira/browse/HIVE-24230
 Project: Hive
  Issue Type: Bug
  Components: HiveServer2, hpl/sql
Reporter: Attila Magyar
Assignee: Attila Magyar


HPL/SQL is a standalone command line program that can store and load scripts 
from text files, or from Hive Metastore (since HIVE-24217). Currently HPL/SQL 
depends on Hive and not the other way around.

Changing the dependency order between HPL/SQL and HiveServer would open up some 
possibilities which are currently not feasable to implement. For example one 
might want to use a third party SQL tool to run selects on stored procedure (or 
rather function in this case) outputs.
{code:java}
SELECT * from myStoredProcedure(1, 2); {code}
HPL/SQL doesn’t have a JDBC interface and it’s not a daemon so this would not 
work with the current architecture.

Another important factor is performance. Declarative SQL commands are sent to 
Hive via JDBC by HPL/SQL. The integration would make it possible to drop JDBC 
and use HiveSever’s internal API for compilation and execution.

The third factor is that existing tools like Beeline or Hue cannot be used with 
HPL/SQL since it has its own, separated CLI.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HIVE-24229) DirectSql fails in case of OracleDB

2020-10-05 Thread Ayush Saxena (Jira)
Ayush Saxena created HIVE-24229:
---

 Summary: DirectSql fails in case of OracleDB
 Key: HIVE-24229
 URL: https://issues.apache.org/jira/browse/HIVE-24229
 Project: Hive
  Issue Type: Bug
Reporter: Ayush Saxena
Assignee: Ayush Saxena


Direct Sql fails due to different data type mapping incase of Oracle DB




--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Review Request 72929: Re-order methods in Driver

2020-10-05 Thread Miklos Gergely via Review Board

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72929/
---

Review request for hive and David Mollitor.


Bugs: HIVE-24184
https://issues.apache.org/jira/browse/HIVE-24184


Repository: hive-git


Description
---

Driver is still a huge class, with a lot of methods. They are not representing 
the order of the process done by the Driver (compilation, execution, result 
providing, closing). Also the constructors are not at the beginning of the 
class. All of these make the class harder to read. By re-ordering them it would 
be easier.


Diffs
-

  ql/src/java/org/apache/hadoop/hive/ql/Driver.java c4517fa15e 


Diff: https://reviews.apache.org/r/72929/diff/1/


Testing
---

All the tests are still passing.


Thanks,

Miklos Gergely



Review Request 72928: HIVE-24228-complex-types-llap implementation

2020-10-05 Thread Yuriy Baltovskyy via Review Board

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72928/
---

Review request for hive.


Repository: hive-git


Description
---

HIVE-24228-complex-types-llap implementation


Diffs
-

  llap-client/src/java/org/apache/hadoop/hive/llap/LlapRowRecordReader.java 
ee92f3e231e72546f3052b238a0ea041453d040b 
  llap-common/src/java/org/apache/hadoop/hive/llap/FieldDesc.java 
9621978c3196f24750503aa63e7a1e4ad08a4e2c 
  llap-common/src/java/org/apache/hadoop/hive/llap/Row.java 
a84fadc42f67a22cccf30bdd8699c4e57c70635d 
  llap-common/src/test/org/apache/hadoop/hive/llap/TestRow.java 
d4e68f4df0ab31b6aff9f648ef5b7c92a640c7df 
  llap-ext-client/src/java/org/apache/hadoop/hive/llap/LlapBaseInputFormat.java 
15a81da4ccd9dc2c1c9d06de924af59dde5a7c4c 
  ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDTFGetSplits.java 
9ddbd7e61b4c37ed1e552f5a4c9acdd84cc29373 


Diff: https://reviews.apache.org/r/72928/diff/1/


Testing
---


Thanks,

Yuriy Baltovskyy