[jira] [Created] (HIVE-22392) Hive JDBC Storage Handler: Support For Writing Data to JDBC Data Source
Syed Shameerur Rahman created HIVE-22392: Summary: Hive JDBC Storage Handler: Support For Writing Data to JDBC Data Source Key: HIVE-22392 URL: https://issues.apache.org/jira/browse/HIVE-22392 Project: Hive Issue Type: New Feature Reporter: Syed Shameerur Rahman Assignee: Syed Shameerur Rahman JDBC Storage Handler supports reading from JDBC data source in Hive. Currently writing to a JDBC data source is not supported. Hence adding support for simple insert query so that the data can be written back to JDBC data source. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-22391) NPE while checking Hive query results cache
Jason Dere created HIVE-22391:
-
Summary: NPE while checking Hive query results cache
Key: HIVE-22391
URL: https://issues.apache.org/jira/browse/HIVE-22391
Project: Hive
Issue Type: Bug
Components: Query Planning
Reporter: Jason Dere
Assignee: Jason Dere
NPE when results cache was enabled:
{noformat}
2019-10-21T14:51:55,718 ERROR [b7d7bea8-eef0-4ea4-ae12-951cb5dc96e3
HiveServer2-Handler-Pool: Thread-210]: ql.Driver (:()) - FAILED:
NullPointerException null
java.lang.NullPointerException
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.checkResultsCache(SemanticAnalyzer.java:15061)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:12320)
at
org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:360)
at
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:289)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:664)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1869)
at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1816)
at org.apache.hadoop.hive.ql.Driver.compileAndRespond(Driver.java:1811)
at
org.apache.hadoop.hive.ql.reexec.ReExecDriver.compileAndRespond(ReExecDriver.java:126)
at
org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:197)
at
org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:262)
at
org.apache.hive.service.cli.operation.Operation.run(Operation.java:247)
at
org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:575)
at
org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:561)
at
org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:315)
at
org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:566)
at
org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1557)
at
org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1542)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge.java:647)
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HIVE-22390) Remove Dependency on JODA Time Library
David Mollitor created HIVE-22390:
-
Summary: Remove Dependency on JODA Time Library
Key: HIVE-22390
URL: https://issues.apache.org/jira/browse/HIVE-22390
Project: Hive
Issue Type: Improvement
Reporter: David Mollitor
Assignee: David Mollitor
Hive uses Joda time library.
{quote}
Joda-Time is the de facto standard date and time library for Java prior to Java
SE 8. Users are now asked to migrate to java.time (JSR-310).
https://www.joda.org/joda-time/
{quote}
Remove this dependency from classes, POM files, and licence files.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
HIVE-22337
Hello Team, Wondering if anyone could take a look at some work in the SerDe package that I would like to introduce... adding a 'text' package for building a common class hierarchy for handling text-based data. https://issues.apache.org/jira/browse/HIVE-22337 Thanks!
Re: Review Request 71589: Create read-only transactions
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/71589/ --- (Updated Oct. 22, 2019, 1:24 p.m.) Review request for hive, Laszlo Pinter and Peter Vary. Bugs: HIVE-21114 https://issues.apache.org/jira/browse/HIVE-21114 Repository: hive-git Description --- With HIVE-21036 we have a way to indicate that a txn is read only. We should (at least in auto-commit mode) determine if the single stmt is a read and mark the txn accordingly. Then we can optimize TxnHandler.commitTxn() so that it doesn't do any checks in write_set etc. TxnHandler.commitTxn() already starts with lockTransactionRecord(stmt, txnid, TXN_OPEN) so it can read the txn type in the same SQL stmt. HiveOperation only has QUERY, which includes Insert and Select, so this requires figuring out how to determine if a query is a SELECT. By the time Driver.openTransaction(); is called, we have already parsed the query so there should be a way to know if the statement only reads. For multi-stmt txns (once these are supported) we should allow user to indicate that a txn is read-only and then not allow any statements that can make modifications in this txn. This should be a different jira. Diffs (updated) - ql/src/java/org/apache/hadoop/hive/ql/Driver.java 91910d1c0c ql/src/java/org/apache/hadoop/hive/ql/io/AcidUtils.java fcf499d53a ql/src/java/org/apache/hadoop/hive/ql/lockmgr/DbTxnManager.java 943aa383bb ql/src/java/org/apache/hadoop/hive/ql/lockmgr/DummyTxnManager.java ac813c8288 ql/src/java/org/apache/hadoop/hive/ql/lockmgr/HiveTxnManager.java 1c53426966 ql/src/test/org/apache/hadoop/hive/ql/lockmgr/TestDbTxnManager.java cc86afedbf ql/src/test/org/apache/hadoop/hive/ql/parse/TestParseUtils.java PRE-CREATION standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java 504e6b12a1 standalone-metastore/metastore-server/src/test/java/org/apache/hadoop/hive/metastore/TestHiveMetaStoreTxns.java 46fc3ed1e0 Diff: https://reviews.apache.org/r/71589/diff/5/ Changes: https://reviews.apache.org/r/71589/diff/4-5/ Testing --- Unit + manual test File Attachments (updated) HIVE-21114.1.patch https://reviews.apache.org/media/uploaded/files/2019/10/10/0929ed4a-17be-4098-8c61-0819a30613fd__HIVE-21114.1.patch HIVE-21114.5.patch https://reviews.apache.org/media/uploaded/files/2019/10/17/80cbb092-97d6-48d2-b603-24213141cb5e__HIVE-21114.5.patch HIVE-21114.8.patch https://reviews.apache.org/media/uploaded/files/2019/10/22/b14eedb4-a2f1-4f77-9676-c258b6804b98__HIVE-21114.8.patch HIVE-21114.8.patch https://reviews.apache.org/media/uploaded/files/2019/10/22/9096f402-3d2e-4cd2-9f85-df1dfeb25863__HIVE-21114.8.patch Thanks, Denys Kuzmenko
Review Request 71645: HIVE-22292
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/71645/ --- Review request for hive, Jesús Camacho Rodríguez and Zoltan Haindrich. Bugs: HIVE-22292 https://issues.apache.org/jira/browse/HIVE-22292 Repository: hive-git Description --- Implement Hypothetical-Set Aggregate Functions == 1. rank, dense_rank, precent_rank, cume_dist 2. Allow unlimited column references in `WITHIN GROUP` clause 3. Refactor the implementation of the functions `percentile_cont` and `percentile_disc`: - validate that only one parameter and column reference is passed to these two functions. - since the semantics of the `WITHIN GROUP` clause allows multiple column references the parameter order had to be changed and this affect backward compatibility. Diffs - ql/src/java/org/apache/hadoop/hive/ql/ErrorMsg.java 5e88f30cab ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java 059919710e ql/src/java/org/apache/hadoop/hive/ql/exec/WindowFunctionDescription.java 48645dc3f2 ql/src/java/org/apache/hadoop/hive/ql/exec/WindowFunctionInfo.java a0b0e48f4c ql/src/java/org/apache/hadoop/hive/ql/parse/IdentifiersParser.g 55c6863f67 ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java 30d37914d0 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFCumeDist.java d0c155ff2d ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFDenseRank.java 992f5bfd21 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFPercentRank.java 64e9c8b7ca ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFPercentileCont.java ad61410180 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFPercentileDisc.java c8d3c12c80 ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFRank.java 13e2f537cd ql/src/java/org/apache/hadoop/hive/ql/util/NullOrdering.java PRE-CREATION ql/src/test/org/apache/hadoop/hive/ql/exec/TestFunctionRegistry.java dead3ec472 ql/src/test/org/apache/hadoop/hive/ql/parse/TestParseWithinGroupClause.java 9d44ed87e9 ql/src/test/queries/clientpositive/hypothetical_set_aggregates.q PRE-CREATION ql/src/test/results/clientpositive/hypothetical_set_aggregates.q.out PRE-CREATION ql/src/test/results/clientpositive/udaf_percentile_cont.q.out f12cb6cd5e ql/src/test/results/clientpositive/udaf_percentile_disc.q.out d10fee577c Diff: https://reviews.apache.org/r/71645/diff/1/ Testing --- New q test added for testing Hypothetical-Set Aggregate Functions: hypothetical_set_aggregates.q Run q tests: hypothetical_set_aggregates.q, udaf_percentile_cont.q, udaf_percentile_disc.q Run unit test: TestParseWithinGroupClause.java Thanks, Krisztian Kasa
