hive CHD5.12.1 在java中如何获取日志
hive CHD5.12.1 版本前使用：
public String getQueryLog(TOperationHandle tOperationHandle) throws Exception {
//TCLIService.Client client;
if(tOperationHandle!=null){
TGetLogReq tGetLogReq = new TGetLogReq(tOperationHandle);
TGetLogResp logResp = client.GetLog(tGetLogReq);
log = logResp.getLog();
}
return log;
}
使用hive-service-0.12.0-cdh5.01.jar中的类
但是 CDH5.12.1，hive-service中的TCLIService.Client
中不在提供GetLog方法了，不知道有什么办法可以获取sql查询日志吗 ？
hive CDH5.12.1 TGetLogReq cannot be resolved to a type
hive CDH5.12.1 TGetLogReq cannot be resolved to a type 5...@163.com
[jira] [Created] (HIVE-20102) Add a couple of additional tests for query parsing
Jesus Camacho Rodriguez created HIVE-20102: -- Summary: Add a couple of additional tests for query parsing Key: HIVE-20102 URL: https://issues.apache.org/jira/browse/HIVE-20102 Project: Hive Issue Type: Improvement Components: Parser Reporter: Jesus Camacho Rodriguez Assignee: Jesus Camacho Rodriguez -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-20101) BloomKFilter: Avoid using the local byte[] arrays entirely
Gopal V created HIVE-20101:
--
Summary: BloomKFilter: Avoid using the local byte[] arrays entirely
Key: HIVE-20101
URL: https://issues.apache.org/jira/browse/HIVE-20101
Project: Hive
Issue Type: Bug
Components: Query Processor
Affects Versions: 4.0.0
Reporter: Gopal V
HIVE-18866 introduced a fast-path for integer -> murmur hash, but the change
hasn't been applied to BloomKFilter for integers.
{code}
public class BloomKFilter {
private final byte[] BYTE_ARRAY_4 = new byte[4];
private final byte[] BYTE_ARRAY_8 = new byte[8];
{code}
Remove these objects and use the fast-path.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (HIVE-20100) OpTraits : Select Optraits should stop when a mismatch is detected
Deepak Jaiswal created HIVE-20100: - Summary: OpTraits : Select Optraits should stop when a mismatch is detected Key: HIVE-20100 URL: https://issues.apache.org/jira/browse/HIVE-20100 Project: Hive Issue Type: Bug Reporter: Deepak Jaiswal Assignee: Deepak Jaiswal The select operator's optraits logic as stated in the comment is, // For bucket columns // If all the columns match to the parent, put them in the bucket cols // else, add empty list. // For sort columns // Keep the subset of all the columns as long as order is maintained. However, this is not happening due to a bug. The bool found is never reset, so if a single match is found, the value remains true and allows the optraits get populated with partial list of columns for bucket col which is incorrect. This may lead to creation of SMB join which should not happen. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] hive pull request #392: HIVE-20099: Fix logger for LlapServlet
GitHub user rajkrrsingh opened a pull request: https://github.com/apache/hive/pull/392 HIVE-20099: Fix logger for LlapServlet logger should be LlapServlet, not the JMXJsonServlet, it can mislead the user while debugging UI issues. so fixing this logger You can merge this pull request into a Git repository by running: $ git pull https://github.com/rajkrrsingh/hive HIVE-20099 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/392.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #392 commit 0a814b76df75f1cfda3ba8522bf67eaa172d92f1 Author: Rajkumar singh Date: 2018-07-05T21:20:23Z HIVE-20099: Fix logger for LlapServlet ---
[jira] [Created] (HIVE-20099) incorrect logger for LlapServlet
Rajkumar Singh created HIVE-20099: - Summary: incorrect logger for LlapServlet Key: HIVE-20099 URL: https://issues.apache.org/jira/browse/HIVE-20099 Project: Hive Issue Type: Improvement Affects Versions: 2.1.0 Reporter: Rajkumar Singh logger should be LlapServlet, not the JMXJsonServlet, it can mislead the user while debugging UI issues. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-20098) NPE when getting Date column statistics
Andy Rosa created HIVE-20098:
Summary: NPE when getting Date column statistics
Key: HIVE-20098
URL: https://issues.apache.org/jira/browse/HIVE-20098
Project: Hive
Issue Type: Bug
Components: Metastore, Standalone Metastore
Affects Versions: 1.2.1, 4.0.0
Environment: Tested on versions `1.2.1` and the latest 4.0.0-SNAPSHOT
Reporter: Andy Rosa
The issue reproduces only for a date column for a partitioned table. It
reproduces only if the date column has all the values set to null, and if the
partition is not empty.
Here is a quick reproducer:
{code:java}
CREATE TABLE dummy_table (
c_date DATE,
c_bigint BIGINT
)
PARTITIONED BY (ds STRING);
INSERT OVERWRITE TABLE dummy_table PARTITION (ds='2018-01-01') SELECT CAST(null
AS DATE), CAST(null AS BIGINT) FROM ;
ANALYZE TABLE dummy_table COMPUTE STATISTICS FOR COLUMNS;
DESCRIBE FORMATTED dummy_table.c_bigint PARTITION (ds='2018-01-01');
DESCRIBE FORMATTED dummy_table.c_date PARTITION (ds='2018-01-01');
{code}
The first `DESCRIBE FORMATTED` statement succeeds, when the second fails with
an `NPE`
It happens because the null check is missing when converting Object from the
ObjectStore to the Thrift object. The null check is missing only in the date
statistics conversion for the partitioned table.
Missing:
[https://github.com/apache/hive/blob/master/standalone-metastore/src/main/java/org/apache/hadoop/hive/metastore/StatObjectConverter.java#L469]
Present:
[https://github.com/apache/hive/blob/master/standalone-metastore/src/main/java/org/apache/hadoop/hive/metastore/StatObjectConverter.java#L558]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[GitHub] hive pull request #391: HIVE-20001: With doas set to true, running select qu...
GitHub user beltran opened a pull request: https://github.com/apache/hive/pull/391 HIVE-20001: With doas set to true, running select query as hrt_qa use⦠â¦r on external table fails due to permission denied to read /warehouse/tablespace/managed directory You can merge this pull request into a Git repository by running: $ git pull https://github.com/beltran/hive HIVE-20001-4 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/391.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #391 commit 9de14778b2d7e2eb4e8504cd936fa6d8717f57f9 Author: Jaume Marhuenda Date: 2018-07-01T03:47:15Z HIVE-20001: With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory ---
Re: Review Request 67815: HIVE-19733 : RemoteSparkJobStatus#getSparkStageProgress inefficient implementation
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/67815/ --- (Updated July 5, 2018, 7:34 p.m.) Review request for hive, Peter Vary and Sahil Takiar. Repository: hive-git Description --- Adding GetSparkStagesInfoJob which gets the jobInfo and stageInfos in a single job Diffs (updated) - ql/src/java/org/apache/hadoop/hive/ql/exec/spark/status/impl/RemoteSparkJobStatus.java 832832b325d7eb0e43fb34a4306d7ffa43ceaa78 Diff: https://reviews.apache.org/r/67815/diff/2/ Changes: https://reviews.apache.org/r/67815/diff/1-2/ Testing --- Thanks, Bharathkrishna Guruvayoor Murali
[jira] [Created] (HIVE-20097) Convert standalone-metastore to a submodule
Alexander Kolbasov created HIVE-20097: - Summary: Convert standalone-metastore to a submodule Key: HIVE-20097 URL: https://issues.apache.org/jira/browse/HIVE-20097 Project: Hive Issue Type: Sub-task Components: Hive, Metastore, Standalone Metastore Affects Versions: 3.1.0, 4.0.0 Reporter: Alexander Kolbasov Assignee: Alexander Kolbasov This is a subtask to stage HIVE-17751 changes into several smaller phases. The first part is moving existing code in hive-standalone-metastore to a sub-module. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] hive pull request #380: HIVE-20001: With doas set to true, running select qu...
Github user beltran closed the pull request at: https://github.com/apache/hive/pull/380 ---
[GitHub] hive pull request #389: HIVE-20001: With doas set to true, running select qu...
Github user beltran closed the pull request at: https://github.com/apache/hive/pull/389 ---
[GitHub] hive pull request #390: HIVE-20080: TxnHandler checkLock direct sql fail wit...
GitHub user rajkrrsingh opened a pull request: https://github.com/apache/hive/pull/390 HIVE-20080: TxnHandler checkLock direct sql fail with ORA-01795 , if ⦠check if the dbType is oracle break the query IN clause to include hl_partition in batch of 1000. You can merge this pull request into a Git repository by running: $ git pull https://github.com/rajkrrsingh/hive HIVE-20080 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/hive/pull/390.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #390 commit 097c42a8e54ca48cd634dd5c777021eebab076bb Author: Rajkumar singh Date: 2018-07-05T17:52:30Z HIVE-20080: TxnHandler checkLock direct sql fail with ORA-01795 , if the table has more than 1000 partitions ---
[jira] [Created] (HIVE-20096) dynamic partition pruning results in java.lang.UnsupportedOperationException: Not expecting to handle any events
Karthik created HIVE-20096: -- Summary: dynamic partition pruning results in java.lang.UnsupportedOperationException: Not expecting to handle any events Key: HIVE-20096 URL: https://issues.apache.org/jira/browse/HIVE-20096 Project: Hive Issue Type: Bug Affects Versions: 3.0.0 Environment: Hive 3.0.0 and Tez 0.91 . Reporter: Karthik * Setting hive.tez.dynamic.partition.pruning=true partition results in error "java.lang.UnsupportedOperationException: Not expecting to handle any events" for some queries. * Below is stack trace as shown in Hive CLI and JDBC. -- VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED -- Map 3 llap INITED 1 0 0 1 0 0 Map 4 .. llap SUCCEEDED 1 1 0 0 0 0 Map 1 llap INITIALIZING -1 0 0 -1 0 0 Reducer 2 llap INITED 3 0 0 3 0 0 -- VERTICES: 01/04 [=>>-] 20% ELAPSED TIME: 0.56 s -- 2018-07-05 06:41:22,813 INFO [32a75ad3-f0de-4255-b1d5-0c919e3bc672 main] SessionState (SessionState.java:logInfo(1163)) - Map 1: -/- Map 3: 0/1 Map 4: 1/1 Reducer 2: 0/3 Status: Failed 2018-07-05 06:41:22,814 ERROR [32a75ad3-f0de-4255-b1d5-0c919e3bc672 main] SessionState (SessionState.java:printError(1237)) - Status: Failed Vertex failed, vertexName=Map 1, vertexId=vertex_1530776596475_0020_4_02, diagnostics=[Vertex vertex_1530776596475_0020_4_02 [Map 1] killed/failed due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: my_fact_table initializer failed, vertex=vertex_1530776596475_0020_4_02 [Map 1], java.lang.UnsupportedOperationException: Not expecting to handle any events at org.apache.tez.mapreduce.common.MRInputAMSplitGenerator.handleInputInitializerEvent(MRInputAMSplitGenerator.java:170) at org.apache.tez.dag.app.dag.RootInputInitializerManager$InitializerWrapper.sendEvents(RootInputInitializerManager.java:518) at org.apache.tez.dag.app.dag.RootInputInitializerManager$InitializerWrapper.handleInputInitializerEvents(RootInputInitializerManager.java:511) at org.apache.tez.dag.app.dag.RootInputInitializerManager.handleInitializerEvents(RootInputInitializerManager.java:201) at org.apache.tez.dag.app.dag.impl.VertexImpl.handleRoutedTezEvents(VertexImpl.java:4009) at org.apache.tez.dag.app.dag.impl.VertexImpl.access$4000(VertexImpl.java:205) at org.apache.tez.dag.app.dag.impl.VertexImpl$RouteEventTransition.transition(VertexImpl.java:3738) at org.apache.tez.dag.app.dag.impl.VertexImpl$RouteEventTransition.transition(VertexImpl.java:3731) at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385) at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) at org.apache.hadoop.yarn.state.StateMachineFactory.access$500(StateMachineFactory.java:46) at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:487) at org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:59) at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1939) at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:204) at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:2317) at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:2303) at org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:180) at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:115) at java.lang.Thread.run(Thread.java:748) ] 2018-07-05 06:41:22,814 ERROR [32a75ad3-f0de-4255-b1d5-0c919e3bc672 main] SessionState (SessionState.java:printError(1237)) - Vertex failed, vertexName=Map 1, vertexId=vertex_1530776596475_0020_4_02, diagnostics=[Vertex vertex_1530776596475_0020_4_02 [Map 1] killed/failed due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: my_fact_table initializer failed, vertex=vertex_1530776596475_0020_4_02 [Map 1], java.lang.UnsupportedOperationException: Not expecting to handle any events at org.apache.tez.mapreduce.common.MRInputAMSplitGenerator.handleInputInitializerEvent(MRInputAMSplitGenerator.java:170) at org.apache.tez.dag.app.dag.RootInputInitializerManager$InitializerWrapper.sendEvents(RootInputInitializerManager.java:518) at org.apache.tez.dag.app.dag.RootInputInitializerManager$InitializerWrapper.handleInputInitializerEvents(RootInputInitializerManager.java:511) at org.apache.tez.dag.app.dag.RootInputInitializerManager.handleInitializerEvents(RootInputInitializerManager.java:201) at
[jira] [Created] (HIVE-20095) Fix jdbc external table feature
Jonathan Doron created HIVE-20095: - Summary: Fix jdbc external table feature Key: HIVE-20095 URL: https://issues.apache.org/jira/browse/HIVE-20095 Project: Hive Issue Type: Bug Reporter: Jonathan Doron Assignee: Jonathan Doron It seems like the committed code for HIVE-19161 (7584b3276bebf64aa006eaa162c0a6264d8fcb56) reverted some of HIVE-18423 updates, and therefore some of the external table queries are not working correctly. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-20094) Update Druid to 0.12.1 version
slim bouguerra created HIVE-20094: - Summary: Update Druid to 0.12.1 version Key: HIVE-20094 URL: https://issues.apache.org/jira/browse/HIVE-20094 Project: Hive Issue Type: Bug Reporter: slim bouguerra Assignee: slim bouguerra As per Jira title. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (HIVE-20093) LlapOutputFomatService: Use ArrowBuf with Netty for Accounting
Eric Wohlstadter created HIVE-20093:
---
Summary: LlapOutputFomatService: Use ArrowBuf with Netty for
Accounting
Key: HIVE-20093
URL: https://issues.apache.org/jira/browse/HIVE-20093
Project: Hive
Issue Type: Bug
Reporter: Eric Wohlstadter
Assignee: Eric Wohlstadter
Combining {{Unpooled.wrappedBuffer}} with Arrow buffers can create corrupted
buffers from buffer reuse race-condition.
This change ensures Arrow memory to be accounted by the same BufferAllocator.
RootAllocator will return an ArrowBuf which cooperates with Arrow memory arrow
accounting after Netty {{release(1)}} the buffer.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (HIVE-20092) Hive create table like comment
wxmimperio created HIVE-20092:
-
Summary: Hive create table like comment
Key: HIVE-20092
URL: https://issues.apache.org/jira/browse/HIVE-20092
Project: Hive
Issue Type: Bug
Components: SQL
Affects Versions: 1.1.0
Reporter: wxmimperio
In cloudera:
*Cloning tables (LIKE clause):*
*!image-2018-07-05-14-01-56-160.png!*
[https://www.cloudera.com/documentation/enterprise/5-8-x/topics/impala_create_table.html]
However can not run：
{code:java}
hive> CREATE TABLE `test_like` LIKE `test` COMMENT 'test_like' STORED AS ORC
TBLPROPERTIES('orc.compress'='SNAPPY');
FAILED: ParseException line 1:38 missing EOF at 'COMMENT' near 'test'
{code}
Can I add COMMIT in sql if I create table like?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
