[
https://issues.apache.org/jira/browse/HIVE-16115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15904663#comment-15904663
]
anishek edited comment on HIVE-16115 at 3/10/17 8:01 AM:
---------------------------------------------------------
in place progress bar enabled + hiveserver2 progress bar enabled
{code}
0: jdbc:hive2://localhost:10000/default> select max(age) from t;
org.apache.hadoop.hive.ql.Driver INFO : Compiling
command(queryId=testUser_20170306110118_3360db49-6f1b-4caf-93dc-7d8647d515be):
select max(age) from t
org.apache.hadoop.hive.ql.Driver INFO : Semantic Analysis Completed
org.apache.hadoop.hive.ql.Driver INFO : Returning Hive schema:
Schema(fieldSchemas:[FieldSchema(name:_c0, type:int, comment:null)],
properties:null)
org.apache.hadoop.hive.ql.Driver INFO : Completed compiling
command(queryId=testUser_20170306110118_3360db49-6f1b-4caf-93dc-7d8647d515be);
Time taken: 2.856 seconds
org.apache.hadoop.hive.ql.Driver INFO : Concurrency mode is disabled, not
creating a lock manager
org.apache.hadoop.hive.ql.Driver INFO : Executing
command(queryId=testUser_20170306110118_3360db49-6f1b-4caf-93dc-7d8647d515be):
select max(age) from t
org.apache.hadoop.hive.ql.Driver INFO : Query ID =
testUser_20170306110118_3360db49-6f1b-4caf-93dc-7d8647d515be
org.apache.hadoop.hive.ql.Driver INFO : Total jobs = 1
org.apache.hadoop.hive.ql.Driver INFO : Launching Job 1 out of 1
org.apache.hadoop.hive.ql.Driver INFO : Starting task [Stage-1:MAPRED] in
serial mode
org.apache.hadoop.hive.ql.exec.Task INFO : Tez session hasn't been created
yet. Opening session
org.apache.hadoop.hive.ql.exec.Task INFO : Dag name: select max(age) from
t(Stage-1)
SessionState INFO : Status: Running (Executing on YARN cluster with App id
application_1488775060297_0003)
----------------------------------------------------------------------------------------------
VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING
FAILED KILLED
----------------------------------------------------------------------------------------------
Map 1 .......... container SUCCEEDED 1 1 0 0
0 0
Reducer 2 ...... container SUCCEEDED 1 1 0 0
0 0
----------------------------------------------------------------------------------------------
VERTICES: 02/02 [==========================>>] 100% ELAPSED TIME: 3.93 s
----------------------------------------------------------------------------------------------
org.apache.hadoop.hive.ql.Driver INFO : Completed executing
command(queryId=testUser_20170306110118_3360db49-6f1b-4caf-93dc-7d8647d515be);
Time taken: 9.945 seconds
org.apache.hadoop.hive.ql.Driver INFO : OK
+------+
| _c0 |
+------+
| 100 |
+------+
{code}
hive in place progress bar enabled + hiveserver2 in place progress bar disabled.
{code}
0: jdbc:hive2://localhost:10000/default> select max(age) from t;
org.apache.hadoop.hive.ql.Driver INFO : Compiling
command(queryId=testUser_20170306110233_29c7355a-edf5-4d90-9710-61f428dff2bf):
select max(age) from t
org.apache.hadoop.hive.ql.Driver INFO : Semantic Analysis Completed
org.apache.hadoop.hive.ql.Driver INFO : Returning Hive schema:
Schema(fieldSchemas:[FieldSchema(name:_c0, type:int, comment:null)],
properties:null)
org.apache.hadoop.hive.ql.Driver INFO : Completed compiling
command(queryId=testUser_20170306110233_29c7355a-edf5-4d90-9710-61f428dff2bf);
Time taken: 2.563 seconds
org.apache.hadoop.hive.ql.Driver INFO : Concurrency mode is disabled, not
creating a lock manager
org.apache.hadoop.hive.ql.Driver INFO : Executing
command(queryId=testUser_20170306110233_29c7355a-edf5-4d90-9710-61f428dff2bf):
select max(age) from t
org.apache.hadoop.hive.ql.Driver INFO : Query ID =
testUser_20170306110233_29c7355a-edf5-4d90-9710-61f428dff2bf
org.apache.hadoop.hive.ql.Driver INFO : Total jobs = 1
org.apache.hadoop.hive.ql.Driver INFO : Launching Job 1 out of 1
org.apache.hadoop.hive.ql.Driver INFO : Starting task [Stage-1:MAPRED] in
serial mode
org.apache.hadoop.hive.ql.exec.Task INFO : Tez session hasn't been created
yet. Opening session
org.apache.hadoop.hive.ql.exec.Task INFO : Dag name: select max(age) from
t(Stage-1)
SessionState INFO : Status: Running (Executing on YARN cluster with App id
application_1488775060297_0004)
SessionState INFO : Map 1: 0/1 Reducer 2: 0/1
SessionState INFO : Map 1: 0(+1)/1 Reducer 2: 0/1
SessionState INFO : Map 1: 1/1 Reducer 2: 0(+1)/1
SessionState INFO : Map 1: 1/1 Reducer 2: 1/1
org.apache.hadoop.hive.ql.Driver INFO : Completed executing
command(queryId=testUser_20170306110233_29c7355a-edf5-4d90-9710-61f428dff2bf);
Time taken: 9.156 seconds
org.apache.hadoop.hive.ql.Driver INFO : OK
+------+
| _c0 |
+------+
| 100 |
+------+
{code}
was (Author: anishek):
in place progress bar enabled + hiveserver2 progress bar enabled
{code}
0: jdbc:hive2://localhost:10000/default> select max(age) from t;
org.apache.hadoop.hive.ql.Driver INFO : Compiling
command(queryId=anagarwal_20170306110118_3360db49-6f1b-4caf-93dc-7d8647d515be):
select max(age) from t
org.apache.hadoop.hive.ql.Driver INFO : Semantic Analysis Completed
org.apache.hadoop.hive.ql.Driver INFO : Returning Hive schema:
Schema(fieldSchemas:[FieldSchema(name:_c0, type:int, comment:null)],
properties:null)
org.apache.hadoop.hive.ql.Driver INFO : Completed compiling
command(queryId=anagarwal_20170306110118_3360db49-6f1b-4caf-93dc-7d8647d515be);
Time taken: 2.856 seconds
org.apache.hadoop.hive.ql.Driver INFO : Concurrency mode is disabled, not
creating a lock manager
org.apache.hadoop.hive.ql.Driver INFO : Executing
command(queryId=anagarwal_20170306110118_3360db49-6f1b-4caf-93dc-7d8647d515be):
select max(age) from t
org.apache.hadoop.hive.ql.Driver INFO : Query ID =
anagarwal_20170306110118_3360db49-6f1b-4caf-93dc-7d8647d515be
org.apache.hadoop.hive.ql.Driver INFO : Total jobs = 1
org.apache.hadoop.hive.ql.Driver INFO : Launching Job 1 out of 1
org.apache.hadoop.hive.ql.Driver INFO : Starting task [Stage-1:MAPRED] in
serial mode
org.apache.hadoop.hive.ql.exec.Task INFO : Tez session hasn't been created
yet. Opening session
org.apache.hadoop.hive.ql.exec.Task INFO : Dag name: select max(age) from
t(Stage-1)
SessionState INFO : Status: Running (Executing on YARN cluster with App id
application_1488775060297_0003)
----------------------------------------------------------------------------------------------
VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING
FAILED KILLED
----------------------------------------------------------------------------------------------
Map 1 .......... container SUCCEEDED 1 1 0 0
0 0
Reducer 2 ...... container SUCCEEDED 1 1 0 0
0 0
----------------------------------------------------------------------------------------------
VERTICES: 02/02 [==========================>>] 100% ELAPSED TIME: 3.93 s
----------------------------------------------------------------------------------------------
org.apache.hadoop.hive.ql.Driver INFO : Completed executing
command(queryId=anagarwal_20170306110118_3360db49-6f1b-4caf-93dc-7d8647d515be);
Time taken: 9.945 seconds
org.apache.hadoop.hive.ql.Driver INFO : OK
+------+
| _c0 |
+------+
| 100 |
+------+
{code}
hive in place progress bar enabled + hiveserver2 in place progress bar disabled.
{code}
0: jdbc:hive2://localhost:10000/default> select max(age) from t;
org.apache.hadoop.hive.ql.Driver INFO : Compiling
command(queryId=anagarwal_20170306110233_29c7355a-edf5-4d90-9710-61f428dff2bf):
select max(age) from t
org.apache.hadoop.hive.ql.Driver INFO : Semantic Analysis Completed
org.apache.hadoop.hive.ql.Driver INFO : Returning Hive schema:
Schema(fieldSchemas:[FieldSchema(name:_c0, type:int, comment:null)],
properties:null)
org.apache.hadoop.hive.ql.Driver INFO : Completed compiling
command(queryId=anagarwal_20170306110233_29c7355a-edf5-4d90-9710-61f428dff2bf);
Time taken: 2.563 seconds
org.apache.hadoop.hive.ql.Driver INFO : Concurrency mode is disabled, not
creating a lock manager
org.apache.hadoop.hive.ql.Driver INFO : Executing
command(queryId=anagarwal_20170306110233_29c7355a-edf5-4d90-9710-61f428dff2bf):
select max(age) from t
org.apache.hadoop.hive.ql.Driver INFO : Query ID =
anagarwal_20170306110233_29c7355a-edf5-4d90-9710-61f428dff2bf
org.apache.hadoop.hive.ql.Driver INFO : Total jobs = 1
org.apache.hadoop.hive.ql.Driver INFO : Launching Job 1 out of 1
org.apache.hadoop.hive.ql.Driver INFO : Starting task [Stage-1:MAPRED] in
serial mode
org.apache.hadoop.hive.ql.exec.Task INFO : Tez session hasn't been created
yet. Opening session
org.apache.hadoop.hive.ql.exec.Task INFO : Dag name: select max(age) from
t(Stage-1)
SessionState INFO : Status: Running (Executing on YARN cluster with App id
application_1488775060297_0004)
SessionState INFO : Map 1: 0/1 Reducer 2: 0/1
SessionState INFO : Map 1: 0(+1)/1 Reducer 2: 0/1
SessionState INFO : Map 1: 1/1 Reducer 2: 0(+1)/1
SessionState INFO : Map 1: 1/1 Reducer 2: 1/1
org.apache.hadoop.hive.ql.Driver INFO : Completed executing
command(queryId=anagarwal_20170306110233_29c7355a-edf5-4d90-9710-61f428dff2bf);
Time taken: 9.156 seconds
org.apache.hadoop.hive.ql.Driver INFO : OK
+------+
| _c0 |
+------+
| 100 |
+------+
{code}
> Stop printing progress info from operation logs with beeline progress bar
> -------------------------------------------------------------------------
>
> Key: HIVE-16115
> URL: https://issues.apache.org/jira/browse/HIVE-16115
> Project: Hive
> Issue Type: Improvement
> Components: HiveServer2
> Affects Versions: 2.2.0
> Reporter: anishek
> Assignee: anishek
> Priority: Minor
> Fix For: 2.2.0
>
> Attachments: HIVE-16115.1.patch, HIVE-16115.2.patch,
> HIVE-16115.3.patch, HIVE-16115.4.patch
>
>
> when in progress bar is enabled, we should not print the progress information
> via the operations logs.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
