Gopal V created HIVE-13871:
------------------------------
Summary: Tez exec summary does not get the HIVE counters right
Key: HIVE-13871
URL: https://issues.apache.org/jira/browse/HIVE-13871
Project: Hive
Issue Type: Bug
Components: llap, Tez
Affects Versions: 2.1.0
Reporter: Gopal V
{code}
2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - HIVE:
2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - CREATED_FILES: 1
2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - DESERIALIZE_ERRORS: 0
2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - RECORDS_IN_Map_1: 0
2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - RECORDS_IN_Map_4: 0
2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - RECORDS_IN_Map_5: 0
2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - RECORDS_IN_Map_6: 0
2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - RECORDS_IN_Map_7: 0
2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - RECORDS_OUT_0: 10
2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) -
RECORDS_OUT_INTERMEDIATE_Map_1: 418284
2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) -
RECORDS_OUT_INTERMEDIATE_Map_4: 27440
2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) -
RECORDS_OUT_INTERMEDIATE_Map_5: 365
2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) -
RECORDS_OUT_INTERMEDIATE_Map_6: 101
2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) -
RECORDS_OUT_INTERMEDIATE_Map_7: 48000
2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) -
RECORDS_OUT_INTERMEDIATE_Reducer_2: 10
2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) - Shuffle Errors:
{code}
However, the actual operator counters do indicate the total # of vectors.
{code}
2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) -
TaskCounter_Map_1_INPUT_Map_4:
2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) -
FIRST_EVENT_RECEIVED: 1
2016-05-26T21:59:51,421 INFO [main]: exec.Task (:()) -
INPUT_RECORDS_PROCESSED: 27440
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
