[
https://issues.apache.org/jira/browse/HIVE-20169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16551404#comment-16551404
]
Bharathkrishna Guruvayoor Murali edited comment on HIVE-20169 at 7/20/18 10:53
PM:
-----------------------------------------------------------------------------------
Added patch, now it prints log like the following at INFO level:
{code:java}
2018-07-20T15:42:08,459 INFO [LocalJobRunner Map Task Executor #0]
exec.MapOperator: MAP[0]: Total records read - 3
{code}
was (Author: bharos92):
Added patch, now it prints log like :
{code:java}
2018-07-20T15:42:08,459 INFO [LocalJobRunner Map Task Executor #0]
exec.MapOperator: MAP[0]: Total records read - 3
{code}
> Print Final Rows Processed in MapOperator
> -----------------------------------------
>
> Key: HIVE-20169
> URL: https://issues.apache.org/jira/browse/HIVE-20169
> Project: Hive
> Issue Type: Improvement
> Components: Operators
> Affects Versions: 3.0.0, 4.0.0
> Reporter: BELUGA BEHR
> Assignee: Bharathkrishna Guruvayoor Murali
> Priority: Minor
> Labels: newbie, noob
> Attachments: HIVE-20169.1.patch
>
>
> https://github.com/apache/hive/blob/ac6b2a3fb195916e22b2e5f465add2ffbcdc7430/ql/src/java/org/apache/hadoop/hive/ql/exec/MapOperator.java#L573-L582
> This class emits a log message every time it a certain number of records are
> processed, but it does not print a final count.
> Overload the {{MapOperator}} class's {{closeOp}} method to print a final log
> message providing the total number of rows read by this mapper.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
