[
https://issues.apache.org/jira/browse/MAPREDUCE-7002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802811#comment-17802811
]
Shilun Fan commented on MAPREDUCE-7002:
---------------------------------------
Bulk update: moved all 3.4.0 non-blocker issues, please move back if it is a
blocker. Retarget 3.5.0.
> Shows processed record count with _SUCCESS file
> -----------------------------------------------
>
> Key: MAPREDUCE-7002
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7002
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: task
> Affects Versions: 3.0.0-beta1
> Reporter: Mehul Garnara (MG)
> Assignee: Mehul Garnara (MG)
> Priority: Minor
>
> I'm using spark jobs for processing files and found requirement for getting
> number of records process after spark submit ran successfully. After analyze
> it we realized spark using hadoop underline where hadoop is generating the
> _SUCCESS file as an indicator of the successful completion. I would like to
> propose requirement for adding number of count with the file name, for
> example for 100 record processed it would generate like "100_SUCCESS" this
> will give ability to know how many records get processed on completion of
> job.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
