[
https://issues.apache.org/jira/browse/MAPREDUCE-7002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sunil Govindan updated MAPREDUCE-7002:
--------------------------------------
Target Version/s: 3.3.0 (was: 3.2.0)
Bulk update: moved all 3.2.0 non-blocker issues, please move back if it is a
blocker.
> Shows processed record count with _SUCCESS file
> -----------------------------------------------
>
> Key: MAPREDUCE-7002
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7002
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: task
> Affects Versions: 3.0.0-beta1
> Reporter: Mehul Garnara (MG)
> Assignee: Mehul Garnara (MG)
> Priority: Minor
>
> I'm using spark jobs for processing files and found requirement for getting
> number of records process after spark submit ran successfully. After analyze
> it we realized spark using hadoop underline where hadoop is generating the
> _SUCCESS file as an indicator of the successful completion. I would like to
> propose requirement for adding number of count with the file name, for
> example for 100 record processed it would generate like "100_SUCCESS" this
> will give ability to know how many records get processed on completion of
> job.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
