Mehul Garnara (MG) created MAPREDUCE-7002:
---------------------------------------------
Summary: Shows processed record count with _SUCCESS file
Key: MAPREDUCE-7002
URL: https://issues.apache.org/jira/browse/MAPREDUCE-7002
Project: Hadoop Map/Reduce
Issue Type: Improvement
Components: task
Affects Versions: 3.0.0-beta1
Reporter: Mehul Garnara (MG)
Assignee: Mehul Garnara (MG)
Priority: Minor
I'm using spark jobs for processing files and found requirement for getting
number of records process after spark submit ran successfully. After analyze it
we realized spark using hadoop underline where hadoop is generating the
_SUCCESS file as an indicator of the successful completion. I would like to
propose requirement for adding number of count with the file name, for example
for 100 record processed it would generate like "100_SUCCESS" this will give
ability to know how many records get processed on completion of job.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
