You can try adding logs in the operator to see where your records are getting
> On Aug 9, 2017, at 7:08 AM, chiranjeevi vasupilli <chiru....@gmail.com> wrote:
> Hi Team,
> In my use case im seeing some random issue in writing data to HDFS.
> Im using AbstractFileOutPutOperator to write the data to HDFS, and upstream
> operator generate the data. In DT console we can see the writer operator
> processed 100 tuples but in hdfs we can 80-90 records. When we kill/shutdown
> the application we are getting 95-100 records.
> Its a random behavior, not same tuple is missing in every run. Please suggest
> further without killing/shutdown the app we need to write all incoming tuples
> to HFDS.
> let me know if you need more information.
> Chiranjeevi V