You can try adding logs in the operator to see where your records are getting 


> On Aug 9, 2017, at 7:08 AM, chiranjeevi vasupilli <> wrote:
> Hi Team,
> In my use case im seeing some random issue in writing data to HDFS.
> Im using AbstractFileOutPutOperator to write the data to HDFS, and upstream 
> operator generate the data. In DT console we can see the writer operator 
> processed 100 tuples but in hdfs we can 80-90 records. When we kill/shutdown 
> the application we are getting 95-100 records.
> Its a random behavior, not same tuple is missing in every run. Please suggest 
> further without killing/shutdown the app we need to write all incoming tuples 
> to HFDS.
> let me know if you need more information.
> Thanks
> Chiranjeevi V 

Reply via email to