You can try adding logs in the operator to see where your records are getting 
skipped. 

-Venky.


> On Aug 9, 2017, at 7:08 AM, chiranjeevi vasupilli <chiru....@gmail.com> wrote:
> 
> Hi Team,
> 
> In my use case im seeing some random issue in writing data to HDFS.
> 
> Im using AbstractFileOutPutOperator to write the data to HDFS, and upstream 
> operator generate the data. In DT console we can see the writer operator 
> processed 100 tuples but in hdfs we can 80-90 records. When we kill/shutdown 
> the application we are getting 95-100 records.
> 
> Its a random behavior, not same tuple is missing in every run. Please suggest 
> further without killing/shutdown the app we need to write all incoming tuples 
> to HFDS.
> 
> let me know if you need more information.
> 
> Thanks
> Chiranjeevi V 

Reply via email to