On 2017-11-11 01:24, Mohan <mohandoss...@gmail.com> wrote: > Is there any option to check source input records counts and writer count > using property or any other logic in Gobblin ? >
Yes. Look at "RowLevelPolicy" and "TaskLevelPolicy". Their config keys = are "qualitychecker.row.policies", "qualitychecker.row.policy.types", = "qualitychecker.task.policies", and "qualitychecker.task.policy.types". = A couple examples are: "RowCountPolicy" and "AvroHeaderTimestampPolicy".
