Hanghang Liu created GOBBLIN-1413:
-------------------------------------

             Summary: Emit GMCE as long as watermark moved
                 Key: GOBBLIN-1413
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1413
             Project: Apache Gobblin
          Issue Type: Bug
            Reporter: Hanghang Liu


Emit GMCE(Gobblin Metadata Change Event) as long as watermark moved on 
streaming pipeline. 

Currently the GMCE won't be triggered within streaming pipeline if no new file 
being generated. This causes problem if watermarks moved, while no file being 
generated(for example, data been filtered out by quality checker), GMCE will be 
missed.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to