Hanghang Liu created GOBBLIN-1413:
-------------------------------------
Summary: Emit GMCE as long as watermark moved
Key: GOBBLIN-1413
URL: https://issues.apache.org/jira/browse/GOBBLIN-1413
Project: Apache Gobblin
Issue Type: Bug
Reporter: Hanghang Liu
Emit GMCE(Gobblin Metadata Change Event) as long as watermark moved on
streaming pipeline.
Currently the GMCE won't be triggered within streaming pipeline if no new file
being generated. This causes problem if watermarks moved, while no file being
generated(for example, data been filtered out by quality checker), GMCE will be
missed.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)