Zihan Li created GOBBLIN-1565:
---------------------------------
Summary: Make GMCEWriter fault tolerant so that one topic failure
will not affect other topics in the same container
Key: GOBBLIN-1565
URL: https://issues.apache.org/jira/browse/GOBBLIN-1565
Project: Apache Gobblin
Issue Type: Improvement
Reporter: Zihan Li
GMIP should be fault tolerant, so that one topic failure should not affect
other topics in the same container. One potential solution is that we can catch
the error and document the error dataset, if we have more than one datasets
have issue, that normally something wrong happening on the whole job, we should
fail the task, but if there is only one problematic topic, we can handle the
exception and let the pipeline move on and process other topics.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
