William Lo created GOBBLIN-1771:
-----------------------------------
Summary: Reduce logs in failed job states and cleanup
Key: GOBBLIN-1771
URL: https://issues.apache.org/jira/browse/GOBBLIN-1771
Project: Apache Gobblin
Issue Type: Improvement
Components: gobblin-core
Reporter: William Lo
Assignee: Abhishek Tiwari
Large datasets (multiple terabytes), depending on their jobs, can send a large
number of repetitive logs for failing dataset states and cleaning up the
dataset state.
We should make the logs more meaningful by reducing their number for these
scenarios.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
