[
https://issues.apache.org/jira/browse/GOBBLIN-379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Tiwari updated GOBBLIN-379:
------------------------------------
Fix Version/s: (was: 0.13.0)
> Submit an event when DistCp job resource requirements exceed a hard bound.
> --------------------------------------------------------------------------
>
> Key: GOBBLIN-379
> URL: https://issues.apache.org/jira/browse/GOBBLIN-379
> Project: Apache Gobblin
> Issue Type: Improvement
> Components: distcp-ng
> Affects Versions: 0.11.0, 0.12.0, 0.13.0
> Reporter: Sudarshan Vasudevan
> Assignee: Issac Buenrostro
> Priority: Major
> Fix For: 0.12.0
>
>
> When the resource requirements imposed by a distcp dataset exceed those
> specified by properties gobblin.copy.prioritization.maxCopy.copyEntities &
> gobblin.copy.prioritization.maxCopy.size (default: 20000 and 10TB
> respectively), the dataset is skipped with a WARN message in the log. In a
> production setting, this will not suffice and it would be nice to submit an
> event to Kafka for downstream processing and alerting.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
