[
https://issues.apache.org/jira/browse/GOBBLIN-364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Tiwari updated GOBBLIN-364:
------------------------------------
Fix Version/s: 0.12.0
> Exclude JobState from WorkUnit created by PartitionedFileSourceBase
> -------------------------------------------------------------------
>
> Key: GOBBLIN-364
> URL: https://issues.apache.org/jira/browse/GOBBLIN-364
> Project: Apache Gobblin
> Issue Type: Task
> Reporter: Zhixiong Chen
> Assignee: Zhixiong Chen
> Priority: Major
> Fix For: 0.12.0, 0.13.0
>
>
> Currently, each `WorkUnit` created by a `PartitionedFileSourceBase` source
> has a copy of the entire job configurations. For the following 2 reasons, we
> want to exclude job configurations from `WorkUnit`:
> - It's redundant as the runtime counterpart of `WorkUnit`, which is
> `WorkUnitState`, would have a reference to all job configurations.
> - Adding job configurations to `WorkUnit` has the bad side effect of
> masking dynamic job level configurations in MR Task runner
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
