Hi Dev Team, The PullFromWikipedia example fails on Gobblin MR mode.
the issue I have found so far is that even after the MR job completes successfully and sseen by gobblin, its explicitly marking it as FAILED due to missing "workunit.working.state" in WorkUnitState ( at SafeDatasetCommit # finalizeDatasetStateBeforeCommit method ). This is how i believe states are structured, just for the reference here JobState ->DatasetState-> TaskState -> WorkUnitState since its missing in the WorkUniteState, It by default get "PENDING" state (by taskState.getWorkingState()) and the function (finalizeDatasetStateBeforeCommit) sets it to FAIL in any other state other than "SUCCESSFUL". Now, I am not sure if this is a bug or i m missing any config like JobCommitPolicy or to tell not to commit at job level at all. can someone pls take a look and comment? Thanks Jay
