[ 
https://issues.apache.org/jira/browse/HADOOP-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated HADOOP-15107:
------------------------------------
    Description: 
I'm writing about the paper on the committers, one which, being a proper paper, 
requires me to show the committers work.

# define the requirements of a "Correct" committed job (this applies to the 
FileOutputCommitter too)
# show that the Staging committer meets these requirements (most of this is 
implicit in that it uses the V1 FileOutputCommitter to marshall .pendingset 
lists from committed tasks to the final destination, where they are read and 
committed.
# Show the magic committer also works.





  was:
I'm writing about the paper on the committers, one which, being a proper paper, 
requires me to show the committers work.

# define the requirements of a "Correct" committed job (this applies to the 
FileOutputCommitter too)
# show that the Staging committer meets these requirements (most of this is 
implicit in that it uses the V1 FileOutputCommitter to marshall .pendingset 
lists from committed tasks to the final destination, where they are read and 
committed.
# Show the magic committer also works.

I'm now not sure that the magic committer works.




> Prove the correctness of the new committers, or fix where they are not correct
> ------------------------------------------------------------------------------
>
>                 Key: HADOOP-15107
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15107
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 3.1.0
>            Reporter: Steve Loughran
>            Assignee: Steve Loughran
>            Priority: Major
>         Attachments: HADOOP-15107-001.patch
>
>
> I'm writing about the paper on the committers, one which, being a proper 
> paper, requires me to show the committers work.
> # define the requirements of a "Correct" committed job (this applies to the 
> FileOutputCommitter too)
> # show that the Staging committer meets these requirements (most of this is 
> implicit in that it uses the V1 FileOutputCommitter to marshall .pendingset 
> lists from committed tasks to the final destination, where they are read and 
> committed.
> # Show the magic committer also works.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

Reply via email to