[
https://issues.apache.org/jira/browse/HADOOP-17318?focusedWorklogId=502840&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-502840
]
ASF GitHub Bot logged work on HADOOP-17318:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 20/Oct/20 20:38
Start Date: 20/Oct/20 20:38
Worklog Time Spent: 10m
Work Description: steveloughran opened a new pull request #2399:
URL: https://github.com/apache/hadoop/pull/2399
All S3A committers can have purging pending deletes on job commit
disabled. (new option; old one deprecated).
More logging of what is going on with individual file load/upload/commit
(including with duration)
Test of concurrent jobs designed to trigger the specific failure conditions
of Staging (job2 commit after task1 commit) and Magic (job2 commit before
task2 commit)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 502840)
Remaining Estimate: 0h
Time Spent: 10m
> S3A Magic committer to make cleanup of pending uploads optional
> ---------------------------------------------------------------
>
> Key: HADOOP-17318
> URL: https://issues.apache.org/jira/browse/HADOOP-17318
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.3.0
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Minor
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Reported failure of magic committer block uploads as pending upload ID is
> unknown. Likely cause: it's been aborted by another job
> # Make it possible to turn off cleanup of pending uploads in magic committer
> # log more about uploads being deleted in committers
> # and upload ID in the S3aBlockOutputStream errors
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
