[
https://issues.apache.org/jira/browse/BEAM-4291?focusedWorklogId=112131&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-112131
]
ASF GitHub Bot logged work on BEAM-4291:
----------------------------------------
Author: ASF GitHub Bot
Created on: 15/Jun/18 01:13
Start Date: 15/Jun/18 01:13
Worklog Time Spent: 10m
Work Description: jkff commented on issue #5651: [BEAM-4291] Implements
distributed artifact retrieval
URL: https://github.com/apache/beam/pull/5651#issuecomment-397484292
Thanks Robert. I deleted ArtifactSource in this PR now (it did not
participate in any live code paths), and added MD5 verification during staging.
I want to keep the verification during retrieval as well - the scenario I have
in mind is detecting if one job overwrites another job's staged files in the
same directory, or if a staged file is incorrectly cached in some way, etc. -
it's cheap but can help avoid a number of plausible bugs that otherwise would
give a lot of trouble.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 112131)
Time Spent: 6h (was: 5h 50m)
> ArtifactRetrievalService that retrieves artifacts from a distributed
> filesystem
> -------------------------------------------------------------------------------
>
> Key: BEAM-4291
> URL: https://issues.apache.org/jira/browse/BEAM-4291
> Project: Beam
> Issue Type: Sub-task
> Components: runner-core
> Reporter: Eugene Kirpichov
> Assignee: Axel Magnuson
> Priority: Major
> Time Spent: 6h
> Remaining Estimate: 0h
>
> In agreement with how they are staged in BEAM-4290.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
