[
https://issues.apache.org/jira/browse/BEAM-10078?focusedWorklogId=438101&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-438101
]
ASF GitHub Bot logged work on BEAM-10078:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 28/May/20 00:29
Start Date: 28/May/20 00:29
Worklog Time Spent: 10m
Work Description: steveniemitz edited a comment on pull request #11814:
URL: https://github.com/apache/beam/pull/11814#issuecomment-635015560
I just tested this change out, it seems like things work as they did before
in 2.20. The only difference I noticed is that my `filesToStage` are slightly
different.
Previously they looked like:
```
dataflow-worker.jar=<my dataflow jar>,
<some other jar>
```
however now they're just:
```
<my dataflow jar>,
<some other jar>
```
It seems like the job launches correctly and uses the jar I set, so it seems
like it's still working correctly, but I'm not sure if that missing might cause
other issues down the road. Also, the names are deterministic again which is
great!
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 438101)
Time Spent: 1h 20m (was: 1h 10m)
> uniquify Dataflow specific jars when staging
> --------------------------------------------
>
> Key: BEAM-10078
> URL: https://issues.apache.org/jira/browse/BEAM-10078
> Project: Beam
> Issue Type: Bug
> Components: runner-dataflow
> Reporter: Heejong Lee
> Assignee: Heejong Lee
> Priority: P2
> Fix For: 2.22.0
>
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> After BEAM-9383, Dataflow specific jars (dataflow-worker.jar, windmill_main)
> could be overwritten when two or more jobs share the same staging location.
> Since they 1) should have specific predefined names AND 2) should have unique
> location for avoiding collision, they need special handling when staging
> artifacts.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
