[
https://issues.apache.org/jira/browse/BEAM-8183?focusedWorklogId=326375&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-326375
]
ASF GitHub Bot logged work on BEAM-8183:
----------------------------------------
Author: ASF GitHub Bot
Created on: 10/Oct/19 14:48
Start Date: 10/Oct/19 14:48
Worklog Time Spent: 10m
Work Description: tweise commented on issue #9752: [BEAM-8183]
restructure Flink portable jars to support multiple pipel…
URL: https://github.com/apache/beam/pull/9752#issuecomment-540623272
I tested the inclusion of multiple pipelines using output jar as jobserver
jar (just had to hack MANIFEST) and see multiple pipelines included:
```
$ jar -tvf beam-pipeline.jar | grep BEAM
43760 Thu Oct 10 07:27:00 PDT 2019
BEAM-PIPELINE/BeamApp-tweise-1010142647-d4df5a63/pipeline.json
2104 Thu Oct 10 07:27:00 PDT 2019
BEAM-PIPELINE/BeamApp-tweise-1010142647-d4df5a63/pipeline-options.json
1700 Thu Oct 10 07:27:00 PDT 2019
BEAM-PIPELINE/BeamApp-tweise-1010142647-d4df5a63/artifacts/ba316acc-a9f7-4443-9373-84c4ee7e1d72
365 Thu Oct 10 07:27:00 PDT 2019
BEAM-PIPELINE/BeamApp-tweise-1010142647-d4df5a63/artifact-manifest.json
43760 Thu Oct 10 07:43:44 PDT 2019
BEAM-PIPELINE/BeamApp-tweise-1010144331-363120ad/pipeline.json
2041 Thu Oct 10 07:43:44 PDT 2019
BEAM-PIPELINE/BeamApp-tweise-1010144331-363120ad/pipeline-options.json
1700 Thu Oct 10 07:43:46 PDT 2019
BEAM-PIPELINE/BeamApp-tweise-1010144331-363120ad/artifacts/d7674a76-2391-426e-918d-5b68a2c0e6b7
365 Thu Oct 10 07:43:46 PDT 2019
BEAM-PIPELINE/BeamApp-tweise-1010144331-363120ad/artifact-manifest.json
```
I'm going to create a separate PR to allow for readable job names.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 326375)
Time Spent: 0.5h (was: 20m)
> Optionally bundle multiple pipelines into a single Flink jar
> ------------------------------------------------------------
>
> Key: BEAM-8183
> URL: https://issues.apache.org/jira/browse/BEAM-8183
> Project: Beam
> Issue Type: New Feature
> Components: runner-flink
> Reporter: Kyle Weaver
> Assignee: Kyle Weaver
> Priority: Major
> Labels: portability-flink
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> [https://github.com/apache/beam/pull/9331#issuecomment-526734851]
> "With Flink you can bundle multiple entry points into the same jar file and
> specify which one to use with optional flags. It may be desirable to allow
> inclusion of multiple pipelines for this tool also, although that would
> require a different workflow. Absent this option, it becomes quite convoluted
> for users that need the flexibility to choose which pipeline to launch at
> submission time."
--
This message was sent by Atlassian Jira
(v8.3.4#803005)