[ 
https://issues.apache.org/jira/browse/BEAM-8183?focusedWorklogId=326375&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-326375
 ]

ASF GitHub Bot logged work on BEAM-8183:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 10/Oct/19 14:48
            Start Date: 10/Oct/19 14:48
    Worklog Time Spent: 10m 
      Work Description: tweise commented on issue #9752: [BEAM-8183] 
restructure Flink portable jars to support multiple pipel…
URL: https://github.com/apache/beam/pull/9752#issuecomment-540623272
 
 
   I tested the inclusion of multiple pipelines using output jar as jobserver 
jar (just had to hack MANIFEST) and see multiple pipelines included:
   ```
   $ jar -tvf beam-pipeline.jar | grep BEAM
    43760 Thu Oct 10 07:27:00 PDT 2019 
BEAM-PIPELINE/BeamApp-tweise-1010142647-d4df5a63/pipeline.json
     2104 Thu Oct 10 07:27:00 PDT 2019 
BEAM-PIPELINE/BeamApp-tweise-1010142647-d4df5a63/pipeline-options.json
     1700 Thu Oct 10 07:27:00 PDT 2019 
BEAM-PIPELINE/BeamApp-tweise-1010142647-d4df5a63/artifacts/ba316acc-a9f7-4443-9373-84c4ee7e1d72
      365 Thu Oct 10 07:27:00 PDT 2019 
BEAM-PIPELINE/BeamApp-tweise-1010142647-d4df5a63/artifact-manifest.json
    43760 Thu Oct 10 07:43:44 PDT 2019 
BEAM-PIPELINE/BeamApp-tweise-1010144331-363120ad/pipeline.json
     2041 Thu Oct 10 07:43:44 PDT 2019 
BEAM-PIPELINE/BeamApp-tweise-1010144331-363120ad/pipeline-options.json
     1700 Thu Oct 10 07:43:46 PDT 2019 
BEAM-PIPELINE/BeamApp-tweise-1010144331-363120ad/artifacts/d7674a76-2391-426e-918d-5b68a2c0e6b7
      365 Thu Oct 10 07:43:46 PDT 2019 
BEAM-PIPELINE/BeamApp-tweise-1010144331-363120ad/artifact-manifest.json
   ```
   I'm going to create a separate PR to allow for readable job names.
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


Issue Time Tracking
-------------------

    Worklog Id:     (was: 326375)
    Time Spent: 0.5h  (was: 20m)

> Optionally bundle multiple pipelines into a single Flink jar
> ------------------------------------------------------------
>
>                 Key: BEAM-8183
>                 URL: https://issues.apache.org/jira/browse/BEAM-8183
>             Project: Beam
>          Issue Type: New Feature
>          Components: runner-flink
>            Reporter: Kyle Weaver
>            Assignee: Kyle Weaver
>            Priority: Major
>              Labels: portability-flink
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> [https://github.com/apache/beam/pull/9331#issuecomment-526734851]
> "With Flink you can bundle multiple entry points into the same jar file and 
> specify which one to use with optional flags. It may be desirable to allow 
> inclusion of multiple pipelines for this tool also, although that would 
> require a different workflow. Absent this option, it becomes quite convoluted 
> for users that need the flexibility to choose which pipeline to launch at 
> submission time."



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to