[ https://issues.apache.org/jira/browse/BEAM-551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15680417#comment-15680417 ]
ASF GitHub Bot commented on BEAM-551: ------------------------------------- GitHub user sammcveety reopened a pull request: https://github.com/apache/incubator-beam/pull/1230 [BEAM-551] PubsubIO with ValueProvider R: @davorbonaci You can merge this pull request into a Git repository by running: $ git pull https://github.com/sammcveety/incubator-beam sgmc/pubsub_new Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1230.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1230 ---- commit e06fd8ce238971d1b235ce01f527f7cedb058127 Author: sammcveety <sam.mcve...@gmail.com> Date: 2016-10-20T16:29:04Z Add NestedValueProvider commit 54af0b970701115ba3843d02f85cb25086101734 Author: Sam McVeety <s...@google.com> Date: 2016-10-30T02:02:51Z Demonstrate PubsubIO with NVP commit a3730dcf3c7072e11fe6340dd3b757bf64b18f52 Author: Sam McVeety <s...@google.com> Date: 2016-10-30T03:47:42Z Fix null pointer issues commit 4a2d2637a4c09049500b22231674536e4ae20706 Author: Sam McVeety <s...@google.com> Date: 2016-11-01T20:42:11Z Merge branch 'master' into sgmc/pubsub_new commit 6cb4822e18e1f6850e855b0f7ce2d9737cc73002 Author: Sam McVeety <s...@google.com> Date: 2016-11-01T21:07:36Z Fix up tests commit 57e52a23b46b76a3e45884c33c52a0331f0d4e8a Author: Sam McVeety <s...@google.com> Date: 2016-11-02T15:48:48Z Address comments. commit a94526af16465be54a9792a41a5ead9162e7c3c7 Author: Sam McVeety <s...@google.com> Date: 2016-11-03T22:26:06Z Address comments commit a8811ace2cce6f685bb4875562355a8e664fa5bd Author: Sam McVeety <s...@google.com> Date: 2016-11-14T19:17:50Z Address builder comments ---- > Support Dynamic PipelineOptions > ------------------------------- > > Key: BEAM-551 > URL: https://issues.apache.org/jira/browse/BEAM-551 > Project: Beam > Issue Type: New Feature > Components: beam-model > Reporter: Sam McVeety > Assignee: Frances Perry > Priority: Minor > > During the graph construction phase, the given SDK generates an initial > execution graph for the program. At execution time, this graph is > executed, either locally or by a service. Currently, Beam only supports > parameterization at graph construction time. Both Flink and Spark supply > functionality that allows a pre-compiled job to be run without SDK > interaction with updated runtime parameters. > In its current incarnation, Dataflow can read values of PipelineOptions at > job submission time, but this requires the presence of an SDK to properly > encode these values into the job. We would like to build a common layer > into the Beam model so that these dynamic options can be properly provided > to jobs. > Please see > https://docs.google.com/document/d/1I-iIgWDYasb7ZmXbGBHdok_IK1r1YAJ90JG5Fz0_28o/edit > for the high-level model, and > https://docs.google.com/document/d/17I7HeNQmiIfOJi0aI70tgGMMkOSgGi8ZUH-MOnFatZ8/edit > for > the specific API proposal. -- This message was sent by Atlassian JIRA (v6.3.4#6332)