[
https://issues.apache.org/jira/browse/BEAM-646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15875614#comment-15875614
]
ASF GitHub Bot commented on BEAM-646:
-------------------------------------
GitHub user aljoscha opened a pull request:
https://github.com/apache/beam/pull/2053
[BEAM-646] Get flink runner out of apply
Just for testing, I want to refactor this once the lightweight override
factories by @tgroh from #2039 are in.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/aljoscha/beam get-flink-runner-out-of-apply
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/beam/pull/2053.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2053
----
commit e55e4e45b3a9181b1db76b9c85d3f07ba8c038ca
Author: Stas Levin <[email protected]>
Date: 2016-12-22T17:13:01Z
[BEAM-1205] Auto set "enableAbandonedNodeEnforcement" in TestPipeline
commit c86894bd0ddbeeef1814a9d65321c002fbc56446
Author: Kenneth Knowles <[email protected]>
Date: 2017-02-07T22:11:13Z
Fix some DoFn javadoc literals
commit de072b5f6e99dd892b0a7b74d9c0cc30ed66696c
Author: Pei He <[email protected]>
Date: 2017-02-14T01:17:55Z
[BEAM-59] Beam GcsFileSystem: port expand() from GcsUtil for glob matching.
commit dc4a3aab10c701eb8fe3e2b8c184d1f5a35ddb59
Author: Vikas Kedigehalli <[email protected]>
Date: 2017-02-14T06:11:25Z
Add unsigned 64 bit int read/write methods to cythonized stream
commit c50e0390ec6b51509530b571b83bc6974bf094f7
Author: Thomas Groh <[email protected]>
Date: 2017-02-15T20:57:52Z
Add runners/core-construction-java
This module contains pre-execution PipelineRunner utilities.
Move PTransformMatchers to core-construction-java
commit f9957c0721cfb9444a2142325aceee128a6f22ce
Author: Kenneth Knowles <[email protected]>
Date: 2017-02-15T22:02:38Z
Upgrade bytebuddy to 1.6.8 to jump past asm 5.0
There is a suspected bug in asm 5.0 that is considered the likely root
cause of
a bug sbt-assembly [1] that carried over to Gearpump [2]. This commit
upgrades
us to depend on asm 5.2 in which those derivative bugs have cleared up.
I have not found a direct reference to what the issue is, precisely, but
the dependency effect of this is extremely small and these are libraries
that are useful to keep current.
[1] https://github.com/sbt/sbt-assembly/issues/205#issuecomment-279964607
[2] https://issues.apache.org/jira/browse/GEARPUMP-236
commit 3f0b910b42bfa0f24b4d3082bfb88023c83d88be
Author: JingsongLi <[email protected]>
Date: 2017-02-07T08:11:12Z
[BEAM-1393/1394/1445] Update to Flink 1.2.0 and fix resulting problems
We now use the Flink InternalTimerService for all our timer needs and we
use Flink Broadcast state to store side inputs.
Changing those was both necessary and easier to to in one commit while
updating to Flink 1.2.
commit f7c1d8195a11fcc3d86be6e8d9554fe7e1ac7d0f
Author: Thomas Groh <[email protected]>
Date: 2017-02-17T16:31:00Z
Obtain Flink Views from the Context Output
commit 55447b46708c85eac14984739bbbfc56580afc53
Author: Aljoscha Krettek <[email protected]>
Date: 2017-02-18T15:12:19Z
[BEAM-646] Get Flink Runner out of apply()
----
> Get runners out of the apply()
> ------------------------------
>
> Key: BEAM-646
> URL: https://issues.apache.org/jira/browse/BEAM-646
> Project: Beam
> Issue Type: Improvement
> Components: beam-model-runner-api, sdk-java-core
> Reporter: Kenneth Knowles
> Assignee: Thomas Groh
> Labels: backwards-incompatible
>
> Right now, the runner intercepts calls to apply() and replaces transforms as
> we go. This means that there is no "original" user graph. For portability and
> misc architectural benefits, we would like to build the original graph first,
> and have the runner override later.
> Some runners already work in this manner, but we could integrate it more
> smoothly, with more validation, via some handy APIs on e.g. the Pipeline
> object.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
