[jira] [Comment Edited] (BEAM-612) Add BSP runner

2016-08-31 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15454377#comment-15454377 ] Edward J. Yoon edited comment on BEAM-612 at 9/1/16 5:42 AM: - Here's the link

[jira] [Commented] (BEAM-612) Add BSP runner

2016-08-31 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15454377#comment-15454377 ] Edward J. Yoon commented on BEAM-612: - Here's the link about BSP:

[jira] [Commented] (BEAM-612) Add BSP runner

2016-08-31 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15454276#comment-15454276 ] Jean-Baptiste Onofré commented on BEAM-612: --- Do you have a link about BSP ? > Add BSP runner >

[jira] [Created] (BEAM-612) Add BSP runner

2016-08-31 Thread Edward J. Yoon (JIRA)
Edward J. Yoon created BEAM-612: --- Summary: Add BSP runner Key: BEAM-612 URL: https://issues.apache.org/jira/browse/BEAM-612 Project: Beam Issue Type: New Feature Components:

[jira] [Updated] (BEAM-604) Use Watermark Check Streaming Job Finish in DataflowPipelineJob

2016-08-31 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-604: -- Description: Currently, streaming job with bounded input can't be terminated automatically and

[1/2] incubator-beam git commit: Remove empty unused method in TestStreamEvaluatorFactory

2016-08-31 Thread bchambers
Repository: incubator-beam Updated Branches: refs/heads/master a5320607a -> f65795661 Remove empty unused method in TestStreamEvaluatorFactory Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ccfb78ea

[jira] [Updated] (BEAM-604) Use Watermark Check Streaming Job Finish in DataflowPipelineJob

2016-08-31 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-604: -- Description: Currently, streaming job with bounded input can't be terminated automatically and

[2/2] incubator-beam git commit: Closes #910

2016-08-31 Thread bchambers
Closes #910 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f6579566 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/f6579566 Diff:

[jira] [Updated] (BEAM-604) Use Watermark Check Streaming Job Finish in DataflowPipelineJob

2016-08-31 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-604: -- Summary: Use Watermark Check Streaming Job Finish in DataflowPipelineJob (was: Use Watermark Check Streaming Job

[GitHub] incubator-beam pull request #910: Remove empty unused method in TestStreamEv...

2016-08-31 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/910 Remove empty unused method in TestStreamEvaluatorFactory Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] incubator-beam pull request #907: Test that multiple instances of TestStream...

2016-08-31 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/907 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: Test that multiple instances of TestStream are supported

2016-08-31 Thread bchambers
Repository: incubator-beam Updated Branches: refs/heads/master 7dcb4c72c -> a5320607a Test that multiple instances of TestStream are supported Add KeyedResourcePool This interface represents some shared pool of values that may be used by at most one caller at a time. Add

[2/2] incubator-beam git commit: Closes #907

2016-08-31 Thread bchambers
Closes #907 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a5320607 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a5320607 Diff:

[jira] [Created] (BEAM-611) Add support for MapValues

2016-08-31 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-611: -- Summary: Add support for MapValues Key: BEAM-611 URL: https://issues.apache.org/jira/browse/BEAM-611 Project: Beam Issue Type: Improvement Components:

[jira] [Commented] (BEAM-610) Enable spark's checkpointing mechanism for driver-failure recovery in streaming

2016-08-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15453099#comment-15453099 ] ASF GitHub Bot commented on BEAM-610: - GitHub user amitsela opened a pull request:

[GitHub] incubator-beam pull request #909: [BEAM-610] Enable spark's checkpointing me...

2016-08-31 Thread amitsela
GitHub user amitsela opened a pull request: https://github.com/apache/incubator-beam/pull/909 [BEAM-610] Enable spark's checkpointing mechanism for driver-failure recovery in streaming Be sure to do all of the following to help us incorporate your contribution quickly and

[jira] [Created] (BEAM-610) Enable spark's checkpointing mechanism for driver-failure recovery in streaming

2016-08-31 Thread Amit Sela (JIRA)
Amit Sela created BEAM-610: -- Summary: Enable spark's checkpointing mechanism for driver-failure recovery in streaming Key: BEAM-610 URL: https://issues.apache.org/jira/browse/BEAM-610 Project: Beam

[jira] [Created] (BEAM-609) Add Interface around Evaluator Caching

2016-08-31 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-609: Summary: Add Interface around Evaluator Caching Key: BEAM-609 URL: https://issues.apache.org/jira/browse/BEAM-609 Project: Beam Issue Type: Improvement

[GitHub] incubator-beam pull request #778: Correct some accidental renames

2016-08-31 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/778 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: Correct some accidental renames

2016-08-31 Thread bchambers
Repository: incubator-beam Updated Branches: refs/heads/master 98da6e8fb -> 7dcb4c72c Correct some accidental renames IDE over-eagerly replaced some occurrences of createAggregator with createAggregatorForDoFn. This corrects that. Project:

[2/2] incubator-beam git commit: Closes #778

2016-08-31 Thread bchambers
Closes #778 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7dcb4c72 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7dcb4c72 Diff:

[jira] [Commented] (BEAM-572) Remove Spark references in WordCount

2016-08-31 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15452754#comment-15452754 ] Mark Liu commented on BEAM-572: --- PR is closed. This jira can be marked as resolved. > Remove Spark references

[jira] [Created] (BEAM-608) Set EvaluationContext once in the TransformEvaluatorFactory instead of forApplication

2016-08-31 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-608: Summary: Set EvaluationContext once in the TransformEvaluatorFactory instead of forApplication Key: BEAM-608 URL: https://issues.apache.org/jira/browse/BEAM-608 Project:

[GitHub] incubator-beam pull request #908: Fix inconsistent in formatting flink logs

2016-08-31 Thread xhumanoid
GitHub user xhumanoid opened a pull request: https://github.com/apache/incubator-beam/pull/908 Fix inconsistent in formatting flink logs **leaveCompositeTransform** always decrement _this.depth_, but **enterCompositeTransform** increment _this.depth_ only on ENTER_TRANSFORM

incubator-beam git commit: Fix condition in FlinkStreamingPipelineTranslator

2016-08-31 Thread aljoscha
Repository: incubator-beam Updated Branches: refs/heads/master 1dc1f25b6 -> 98da6e8fb Fix condition in FlinkStreamingPipelineTranslator Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/98da6e8f Tree:

[2/2] incubator-beam git commit: Merge branch 'flink-fixes'

2016-08-31 Thread aljoscha
Merge branch 'flink-fixes' This closes #883 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1dc1f25b Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/1dc1f25b Diff:

[1/2] incubator-beam git commit: Address comments of Flink Side-Input PR

2016-08-31 Thread aljoscha
Repository: incubator-beam Updated Branches: refs/heads/master 33d747efa -> 1dc1f25b6 Address comments of Flink Side-Input PR Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/cae96380 Tree:

[jira] [Updated] (BEAM-607) Add DistributedLog IO

2016-08-31 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré updated BEAM-607: -- Fix Version/s: (was: 0.3.0-incubating) > Add DistributedLog IO >

[jira] [Commented] (BEAM-607) Add DistributedLog IO

2016-08-31 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15451642#comment-15451642 ] Jean-Baptiste Onofré commented on BEAM-607: --- We don't assign Jira if you are not committer. So,

[GitHub] incubator-beam pull request #883: Address comments of Flink Side-Input PR

2016-08-31 Thread aljoscha
Github user aljoscha closed the pull request at: https://github.com/apache/incubator-beam/pull/883 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Updated] (BEAM-607) Add DistributedLog IO

2016-08-31 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré updated BEAM-607: -- Assignee: (was: James Malone) > Add DistributedLog IO > - > >

[jira] [Commented] (BEAM-607) Add DistributedLog IO

2016-08-31 Thread Khurrum Nasim (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15451628#comment-15451628 ] Khurrum Nasim commented on BEAM-607: I'd like to contribute. Can you assign this to me? > Add

[jira] [Created] (BEAM-607) Add DistributedLog IO

2016-08-31 Thread Khurrum Nasim (JIRA)
Khurrum Nasim created BEAM-607: -- Summary: Add DistributedLog IO Key: BEAM-607 URL: https://issues.apache.org/jira/browse/BEAM-607 Project: Beam Issue Type: New Feature Components: