[GitHub] incubator-beam pull request #940: [BEAM-] Making Dataflow Py...

2016-09-09 Thread katsiapis
GitHub user katsiapis opened a pull request: https://github.com/apache/incubator-beam/pull/940 [BEAM-] Making Dataflow Python Materialized PCollection representation more efficient (3 of several). Be sure to do all of the following to help us incorporate your contribution

[jira] [Created] (BEAM-625) Make Dataflow Python Materialized PCollection representation more efficient

2016-09-09 Thread Konstantinos Katsiapis (JIRA)
Konstantinos Katsiapis created BEAM-625: --- Summary: Make Dataflow Python Materialized PCollection representation more efficient Key: BEAM-625 URL: https://issues.apache.org/jira/browse/BEAM-625

[GitHub] incubator-beam pull request #865: Support mode attribute on GCS files

2016-09-09 Thread charlesccychen
Github user charlesccychen closed the pull request at: https://github.com/apache/incubator-beam/pull/865 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[jira] [Closed] (BEAM-495) Generalize FileChecksumMatcher used for all E2E test

2016-09-09 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-495. - > Generalize FileChecksumMatcher used for all E2E test > > >

[jira] [Resolved] (BEAM-624) NoClassDefFoundError Failed Dataflow Streaming Job

2016-09-09 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-624. --- Resolution: Fixed Fix Version/s: Not applicable > NoClassDefFoundError Failed Dataflow Streaming Job >

[jira] [Closed] (BEAM-624) NoClassDefFoundError Failed Dataflow Streaming Job

2016-09-09 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-624. - > NoClassDefFoundError Failed Dataflow Streaming Job > -- > >

[GitHub] incubator-beam pull request #939: Use cStringIO instead of StringIO

2016-09-09 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/incubator-beam/pull/939 Use cStringIO instead of StringIO You can merge this pull request into a Git repository by running: $ git pull https://github.com/charlesccychen/incubator-beam fix-stringio

[jira] [Commented] (BEAM-624) NoClassDefFoundError Failed Dataflow Streaming Job

2016-09-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478121#comment-15478121 ] ASF GitHub Bot commented on BEAM-624: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request #938: [BEAM-624] Revert Backoff Classes to Fix N...

2016-09-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/938 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: Revert Backoff Classes to Fix Worker Dependency Error

2016-09-09 Thread dhalperi
Repository: incubator-beam Updated Branches: refs/heads/master e9326c8b1 -> 82ebfd487 Revert Backoff Classes to Fix Worker Dependency Error Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/51c73a29 Tree:

[2/2] incubator-beam git commit: Closes #938

2016-09-09 Thread dhalperi
Closes #938 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/82ebfd48 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/82ebfd48 Diff:

[2/2] incubator-beam git commit: Closes #933

2016-09-09 Thread dhalperi
Closes #933 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/009230e8 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/009230e8 Diff:

[1/2] incubator-beam git commit: Update 404 link to setuptools docs

2016-09-09 Thread dhalperi
Repository: incubator-beam Updated Branches: refs/heads/python-sdk 76a6d6bdc -> 009230e8b Update 404 link to setuptools docs Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f04e6e21 Tree:

[jira] [Commented] (BEAM-624) NoClassDefFoundError Failed Dataflow Streaming Job

2016-09-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477705#comment-15477705 ] ASF GitHub Bot commented on BEAM-624: - GitHub user markflyhigh opened a pull request:

[GitHub] incubator-beam pull request #938: [BEAM-624] Revert Backoff Classes to Fix N...

2016-09-09 Thread markflyhigh
GitHub user markflyhigh opened a pull request: https://github.com/apache/incubator-beam/pull/938 [BEAM-624] Revert Backoff Classes to Fix NoClassDefFoundError in Dataflow Streaming Job Be sure to do all of the following to help us incorporate your contribution quickly and

[jira] [Created] (BEAM-624) NoClassDefFoundError Failed Dataflow Streaming Job

2016-09-09 Thread Mark Liu (JIRA)
Mark Liu created BEAM-624: - Summary: NoClassDefFoundError Failed Dataflow Streaming Job Key: BEAM-624 URL: https://issues.apache.org/jira/browse/BEAM-624 Project: Beam Issue Type: Bug

[GitHub] incubator-beam pull request #937: Remove EvaluationContext as a forApplicati...

2016-09-09 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/937 Remove EvaluationContext as a forApplication Parameter Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[jira] [Created] (BEAM-623) Integate Flink's RestartStrategies in FlinkPipelineOptions

2016-09-09 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-623: --- Summary: Integate Flink's RestartStrategies in FlinkPipelineOptions Key: BEAM-623 URL: https://issues.apache.org/jira/browse/BEAM-623 Project: Beam

[GitHub] incubator-beam pull request #929: [flink] initialize watermarkTimeQueue with...

2016-09-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/929 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: This closes #929

2016-09-09 Thread mxm
This closes #929 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/e9326c8b Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/e9326c8b Diff:

[1/2] incubator-beam git commit: [flink] initialize watermarkTimeQueue with Comparator

2016-09-09 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master b6205ffa3 -> e9326c8b1 [flink] initialize watermarkTimeQueue with Comparator Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/de6ec823 Tree:

[jira] [Created] (BEAM-622) Add checkpointing tests for DoFnOperator and WindowDoFnOperator

2016-09-09 Thread Maximilian Michels (JIRA)
Maximilian Michels created BEAM-622: --- Summary: Add checkpointing tests for DoFnOperator and WindowDoFnOperator Key: BEAM-622 URL: https://issues.apache.org/jira/browse/BEAM-622 Project: Beam

[jira] [Resolved] (BEAM-333) Support "stop" for streaming pipelines

2016-09-09 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-333. - Resolution: Fixed Fix Version/s: 0.3.0-incubating Stop is also supported on the

[jira] [Commented] (BEAM-619) UnboundedSourceWrapper snapshotting fails with IndexOutOfBoundsException

2016-09-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477147#comment-15477147 ] ASF GitHub Bot commented on BEAM-619: - Github user asfgit closed the pull request at:

[jira] [Closed] (BEAM-619) UnboundedSourceWrapper snapshotting fails with IndexOutOfBoundsException

2016-09-09 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-619. --- Resolution: Fixed Fix Version/s: 0.3.0-incubating > UnboundedSourceWrapper snapshotting

[jira] [Commented] (BEAM-333) Support "stop" for streaming pipelines

2016-09-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477146#comment-15477146 ] ASF GitHub Bot commented on BEAM-333: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request #927: [BEAM-619] keep track of local split sourc...

2016-09-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/927 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #924: [BEAM-333][flink] make unbounded sources s...

2016-09-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/924 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/5] incubator-beam git commit: [BEAM-333][flink] make bounded/unbounded sources stoppable

2016-09-09 Thread mxm
[BEAM-333][flink] make bounded/unbounded sources stoppable Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7e2820b0 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7e2820b0 Diff:

[1/5] incubator-beam git commit: [BEAM-619] keep track of local split sources in UnboundedSourceWrapper

2016-09-09 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master a96ea98a4 -> b6205ffa3 [BEAM-619] keep track of local split sources in UnboundedSourceWrapper Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[5/5] incubator-beam git commit: This closes #927

2016-09-09 Thread mxm
This closes #927 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b6205ffa Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b6205ffa Diff:

[4/5] incubator-beam git commit: [BEAM-619] extend test case to be parameterized

2016-09-09 Thread mxm
[BEAM-619] extend test case to be parameterized - extend test case with number of tasks and splits parameters Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/4afd25a7 Tree:

[3/5] incubator-beam git commit: This closes #924

2016-09-09 Thread mxm
This closes #924 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c78db9ad Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c78db9ad Diff:

[jira] [Closed] (BEAM-617) Allow setting of StateBackend on FlinkPipelineOptions

2016-09-09 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels closed BEAM-617. --- Resolution: Fixed Fix Version/s: 0.3.0-incubating > Allow setting of StateBackend on

[jira] [Commented] (BEAM-617) Allow setting of StateBackend on FlinkPipelineOptions

2016-09-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477127#comment-15477127 ] ASF GitHub Bot commented on BEAM-617: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request #923: [BEAM-617][flink] introduce option to set ...

2016-09-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/923 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #928: [flink] use exploded WindowValue in FlinkD...

2016-09-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/928 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/4] incubator-beam git commit: [BEAM-617][flink] introduce option to set state backend

2016-09-09 Thread mxm
[BEAM-617][flink] introduce option to set state backend Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d4f85912 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d4f85912 Diff:

[1/4] incubator-beam git commit: [flink] use exploded WindowValue in FlinkDoFnFunction

2016-09-09 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master 817515fe4 -> a96ea98a4 [flink] use exploded WindowValue in FlinkDoFnFunction Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3461ce21 Tree:

[3/4] incubator-beam git commit: This closes #923

2016-09-09 Thread mxm
This closes #923 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/0399dbc7 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/0399dbc7 Diff:

[4/4] incubator-beam git commit: This closes #928

2016-09-09 Thread mxm
This closes #928 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a96ea98a Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a96ea98a Diff:

[jira] [Created] (BEAM-621) Add MapValues and MapKeys functions

2016-09-09 Thread JIRA
Jean-Baptiste Onofré created BEAM-621: - Summary: Add MapValues and MapKeys functions Key: BEAM-621 URL: https://issues.apache.org/jira/browse/BEAM-621 Project: Beam Issue Type: New