[jira] [Commented] (BEAM-1293) Python post commits failing

2017-01-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832870#comment-15832870 ] ASF GitHub Bot commented on BEAM-1293: -- GitHub user aaltay opened a pull request:

[GitHub] beam pull request #1809: [BEAM-1293] Update DataflowPipelineResult.state at ...

2017-01-20 Thread aaltay
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/1809 [BEAM-1293] Update DataflowPipelineResult.state at the end of poll_for_job_completion https://github.com/apache/beam/pull/1802 exposed a bug in `poll_for_job_completion`. At the end of the wait the

Build failed in Jenkins: beam_PostCommit_Python_Verify #1059

2017-01-20 Thread Apache Jenkins Server
See Changes: [dhalperi] Clean *.pyc files with mvn clean. -- [...truncated 18927 lines...] } }, { "kind": "GroupByKey", "name": "s8",

Build failed in Jenkins: beam_PostCommit_Python_Verify #1058

2017-01-20 Thread Apache Jenkins Server
See Changes: [robertwb] Make TestPipeline.run fail when the underlying execution fails. [robertwb] DataflowRunner will raise an exception on failures. -- [...truncated 18920

[jira] [Commented] (BEAM-1288) `mvn verify` leaves .pyc files throughout source tree

2017-01-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832758#comment-15832758 ] ASF GitHub Bot commented on BEAM-1288: -- Github user aaltay closed the pull request at:

[GitHub] beam pull request #1806: [BEAM-1288] Clean *.pyc files with mvn clean.

2017-01-20 Thread aaltay
Github user aaltay closed the pull request at: https://github.com/apache/beam/pull/1806 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #1806

2017-01-20 Thread dhalperi
This closes #1806 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c03e6f37 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c03e6f37 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/c03e6f37 Branch:

[1/2] beam git commit: Clean *.pyc files with mvn clean.

2017-01-20 Thread dhalperi
Repository: beam Updated Branches: refs/heads/python-sdk 82599a241 -> c03e6f375 Clean *.pyc files with mvn clean. Added maven-clean-plugin configuration to clean artifacts generated by other phases of mvn. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[GitHub] beam-site pull request #129: [BEAM-751] Extract Python code snippets from te...

2017-01-20 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam-site/pull/129 [BEAM-751] Extract Python code snippets from tested examples. You can merge this pull request into a Git repository by running: $ git pull https://github.com/robertwb/incubator-beam-site

[jira] [Commented] (BEAM-59) IOChannelFactory rethinking/redesign

2017-01-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-59?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832733#comment-15832733 ] ASF GitHub Bot commented on BEAM-59: GitHub user peihe opened a pull request:

[GitHub] beam pull request #1808: [BEAM-59] Beam FileSystem: initial implementation.

2017-01-20 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/1808 [BEAM-59] Beam FileSystem: initial implementation. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[jira] [Commented] (BEAM-1100) Consider removing pylint from mvn verify

2017-01-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832726#comment-15832726 ] ASF GitHub Bot commented on BEAM-1100: -- GitHub user aaltay opened a pull request:

[GitHub] beam pull request #1807: [BEAM-1100] Skip pylint when running outside of a g...

2017-01-20 Thread aaltay
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/1807 [BEAM-1100] Skip pylint when running outside of a git repository. You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/incubator-beam pyl

Jenkins build is back to stable : beam_PostCommit_Java_RunnableOnService_Dataflow #2067

2017-01-20 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-1292) PubSubIO: throws error when configured with topic

2017-01-20 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1292: - Summary: PubSubIO: throws error when configured with topic Key: BEAM-1292 URL: https://issues.apache.org/jira/browse/BEAM-1292 Project: Beam Issue Type:

[jira] [Commented] (BEAM-974) Adds attributes support to PubsubIO

2017-01-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832565#comment-15832565 ] ASF GitHub Bot commented on BEAM-974: - Github user asfgit closed the pull request at:

[1/3] beam git commit: Add PubSub attributes support to PubsubIO.

2017-01-20 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master a6810372b -> c6e46b655 http://git-wip-us.apache.org/repos/asf/beam/blob/f032facb/sdks/java/core/src/test/java/org/apache/beam/sdk/io/PubsubUnboundedSinkTest.java -- diff

[3/4] beam git commit: A couple more examples.

2017-01-20 Thread robertwb
A couple more examples. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7e5dc400 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7e5dc400 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/7e5dc400 Branch:

[4/4] beam git commit: Closes #1764

2017-01-20 Thread robertwb
Closes #1764 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c57c66ed Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c57c66ed Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/c57c66ed Branch:

[2/4] beam git commit: Add a --fix option to the standard coder test that populates encodings.

2017-01-20 Thread robertwb
Add a --fix option to the standard coder test that populates encodings. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5c054aef Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5c054aef Diff:

[jira] [Commented] (BEAM-498) Make DoFnWithContext the new DoFn

2017-01-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832533#comment-15832533 ] ASF GitHub Bot commented on BEAM-498: - Github user asfgit closed the pull request at:

[3/4] beam git commit: Point to new Dataflow worker

2017-01-20 Thread kenn
ava/src/main/resources/org/apache/beam/runners/dataflow/dataflow.properties @@ -18,6 +18,6 @@ environment.major.version=6 -worker.image.batch=dataflow.gcr.io/v1beta3/beam-java-batch:beam-master-20170119 +worker.image.batch=dataflow.gcr.io/v1beta3/beam-java-batch:beam-master-20170120 -worker.ima

[2/4] beam git commit: Moves OldDoFn to runners-core

2017-01-20 Thread kenn
Moves OldDoFn to runners-core Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5f8b8c5b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5f8b8c5b Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/5f8b8c5b Branch:

[jira] [Commented] (BEAM-886) Support new DoFn in Python SDK

2017-01-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832500#comment-15832500 ] ASF GitHub Bot commented on BEAM-886: - Github user sb2nov closed the pull request at:

[GitHub] beam pull request #1782: [BEAM-886] Implement annotation based NewDoFn in Py...

2017-01-20 Thread sb2nov
Github user sb2nov closed the pull request at: https://github.com/apache/beam/pull/1782 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/4] beam git commit: DoFnSignature: deprecate isStateful in favor of usesState

2017-01-20 Thread kenn
Repository: beam Updated Branches: refs/heads/master eecbcc48b -> 77c7505b8 DoFnSignature: deprecate isStateful in favor of usesState Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ed434ecf Tree:

[3/4] beam git commit: Set USES_KEYED_STATE in Dataflow when DoFn uses timers

2017-01-20 Thread kenn
Set USES_KEYED_STATE in Dataflow when DoFn uses timers Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f535d658 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f535d658 Diff:

[jira] [Created] (BEAM-1290) Consider rehtrowing the original exception from the waitUntilFinish

2017-01-20 Thread Ahmet Altay (JIRA)
Ahmet Altay created BEAM-1290: - Summary: Consider rehtrowing the original exception from the waitUntilFinish Key: BEAM-1290 URL: https://issues.apache.org/jira/browse/BEAM-1290 Project: Beam

[jira] [Updated] (BEAM-1286) DataflowRunner handling of missing filesToStage

2017-01-20 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci updated BEAM-1286: --- Assignee: (was: Davor Bonaci) > DataflowRunner handling of missing filesToStage >

[jira] [Updated] (BEAM-1289) TextIO (and others) should provide more informative messages when encountering RVP

2017-01-20 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci updated BEAM-1289: --- Assignee: Sam McVeety (was: Davor Bonaci) > TextIO (and others) should provide more informative

[jira] [Commented] (BEAM-1056) Reference beam version only once in Archetypes

2017-01-20 Thread Tim Taschke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15831379#comment-15831379 ] Tim Taschke commented on BEAM-1056: --- Just to be sure: This is just about the archetypes in

[jira] [Commented] (BEAM-25) Add user-ready API for interacting with state

2017-01-20 Thread Jingsong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-25?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15831368#comment-15831368 ] Jingsong Lee commented on BEAM-25: -- Are there plans to support StatefulCombineFn? eg: select itemId,

[jira] [Created] (BEAM-1288) `mvn verify` leaves .pyc files throughout source tree

2017-01-20 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1288: - Summary: `mvn verify` leaves .pyc files throughout source tree Key: BEAM-1288 URL: https://issues.apache.org/jira/browse/BEAM-1288 Project: Beam Issue

[jira] [Commented] (BEAM-1100) Consider removing pylint from mvn verify

2017-01-20 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15831361#comment-15831361 ] Daniel Halperin commented on BEAM-1100: --- Just ran into this issue now. To be included in a Beam