[GitHub] incubator-beam pull request #1339: [BEAM-310] Actually Split Root Transforms

2016-11-10 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1339 [BEAM-310] Actually Split Root Transforms Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[GitHub] incubator-beam pull request #1340: [BEAM-962] Fix games example pipeline opt...

2016-11-10 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1340 [BEAM-962] Fix games example pipeline options default values conflicts. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ]

[GitHub] incubator-beam pull request #1338: [BEAM-664] Update examples archetype

2016-11-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1338 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Created] (BEAM-960) JdbcIO should infer coder based on RowMapper when possible

2016-11-10 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-960: Summary: JdbcIO should infer coder based on RowMapper when possible Key: BEAM-960 URL: https://issues.apache.org/jira/browse/BEAM-960 Project: Beam Issue

[jira] [Updated] (BEAM-958) desiredNumWorkers in Dataflow is too low

2016-11-10 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated BEAM-958: -- Labels: breaking_change (was: ) > desiredNumWorkers in Dataflow is too low >

Re: [jira] [Created] (BEAM-961) CountingInput could have starting number

2016-11-10 Thread Dan Halperin
Why not support this in a follow-on pardo that shifts the range? On Thu, Nov 10, 2016 at 1:22 PM, Kenneth Knowles (JIRA) wrote: > Kenneth Knowles created BEAM-961: > > > Summary: CountingInput could have starting number >

[1/2] incubator-beam git commit: [BEAM-944] Spark runner causes an exception when creating pipeline options. Create a SparkContextOptions for context-ware options.

2016-11-10 Thread amitsela
Repository: incubator-beam Updated Branches: refs/heads/master cd3f61cf8 -> e43a38355 [BEAM-944] Spark runner causes an exception when creating pipeline options. Create a SparkContextOptions for context-ware options. Move UsesProvidedSparkContext property to SparkPipelineOptions so it's

[jira] [Commented] (BEAM-944) Spark runner causes an exception when creating pipeline options

2016-11-10 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655240#comment-15655240 ] Pei He commented on BEAM-944: - Filed https://issues.apache.org/jira/browse/BEAM-962 And, I will send a PR soon.

[2/2] incubator-beam git commit: This closes #1316

2016-11-10 Thread amitsela
This closes #1316 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/e43a3835 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/e43a3835 Diff:

[GitHub] incubator-beam pull request #1316: [BEAM-944] Spark runner causes an excepti...

2016-11-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1316 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Created] (BEAM-962) Fix games example pipeline options default values conflicts.

2016-11-10 Thread Pei He (JIRA)
Pei He created BEAM-962: --- Summary: Fix games example pipeline options default values conflicts. Key: BEAM-962 URL: https://issues.apache.org/jira/browse/BEAM-962 Project: Beam Issue Type: Bug

[2/2] incubator-beam git commit: Closes #1330

2016-11-10 Thread robertwb
Closes #1330 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/778194f2 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/778194f2 Diff:

[1/2] incubator-beam git commit: Remove tox cache from previous workspace

2016-11-10 Thread robertwb
Repository: incubator-beam Updated Branches: refs/heads/python-sdk ec00c530c -> 778194f22 Remove tox cache from previous workspace Jenkins doesn't cleanup the previous workspace, and since .tox is in the gitignore, we must explicitly delete it. Project:

[2/4] incubator-beam git commit: Remove OnTimerInvokers.INSTANCE; deprecate DoFnInvokers.INSTANCE

2016-11-10 Thread kenn
Remove OnTimerInvokers.INSTANCE; deprecate DoFnInvokers.INSTANCE Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/14a71e43 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/14a71e43 Diff:

[1/4] incubator-beam git commit: Remove OnTimerInvokers.INSTANCE; deprecate DoFnInvokers.INSTANCE

2016-11-10 Thread kenn
Repository: incubator-beam Updated Branches: refs/heads/master f7745dc29 -> 3f8db06bd http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/14a71e43/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/reflect/DoFnInvokers.java

[jira] [Commented] (BEAM-664) Port Dataflow SDK WordCount walkthrough to Beam site

2016-11-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655006#comment-15655006 ] ASF GitHub Bot commented on BEAM-664: - GitHub user kennknowles opened a pull request:

[jira] [Updated] (BEAM-958) desiredNumWorkers in Dataflow is too low

2016-11-10 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-958: - Labels: backward-incompatible (was: breaking_change) > desiredNumWorkers in Dataflow is too low >

[jira] [Commented] (BEAM-944) Spark runner causes an exception when creating pipeline options

2016-11-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655237#comment-15655237 ] ASF GitHub Bot commented on BEAM-944: - Github user asfgit closed the pull request at:

[1/4] incubator-beam git commit: fixup! Add script

2016-11-10 Thread kenn
Repository: incubator-beam Updated Branches: refs/heads/master e43a38355 -> 503b40717 fixup! Add script Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/cd5eca8d Tree:

[4/4] incubator-beam git commit: This closes #1338

2016-11-10 Thread kenn
This closes #1338 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/503b4071 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/503b4071 Diff:

[3/4] incubator-beam git commit: Add script to update examples archetype automatically

2016-11-10 Thread kenn
Add script to update examples archetype automatically Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9f78c443 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/9f78c443 Diff:

[2/4] incubator-beam git commit: Update examples archetype to match examples

2016-11-10 Thread kenn
Update examples archetype to match examples Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1e132ee8 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/1e132ee8 Diff:

[jira] [Commented] (BEAM-664) Port Dataflow SDK WordCount walkthrough to Beam site

2016-11-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655301#comment-15655301 ] ASF GitHub Bot commented on BEAM-664: - Github user asfgit closed the pull request at:

[jira] [Created] (BEAM-958) desiredNumWorkers in Dataflow is too low

2016-11-10 Thread Raghu Angadi (JIRA)
Raghu Angadi created BEAM-958: - Summary: desiredNumWorkers in Dataflow is too low Key: BEAM-958 URL: https://issues.apache.org/jira/browse/BEAM-958 Project: Beam Issue Type: Improvement

[2/2] incubator-beam git commit: This closes #1336

2016-11-10 Thread davor
This closes #1336 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/cd3f61cf Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/cd3f61cf Diff:

[jira] [Commented] (BEAM-939) New credentials code broke Dataflow runner

2016-11-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655094#comment-15655094 ] ASF GitHub Bot commented on BEAM-939: - Github user asfgit closed the pull request at:

[1/2] incubator-beam git commit: Update BigtableWriteIT to set Credentials

2016-11-10 Thread davor
Repository: incubator-beam Updated Branches: refs/heads/master aec7a0a76 -> cd3f61cf8 Update BigtableWriteIT to set Credentials Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/97c883de Tree:

[GitHub] incubator-beam pull request #1336: [BEAM-939] Update BigtableWriteIT to set ...

2016-11-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1336 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Resolved] (BEAM-944) Spark runner causes an exception when creating pipeline options

2016-11-10 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela resolved BEAM-944. Resolution: Fixed > Spark runner causes an exception when creating pipeline options >

Re: [jira] [Created] (BEAM-961) CountingInput could have starting number

2016-11-10 Thread Kenneth Knowles
I'm not particular about whether the source itself does it versus replacing uses of the source with a new PTransform encapsulating them. As long as there is some object with `startingAt` and `upTo`. Either way should be easy? Left it with starter tag as it would potentially be a fun initial dive

[GitHub] incubator-beam pull request #1342: [BEAM-802] -- Add ability to stage a job ...

2016-11-10 Thread mariapython
GitHub user mariapython opened a pull request: https://github.com/apache/incubator-beam/pull/1342 [BEAM-802] -- Add ability to stage a job and/or stop the execution Modify create_job to allow staging the job and not submitting it to the service. - Modularize create_job in

[jira] [Commented] (BEAM-802) Support Dynamic PipelineOptions for python

2016-11-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655314#comment-15655314 ] ASF GitHub Bot commented on BEAM-802: - GitHub user mariapython opened a pull request:

[jira] [Commented] (BEAM-962) Fix games example pipeline options default values conflicts.

2016-11-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655330#comment-15655330 ] ASF GitHub Bot commented on BEAM-962: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request #1340: [BEAM-962] Fix games example pipeline opt...

2016-11-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1340 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

Jenkins build is unstable: beam_PostCommit_MavenVerify #1787

2016-11-10 Thread Apache Jenkins Server
See

[2/2] incubator-beam git commit: This closes #1340

2016-11-10 Thread davor
This closes #1340 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f7745dc2 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/f7745dc2 Diff:

[GitHub] incubator-beam pull request #1343: Support @ValidatesRunner(RunnableOnServic...

2016-11-10 Thread markflyhigh
GitHub user markflyhigh opened a pull request: https://github.com/apache/incubator-beam/pull/1343 Support @ValidatesRunner(RunnableOnService) in Python Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the

[GitHub] incubator-beam pull request #1338: [BEAM-664] Update examples archetype

2016-11-10 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/incubator-beam/pull/1338 [BEAM-664] Update examples archetype Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title is

[jira] [Commented] (BEAM-958) desiredNumWorkers in Dataflow is too low

2016-11-10 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655020#comment-15655020 ] Raghu Angadi commented on BEAM-958: --- A change to this policy can break Dataflow job update depending the

[jira] [Updated] (BEAM-958) desiredNumWorkers in Dataflow is too low

2016-11-10 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci updated BEAM-958: -- Assignee: Raghu Angadi (was: Davor Bonaci) > desiredNumWorkers in Dataflow is too low >

[1/2] incubator-beam git commit: [BEAM-962] Fix games example pipeline options default values conflicts.

2016-11-10 Thread davor
Repository: incubator-beam Updated Branches: refs/heads/master 503b40717 -> f7745dc29 [BEAM-962] Fix games example pipeline options default values conflicts. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[jira] [Commented] (BEAM-856) IO test should use a free port for embedded resource instance

2016-11-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655373#comment-15655373 ] ASF GitHub Bot commented on BEAM-856: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request #1344: [BEAM-194] Add Java 8 examples archetype ...

2016-11-10 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/incubator-beam/pull/1344 [BEAM-194] Add Java 8 examples archetype including mobile gaming example, with generator script Be sure to do all of the following to help us incorporate your contribution quickly

[jira] [Commented] (BEAM-194) Create a walkthrough of Beam examples in mobile gaming domain

2016-11-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655453#comment-15655453 ] ASF GitHub Bot commented on BEAM-194: - GitHub user kennknowles opened a pull request:

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_SparkLocal #113

2016-11-10 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-944) Spark runner causes an exception when creating pipeline options

2016-11-10 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655172#comment-15655172 ] Davor Bonaci commented on BEAM-944: --- Looks like another, unrelated regression. [~pei...@gmail.com], can

[jira] [Updated] (BEAM-960) JdbcIO should infer coder when possible (such as via RowMapper)

2016-11-10 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-960: - Summary: JdbcIO should infer coder when possible (such as via RowMapper) (was: JdbcIO should infer

[GitHub] incubator-beam pull request #1341: Simplify FileOperations interface by refa...

2016-11-10 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1341 Simplify FileOperations interface by refactoring removeDirectoryAndFiles() into FileBasedSink. Be sure to do all of the following to help us incorporate your contribution quickly and

[GitHub] incubator-beam pull request #1262: [BEAM-856] Use free network port for the ...

2016-11-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1262 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: This closes #1262

2016-11-10 Thread davor
This closes #1262 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/48917845 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/48917845 Diff:

[jira] [Updated] (BEAM-688) Failure of beam-sdks-java-maven-archetypes-starter with undeclared dependency error

2016-11-10 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-688: - Priority: Major (was: Minor) > Failure of beam-sdks-java-maven-archetypes-starter with undeclared

[jira] [Updated] (BEAM-688) Failure of beam-sdks-java-maven-archetypes-starter with undeclared dependency error

2016-11-10 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-688: - Description: The starter archetype has flaky dependencies. It is reported to fail reliably on

[jira] [Updated] (BEAM-912) Range join in Beam

2016-11-10 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-912: - Assignee: Frances Perry (was: Kenneth Knowles) > Range join in Beam > -- > >

[jira] [Resolved] (BEAM-947) WindowedWordCountIT fails due to not setting "--output" pipeline options

2016-11-10 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-947. -- Resolution: Fixed Fix Version/s: 0.4.0-incubating > WindowedWordCountIT fails due to not

[jira] [Resolved] (BEAM-922) runner-core does not pass under findbugs

2016-11-10 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-922. -- Resolution: Fixed Fix Version/s: 0.4.0-incubating > runner-core does not pass under

[jira] [Commented] (BEAM-960) JdbcIO should infer coder when possible (such as via RowMapper)

2016-11-10 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656256#comment-15656256 ] Jean-Baptiste Onofré commented on BEAM-960: --- Thanks [~kenn], it makes sense. I will do the

[jira] [Assigned] (BEAM-959) JdbcIO validation messages need improvement

2016-11-10 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré reassigned BEAM-959: - Assignee: Jean-Baptiste Onofré (was: James Malone) > JdbcIO validation messages

[GitHub] incubator-beam pull request #1347: [BEAM-25] Allow stateful DoFn. Implement ...

2016-11-10 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/incubator-beam/pull/1347 [BEAM-25] Allow stateful DoFn. Implement for DirectRunner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure

[jira] [Assigned] (BEAM-960) JdbcIO should infer coder when possible (such as via RowMapper)

2016-11-10 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré reassigned BEAM-960: - Assignee: Jean-Baptiste Onofré (was: James Malone) > JdbcIO should infer coder

Jenkins build is back to stable : beam_PostCommit_RunnableOnService_SparkLocal #117

2016-11-10 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-688) Repeated 'mvn install' fails on beam-sdks-java-maven-archetypes-starter with undeclared dependency error

2016-11-10 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656070#comment-15656070 ] Kenneth Knowles commented on BEAM-688: -- I don't believe it has to be repeated. It causes flakes on

[jira] [Updated] (BEAM-688) Failure of beam-sdks-java-maven-archetypes-starter with undeclared dependency error

2016-11-10 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-688: - Summary: Failure of beam-sdks-java-maven-archetypes-starter with undeclared dependency error (was:

[jira] [Updated] (BEAM-912) Range join in Beam

2016-11-10 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-912: - Assignee: (was: Frances Perry) > Range join in Beam > -- > >

[GitHub] incubator-beam pull request #1345: [BEAM-945] Make BigQueryIO.parseTableSpec...

2016-11-10 Thread andrewsmartin
GitHub user andrewsmartin opened a pull request: https://github.com/apache/incubator-beam/pull/1345 [BEAM-945] Make BigQueryIO.parseTableSpec public Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[jira] [Commented] (BEAM-945) BigQueryIO.parseTableSpec is package-private

2016-11-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655595#comment-15655595 ] ASF GitHub Bot commented on BEAM-945: - GitHub user andrewsmartin opened a pull request:

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_SparkLocal #115

2016-11-10 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_MavenVerify #1789

2016-11-10 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_SparkLocal #116

2016-11-10 Thread Apache Jenkins Server
See

[GitHub] incubator-beam pull request #1346: DirectPipelineRunner bug fixes

2016-11-10 Thread aaltay
GitHub user aaltay opened a pull request: https://github.com/apache/incubator-beam/pull/1346 DirectPipelineRunner bug fixes - Execute empty [] | pipelines to the end. - use pickler to serialize/deserialize DoFns instead of deepcopy similar to the othe execution environments.

Jenkins build is still unstable: beam_PostCommit_MavenVerify #1788

2016-11-10 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-959) JdbcIO validation messages need improvement

2016-11-10 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-959: Summary: JdbcIO validation messages need improvement Key: BEAM-959 URL: https://issues.apache.org/jira/browse/BEAM-959 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-958) desiredNumWorkers in Dataflow is too low

2016-11-10 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-958: - Affects Version/s: (was: 0.3.0-incubating) > desiredNumWorkers in Dataflow is too low >

[jira] [Updated] (BEAM-958) desiredNumWorkers in Dataflow is too low

2016-11-10 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-958: - Affects Version/s: Not applicable > desiredNumWorkers in Dataflow is too low >

[jira] [Created] (BEAM-961) CountingInput could have starting number

2016-11-10 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-961: Summary: CountingInput could have starting number Key: BEAM-961 URL: https://issues.apache.org/jira/browse/BEAM-961 Project: Beam Issue Type: New Feature

[jira] [Commented] (BEAM-310) Exercise splitIntoBundles/generateInitialSplits in the Direct Runner

2016-11-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655261#comment-15655261 ] ASF GitHub Bot commented on BEAM-310: - GitHub user tgroh opened a pull request:

[jira] [Commented] (BEAM-962) Fix games example pipeline options default values conflicts.

2016-11-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655280#comment-15655280 ] ASF GitHub Bot commented on BEAM-962: - GitHub user peihe opened a pull request:

[GitHub] incubator-beam pull request #1309: [BEAM-941] Refactor DoFnSignatures & DoFn...

2016-11-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1309 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[3/4] incubator-beam git commit: Remove DoFnSignatures.INSTANCE

2016-11-10 Thread kenn
Remove DoFnSignatures.INSTANCE Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/efad9d47 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/efad9d47 Diff:

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_SparkLocal #114

2016-11-10 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-747) Text checksum verifier is not resilient to eventually consistent filesystems

2016-11-10 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655332#comment-15655332 ] Kenneth Knowles commented on BEAM-747: -- While we wait to get a reliable fix in, there are only a few

[jira] [Updated] (BEAM-953) Consider moving control of output location out of WordCountIT and WindowedWordCountIT

2016-11-10 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci updated BEAM-953: -- Priority: Major (was: Minor) > Consider moving control of output location out of WordCountIT and >

[jira] [Commented] (BEAM-941) Replace Xyz.INSTANCE throughout the SDK with either static methods or XyzFactory.default()

2016-11-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655338#comment-15655338 ] ASF GitHub Bot commented on BEAM-941: - Github user asfgit closed the pull request at:

[1/2] incubator-beam git commit: [BEAM-856] Use free network port for the Derby test instance

2016-11-10 Thread davor
Repository: incubator-beam Updated Branches: refs/heads/master 3f8db06bd -> 48917845b [BEAM-856] Use free network port for the Derby test instance Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/67215786

[jira] [Issue Comment Deleted] (BEAM-891) Flake in Spark metrics library?

2016-11-10 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela updated BEAM-891: --- Comment: was deleted (was: My best guess for what causes the race condition is the fact that Spark Master

[jira] [Comment Edited] (BEAM-891) Flake in Spark metrics library?

2016-11-10 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15654002#comment-15654002 ] Amit Sela edited comment on BEAM-891 at 11/10/16 1:27 PM: -- This seems to be the

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_SparkLocal #107

2016-11-10 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-891) Flake in Spark metrics library?

2016-11-10 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15653971#comment-15653971 ] Amit Sela commented on BEAM-891: My best guess for what causes the race condition is the fact that Spark

[jira] [Comment Edited] (BEAM-891) Flake in Spark metrics library?

2016-11-10 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15653971#comment-15653971 ] Amit Sela edited comment on BEAM-891 at 11/10/16 12:52 PM: --- My best guess for what

[GitHub] incubator-beam pull request #1333: remove artefact after implementation side...

2016-11-10 Thread xhumanoid
GitHub user xhumanoid opened a pull request: https://github.com/apache/incubator-beam/pull/1333 remove artefact after implementation sideOutput in flink after implementation sideOutput in flink still exist System.out.println on console You can merge this pull request into a Git

[jira] [Commented] (BEAM-891) Flake in Spark metrics library?

2016-11-10 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15654002#comment-15654002 ] Amit Sela commented on BEAM-891: This seems to be the race:

[jira] [Closed] (BEAM-931) Findbugs doesn't pass in Flink runner

2016-11-10 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-931. - Resolution: Fixed Fix Version/s: 0.4.0-incubating > Findbugs doesn't pass in Flink runner >

[jira] [Commented] (BEAM-931) Findbugs doesn't pass in Flink runner

2016-11-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15653595#comment-15653595 ] ASF GitHub Bot commented on BEAM-931: - Github user aljoscha closed the pull request at:

[GitHub] incubator-beam pull request #1332: Trying to fix BEAM-891, which makes the b...

2016-11-10 Thread staslev
GitHub user staslev opened a pull request: https://github.com/apache/incubator-beam/pull/1332 Trying to fix BEAM-891, which makes the build occasionally fail on In… Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ]

[jira] [Commented] (BEAM-891) Flake in Spark metrics library?

2016-11-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15653827#comment-15653827 ] ASF GitHub Bot commented on BEAM-891: - GitHub user staslev opened a pull request:

[jira] [Created] (BEAM-956) Execute ReduceFnRunner Directly in Flink Runner

2016-11-10 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-956: - Summary: Execute ReduceFnRunner Directly in Flink Runner Key: BEAM-956 URL: https://issues.apache.org/jira/browse/BEAM-956 Project: Beam Issue Type:

[jira] [Commented] (BEAM-944) Spark runner causes an exception when creating pipeline options

2016-11-10 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15653903#comment-15653903 ] Amit Sela commented on BEAM-944: [~davor] I tried reproducing (on master) the failure with the java8

[1/2] incubator-beam git commit: [BEAM-931] Fix Findbugs Warnings in Flink Runner

2016-11-10 Thread aljoscha
Repository: incubator-beam Updated Branches: refs/heads/master ef750c0f8 -> 66faf74d0 [BEAM-931] Fix Findbugs Warnings in Flink Runner Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a609a19e Tree:

[2/2] incubator-beam git commit: This closes #1311

2016-11-10 Thread aljoscha
This closes #1311 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/66faf74d Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/66faf74d Diff:

[GitHub] incubator-beam pull request #1311: [BEAM-931] Fix Findbugs Warnings in Flink...

2016-11-10 Thread aljoscha
Github user aljoscha closed the pull request at: https://github.com/apache/incubator-beam/pull/1311 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

Jenkins build is still unstable: beam_PostCommit_MavenVerify #1778

2016-11-10 Thread Apache Jenkins Server
See

  1   2   >