Build failed in Jenkins: beam_PerformanceTests_Python #44

2017-06-30 Thread Apache Jenkins Server
See Changes: [tgroh] Add a Combine Test for Sliding Windows without Context [mairbek] Ditch apache commons [sisk] GCP IO ITs now all use --project option [sisk] Don't call .testingPipelineOptions()

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Dataflow #3485

2017-06-30 Thread Apache Jenkins Server
See -- [...truncated 955.67 KB...] 2017-06-30T06:08:13.833 [INFO]

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2520

2017-06-30 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2546) Create InfluxDbIO

2017-06-30 Thread JIRA
Jean-Baptiste Onofré created BEAM-2546: -- Summary: Create InfluxDbIO Key: BEAM-2546 URL: https://issues.apache.org/jira/browse/BEAM-2546 Project: Beam Issue Type: New Feature

[jira] [Commented] (BEAM-2515) BeamSql: refactor the MockedBeamSqlTable and related tests

2017-06-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069635#comment-16069635 ] ASF GitHub Bot commented on BEAM-2515: -- GitHub user xumingming opened a pull request:

[GitHub] beam pull request #3478: [BEAM-2515] BeamSql: refactor the MockedBeamSqlTabl...

2017-06-30 Thread xumingming
GitHub user xumingming opened a pull request: https://github.com/apache/beam/pull/3478 [BEAM-2515] BeamSql: refactor the MockedBeamSqlTable and related tests Summary: * rename `MockedBeamSqlTable` to `MockedBoundedTable` * Use the `RowsBuilder` to build rows in Unit

[jira] [Commented] (BEAM-2140) Fix SplittableDoFn ValidatesRunner tests in FlinkRunner

2017-06-30 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069802#comment-16069802 ] Aljoscha Krettek commented on BEAM-2140: Yep, in the Flink Runner the processing path for

[jira] [Commented] (BEAM-79) Gearpump runner

2017-06-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-79?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069701#comment-16069701 ] ASF GitHub Bot commented on BEAM-79: GitHub user manuzhang opened a pull request:

[GitHub] beam pull request #3479: [BEAM-79] Merge master into gearpump-runner branch

2017-06-30 Thread manuzhang
GitHub user manuzhang opened a pull request: https://github.com/apache/beam/pull/3479 [BEAM-79] Merge master into gearpump-runner branch Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Spark #2521

2017-06-30 Thread Apache Jenkins Server
See -- [...truncated 493.92 KB...] 2017-06-30T09:09:13.257 [INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.792 s - in

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4273

2017-06-30 Thread Apache Jenkins Server
See -- [...truncated 652.39 KB...] 2017-06-30T12:22:16.316 [INFO] Downloaded:

Build failed in Jenkins: beam_PerformanceTests_Python #45

2017-06-30 Thread Apache Jenkins Server
See -- Started by timer [EnvInject] - Loading node environment variables. Building remotely on beam7 (beam) in workspace

[GitHub] beam pull request #3480: [BEAM-2140] Execute Splittable DoFn directly in Fli...

2017-06-30 Thread aljoscha
GitHub user aljoscha opened a pull request: https://github.com/apache/beam/pull/3480 [BEAM-2140] Execute Splittable DoFn directly in Flink Runner Before, we were using ProcessFn. This was causing problems with the Flink Runner for two reasons: 1. StatefulDoFnRunner is

[jira] [Commented] (BEAM-2140) Fix SplittableDoFn ValidatesRunner tests in FlinkRunner

2017-06-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16070150#comment-16070150 ] ASF GitHub Bot commented on BEAM-2140: -- GitHub user aljoscha opened a pull request:

Jenkins build is unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3486

2017-06-30 Thread Apache Jenkins Server
See

Jenkins build is unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2522

2017-06-30 Thread Apache Jenkins Server
See

[GitHub] beam pull request #3481: [BEAM-2528] BeamSql: DDL: create table

2017-06-30 Thread xumingming
GitHub user xumingming opened a pull request: https://github.com/apache/beam/pull/3481 [BEAM-2528] BeamSql: DDL: create table I started this PR as an initial attempt to implement the `create table` statement. The implementation might not be so mature, but I hope this could be a

[jira] [Commented] (BEAM-1348) Model the Fn Api

2017-06-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16070450#comment-16070450 ] ASF GitHub Bot commented on BEAM-1348: -- GitHub user lukecwik opened a pull request:

[2/2] beam git commit: Properly convert milliseconds whether there's less than 3/more than 9 digits.

2017-06-30 Thread lcwik
Properly convert milliseconds whether there's less than 3/more than 9 digits. This closes #3469 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f75dfe71 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f75dfe71 Diff:

[1/2] beam git commit: Properly convert milliseconds whether there's less than 3/more than 9 digits. TimeUtil did not properly convert (and returned null) when the number of digits for fractions of se

2017-06-30 Thread lcwik
Repository: beam Updated Branches: refs/heads/master 893bf428a -> f75dfe711 Properly convert milliseconds whether there's less than 3/more than 9 digits. TimeUtil did not properly convert (and returned null) when the number of digits for fractions of seconds was less than 3 digits or more than

[GitHub] beam pull request #3469: Properly convert milliseconds whether there's less ...

2017-06-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3469 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3482: [BEAM-1348] Remove deprecated concepts in Fn API (n...

2017-06-30 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3482 [BEAM-1348] Remove deprecated concepts in Fn API (now replaced with Runner API concepts). Be sure to do all of the following to help us incorporate your contribution quickly and easily:

[jira] [Commented] (BEAM-2532) BigQueryIO source should avoid expensive JSON schema parsing for every record

2017-06-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16070428#comment-16070428 ] Eugene Kirpichov commented on BEAM-2532: [~reuvenlax] I think you had some thoughts about how to

[13/50] beam git commit: Use PCollectionViews.toAdditionalInputs in ParDo

2017-06-30 Thread kenn
Use PCollectionViews.toAdditionalInputs in ParDo Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ed476dd2 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ed476dd2 Diff:

[39/50] beam git commit: This closes #3471

2017-06-30 Thread kenn
This closes #3471 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ae3a7526 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ae3a7526 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/ae3a7526 Branch:

[10/50] beam git commit: Use PCollectionViews.toAdditionalInputs in ParDoMultiOverrideFactory

2017-06-30 Thread kenn
Use PCollectionViews.toAdditionalInputs in ParDoMultiOverrideFactory Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/42382766 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/42382766 Diff:

[03/50] beam git commit: [BEAM-1187] Improve logging to contain the number of retries done due to IOException and unsuccessful response codes.

2017-06-30 Thread kenn
[BEAM-1187] Improve logging to contain the number of retries done due to IOException and unsuccessful response codes. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/03741ba0 Tree:

[11/50] beam git commit: Fix getAdditionalInputs for SplittableParDo transforms

2017-06-30 Thread kenn
Fix getAdditionalInputs for SplittableParDo transforms Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a66bcd68 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a66bcd68 Diff:

[41/50] beam git commit: [BEAM-2373] Upgrade commons-compress dependency version to 1.14

2017-06-30 Thread kenn
[BEAM-2373] Upgrade commons-compress dependency version to 1.14 This closes #3252 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/36900731 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/36900731 Diff:

[15/50] beam git commit: [BEAM-2488] Elasticsearch IO should read also in replica shards

2017-06-30 Thread kenn
[BEAM-2488] Elasticsearch IO should read also in replica shards Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b1ed9757 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b1ed9757 Diff:

[07/50] beam git commit: Read api with naive implementation

2017-06-30 Thread kenn
Read api with naive implementation Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a21a6d79 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a21a6d79 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/a21a6d79

[35/50] beam git commit: Ditch apache commons

2017-06-30 Thread kenn
Ditch apache commons Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/39a2ed0c Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/39a2ed0c Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/39a2ed0c Branch:

[34/50] beam git commit: This closes #3454

2017-06-30 Thread kenn
This closes #3454 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2dd1907c Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2dd1907c Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/2dd1907c Branch:

[01/50] beam git commit: This closes #3452

2017-06-30 Thread kenn
Repository: beam Updated Branches: refs/heads/gearpump-runner 99f4f8b1b -> 627ae0bc3 This closes #3452 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/beb21f47 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/beb21f47

[24/50] beam git commit: Closes #3466

2017-06-30 Thread kenn
Closes #3466 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0d4c85dd Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/0d4c85dd Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/0d4c85dd Branch:

[31/50] beam git commit: Only use ASCII 'a' through 'z' for temporary Spanner tables

2017-06-30 Thread kenn
Only use ASCII 'a' through 'z' for temporary Spanner tables Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/dbeba09b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/dbeba09b Diff:

[45/50] beam git commit: Don't call .testingPipelineOptions() a second time

2017-06-30 Thread kenn
Don't call .testingPipelineOptions() a second time Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ab7f6f6d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ab7f6f6d Diff:

[20/50] beam git commit: [BEAM-2389] moved GcpCoreApiSurfaceTest to corresponding module, adapted exposed packagees

2017-06-30 Thread kenn
[BEAM-2389] moved GcpCoreApiSurfaceTest to corresponding module, adapted exposed packagees This closes #3436 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1e16aa20 Tree:

[28/50] beam git commit: ReduceFnRunner.onTrigger: add short circuit for empty pane, and move inputWM and pane after the short circuit.

2017-06-30 Thread kenn
ReduceFnRunner.onTrigger: add short circuit for empty pane, and move inputWM and pane after the short circuit. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2efb0d56 Tree:

[33/50] beam git commit: Add PubSub I/O support to Python DirectRunner

2017-06-30 Thread kenn
Add PubSub I/O support to Python DirectRunner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/fb7ec28c Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/fb7ec28c Diff:

[37/50] beam git commit: This closes #3468

2017-06-30 Thread kenn
This closes #3468 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bf5aa1bc Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/bf5aa1bc Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/bf5aa1bc Branch:

[16/50] beam git commit: [BEAM-2488] This closes #3410

2017-06-30 Thread kenn
[BEAM-2488] This closes #3410 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6573e2ea Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/6573e2ea Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/6573e2ea Branch:

[40/50] beam git commit: [BEAM-2373] Upgrade commons-compress dependency version to 1.14

2017-06-30 Thread kenn
[BEAM-2373] Upgrade commons-compress dependency version to 1.14 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5744fa84 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5744fa84 Diff:

[22/50] beam git commit: Upgrade beam bigtable client dependency to 0.9.7.1

2017-06-30 Thread kenn
Upgrade beam bigtable client dependency to 0.9.7.1 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ed815be8 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ed815be8 Diff:

[12/50] beam git commit: Use PCollectionViews.toAdditionalInputs in Combine

2017-06-30 Thread kenn
Use PCollectionViews.toAdditionalInputs in Combine Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/27674f07 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/27674f07 Diff:

[04/50] beam git commit: [BEAM-1187] Improve logging to contain the number of retries done due to IOException and unsuccessful response codes

2017-06-30 Thread kenn
[BEAM-1187] Improve logging to contain the number of retries done due to IOException and unsuccessful response codes This closes #3430 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0b19fb41 Tree:

[02/50] beam git commit: Add WindowFn#assignsToOneWindow

2017-06-30 Thread kenn
Add WindowFn#assignsToOneWindow Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7fee4b93 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7fee4b93 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/7fee4b93 Branch:

[32/50] beam git commit: This closes #3459: [BEAM-2529] Only use ASCII a-z to generate Spanner database names

2017-06-30 Thread kenn
This closes #3459: [BEAM-2529] Only use ASCII a-z to generate Spanner database names Only use ASCII 'a' through 'z' for temporary Spanner tables Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4d41e25d Tree:

[43/50] beam git commit: This closes #3474

2017-06-30 Thread kenn
This closes #3474 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/99b5b056 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/99b5b056 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/99b5b056 Branch:

[21/50] beam git commit: Add a Combine Test for Sliding Windows without Context

2017-06-30 Thread kenn
Add a Combine Test for Sliding Windows without Context Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6ade8426 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/6ade8426 Diff:

[42/50] beam git commit: Select SDK distribution based on the selected SDK name

2017-06-30 Thread kenn
Select SDK distribution based on the selected SDK name Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/dc1dca86 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/dc1dca86 Diff:

[08/50] beam git commit: This closes #3395: [BEAM-1542] Cloud Spanner Source

2017-06-30 Thread kenn
This closes #3395: [BEAM-1542] Cloud Spanner Source Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e5929bd1 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e5929bd1 Diff:

[jira] [Commented] (BEAM-2484) Add streaming examples for Python

2017-06-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16070720#comment-16070720 ] ASF GitHub Bot commented on BEAM-2484: -- GitHub user davidcavazos opened a pull request:

[GitHub] beam pull request #3483: [BEAM-2484] Add Python mobile gaming streaming exam...

2017-06-30 Thread davidcavazos
GitHub user davidcavazos opened a pull request: https://github.com/apache/beam/pull/3483 [BEAM-2484] Add Python mobile gaming streaming examples Hi @aaltay, This adds leader_board.py and game_stats.py for streaming examples in the mobile game series. It also

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2523

2017-06-30 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2547) FireBase IO

2017-06-30 Thread Patrick Reames (JIRA)
Patrick Reames created BEAM-2547: Summary: FireBase IO Key: BEAM-2547 URL: https://issues.apache.org/jira/browse/BEAM-2547 Project: Beam Issue Type: New Feature Components:

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Flink #3294

2017-06-30 Thread Apache Jenkins Server
See

[48/50] beam git commit: This closes #3472: Remove Apache Commons dependency which DataflowRunner appears to not stage

2017-06-30 Thread kenn
This closes #3472: Remove Apache Commons dependency which DataflowRunner appears to not stage Ditch apache commons Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/893bf428 Tree:

[46/50] beam git commit: This closes #3465: [BEAM-2537] GCP IO ITs now all use --project option

2017-06-30 Thread kenn
This closes #3465: [BEAM-2537] GCP IO ITs now all use --project option Don't call .testingPipelineOptions() a second time GCP IO ITs now all use --project option Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/52cea71e

[23/50] beam git commit: This closes #3464: [BEAM-2533] Upgrade beam bigtable client dependency to 0.9.7.1

2017-06-30 Thread kenn
This closes #3464: [BEAM-2533] Upgrade beam bigtable client dependency to 0.9.7.1 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b47e41da Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b47e41da Diff:

[26/50] beam git commit: Removed OnceTriggerStateMachine

2017-06-30 Thread kenn
Removed OnceTriggerStateMachine Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4f9820b1 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/4f9820b1 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/4f9820b1 Branch:

[29/50] beam git commit: WindowingStrategy: add OnTimeBehavior to control whether to emit empty ON_TIME pane.

2017-06-30 Thread kenn
WindowingStrategy: add OnTimeBehavior to control whether to emit empty ON_TIME pane. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/38dd12df Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/38dd12df Diff:

[18/50] beam git commit: This closes #3458

2017-06-30 Thread kenn
This closes #3458 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/23a34f5d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/23a34f5d Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/23a34f5d Branch:

[38/50] beam git commit: Define the projectId in the SpannerIO Read Test (utest, not itest)

2017-06-30 Thread kenn
Define the projectId in the SpannerIO Read Test (utest, not itest) Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c6de4233 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c6de4233 Diff:

[36/50] beam git commit: Use SDK harness container for FnAPI jobs when worker_harness_container_image is not specified. Add a separate image tag to use with the SDK harness container.

2017-06-30 Thread kenn
Use SDK harness container for FnAPI jobs when worker_harness_container_image is not specified. Add a separate image tag to use with the SDK harness container. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f46a40c2 Tree:

[06/50] beam git commit: Bump spanner version

2017-06-30 Thread kenn
Bump spanner version Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/80c92636 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/80c92636 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/80c92636 Branch:

[49/50] beam git commit: Merge branch 'master' of https://github.com/apache/beam into sync-master

2017-06-30 Thread kenn
Merge branch 'master' of https://github.com/apache/beam into sync-master Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f1582570 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f1582570 Diff:

[05/50] beam git commit: Pre read api refactoring. Extract `SpannerConfig` and `AbstractSpannerFn`

2017-06-30 Thread kenn
Pre read api refactoring. Extract `SpannerConfig` and `AbstractSpannerFn` Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/454f1c42 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/454f1c42 Diff:

[GitHub] beam pull request #3479: [BEAM-79] Merge master into gearpump-runner branch

2017-06-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3479 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[25/50] beam git commit: Visit composite nodes when checking for picklability.

2017-06-30 Thread kenn
Visit composite nodes when checking for picklability. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/90cc2bcf Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/90cc2bcf Diff:

[14/50] beam git commit: This closes #3351: [BEAM-2371] Fix getAdditionInputs for SplittableParDo transforms

2017-06-30 Thread kenn
This closes #3351: [BEAM-2371] Fix getAdditionInputs for SplittableParDo transforms Use PCollectionViews.toAdditionalInputs in Combine Use PCollectionViews.toAdditionalInputs in ParDo Use PCollectionViews.toAdditionalInputs in ParDoMultiOverrideFactory Fix getAdditionalInputs for

[30/50] beam git commit: This closes #3446

2017-06-30 Thread kenn
This closes #3446 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/997bf402 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/997bf402 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/997bf402 Branch:

[19/50] beam git commit: [BEAM-2389] moved GcpCoreApiSurfaceTest to corresponding module, adapted exposed packagees

2017-06-30 Thread kenn
[BEAM-2389] moved GcpCoreApiSurfaceTest to corresponding module, adapted exposed packagees Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/fecd64f5 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/fecd64f5 Diff:

[47/50] beam git commit: This closes #3462: Add a Combine Test for Sliding Windows without Context

2017-06-30 Thread kenn
This closes #3462: Add a Combine Test for Sliding Windows without Context Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7fc73d79 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7fc73d79 Diff:

[27/50] beam git commit: This closes #3363: [BEAM-765] TriggerStateMachine does not need to be separate from OnceTriggerStateMachine

2017-06-30 Thread kenn
This closes #3363: [BEAM-765] TriggerStateMachine does not need to be separate from OnceTriggerStateMachine Removed OnceTriggerStateMachine Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b1ece019 Tree:

[09/50] beam git commit: Add utility to expand list of PCollectionViews

2017-06-30 Thread kenn
Add utility to expand list of PCollectionViews Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/58fba590 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/58fba590 Diff:

[jira] [Commented] (BEAM-79) Gearpump runner

2017-06-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-79?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16070757#comment-16070757 ] ASF GitHub Bot commented on BEAM-79: Github user asfgit closed the pull request at:

[jira] [Updated] (BEAM-2547) FireBase IO

2017-06-30 Thread Patrick Reames (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Reames updated BEAM-2547: - Description: Implement IO Source for Java and Python SDKs Work on this had previously been done

[jira] [Created] (BEAM-2548) Batching DoFn

2017-06-30 Thread Ahmet Altay (JIRA)
Ahmet Altay created BEAM-2548: - Summary: Batching DoFn Key: BEAM-2548 URL: https://issues.apache.org/jira/browse/BEAM-2548 Project: Beam Issue Type: New Feature Components: sdk-py

[1/2] beam git commit: UDAF support: - Adds an abstract class BeamSqlUdaf for defining Calcite SQL UDAFs. - Updates built-in COUNT/SUM/AVG/MAX/MIN accumulators to use this new class.

2017-06-30 Thread takidau
Repository: beam Updated Branches: refs/heads/DSL_SQL 2096da25e -> 7ba77dd43 UDAF support: - Adds an abstract class BeamSqlUdaf for defining Calcite SQL UDAFs. - Updates built-in COUNT/SUM/AVG/MAX/MIN accumulators to use this new class. Project:

[2/2] beam git commit: [BEAM-2287] This closes #3447

2017-06-30 Thread takidau
[BEAM-2287] This closes #3447 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7ba77dd4 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7ba77dd4 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/7ba77dd4 Branch:

[jira] [Created] (BEAM-2549) gcsio should set timeouts for http requests

2017-06-30 Thread Ahmet Altay (JIRA)
Ahmet Altay created BEAM-2549: - Summary: gcsio should set timeouts for http requests Key: BEAM-2549 URL: https://issues.apache.org/jira/browse/BEAM-2549 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-2545) bigtable e2e tests failing - UNKNOWN: Stale requests/Error mutating row

2017-06-30 Thread Stephen Sisk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Sisk updated BEAM-2545: --- Fix Version/s: (was: 2.1.0) > bigtable e2e tests failing - UNKNOWN: Stale requests/Error mutating

[jira] [Closed] (BEAM-2537) Can't run IO ITs - conflicting project vs projectId pipeline options

2017-06-30 Thread Stephen Sisk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Sisk closed BEAM-2537. -- Resolution: Fixed Fix Version/s: 2.1.0 PR submitted > Can't run IO ITs - conflicting project vs

[jira] [Resolved] (BEAM-2404) BigQueryIO reading stalls if no data is returned by query

2017-06-30 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-2404. --- Resolution: Not A Problem Fix Version/s: Not applicable > BigQueryIO reading stalls if no data

[GitHub] beam pull request #3485: Website Mergebot Job

2017-06-30 Thread jasonkuster
GitHub user jasonkuster opened a pull request: https://github.com/apache/beam/pull/3485 Website Mergebot Job Signed-off-by: Jason Kuster Be sure to do all of the following to help us incorporate your contribution quickly and easily: -

[jira] [Commented] (BEAM-2549) gcsio should set timeouts for http requests

2017-06-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16070907#comment-16070907 ] ASF GitHub Bot commented on BEAM-2549: -- GitHub user aaltay opened a pull request:

[1/2] beam git commit: Add support for PipelineOptions parameters

2017-06-30 Thread kenn
Repository: beam Updated Branches: refs/heads/master f75dfe711 -> 0e429b33f Add support for PipelineOptions parameters This is a step towards eliminating catch-all context parameters and making DoFns express their fine-grained data needs. Project:

[2/2] beam git commit: This closes #3355: Add support for PipelineOptions parameters

2017-06-30 Thread kenn
This closes #3355: Add support for PipelineOptions parameters Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0e429b33 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/0e429b33 Diff:

[jira] [Commented] (BEAM-1287) Give new DoFn the ability to output to a particular window

2017-06-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16070834#comment-16070834 ] ASF GitHub Bot commented on BEAM-1287: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3355: [BEAM-1287] Add support for PipelineOptions paramet...

2017-06-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3355 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3486: [BEAM-2549] For GCS operations use an http client w...

2017-06-30 Thread aaltay
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/3486 [BEAM-2549] For GCS operations use an http client with a default timeout value. R: @charlesccychen (cc: @sb2nov) Once this is in (and tested) we can consider removing the other timeout

[jira] [Commented] (BEAM-2230) Core SDK ApiSurface should be only org.apache.beam.sdk and should be defined outside of the general ApiSurface class

2017-06-30 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16070958#comment-16070958 ] Kenneth Knowles commented on BEAM-2230: --- What I meant is that {{ApiSurface}} should be a general way

[jira] [Commented] (BEAM-940) ByteBuddyOnTimerInvokerFactory: key the cache with a (Class, id) tuple or OnTimerMethod

2017-06-30 Thread Innocent (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16070987#comment-16070987 ] Innocent commented on BEAM-940: --- A pull request is opened for this [https://github.com/apache/beam/pull/3470]

[jira] [Commented] (BEAM-2545) bigtable e2e tests failing - UNKNOWN: Stale requests/Error mutating row

2017-06-30 Thread Stephen Sisk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16070838#comment-16070838 ] Stephen Sisk commented on BEAM-2545: Given that the tests have stabilized, we have decided not to bump

[jira] [Commented] (BEAM-2231) ApiSurface should be lazy

2017-06-30 Thread Innocent (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16070948#comment-16070948 ] Innocent commented on BEAM-2231: Hi Kenn, I looked a bit at the implementation of this class and found that

[jira] [Commented] (BEAM-2230) Core SDK ApiSurface should be only org.apache.beam.sdk and should be defined outside of the general ApiSurface class

2017-06-30 Thread Innocent (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16070955#comment-16070955 ] Innocent commented on BEAM-2230: Please Kenn, provide more info here, is it specialized because the way

Jenkins build is back to normal : beam_PostCommit_Java_MavenInstall #4274

2017-06-30 Thread Apache Jenkins Server
See

[jira] [Assigned] (BEAM-1287) Give new DoFn the ability to output to a particular window

2017-06-30 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-1287: - Assignee: Kenneth Knowles (was: Thomas Groh) > Give new DoFn the ability to output to a

[jira] [Commented] (BEAM-2272) Test scope & runtime dependencies need reevaluation

2017-06-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16070985#comment-16070985 ] ASF GitHub Bot commented on BEAM-2272: -- GitHub user kennknowles opened a pull request:

  1   2   >