[jira] [Assigned] (BEAM-2742) Switch from primitives to Java types

2017-08-07 Thread James Xu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2742: -- Assignee: James Xu > Switch from primitives to Java types > > >

[jira] [Commented] (BEAM-2671) CreateStreamTest.testFirstElementLate validatesRunner test fails on Spark runner

2017-08-07 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16117853#comment-16117853 ] Jean-Baptiste Onofré commented on BEAM-2671: I bump this to 2.2.0 and I will cut RC3 as it is.

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2785

2017-08-07 Thread Apache Jenkins Server
See

[jira] [Updated] (BEAM-2671) CreateStreamTest.testFirstElementLate validatesRunner test fails on Spark runner

2017-08-07 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré updated BEAM-2671: --- Fix Version/s: (was: 2.1.0) 2.2.0 >

[jira] [Commented] (BEAM-79) Gearpump runner

2017-08-07 Thread Manu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-79?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16117833#comment-16117833 ] Manu Zhang commented on BEAM-79: Hi [~takidau], We've reached a milestone after merging gearpump-runner into

[jira] [Commented] (BEAM-1868) CreateStreamTest testMultiOutputParDo is flaky on the Spark runner

2017-08-07 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16117859#comment-16117859 ] Jean-Baptiste Onofré commented on BEAM-1868: Bumping to 2.2.0 target to avoid to block 2.1.0

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3726

2017-08-07 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PerformanceTests_JDBC #189

2017-08-07 Thread Apache Jenkins Server
See -- [...truncated 31.85 KB...] [INFO] --- maven-failsafe-plugin:2.20:integration-test (integration-test) @ beam-runners-google-cloud-dataflow-java --- [INFO] Tests are

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3727

2017-08-07 Thread Apache Jenkins Server
See

[jira] [Updated] (BEAM-1868) CreateStreamTest testMultiOutputParDo is flaky on the Spark runner

2017-08-07 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré updated BEAM-1868: --- Fix Version/s: (was: 2.1.0) 2.2.0 > CreateStreamTest

Build failed in Jenkins: beam_PerformanceTests_JDBC #184

2017-08-07 Thread Apache Jenkins Server
See -- Started by user chamikara [EnvInject] - Loading node environment variables. Building remotely on beam1 (beam) in workspace

[jira] [Commented] (BEAM-2735) testMergingCustomWindows tests are incorrect

2017-08-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16117404#comment-16117404 ] ASF GitHub Bot commented on BEAM-2735: -- GitHub user tgroh opened a pull request:

[GitHub] beam pull request #3698: [BEAM-2735] Update Custom Window Merging Tests

2017-08-07 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/3698 [BEAM-2735] Update Custom Window Merging Tests Update the merge windows to be order-independent. Follow this checklist to help us incorporate your contribution quickly and easily: -

[1/2] beam git commit: [rebased] remove nullFields in BeamRecord

2017-08-07 Thread takidau
Repository: beam Updated Branches: refs/heads/DSL_SQL 79880b6ab -> 880531aa2 [rebased] remove nullFields in BeamRecord Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4871edbc Tree:

[jira] [Commented] (BEAM-2725) remove nullFields in BeamRecord

2017-08-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16117423#comment-16117423 ] ASF GitHub Bot commented on BEAM-2725: -- Github user asfgit closed the pull request at:

[2/2] beam git commit: [BEAM-2725] This closes #3691

2017-08-07 Thread takidau
[BEAM-2725] This closes #3691 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/880531aa Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/880531aa Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/880531aa Branch:

[GitHub] beam pull request #3691: [BEAM-2725] remove nullFields in BeamRecord

2017-08-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3691 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-2671) CreateStreamTest.testFirstElementLate validatesRunner test fails on Spark runner

2017-08-07 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16117469#comment-16117469 ] Eugene Kirpichov commented on BEAM-2671: Aviem - my apologies for misunderstanding previous

[36/50] [abbrv] beam git commit: Merge branch 'master' of https://github.com/apache/beam into sync-master

2017-08-07 Thread kenn
Merge branch 'master' of https://github.com/apache/beam into sync-master Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f1582570 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f1582570 Diff:

[09/50] [abbrv] beam git commit: [BEAM-79] Fix gearpump-runner merge conflicts and test failure

2017-08-07 Thread kenn
[BEAM-79] Fix gearpump-runner merge conflicts and test failure Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3eab6a64 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3eab6a64 Diff:

[42/50] [abbrv] beam git commit: Revert accidental changes to sdks/java/pom.xml

2017-08-07 Thread kenn
Revert accidental changes to sdks/java/pom.xml Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e655f53c Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e655f53c Diff:

[16/50] [abbrv] beam git commit: Update gearpump-runner against master changes.

2017-08-07 Thread kenn
Update gearpump-runner against master changes. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/44d21ac6 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/44d21ac6 Diff:

[40/50] [abbrv] beam git commit: Fix ParDoTest#testPipelineOptionsParameter

2017-08-07 Thread kenn
Fix ParDoTest#testPipelineOptionsParameter Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/725f547f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/725f547f Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/725f547f

[23/50] [abbrv] beam git commit: This closes #3172: Sync gearpump-runner with master

2017-08-07 Thread kenn
This closes #3172: Sync gearpump-runner with master Update gearpump-runner against master changes Use stable naming strategy for ByteBuddy invokers Translate a Pipeline in SdkComponents [TRIVIAL] runners-core: delete placeholder Fixes an accidentally found bug in SimpleDoFnRunner

[32/50] [abbrv] beam git commit: Fix PCollectionView translation

2017-08-07 Thread kenn
Fix PCollectionView translation Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a7b5d981 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a7b5d981 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/a7b5d981 Branch:

[35/50] [abbrv] beam git commit: This closes #3388: Sync gearpump-runner branch with master

2017-08-07 Thread kenn
This closes #3388: Sync gearpump-runner branch with master Remove unused codes Fix kryo exception Fix PCollectionView translation upgrade to gearpump 0.8.4-SNAPSHOT Fix side input handling in DoFnFunction Respect WindowFn#getOutputTime in gearpump-runner Activate Gearpump

[33/50] [abbrv] beam git commit: Fix kryo exception

2017-08-07 Thread kenn
Fix kryo exception Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/11caa978 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/11caa978 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/11caa978 Branch:

[22/50] [abbrv] beam git commit: Update gearpump-runner against master changes

2017-08-07 Thread kenn
Update gearpump-runner against master changes Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6c06967c Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/6c06967c Diff:

[21/50] [abbrv] beam git commit: Merge branch 'master' of https://github.com/apache/beam into sync-master

2017-08-07 Thread kenn
Merge branch 'master' of https://github.com/apache/beam into sync-master Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bc8da292 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/bc8da292 Diff:

[12/50] [abbrv] beam git commit: This closes #2302: Add unit tests to Gearpump runner

2017-08-07 Thread kenn
This closes #2302: Add unit tests to Gearpump runner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f4f23330 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f4f23330 Diff:

[43/50] [abbrv] beam git commit: Upgrade BEAM version to 2.2.0-SNAPSHOT in gearpump-runner

2017-08-07 Thread kenn
Upgrade BEAM version to 2.2.0-SNAPSHOT in gearpump-runner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/daa75669 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/daa75669 Diff:

[26/50] [abbrv] beam git commit: Activate Gearpump local-validates-runner-tests in precommit

2017-08-07 Thread kenn
Activate Gearpump local-validates-runner-tests in precommit Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3c7e3e6a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3c7e3e6a Diff:

[46/50] [abbrv] beam git commit: Require java 8 for precommit tests and add gearpump-runner

2017-08-07 Thread kenn
Require java 8 for precommit tests and add gearpump-runner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a282165c Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a282165c Diff:

[41/50] [abbrv] beam git commit: This closes #3515: Sync gearpump-runner with master and upgrade to gearpump 0.8.4

2017-08-07 Thread kenn
This closes #3515: Sync gearpump-runner with master and upgrade to gearpump 0.8.4 Fix ParDoTest#testPipelineOptionsParameter Upgrade to gearpump 0.8.4 Fix javadoc generation for AmqpIO, CassandraIO and HCatalogIO Simplified ByteBuddyOnTimerInvokerFactory Fix bad merge Made

[29/50] [abbrv] beam git commit: This closes #3292: Merge master into gearpump-runner

2017-08-07 Thread kenn
This closes #3292: Merge master into gearpump-runner Adjustments to gearpump-runner: Fix side input handling in DoFnFunction Respect WindowFn#getOutputTime in gearpump-runner Activate Gearpump local-validates-runner-tests in precommit Update against master changes Merged from master:

[04/50] [abbrv] beam git commit: [BEAM-79] Add SideInput support for GearpumpRunner

2017-08-07 Thread kenn
[BEAM-79] Add SideInput support for GearpumpRunner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4eb50d15 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/4eb50d15 Diff:

[38/50] [abbrv] beam git commit: Merge branch 'master' of https://github.com/apache/beam into sync-master

2017-08-07 Thread kenn
Merge branch 'master' of https://github.com/apache/beam into sync-master Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c2d3fbc3 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c2d3fbc3 Diff:

[08/50] [abbrv] beam git commit: [BEAM-79] Fix gearpump-runner merge conflicts and test failure

2017-08-07 Thread kenn
http://git-wip-us.apache.org/repos/asf/beam/blob/3eab6a64/runners/gearpump/src/main/java/org/apache/beam/runners/gearpump/translators/WindowBoundTranslator.java -- diff --git

[27/50] [abbrv] beam git commit: Respect WindowFn#getOutputTime in gearpump-runner

2017-08-07 Thread kenn
Respect WindowFn#getOutputTime in gearpump-runner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/98854d4d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/98854d4d Diff:

[15/50] [abbrv] beam git commit: Merge branch 'master' of https://github.com/apache/incubator-beam into gearpump-runner

2017-08-07 Thread kenn
Merge branch 'master' of https://github.com/apache/incubator-beam into gearpump-runner # Conflicts: # .test-infra/jenkins/job_beam_PostCommit_Java_ValidatesRunner_Gearpump.groovy # runners/pom.xml Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[18/50] [abbrv] beam git commit: Merge remote-tracking branch 'upstream/master' into gearpump-runner

2017-08-07 Thread kenn
Merge remote-tracking branch 'upstream/master' into gearpump-runner # Conflicts: # .travis.yml Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9a59ea32 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9a59ea32

[25/50] [abbrv] beam git commit: Update against master changes

2017-08-07 Thread kenn
Update against master changes Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c9aac967 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c9aac967 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/c9aac967 Branch:

[GitHub] beam pull request #3636: [BEAM-79] Merge gearpump-runner into master

2017-08-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3636 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[20/50] [abbrv] beam git commit: This closes #2888: Merge master into gearpump-runner branch

2017-08-07 Thread kenn
This closes #2888: Merge master into gearpump-runner branch Update gearpump-runner against master changes Introduces read/writePubsubMessages Removed coder and formatFn from PubsubIO.Write Removed coder and parseFn from PubsubIO.Read Add Additional CloudObjectTranslators Updating

[01/50] [abbrv] beam git commit: [BEAM-79] Support merging windows in GearpumpRunner

2017-08-07 Thread kenn
Repository: beam Updated Branches: refs/heads/master c9abd15e5 -> 89236e3b5 [BEAM-79] Support merging windows in GearpumpRunner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7af64720 Tree:

[50/50] [abbrv] beam git commit: This closes #3636: Merge GearpumpRunner to master branch

2017-08-07 Thread kenn
This closes #3636: Merge GearpumpRunner to master branch Remove gearpump-runner in precommit tests Override maven-enforcer-plugin for precommit tests Require java 8 for precommit tests and add gearpump-runner Deactivate integration-tests for gearpump-runner by default Add

[19/50] [abbrv] beam git commit: Update gearpump-runner against master changes

2017-08-07 Thread kenn
Update gearpump-runner against master changes Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/12b9719e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/12b9719e Diff:

[30/50] [abbrv] beam git commit: Merge branch 'master' of https://github.com/apache/beam into sync-master

2017-08-07 Thread kenn
Merge branch 'master' of https://github.com/apache/beam into sync-master Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/fed98c84 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/fed98c84 Diff:

[11/50] [abbrv] beam git commit: [BEAM-972] Add unit tests to Gearpump runner

2017-08-07 Thread kenn
[BEAM-972] Add unit tests to Gearpump runner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/eb0d333d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/eb0d333d Diff:

[48/50] [abbrv] beam git commit: Remove gearpump-runner in precommit tests

2017-08-07 Thread kenn
Remove gearpump-runner in precommit tests Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bf154835 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/bf154835 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/bf154835

[28/50] [abbrv] beam git commit: Fix side input handling in DoFnFunction

2017-08-07 Thread kenn
Fix side input handling in DoFnFunction Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7653e7ed Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7653e7ed Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/7653e7ed

[37/50] [abbrv] beam git commit: This closes #3479: [BEAM-79] Merge master into gearpump-runner branch

2017-08-07 Thread kenn
This closes #3479: [BEAM-79] Merge master into gearpump-runner branch Don't call .testingPipelineOptions() a second time GCP IO ITs now all use --project option Select SDK distribution based on the selected SDK name [BEAM-2373] Upgrade commons-compress dependency version to 1.14 Define

[44/50] [abbrv] beam git commit: Add beam-runners-gearpump dependency to javadoc

2017-08-07 Thread kenn
Add beam-runners-gearpump dependency to javadoc Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/49d4ed59 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/49d4ed59 Diff:

[47/50] [abbrv] beam git commit: Override maven-enforcer-plugin for precommit tests

2017-08-07 Thread kenn
Override maven-enforcer-plugin for precommit tests Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/18daed90 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/18daed90 Diff:

[13/50] [abbrv] beam git commit: [BEAM-972] Add more unit test to Gearpump runner

2017-08-07 Thread kenn
[BEAM-972] Add more unit test to Gearpump runner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f3138dde Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f3138dde Diff:

[14/50] [abbrv] beam git commit: This closes #2521: Add more unit test to Gearpump runner

2017-08-07 Thread kenn
This closes #2521: Add more unit test to Gearpump runner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ebbb6139 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ebbb6139 Diff:

[34/50] [abbrv] beam git commit: Remove unused codes

2017-08-07 Thread kenn
Remove unused codes Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b21fa04f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b21fa04f Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b21fa04f Branch:

[07/50] [abbrv] beam git commit: Merge branch 'master' of https://github.com/apache/incubator-beam into gearpump-runner

2017-08-07 Thread kenn
Merge branch 'master' of https://github.com/apache/incubator-beam into gearpump-runner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3f917987 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3f917987 Diff:

[10/50] [abbrv] beam git commit: This closes #2241: merge master to gearpump-master and fixup

2017-08-07 Thread kenn
This closes #2241: merge master to gearpump-master and fixup [BEAM-79] Fix gearpump-runner merge conflicts and test failure Revert BigQueryIO bit of 'Make all uses of CountingOutputStream close their resources' [BEAM-1629] Init metrics/aggregators accumulators before traversing pipeline

[17/50] [abbrv] beam git commit: This closes #2610: Merge master into gearpump-runner branch

2017-08-07 Thread kenn
This closes #2610: Merge master into gearpump-runner branch Update gearpump-runner against master changes. add temp dataset location for non-query BigQuerySource added module option, use more common zero test, show module name in log Modify types for input PCollections of Flatten

[02/50] [abbrv] beam git commit: This closes #1935: Support merging windows in GearpumpRunner

2017-08-07 Thread kenn
This closes #1935: Support merging windows in GearpumpRunner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2d0aed92 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2d0aed92 Diff:

[31/50] [abbrv] beam git commit: upgrade to gearpump 0.8.4-SNAPSHOT

2017-08-07 Thread kenn
upgrade to gearpump 0.8.4-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f61822d4 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f61822d4 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/f61822d4

[06/50] [abbrv] beam git commit: This closes #2150: Add SideInput support for GearpumpRunner

2017-08-07 Thread kenn
This closes #2150: Add SideInput support for GearpumpRunner enable ParDoTest [BEAM-79] Add SideInput support for GearpumpRunner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/15a8ad62 Tree:

[45/50] [abbrv] beam git commit: Deactivate integration-tests for gearpump-runner by default

2017-08-07 Thread kenn
Deactivate integration-tests for gearpump-runner by default Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d9bb4cb6 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d9bb4cb6 Diff:

[24/50] [abbrv] beam git commit: Merge branch 'master' of https://github.com/apache/beam into sync-master

2017-08-07 Thread kenn
Merge branch 'master' of https://github.com/apache/beam into sync-master Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9e6c9061 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9e6c9061 Diff:

[03/50] [abbrv] beam git commit: [BEAM-79] Add SideInput support for GearpumpRunner

2017-08-07 Thread kenn
http://git-wip-us.apache.org/repos/asf/beam/blob/4eb50d15/runners/gearpump/src/main/java/org/apache/beam/runners/gearpump/translators/utils/TranslatorUtils.java -- diff --git

[05/50] [abbrv] beam git commit: enable ParDoTest

2017-08-07 Thread kenn
enable ParDoTest Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3dc8fc81 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3dc8fc81 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/3dc8fc81 Branch:

Build failed in Jenkins: beam_PerformanceTests_JDBC #179

2017-08-07 Thread Apache Jenkins Server
See -- Started by user chamikara [EnvInject] - Loading node environment variables. Building remotely on beam2 (beam) in workspace

Build failed in Jenkins: beam_PerformanceTests_JDBC #180

2017-08-07 Thread Apache Jenkins Server
See -- Started by user chamikara [EnvInject] - Loading node environment variables. Building remotely on beam2 (beam) in workspace

Build failed in Jenkins: beam_PostCommit_Python_Verify #2875

2017-08-07 Thread Apache Jenkins Server
See -- Started by user chamikara [EnvInject] - Loading node environment variables. Building remotely on beam3 (beam) in workspace

[jira] [Commented] (BEAM-2140) Fix SplittableDoFn ValidatesRunner tests in FlinkRunner

2017-08-07 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16116972#comment-16116972 ] Aljoscha Krettek commented on BEAM-2140: [~jkff] [~kenn] [~lzljs3620320] Returning to this after a

[jira] [Created] (BEAM-2749) update BeamSqlExample

2017-08-07 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-2749: Summary: update BeamSqlExample Key: BEAM-2749 URL: https://issues.apache.org/jira/browse/BEAM-2749 Project: Beam Issue Type: Sub-task Components: dsl-sql

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4526

2017-08-07 Thread Apache Jenkins Server
See -- [...truncated 1.20 MB...] 2017-08-07T18:28:50.357 [INFO] Downloaded:

Build failed in Jenkins: beam_PerformanceTests_JDBC #181

2017-08-07 Thread Apache Jenkins Server
See -- Started by user chamikara [EnvInject] - Loading node environment variables. Building remotely on beam1 (beam) in workspace

Build failed in Jenkins: beam_PerformanceTests_JDBC #182

2017-08-07 Thread Apache Jenkins Server
See -- [...truncated 25.66 KB...] [INFO] Replacing

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2781

2017-08-07 Thread Apache Jenkins Server
See

[jira] [Assigned] (BEAM-2749) update BeamSqlExample

2017-08-07 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin reassigned BEAM-2749: Assignee: Xu Mingmin > update BeamSqlExample > - > > Key:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3724

2017-08-07 Thread Apache Jenkins Server
See

[GitHub] beam pull request #3696: [BEAM-1542] Make AbstractSpannerFn public

2017-08-07 Thread mairbek
GitHub user mairbek opened a pull request: https://github.com/apache/beam/pull/3696 [BEAM-1542] Make AbstractSpannerFn public Make AbstractSpannerFn public to support custom user defined functions that use Cloud Spanner. R: @jkff You can merge this pull request into a

[jira] [Commented] (BEAM-1542) Need Source/Sink for Spanner

2017-08-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16117126#comment-16117126 ] ASF GitHub Bot commented on BEAM-1542: -- GitHub user mairbek opened a pull request:

[jira] [Commented] (BEAM-2671) CreateStreamTest.testFirstElementLate validatesRunner test fails on Spark runner

2017-08-07 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16117127#comment-16117127 ] Jean-Baptiste Onofré commented on BEAM-2671: Actually, as the test is flacky, it makes {{git

[GitHub] beam pull request #3543: [BEAM-2586] Accommodate custom delimiters in TextIO

2017-08-07 Thread cphbrt
Github user cphbrt closed the pull request at: https://github.com/apache/beam/pull/3543 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-2586) Accommodate custom delimiters in TextIO

2017-08-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16117152#comment-16117152 ] ASF GitHub Bot commented on BEAM-2586: -- Github user cphbrt closed the pull request at:

[jira] [Closed] (BEAM-2586) Accommodate custom delimiters in TextIO

2017-08-07 Thread Christopher Hebert (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christopher Hebert closed BEAM-2586. Resolution: Won't Fix Fix Version/s: Not applicable The approach I proposed isn't a

[GitHub] beam pull request #3689: [BEAM-2722] Remove redundant windowing information ...

2017-08-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3689 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[3/4] beam git commit: Remove redundant windowing information from the BeamRecord itself element window information `BoundedWindow` is added in `BeamSqlExpression`.

2017-08-07 Thread takidau
Remove redundant windowing information from the BeamRecord itself element window information `BoundedWindow` is added in `BeamSqlExpression`. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c0b1fed1 Tree:

[4/4] beam git commit: [BEAM-2722] This closes #3689

2017-08-07 Thread takidau
[BEAM-2722] This closes #3689 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/79880b6a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/79880b6a Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/79880b6a Branch:

[jira] [Commented] (BEAM-2749) update BeamSqlExample

2017-08-07 Thread Tyler Akidau (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16117390#comment-16117390 ] Tyler Akidau commented on BEAM-2749: Error messages given the query: {code:java} select team,

Build failed in Jenkins: beam_PerformanceTests_JDBC #187

2017-08-07 Thread Apache Jenkins Server
See -- [...truncated 45.32 KB...] [INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.8.9 from the shaded jar. [INFO] Excluding

[jira] [Updated] (BEAM-2750) Read whole files as one PCollection element each

2017-08-07 Thread Christopher Hebert (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christopher Hebert updated BEAM-2750: - Summary: Read whole files as one PCollection element each (was: Read whole files as one

[jira] [Created] (BEAM-2751) Write PCollection elements to individual files

2017-08-07 Thread Christopher Hebert (JIRA)
Christopher Hebert created BEAM-2751: Summary: Write PCollection elements to individual files Key: BEAM-2751 URL: https://issues.apache.org/jira/browse/BEAM-2751 Project: Beam Issue

[2/4] beam git commit: Remove redundant windowing information from the BeamRecord itself element window information `BoundedWindow` is added in `BeamSqlExpression`.

2017-08-07 Thread takidau
http://git-wip-us.apache.org/repos/asf/beam/blob/c0b1fed1/sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/transform/BeamSqlProjectFn.java -- diff --git

[1/4] beam git commit: Remove redundant windowing information from the BeamRecord itself element window information `BoundedWindow` is added in `BeamSqlExpression`.

2017-08-07 Thread takidau
Repository: beam Updated Branches: refs/heads/DSL_SQL 8f922f74b -> 79880b6ab http://git-wip-us.apache.org/repos/asf/beam/blob/c0b1fed1/sdks/java/extensions/sql/src/test/java/org/apache/beam/sdk/extensions/sql/impl/interpreter/operator/string/BeamSqlPositionExpressionTest.java

Jenkins build is back to normal : beam_PostCommit_Python_Verify #2876

2017-08-07 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2431) Model Runner interactions in RPC layer for Runner API

2017-08-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16117451#comment-16117451 ] ASF GitHub Bot commented on BEAM-2431: -- Github user asfgit closed the pull request at:

Jenkins build is back to normal : beam_PostCommit_Java_MavenInstall #4528

2017-08-07 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PerformanceTests_JDBC #185

2017-08-07 Thread Apache Jenkins Server
See -- Started by user chamikara [EnvInject] - Loading node environment variables. Building remotely on beam1 (beam) in workspace

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3725

2017-08-07 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2750) Read whole files as one element each

2017-08-07 Thread Christopher Hebert (JIRA)
Christopher Hebert created BEAM-2750: Summary: Read whole files as one element each Key: BEAM-2750 URL: https://issues.apache.org/jira/browse/BEAM-2750 Project: Beam Issue Type: New

[jira] [Commented] (BEAM-2736) Dataflow ValidatesRunner tests are failing MetricsTests

2017-08-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16117361#comment-16117361 ] ASF GitHub Bot commented on BEAM-2736: -- Github user asfgit closed the pull request at:

  1   2   >