[2/2] beam git commit: This closes #3851: [BEAM-2467] Kinesis source watermark based on approximateArrivalTimestamp

This closes #3851: [BEAM-2467] Kinesis source watermark based on approximateArrivalTimestamp Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3bf65dc7 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3bf65dc7 Diff:

[1/2] beam git commit: [BEAM-2467] Kinesis source watermark based on approximateArrivalTimestamp

Repository: beam Updated Branches: refs/heads/master 1bd17d1b9 -> 3bf65dc7a [BEAM-2467] Kinesis source watermark based on approximateArrivalTimestamp Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/21a62ed4 Tree:

[GitHub] beam pull request #3851: [BEAM-2467] Kinesis source watermark based on appro...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3851 ---

[jira] [Resolved] (BEAM-2982) PubSubIO.readMessages().fromSubscription(...) doesn't work with ValueProvider

[ https://issues.apache.org/jira/browse/BEAM-2982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-2982. --- Resolution: Fixed Fix Version/s: 2.2.0 > PubSubIO.readMessages().fromSubscription(...) doesn't

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4878

See Changes: [tgroh] Update the Dataflow v1b3 API version -- [...truncated 1.19 MB...] 2017-09-25T23:22:19.383 [INFO] Downloading:

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #4045

See

[2/2] beam git commit: This closes #3896

This closes #3896 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/446f3117 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/446f3117 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/446f3117 Branch:

[GitHub] beam pull request #3896: Update Beam's root pom.xml to use a newer API clien...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3896 ---

[1/2] beam git commit: Update the Dataflow v1b3 API version

Repository: beam Updated Branches: refs/heads/master 3bf65dc7a -> 446f31174 Update the Dataflow v1b3 API version Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/95ef860b Tree:

[jira] [Commented] (BEAM-2975) Results of ReadableState.read() should be snapshots of the underlying state

[ https://issues.apache.org/jira/browse/BEAM-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179931#comment-16179931 ] Luke Cwik commented on BEAM-2975: - Also, what are the semantics of readLater(), should it return a view of

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3926

See

Jenkins build is back to normal : beam_PostCommit_Java_MavenInstall #4879

See

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4877

See Changes: [kirpichov] [BEAM-2467] Kinesis source watermark based on -- [...truncated 1.19 MB...] 2017-09-25T23:05:49.349 [INFO] Downloaded:

[2/2] beam git commit: Change checksum back to md5

Change checksum back to md5 The harness boot code depends on the type of checksum being an md5 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/166fadb6 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/166fadb6 Diff:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3924

See

[GitHub] beam pull request #3888: [BEAM-2982] Use the SubscriptionProvider in PubsubU...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3888 ---

[2/2] beam git commit: Use the SubscriptionProvider in PubsubUnboundedSource

Use the SubscriptionProvider in PubsubUnboundedSource During expansion, a ValueProvider may not be accessible. This ensures that if the subscription is based on a value provider, it will only be evaluated when that ValueProvider is bound, rather than at construction time. Project:

[1/2] beam git commit: This closes #3888

Repository: beam Updated Branches: refs/heads/master a2ff162c9 -> 1bd17d1b9 This closes #3888 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1bd17d1b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/1bd17d1b Diff:

[jira] [Commented] (BEAM-2982) PubSubIO.readMessages().fromSubscription(...) doesn't work with ValueProvider

[ https://issues.apache.org/jira/browse/BEAM-2982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179737#comment-16179737 ] ASF GitHub Bot commented on BEAM-2982: -- Github user asfgit closed the pull request at:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3923

See

[jira] [Commented] (BEAM-2899) Universal Local Runner

[ https://issues.apache.org/jira/browse/BEAM-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179967#comment-16179967 ] ASF GitHub Bot commented on BEAM-2899: -- GitHub user tgroh opened a pull request:

[GitHub] beam pull request #3898: [BEAM-2899] Add a Bare-bones ReferenceRunner Job Se...

GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/3898 [BEAM-2899] Add a Bare-bones ReferenceRunner Job Service Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[jira] [Commented] (BEAM-2467) KinesisIO watermark based on approximateArrivalTimestamp

[ https://issues.apache.org/jira/browse/BEAM-2467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179888#comment-16179888 ] ASF GitHub Bot commented on BEAM-2467: -- Github user asfgit closed the pull request at:

[jira] [Closed] (BEAM-2467) KinesisIO watermark based on approximateArrivalTimestamp

[ https://issues.apache.org/jira/browse/BEAM-2467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2467. -- Resolution: Fixed Fix Version/s: 2.2.0 > KinesisIO watermark based on

[beam-site] branch mergebot updated (cd4fe42 -> 8c112de)

This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. discard cd4fe42 This closes #325 discard c43098e Manually add missing generated files new dc0da0b

[beam-site] 01/02: Update Mapreduce capability matrix when/how entries

This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit dc0da0b3ef6d666a8bea5014a9a24f7dafdcd975 Author: melissa AuthorDate: Thu Sep 21

[beam-site] branch asf-site updated (ed155be -> 07615ea)

This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git. from ed155be Prepare repository for deployment. add dc0da0b Update Mapreduce capability matrix

[jira] [Commented] (BEAM-2724) MSEC counters should support Structured Names in Dataflow

[ https://issues.apache.org/jira/browse/BEAM-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180118#comment-16180118 ] ASF GitHub Bot commented on BEAM-2724: -- Github user pabloem closed the pull request at:

[jira] [Commented] (BEAM-2724) MSEC counters should support Structured Names in Dataflow

[ https://issues.apache.org/jira/browse/BEAM-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180119#comment-16180119 ] ASF GitHub Bot commented on BEAM-2724: -- GitHub user pabloem reopened a pull request:

Build failed in Jenkins: beam_PostCommit_Python_Verify #3215

See -- [...truncated 44.47 KB...] Collecting mock<3.0.0,>=1.0.1 (from apache-beam==2.2.0.dev0) Using cached mock-2.0.0-py2.py3-none-any.whl Collecting

Build failed in Jenkins: beam_PostCommit_Python_Verify #3208

See -- [...truncated 44.47 KB...] Collecting mock<3.0.0,>=1.0.1 (from apache-beam==2.2.0.dev0) Using cached mock-2.0.0-py2.py3-none-any.whl Collecting

[jira] [Commented] (BEAM-2956) DataflowRunner incorrectly reports the user agent for the Dataflow distribution

[ https://issues.apache.org/jira/browse/BEAM-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179243#comment-16179243 ] Luke Cwik commented on BEAM-2956: - The remaining change is within the Dataflow distribution so this can be

[jira] [Created] (BEAM-2986) Support reading avro GenericRecords with BigQueryIO

Steve Niemitz created BEAM-2986: --- Summary: Support reading avro GenericRecords with BigQueryIO Key: BEAM-2986 URL: https://issues.apache.org/jira/browse/BEAM-2986 Project: Beam Issue Type: New

[jira] [Commented] (BEAM-2986) Support reading avro GenericRecords with BigQueryIO

[ https://issues.apache.org/jira/browse/BEAM-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179175#comment-16179175 ] Eugene Kirpichov commented on BEAM-2986: To do this change in a compatible way, you may want to

[GitHub] beam pull request #3894: [BEAM-2986] Support for reading avro GenericRecords...

GitHub user steveniemitz opened a pull request: https://github.com/apache/beam/pull/3894 [BEAM-2986] Support for reading avro GenericRecords from BigQuery Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA

[jira] [Commented] (BEAM-2986) Support reading avro GenericRecords with BigQueryIO

[ https://issues.apache.org/jira/browse/BEAM-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179176#comment-16179176 ] ASF GitHub Bot commented on BEAM-2986: -- GitHub user steveniemitz opened a pull request:

[1/2] beam git commit: This closes #3885

Repository: beam Updated Branches: refs/heads/master aa2604a39 -> 06809b982 This closes #3885 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/06809b98 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/06809b98 Diff:

[GitHub] beam pull request #3885: [BEAM-2876] Add preliminary provision API

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3885 ---

[jira] [Resolved] (BEAM-2985) BigQuery IO write transform is broken for DirectRunner

[ https://issues.apache.org/jira/browse/BEAM-2985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath resolved BEAM-2985. -- Resolution: Fixed Fix Version/s: 2.2.0 > BigQuery IO write transform is broken

[jira] [Commented] (BEAM-2985) BigQuery IO write transform is broken for DirectRunner

[ https://issues.apache.org/jira/browse/BEAM-2985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179477#comment-16179477 ] ASF GitHub Bot commented on BEAM-2985: -- Github user asfgit closed the pull request at:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3919

See

[1/2] beam git commit: Updates WriteToBigQuery PTransform to get project id from GoogleCloudOptions when using DirectRunner.

Repository: beam Updated Branches: refs/heads/master 06809b982 -> a2ff162c9 Updates WriteToBigQuery PTransform to get project id from GoogleCloudOptions when using DirectRunner. WriteToBigQuery PTransform behaves differently for DirectRunner and DataflowRunner when it comes to determining

[2/2] beam git commit: This closes #3892

This closes #3892 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a2ff162c Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a2ff162c Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/a2ff162c Branch:

[GitHub] beam pull request #3892: [BEAM-2985] Updates WriteToBigQuery PTransform to g...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3892 ---

[GitHub] beam pull request #3895: Change checksum back to md5

GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/3895 Change checksum back to md5 Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[2/2] beam git commit: [BEAM-2876] Add preliminary provision API

[BEAM-2876] Add preliminary provision API Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ef1e7191 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ef1e7191 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/ef1e7191

[jira] [Commented] (BEAM-2876) Add provision api proto

[ https://issues.apache.org/jira/browse/BEAM-2876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179410#comment-16179410 ] ASF GitHub Bot commented on BEAM-2876: -- Github user asfgit closed the pull request at:

[jira] [Resolved] (BEAM-2876) Add provision api proto

[ https://issues.apache.org/jira/browse/BEAM-2876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde resolved BEAM-2876. - Resolution: Fixed Fix Version/s: 2.3.0 > Add provision api proto > ---

Jenkins build is back to normal : beam_PostCommit_Python_Verify #3209

See

[GitHub] beam pull request #3897: Option to disable validation of BigtableIO.write ta...

GitHub user steveniemitz opened a pull request: https://github.com/apache/beam/pull/3897 Option to disable validation of BigtableIO.write target table Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3921

See

[beam-site] 01/01: Prepare repository for deployment.

This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 07615eaabc0c84ad2f2ac6818d5e00622b997c9d Author: Mergebot AuthorDate: Tue Sep 26

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Dataflow #4046

See

[GitHub] beam pull request #3786: [BEAM-2724] Preparing statesampler to work with str...

Github user pabloem closed the pull request at: https://github.com/apache/beam/pull/3786 ---

[GitHub] beam pull request #3786: [BEAM-2724] Preparing statesampler to work with str...

GitHub user pabloem reopened a pull request: https://github.com/apache/beam/pull/3786 [BEAM-2724] Preparing statesampler to work with structured names You can merge this pull request into a Git repository by running: $ git pull https://github.com/pabloem/incubator-beam

[jira] [Created] (BEAM-2987) Close of InputStream should be placed in finally block

Ted Yu created BEAM-2987: Summary: Close of InputStream should be placed in finally block Key: BEAM-2987 URL: https://issues.apache.org/jira/browse/BEAM-2987 Project: Beam Issue Type: Bug

Jenkins build is back to normal : beam_PostCommit_Java_MavenInstall #4874

See

[beam-site] branch mergebot updated (91aa43c -> cd4fe42)

This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. discard 91aa43c This closes #324 discard eeba9b3 Update Mapreduce capability matrix when/how entries new

[beam-site] 01/02: Manually add missing generated files

This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit c43098e8e0a0d49fe99f70e2ad26ab97210ae28b Author: melissa AuthorDate: Mon Sep 25

[beam-site] 02/02: This closes #325

This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit cd4fe4255ffc39e784714438950990f34e46d48c Merge: ed155be c43098e Author: Mergebot

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3922

See

[jira] [Created] (BEAM-2988) PubSub subscriptions automatically created in Python DirectRunner not reliably cleaned up

Charles Chen created BEAM-2988: -- Summary: PubSub subscriptions automatically created in Python DirectRunner not reliably cleaned up Key: BEAM-2988 URL: https://issues.apache.org/jira/browse/BEAM-2988

[jira] [Commented] (BEAM-2975) Results of ReadableState.read() should be snapshots of the underlying state

[ https://issues.apache.org/jira/browse/BEAM-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179920#comment-16179920 ] Luke Cwik commented on BEAM-2975: - Is this really what users expect? I would expect that read() is a live

[GitHub] beam pull request #3895: Change checksum back to md5

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3895 ---

[1/2] beam git commit: This closes #3895

Repository: beam Updated Branches: refs/heads/master 446f31174 -> 352f106f9 This closes #3895 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/352f106f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/352f106f Diff:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3925

See

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Spark #3147

See -- [...truncated 218.58 KB...] 2017-09-25T06:03:10.750 [INFO] Downloading:

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4872

See -- [...truncated 420.58 KB...] 2017-09-25T12:05:08.661 [INFO] Downloaded:

Jenkins build is back to normal : beam_PostCommit_Python_Verify #3207

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3917

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3918

See

[jira] [Commented] (BEAM-2840) BigQueryIO write is slow/fail with a bounded source

[ https://issues.apache.org/jira/browse/BEAM-2840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178928#comment-16178928 ] Vincent Spiewak commented on BEAM-2840: --- I tried to reproduce the issue with a public dataset without

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Spark #3148

See