[jira] [Updated] (BEAM-3310) Push metrics to a backend in an runner agnostic way

[ https://issues.apache.org/jira/browse/BEAM-3310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-3310: --- Description: The idea is to avoid relying on the runners to provide access to the metrics

[jira] [Updated] (BEAM-3310) Push metrics to a backend in an runner agnostic way

[ https://issues.apache.org/jira/browse/BEAM-3310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-3310: --- Description: The idea is to avoid relying on the runners to provide access to the metrics

Build failed in Jenkins: beam_PerformanceTests_Spark #1136

See Changes: [robertwb] [BEAM-3183] Add runner.run(transform) to Python SDK. [robertwb] Fix getitem and list comprehension type inference. [github] Guard against closing data channel twice (#4283)

Build failed in Jenkins: beam_PostCommit_Python_Verify #3761

See -- [...truncated 1021.20 KB...] test_retry_fork_graph (apache_beam.pipeline_test.DirectRunnerRetryTests) ... ok test_element (apache_beam.pipeline_test.DoFnTest) ... ok

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Dataflow #4559

See

[jira] [Created] (BEAM-3369) Python HEAD fails tests due to a ValueError

Chamikara Jayalath created BEAM-3369: Summary: Python HEAD fails tests due to a ValueError Key: BEAM-3369 URL: https://issues.apache.org/jira/browse/BEAM-3369 Project: Beam Issue Type:

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Apex #3025

See

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #4558

See

[jira] [Commented] (BEAM-3183) Add the ability run a pipeline via Runner.run(transform)

[ https://issues.apache.org/jira/browse/BEAM-3183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16296015#comment-16296015 ] ASF GitHub Bot commented on BEAM-3183: -- robertwb closed pull request #4247: [BEAM-3183] Add

[beam] 01/01: Merge pull request #4247 from robertwb/runner-run

This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 1ff54bb17a45a532ffc1c9377da6e63760618180 Merge: 1acd1ae 8cf222d Author: Robert Bradshaw AuthorDate:

[beam] branch master updated (1acd1ae -> 1ff54bb)

This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 1acd1ae Merge pull request #4282 from robertwb/type-inference add 8cf222d [BEAM-3183] Add

[beam] 01/01: Merge pull request #4282 from robertwb/type-inference

This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 1acd1ae901eefbcc8249d90e12ca82db0f91e41e Merge: 26560d0 8103010 Author: Robert Bradshaw AuthorDate:

[beam] branch master updated (26560d0 -> 1acd1ae)

This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 26560d0 Guard against closing data channel twice (#4283) add 8103010 Fix getitem and list comprehension type

[beam] branch master updated: Guard against closing data channel twice (#4283)

This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 26560d0 Guard against closing data channel

[jira] [Commented] (BEAM-2937) Fn API combiner support w/ lifting to PGBK

[ https://issues.apache.org/jira/browse/BEAM-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16296006#comment-16296006 ] ASF GitHub Bot commented on BEAM-2937: -- robertwb opened a new pull request #4290: [BEAM-2937] Basic

[jira] [Commented] (BEAM-3356) Add varint coder

[ https://issues.apache.org/jira/browse/BEAM-3356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295984#comment-16295984 ] ASF GitHub Bot commented on BEAM-3356: -- herohde opened a new pull request #4289: [BEAM-3356] Add

Jenkins build is back to normal : beam_PostCommit_Java_MavenInstall #5470

See

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Spark #3716

See

Jenkins build is back to normal : beam_PerformanceTests_Python #691

See

Build failed in Jenkins: beam_PerformanceTests_Spark #1135

See Changes: [robertwb] [BEAM-3143] Type Inference Python 3 Compatibility (#4183) [lcwik] [BEAM-2929] Remove Dataflow expansions for PCollectionView that have

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Flink #4511

See

[jira] [Commented] (BEAM-3357) Python SDK head fails to run tests due to Requirement.parse('protobuf<=3.4.0,>=3.2.0')

[ https://issues.apache.org/jira/browse/BEAM-3357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295882#comment-16295882 ] ASF GitHub Bot commented on BEAM-3357: -- udim opened a new pull request #4287: [BEAM-3357] Add

[jira] [Commented] (BEAM-3356) Add varint coder

[ https://issues.apache.org/jira/browse/BEAM-3356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295863#comment-16295863 ] ASF GitHub Bot commented on BEAM-3356: -- robertwb closed pull request #4276: [BEAM-3356] Add Go SDK int

[beam] branch go-sdk updated: [BEAM-3356] Add Go SDK int and varint custom coders (#4276)

This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch go-sdk in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/go-sdk by this push: new 14eb2cd [BEAM-3356] Add Go SDK int and varint

[jira] [Commented] (BEAM-3041) Add portable Python SDK container setup support

[ https://issues.apache.org/jira/browse/BEAM-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295837#comment-16295837 ] ASF GitHub Bot commented on BEAM-3041: -- aaltay opened a new pull request #4286: [BEAM-3041] Add a

[jira] [Assigned] (BEAM-3342) Create a Cloud Bigtable Python connector

[ https://issues.apache.org/jira/browse/BEAM-3342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-3342: - Assignee: Solomon Duskis (was: Ahmet Altay) > Create a Cloud Bigtable Python connector >

[jira] [Commented] (BEAM-3363) Auto discover dependency issues

[ https://issues.apache.org/jira/browse/BEAM-3363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295828#comment-16295828 ] Ahmet Altay commented on BEAM-3363: --- Potential tool for helping with this: https://dependabot.com/ >

[jira] [Resolved] (BEAM-2904) Python SDK support for portable progress reporting

[ https://issues.apache.org/jira/browse/BEAM-2904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde resolved BEAM-2904. - Resolution: Fixed Fix Version/s: 2.3.0 > Python SDK support for portable progress reporting

[jira] [Commented] (BEAM-3338) Update left navs to bubble up buried pages

[ https://issues.apache.org/jira/browse/BEAM-3338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295748#comment-16295748 ] ASF GitHub Bot commented on BEAM-3338: -- asfgit closed pull request #364: [BEAM-3338] Add SDK specific

[beam-site] branch asf-site updated (1b0d03e -> 4763bdb)

This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 1b0d03e Regenerate website add 80ec174 [BEAM-3338] Add SDK specific pages to SDK left nav

[beam-site] 01/01: Prepare repository for deployment.

This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 4763bdb1f3c9dd7b052c034db2c295948c0ca4eb Author: Mergebot AuthorDate: Mon Dec 18

[beam-site] 01/02: [BEAM-3338] Add SDK specific pages to SDK left nav

This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 80ec174c8f1c8e11510104023430b3df72265cbd Author: melissa AuthorDate: Tue Dec 12

[beam-site] 02/02: This closes #364

This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 744c72aba197a114fe34c740bff7f63295f36fb7 Merge: 1b0d03e 80ec174 Author: Mergebot

[beam-site] branch mergebot updated (f99d6f5 -> 744c72a)

This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. discard f99d6f5 This closes #364 discard 8ca9dc7 [BEAM-3338] Add SDK specific pages to SDK left nav new

[jira] [Commented] (BEAM-2929) Dataflow support for portable side input

[ https://issues.apache.org/jira/browse/BEAM-2929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295674#comment-16295674 ] ASF GitHub Bot commented on BEAM-2929: -- lukecwik closed pull request #4251: [BEAM-2929] Remove

[beam] branch master updated: [BEAM-2929] Remove Dataflow expansions for PCollectionView that have been migrated into the Dataflow service for the portability framework.

This is an automated email from the ASF dual-hosted git repository. lcwik pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 9d9ffa5 [BEAM-2929] Remove Dataflow expansions

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #5468

See

[beam-site] 02/02: This closes #364

This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit f99d6f5deb6a67c28a5ee5f2df82d0e0201a40a6 Merge: 1b0d03e 8ca9dc7 Author: Mergebot

[beam-site] branch mergebot updated (7ba9a65 -> f99d6f5)

This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 7ba9a65 This closes #365 add 0c1c7f4 Prepare repository for deployment. add 83041d5 Make

[beam-site] 01/02: [BEAM-3338] Add SDK specific pages to SDK left nav

This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 8ca9dc7b4d5935364fa071586816c1bcb1d81b96 Author: melissa AuthorDate: Tue Dec 12

[jira] [Commented] (BEAM-3361) Go SDK needs to increase gRPC receive buffer size

[ https://issues.apache.org/jira/browse/BEAM-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295611#comment-16295611 ] ASF GitHub Bot commented on BEAM-3361: -- wcn3 opened a new pull request #4285: BEAM-3361 Increase Go

[jira] [Resolved] (BEAM-2101) Reading public GCS files requires authentication

[ https://issues.apache.org/jira/browse/BEAM-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-2101. - Resolution: Fixed Fix Version/s: 2.3.0 > Reading public GCS files requires authentication >

[jira] [Commented] (BEAM-3368) Go model pipeline doesn't support External transform

[ https://issues.apache.org/jira/browse/BEAM-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295595#comment-16295595 ] ASF GitHub Bot commented on BEAM-3368: -- wcn3 opened a new pull request #4284: BEAM-3368 fix

[jira] [Created] (BEAM-3368) Go model pipeline doesn't support External transform

Bill Neubauer created BEAM-3368: --- Summary: Go model pipeline doesn't support External transform Key: BEAM-3368 URL: https://issues.apache.org/jira/browse/BEAM-3368 Project: Beam Issue Type:

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #5467

See

[beam] 01/01: Merge pull request #4279: Fix storagePath variable.

This is an automated email from the ASF dual-hosted git repository. kenn pushed a commit to branch go-sdk in repository https://gitbox.apache.org/repos/asf/beam.git commit a4e4cb31dfa88010dc915706b338f36ab0fd52f4 Merge: 9bdae2d cb6b6ba Author: Kenn Knowles AuthorDate: Mon

[beam] branch go-sdk updated (9bdae2d -> a4e4cb3)

This is an automated email from the ASF dual-hosted git repository. kenn pushed a change to branch go-sdk in repository https://gitbox.apache.org/repos/asf/beam.git. from 9bdae2d Merge pull request #4271: merge master into go-sdk add cb6b6ba Fix storagePath variable. new a4e4cb3

[jira] [Created] (BEAM-3367) The Java SDK Harness should not expect WindowedValueCoders in FnApiDoFnRunner

Thomas Groh created BEAM-3367: - Summary: The Java SDK Harness should not expect WindowedValueCoders in FnApiDoFnRunner Key: BEAM-3367 URL: https://issues.apache.org/jira/browse/BEAM-3367 Project: Beam

[jira] [Commented] (BEAM-3143) Fix type inference in Python 3 for generators

[ https://issues.apache.org/jira/browse/BEAM-3143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295485#comment-16295485 ] ASF GitHub Bot commented on BEAM-3143: -- robertwb closed pull request #4183: [BEAM-3143] Type Inference

[beam] branch master updated: [BEAM-3143] Type Inference Python 3 Compatibility (#4183)

This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new a424c64 [BEAM-3143] Type Inference Python 3

[jira] [Assigned] (BEAM-3280) There are no examples or tests about how to use typehints with TaggedOutput

[ https://issues.apache.org/jira/browse/BEAM-3280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-3280: --- Assignee: Norio Akagi (was: Ahmet Altay) > There are no examples or tests about how to use typehints

Build failed in Jenkins: beam_PerformanceTests_Python #690

See Changes: [jbonofre] [BEAM-3340] Update Flink Runner to Flink 1.4.0 -- Started by timer [EnvInject] - Loading node environment variables. Building remotely

Build failed in Jenkins: beam_PerformanceTests_Spark #1134

See Changes: [jbonofre] [BEAM-3340] Update Flink Runner to Flink 1.4.0 -- Started by timer [EnvInject] - Loading node environment variables. Building remotely

[jira] [Assigned] (BEAM-2937) Fn API combiner support w/ lifting to PGBK

[ https://issues.apache.org/jira/browse/BEAM-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw reassigned BEAM-2937: - Assignee: Robert Bradshaw > Fn API combiner support w/ lifting to PGBK >

[jira] [Commented] (BEAM-3340) Update Flink Runner to Flink 1.4.0

[ https://issues.apache.org/jira/browse/BEAM-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295158#comment-16295158 ] ASF GitHub Bot commented on BEAM-3340: -- jbonofre closed pull request #4280: [BEAM-3340] Update Flink

[jira] [Resolved] (BEAM-3340) Update Flink Runner to Flink 1.4.0

[ https://issues.apache.org/jira/browse/BEAM-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved BEAM-3340. Resolution: Fixed > Update Flink Runner to Flink 1.4.0 >

[beam] branch master updated: [BEAM-3340] Update Flink Runner to Flink 1.4.0

This is an automated email from the ASF dual-hosted git repository. jbonofre pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 36495b8 [BEAM-3340] Update Flink Runner to

[jira] [Assigned] (BEAM-3340) Update Flink Runner to Flink 1.4.0

[ https://issues.apache.org/jira/browse/BEAM-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-3340: -- Assignee: Ismaël Mejía (was: Hai Zhou UTC+8) > Update Flink Runner to Flink 1.4.0 >

[jira] [Commented] (BEAM-3340) Update Flink Runner to Flink 1.4.0

[ https://issues.apache.org/jira/browse/BEAM-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294927#comment-16294927 ] ASF GitHub Bot commented on BEAM-3340: -- iemejia opened a new pull request #4280: [BEAM-3340] Update

[jira] [Commented] (BEAM-3340) Update Flink Runner to Flink 1.4.0

[ https://issues.apache.org/jira/browse/BEAM-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294926#comment-16294926 ] Ismaël Mejía commented on BEAM-3340: Sorry [~yew1eb] I am (re)taking this one because it should be now

Build failed in Jenkins: beam_PerformanceTests_Spark #1133

See Changes: [jbonofre] [BEAM-1920] Upgrade to Spark runner to Spark 2.2.1 -- Started by timer [EnvInject] - Loading node environment variables. Building

[jira] [Resolved] (BEAM-1920) Add Spark 2.x support in Spark runner

[ https://issues.apache.org/jira/browse/BEAM-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved BEAM-1920. Resolution: Fixed Fix Version/s: 2.3.0 > Add Spark 2.x support in Spark

[jira] [Commented] (BEAM-1920) Add Spark 2.x support in Spark runner

[ https://issues.apache.org/jira/browse/BEAM-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294789#comment-16294789 ] ASF GitHub Bot commented on BEAM-1920: -- iemejia closed pull request #4208: [BEAM-1920] Upgrade Spark

[beam] branch master updated (0e79826 -> 3d99389)

This is an automated email from the ASF dual-hosted git repository. iemejia pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 0e79826 Merge pull request #4260 from DariuszAniszewski/reshuffle-for-other-filebased-ioit add 95d92d4

[beam] 01/01: Merge pull request #4208 from jbonofre/BEAM-1920-SPARK2

This is an automated email from the ASF dual-hosted git repository. iemejia pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 3d99389d31d5a962291d1bb463f125db257f39d7 Merge: 0e79826 95d92d4 Author: Ismaël Mejía AuthorDate: Mon

[jira] [Commented] (BEAM-3357) Python SDK head fails to run tests due to Requirement.parse('protobuf<=3.4.0,>=3.2.0')

[ https://issues.apache.org/jira/browse/BEAM-3357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294628#comment-16294628 ] David Sabater commented on BEAM-3357: - [~redtree1112] try removing your Protobuf version and install