[jira] [Assigned] (BEAM-9486) Python 2 PostCommit Failures due to BQ IT failures

[ https://issues.apache.org/jira/browse/BEAM-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-9486: --- Assignee: Rui Wang (was: Pablo Estrada) > Python 2 PostCommit Failures due to BQ IT

[jira] [Updated] (BEAM-9486) Python 2 PostCommit Failures due to BQ IT failures

[ https://issues.apache.org/jira/browse/BEAM-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-9486: Priority: Major (was: Blocker) > Python 2 PostCommit Failures due to BQ IT failures >

[jira] [Commented] (BEAM-9486) Python 2 PostCommit Failures due to BQ IT failures

[ https://issues.apache.org/jira/browse/BEAM-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058096#comment-17058096 ] Pablo Estrada commented on BEAM-9486: - These logs are part of a pipeline that is meant to fail

[jira] [Resolved] (BEAM-2810) Consider a faster Avro library in Python

[ https://issues.apache.org/jira/browse/BEAM-2810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-2810. - Fix Version/s: Not applicable Resolution: Fixed This has been fixed for a while, I

[jira] [Commented] (BEAM-8910) Use AVRO instead of JSON in BigQuery bounded source.

[ https://issues.apache.org/jira/browse/BEAM-8910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056494#comment-17056494 ] Pablo Estrada commented on BEAM-8910: - I'm picking up this improvement : ) > Use AVRO instead of JSON

[jira] [Assigned] (BEAM-8910) Use AVRO instead of JSON in BigQuery bounded source.

[ https://issues.apache.org/jira/browse/BEAM-8910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-8910: --- Assignee: Pablo Estrada (was: Kamil Wasilewski) > Use AVRO instead of JSON in BigQuery

[jira] [Commented] (BEAM-8898) Enable WriteToBigQuery to perform range partitioning

[ https://issues.apache.org/jira/browse/BEAM-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051675#comment-17051675 ] Pablo Estrada commented on BEAM-8898: - Nevermind. I see that Beam is already updated[1] to the latest

[jira] [Commented] (BEAM-8898) Enable WriteToBigQuery to perform range partitioning

[ https://issues.apache.org/jira/browse/BEAM-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051620#comment-17051620 ] Pablo Estrada commented on BEAM-8898: - it doesn't seem like the library upgrade will be simple. I

[jira] [Commented] (BEAM-9305) Support ValueProvider for BigQuerySource query string

[ https://issues.apache.org/jira/browse/BEAM-9305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17050415#comment-17050415 ] Pablo Estrada commented on BEAM-9305: - [~eliasdjur] that is the right approach, but you want to call

[jira] [Commented] (BEAM-9305) Support ValueProvider for BigQuerySource query string

[ https://issues.apache.org/jira/browse/BEAM-9305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046830#comment-17046830 ] Pablo Estrada commented on BEAM-9305: - Let me know if that's enough guidance, or if you have more

[jira] [Commented] (BEAM-9305) Support ValueProvider for BigQuerySource query string

[ https://issues.apache.org/jira/browse/BEAM-9305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046818#comment-17046818 ] Pablo Estrada commented on BEAM-9305: - Hi [~eliasdjur] - the existing `BigQuerySource` cannot support

[jira] [Assigned] (BEAM-9392) TestStream tests are all flaky

[ https://issues.apache.org/jira/browse/BEAM-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-9392: --- Assignee: Sam Rohde > TestStream tests are all flaky > -- > >

[jira] [Commented] (BEAM-9392) TestStream tests are all flaky

[ https://issues.apache.org/jira/browse/BEAM-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17046227#comment-17046227 ] Pablo Estrada commented on BEAM-9392: - [~rohdesam] can you take a look please? > TestStream tests are

[jira] [Updated] (BEAM-9392) TestStream tests are all flaky

[ https://issues.apache.org/jira/browse/BEAM-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-9392: Status: Open (was: Triage Needed) > TestStream tests are all flaky >

[jira] [Created] (BEAM-9392) TestStream tests are all flaky

Pablo Estrada created BEAM-9392: --- Summary: TestStream tests are all flaky Key: BEAM-9392 URL: https://issues.apache.org/jira/browse/BEAM-9392 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-6807) Implement an Azure blobstore filesystem for Python SDK

[ https://issues.apache.org/jira/browse/BEAM-6807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044941#comment-17044941 ] Pablo Estrada commented on BEAM-6807: - This task will be available for 2020, yes. > Implement an

[jira] [Updated] (BEAM-6807) Implement an Azure blobstore filesystem for Python SDK

[ https://issues.apache.org/jira/browse/BEAM-6807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-6807: Labels: GSoC2019 azure azureblob gsoc gsoc2019 gsoc2020 mentor outreachy19dec (was: GSoC2019 azure

[jira] [Created] (BEAM-9381) Add display data to BoundedSourceSDF

Pablo Estrada created BEAM-9381: --- Summary: Add display data to BoundedSourceSDF Key: BEAM-9381 URL: https://issues.apache.org/jira/browse/BEAM-9381 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-9376) Delete python DirectRunner after FnApiRunner fully supports Batch & Streaming

[ https://issues.apache.org/jira/browse/BEAM-9376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-9376: Status: Open (was: Triage Needed) > Delete python DirectRunner after FnApiRunner fully supports

[jira] [Resolved] (BEAM-9242) Processing Stuck messages are reported by Dataflow as errors

[ https://issues.apache.org/jira/browse/BEAM-9242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-9242. - Fix Version/s: 2.20.0 Resolution: Fixed > Processing Stuck messages are reported by

[jira] [Updated] (BEAM-9242) Processing Stuck messages are reported by Dataflow as errors

[ https://issues.apache.org/jira/browse/BEAM-9242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-9242: Status: Open (was: Triage Needed) > Processing Stuck messages are reported by Dataflow as errors >

[jira] [Created] (BEAM-9242) Processing Stuck messages are reported by Dataflow as errors

Pablo Estrada created BEAM-9242: --- Summary: Processing Stuck messages are reported by Dataflow as errors Key: BEAM-9242 URL: https://issues.apache.org/jira/browse/BEAM-9242 Project: Beam Issue

[jira] [Assigned] (BEAM-9218) Template staging broken on Beam 2.18.0

[ https://issues.apache.org/jira/browse/BEAM-9218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-9218: --- Assignee: Robert Bradshaw > Template staging broken on Beam 2.18.0 >

[jira] [Updated] (BEAM-9218) Template staging broken on Beam 2.18.0

[ https://issues.apache.org/jira/browse/BEAM-9218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-9218: Status: Open (was: Triage Needed) > Template staging broken on Beam 2.18.0 >

[jira] [Assigned] (BEAM-6807) Implement an Azure blobstore filesystem for Python SDK

[ https://issues.apache.org/jira/browse/BEAM-6807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-6807: --- Assignee: (was: Pablo Estrada) > Implement an Azure blobstore filesystem for Python SDK

[jira] [Updated] (BEAM-2572) Implement an S3 filesystem for Python SDK

[ https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-2572: Fix Version/s: 2.19.0 > Implement an S3 filesystem for Python SDK >

[jira] [Resolved] (BEAM-2572) Implement an S3 filesystem for Python SDK

[ https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-2572. - Resolution: Fixed > Implement an S3 filesystem for Python SDK >

[jira] [Commented] (BEAM-2572) Implement an S3 filesystem for Python SDK

[ https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014572#comment-17014572 ] Pablo Estrada commented on BEAM-2572: - This made it into 2.19.0 only. Not 2.17 nor 2.18.0

[jira] [Created] (BEAM-9015) Make py37-cloud test suite for TOX instead of separate py37-gcp, and py37-aws

Pablo Estrada created BEAM-9015: --- Summary: Make py37-cloud test suite for TOX instead of separate py37-gcp, and py37-aws Key: BEAM-9015 URL: https://issues.apache.org/jira/browse/BEAM-9015 Project:

[jira] [Resolved] (BEAM-8976) No default logging story for Pipeline construction time in Python

[ https://issues.apache.org/jira/browse/BEAM-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-8976. - Resolution: Fixed > No default logging story for Pipeline construction time in Python >

[jira] [Commented] (BEAM-3523) Attach Python logging messages to namespaced logger

[ https://issues.apache.org/jira/browse/BEAM-3523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16999510#comment-16999510 ] Pablo Estrada commented on BEAM-3523: - I've started working on thjis > Attach Python logging messages

[jira] [Assigned] (BEAM-6860) WriteToText crash with "GlobalWindow -> ._IntervalWindowBase"

[ https://issues.apache.org/jira/browse/BEAM-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-6860: --- Assignee: Chamikara Madhusanka Jayalath (was: Pawel Kordek) > WriteToText crash with

[jira] [Updated] (BEAM-8981) Test issue

[ https://issues.apache.org/jira/browse/BEAM-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-8981: Labels: label123 (was: ) > Test issue > -- > > Key: BEAM-8981 >

[jira] [Created] (BEAM-8982) Testing board for Beam (ignore issue)

Pablo Estrada created BEAM-8982: --- Summary: Testing board for Beam (ignore issue) Key: BEAM-8982 URL: https://issues.apache.org/jira/browse/BEAM-8982 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-8976) No default logging story for Pipeline construction time in Python

[ https://issues.apache.org/jira/browse/BEAM-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-8976: Fix Version/s: 2.18.0 > No default logging story for Pipeline construction time in Python >

[jira] [Updated] (BEAM-8976) No default logging story for Pipeline construction time in Python

[ https://issues.apache.org/jira/browse/BEAM-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-8976: Status: Open (was: Triage Needed) > No default logging story for Pipeline construction time in

[jira] [Updated] (BEAM-2530) Make Beam compatible with next Java LTS version (Java 11)

[ https://issues.apache.org/jira/browse/BEAM-2530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-2530: Fix Version/s: (was: Not applicable) 2.18.0 > Make Beam compatible with next

[jira] [Updated] (BEAM-2530) Make Beam compatible with next Java LTS version (Java 11)

[ https://issues.apache.org/jira/browse/BEAM-2530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-2530: Fix Version/s: (was: 2.18.0) Not applicable > Make Beam compatible with next

[jira] [Created] (BEAM-8976) No default logging story for Pipeline construction time in Python

Pablo Estrada created BEAM-8976: --- Summary: No default logging story for Pipeline construction time in Python Key: BEAM-8976 URL: https://issues.apache.org/jira/browse/BEAM-8976 Project: Beam

[jira] [Assigned] (BEAM-8953) Extend ParquetIO.Read/ReadFiles.Builder to support Avro GenericData model

[ https://issues.apache.org/jira/browse/BEAM-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-8953: --- Assignee: Ryan Berti > Extend ParquetIO.Read/ReadFiles.Builder to support Avro GenericData

[jira] [Assigned] (BEAM-8932) Expose complete Cloud Pub/Sub messages through PubsubIO API

[ https://issues.apache.org/jira/browse/BEAM-8932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-8932: --- Assignee: Daniel Collins > Expose complete Cloud Pub/Sub messages through PubsubIO API >

[jira] [Commented] (BEAM-8898) Enable WriteToBigQuery to perform range partitioning

[ https://issues.apache.org/jira/browse/BEAM-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990084#comment-16990084 ] Pablo Estrada commented on BEAM-8898: - This would just be a matter of upgrading the library. I'll try

[jira] [Reopened] (BEAM-8864) BigQueryQueryToTableIT.test_big_query_legacy_sql - fails in post commit tests

[ https://issues.apache.org/jira/browse/BEAM-8864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reopened BEAM-8864: - > BigQueryQueryToTableIT.test_big_query_legacy_sql - fails in post commit tests >

[jira] [Issue Comment Deleted] (BEAM-8864) BigQueryQueryToTableIT.test_big_query_legacy_sql - fails in post commit tests

[ https://issues.apache.org/jira/browse/BEAM-8864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-8864: Comment: was deleted (was: 'Duplicate of BEAM-8197) >

[jira] [Resolved] (BEAM-8868) BigQueryWriteIntegrationTests.test_big_query_write_without_schema - flaky post commit

[ https://issues.apache.org/jira/browse/BEAM-8868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-8868. - Fix Version/s: Not applicable Resolution: Duplicate BEAM-8197 >

[jira] [Resolved] (BEAM-8864) BigQueryQueryToTableIT.test_big_query_legacy_sql - fails in post commit tests

[ https://issues.apache.org/jira/browse/BEAM-8864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-8864. - Fix Version/s: Not applicable Resolution: Duplicate 'Duplicate of BEAM-8197 >

[jira] [Commented] (BEAM-8197) test_big_query_write_without_schema might be flaky?

[ https://issues.apache.org/jira/browse/BEAM-8197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989998#comment-16989998 ] Pablo Estrada commented on BEAM-8197: - I ran this many times on my machine without failures. It may

[jira] [Commented] (BEAM-8868) BigQueryWriteIntegrationTests.test_big_query_write_without_schema - flaky post commit

[ https://issues.apache.org/jira/browse/BEAM-8868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989996#comment-16989996 ] Pablo Estrada commented on BEAM-8868: - I ran this many times yesterday without failure. It may have

[jira] [Updated] (BEAM-8898) Enable WriteToBigQuery to perform range partitioning

[ https://issues.apache.org/jira/browse/BEAM-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-8898: Status: Open (was: Triage Needed) > Enable WriteToBigQuery to perform range partitioning >

[jira] [Resolved] (BEAM-8842) Consistently timing out: BigQueryStreamingInsertTransformIntegrationTests.test_multiple_destinations_transform

[ https://issues.apache.org/jira/browse/BEAM-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-8842. - Fix Version/s: 2.19.0 Resolution: Fixed > Consistently timing out: >

[jira] [Commented] (BEAM-8197) test_big_query_write_without_schema might be flaky?

[ https://issues.apache.org/jira/browse/BEAM-8197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989086#comment-16989086 ] Pablo Estrada commented on BEAM-8197: - looking. > test_big_query_write_without_schema might be flaky?

[jira] [Commented] (BEAM-8842) Consistently timing out: BigQueryStreamingInsertTransformIntegrationTests.test_multiple_destinations_transform

[ https://issues.apache.org/jira/browse/BEAM-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989061#comment-16989061 ] Pablo Estrada commented on BEAM-8842: - Sorry about that. I had been missing the emails about this.

[jira] [Assigned] (BEAM-8892) Move Chicago Taxi Example Benchmarks to Beam orchestrator

[ https://issues.apache.org/jira/browse/BEAM-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-8892: --- Assignee: Mikhail Gryzykhin > Move Chicago Taxi Example Benchmarks to Beam orchestrator >

[jira] [Commented] (BEAM-8892) Move Chicago Taxi Example Benchmarks to Beam orchestrator

[ https://issues.apache.org/jira/browse/BEAM-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16988375#comment-16988375 ] Pablo Estrada commented on BEAM-8892: - assigning to Mikhail to see if it makes sense to prioritize at

[jira] [Commented] (BEAM-8892) Move Chicago Taxi Example Benchmarks to Beam orchestrator

[ https://issues.apache.org/jira/browse/BEAM-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16988374#comment-16988374 ] Pablo Estrada commented on BEAM-8892: - cc: [~Ardagan], [~mwalenia] > Move Chicago Taxi Example

[jira] [Updated] (BEAM-8892) Move Chicago Taxi Example Benchmarks to Beam orchestrator

[ https://issues.apache.org/jira/browse/BEAM-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-8892: Priority: Minor (was: Major) > Move Chicago Taxi Example Benchmarks to Beam orchestrator >

[jira] [Updated] (BEAM-8892) Move Chicago Taxi Example Benchmarks to Beam orchestrator

[ https://issues.apache.org/jira/browse/BEAM-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-8892: Status: Open (was: Triage Needed) > Move Chicago Taxi Example Benchmarks to Beam orchestrator >

[jira] [Created] (BEAM-8892) Move Chicago Taxi Example Benchmarks to Beam orchestrator

Pablo Estrada created BEAM-8892: --- Summary: Move Chicago Taxi Example Benchmarks to Beam orchestrator Key: BEAM-8892 URL: https://issues.apache.org/jira/browse/BEAM-8892 Project: Beam Issue

[jira] [Updated] (BEAM-6928) Make Python SDK custom Sink the default Sink for BigQuery

[ https://issues.apache.org/jira/browse/BEAM-6928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-6928: Priority: Major (was: Blocker) > Make Python SDK custom Sink the default Sink for BigQuery >

[jira] [Updated] (BEAM-6892) Use temp_location for BQ FILE_LOADS on DirectRunner, and autocreate it in GCS if not specified by user.

[ https://issues.apache.org/jira/browse/BEAM-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-6892: Fix Version/s: (was: 2.18.0) > Use temp_location for BQ FILE_LOADS on DirectRunner, and

[jira] [Resolved] (BEAM-8803) Default behaviour for Python BQ Streaming inserts sink should be to retry always

[ https://issues.apache.org/jira/browse/BEAM-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-8803. - Resolution: Fixed > Default behaviour for Python BQ Streaming inserts sink should be to retry >

[jira] [Updated] (BEAM-6892) Use temp_location for BQ FILE_LOADS on DirectRunner, and autocreate it in GCS if not specified by user.

[ https://issues.apache.org/jira/browse/BEAM-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-6892: Fix Version/s: 2.19.0 > Use temp_location for BQ FILE_LOADS on DirectRunner, and autocreate it in

[jira] [Updated] (BEAM-6928) Make Python SDK custom Sink the default Sink for BigQuery

[ https://issues.apache.org/jira/browse/BEAM-6928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-6928: Fix Version/s: (was: 2.18.0) 2.19.0 > Make Python SDK custom Sink the

[jira] [Commented] (BEAM-8803) Default behaviour for Python BQ Streaming inserts sink should be to retry always

[ https://issues.apache.org/jira/browse/BEAM-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983801#comment-16983801 ] Pablo Estrada commented on BEAM-8803: - This has been merged to the master branhc, so no need to worry

[jira] [Updated] (BEAM-8803) Default behaviour for Python BQ Streaming inserts sink should be to retry always

[ https://issues.apache.org/jira/browse/BEAM-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-8803: Priority: Major (was: Blocker) > Default behaviour for Python BQ Streaming inserts sink should be

[jira] [Updated] (BEAM-8833) Verify that SDF-related functionality is compatible with multiworker environment for FnApiRunner

[ https://issues.apache.org/jira/browse/BEAM-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-8833: Status: Open (was: Triage Needed) > Verify that SDF-related functionality is compatible with

[jira] [Created] (BEAM-8833) Verify that SDF-related functionality is compatible with multiworker environment for FnApiRunner

Pablo Estrada created BEAM-8833: --- Summary: Verify that SDF-related functionality is compatible with multiworker environment for FnApiRunner Key: BEAM-8833 URL: https://issues.apache.org/jira/browse/BEAM-8833

[jira] [Created] (BEAM-8823) Make FnApiRunner work by executing ready elements instead of stages

Pablo Estrada created BEAM-8823: --- Summary: Make FnApiRunner work by executing ready elements instead of stages Key: BEAM-8823 URL: https://issues.apache.org/jira/browse/BEAM-8823 Project: Beam

[jira] [Commented] (BEAM-8803) Default behaviour for Python BQ Streaming inserts sink should be to retry always

[ https://issues.apache.org/jira/browse/BEAM-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16980434#comment-16980434 ] Pablo Estrada commented on BEAM-8803: - After discussing with Cham, we will change the default behavior

[jira] [Commented] (BEAM-8803) Default behaviour for Python BQ Streaming inserts sink should be to retry always

[ https://issues.apache.org/jira/browse/BEAM-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979799#comment-16979799 ] Pablo Estrada commented on BEAM-8803: - Hm This is very troublesome. I'm writing a fix to make

[jira] [Updated] (BEAM-8803) Default behaviour for Python BQ Streaming inserts sink should be to retry always

[ https://issues.apache.org/jira/browse/BEAM-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-8803: Status: Open (was: Triage Needed) > Default behaviour for Python BQ Streaming inserts sink should

[jira] [Created] (BEAM-8803) Default behaviour for Python BQ Streaming inserts sink should be to retry always

Pablo Estrada created BEAM-8803: --- Summary: Default behaviour for Python BQ Streaming inserts sink should be to retry always Key: BEAM-8803 URL: https://issues.apache.org/jira/browse/BEAM-8803 Project:

[jira] [Updated] (BEAM-8745) More fine-grained controls for the size of a BigQuery Load job

[ https://issues.apache.org/jira/browse/BEAM-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-8745: Status: Open (was: Triage Needed) > More fine-grained controls for the size of a BigQuery Load job

[jira] [Created] (BEAM-8745) More fine-grained controls for the size of a BigQuery Load job

Pablo Estrada created BEAM-8745: --- Summary: More fine-grained controls for the size of a BigQuery Load job Key: BEAM-8745 URL: https://issues.apache.org/jira/browse/BEAM-8745 Project: Beam

[jira] [Resolved] (BEAM-2784) Fix issues from automated conversion to allow Python 2 functionality

[ https://issues.apache.org/jira/browse/BEAM-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-2784. - Fix Version/s: Not applicable Resolution: Won't Fix Marking as Won't fix, as this has been

[jira] [Created] (BEAM-8661) Move the Python codebase to have a logger hierarchy to ease debugging, and customize logging

Pablo Estrada created BEAM-8661: --- Summary: Move the Python codebase to have a logger hierarchy to ease debugging, and customize logging Key: BEAM-8661 URL: https://issues.apache.org/jira/browse/BEAM-8661

[jira] [Commented] (BEAM-2572) Implement an S3 filesystem for Python SDK

[ https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963425#comment-16963425 ] Pablo Estrada commented on BEAM-2572: - Very cool! Thanks [~mattmorgis]. I think you can start a pull

[jira] [Assigned] (BEAM-8012) Perf improvements for Python WriteToBigQuery with Streaming Inserts

[ https://issues.apache.org/jira/browse/BEAM-8012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-8012: --- Assignee: (was: Tanay Tummalapalli) > Perf improvements for Python WriteToBigQuery with

[jira] [Commented] (BEAM-8012) Perf improvements for Python WriteToBigQuery with Streaming Inserts

[ https://issues.apache.org/jira/browse/BEAM-8012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963173#comment-16963173 ] Pablo Estrada commented on BEAM-8012: - Unassigning for now to see if anyone takes a look > Perf

[jira] [Commented] (BEAM-7250) Use annotation based parameters for SDF on Java

[ https://issues.apache.org/jira/browse/BEAM-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963174#comment-16963174 ] Pablo Estrada commented on BEAM-7250: - Assigning to Boyuan to take a look : ) > Use annotation based

[jira] [Assigned] (BEAM-7250) Use annotation based parameters for SDF on Java

[ https://issues.apache.org/jira/browse/BEAM-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-7250: --- Assignee: Boyuan Zhang > Use annotation based parameters for SDF on Java >

[jira] [Created] (BEAM-8505) Too many variations of FnApiRunnerTest are running

Pablo Estrada created BEAM-8505: --- Summary: Too many variations of FnApiRunnerTest are running Key: BEAM-8505 URL: https://issues.apache.org/jira/browse/BEAM-8505 Project: Beam Issue Type:

[jira] [Resolved] (BEAM-8446) apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests.test_big_query_write_new_types is flaky

[ https://issues.apache.org/jira/browse/BEAM-8446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-8446. - Fix Version/s: Not applicable Resolution: Fixed Fixed. Issue now is that the build is

[jira] [Updated] (BEAM-8474) A microbenchmark that exercises the FnAPI runner functionality

[ https://issues.apache.org/jira/browse/BEAM-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-8474: Status: Open (was: Triage Needed) > A microbenchmark that exercises the FnAPI runner functionality

[jira] [Created] (BEAM-8474) A microbenchmark that exercises the FnAPI runner functionality

Pablo Estrada created BEAM-8474: --- Summary: A microbenchmark that exercises the FnAPI runner functionality Key: BEAM-8474 URL: https://issues.apache.org/jira/browse/BEAM-8474 Project: Beam

[jira] [Created] (BEAM-8467) Enable reading compressed files with Python fileio

Pablo Estrada created BEAM-8467: --- Summary: Enable reading compressed files with Python fileio Key: BEAM-8467 URL: https://issues.apache.org/jira/browse/BEAM-8467 Project: Beam Issue Type:

[jira] [Updated] (BEAM-8467) Enable reading compressed files with Python fileio

[ https://issues.apache.org/jira/browse/BEAM-8467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-8467: Status: Open (was: Triage Needed) > Enable reading compressed files with Python fileio >

[jira] [Commented] (BEAM-8457) Instrument Dataflow jobs that are launched from Notebooks

[ https://issues.apache.org/jira/browse/BEAM-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958147#comment-16958147 ] Pablo Estrada commented on BEAM-8457: - yes, this change is for the current release. > Instrument

[jira] [Resolved] (BEAM-8367) Python BigQuery sink should use unique IDs for mode STREAMING_INSERTS

[ https://issues.apache.org/jira/browse/BEAM-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-8367. - Resolution: Fixed > Python BigQuery sink should use unique IDs for mode STREAMING_INSERTS >

[jira] [Commented] (BEAM-8367) Python BigQuery sink should use unique IDs for mode STREAMING_INSERTS

[ https://issues.apache.org/jira/browse/BEAM-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958146#comment-16958146 ] Pablo Estrada commented on BEAM-8367: - Yes. Fixed. Thanks! > Python BigQuery sink should use unique

[jira] [Updated] (BEAM-6892) Use temp_location for BQ FILE_LOADS on DirectRunner, and autocreate it in GCS if not specified by user.

[ https://issues.apache.org/jira/browse/BEAM-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-6892: Fix Version/s: 2.18.0 > Use temp_location for BQ FILE_LOADS on DirectRunner, and autocreate it in

[jira] [Updated] (BEAM-6928) Make Python SDK custom Sink the default Sink for BigQuery

[ https://issues.apache.org/jira/browse/BEAM-6928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-6928: Fix Version/s: 2.18.0 > Make Python SDK custom Sink the default Sink for BigQuery >

[jira] [Updated] (BEAM-8446) apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests.test_big_query_write_new_types is flaky

[ https://issues.apache.org/jira/browse/BEAM-8446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-8446: Status: Open (was: Triage Needed) >

[jira] [Updated] (BEAM-8457) Instrument Dataflow jobs that are launched from Notebooks

[ https://issues.apache.org/jira/browse/BEAM-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-8457: Priority: Blocker (was: Major) > Instrument Dataflow jobs that are launched from Notebooks >

[jira] [Updated] (BEAM-8457) Instrument Dataflow jobs that are launched from Notebooks

[ https://issues.apache.org/jira/browse/BEAM-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-8457: Fix Version/s: 2.17.0 > Instrument Dataflow jobs that are launched from Notebooks >

[jira] [Assigned] (BEAM-8446) apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests.test_big_query_write_new_types is flaky

[ https://issues.apache.org/jira/browse/BEAM-8446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-8446: --- Assignee: Pablo Estrada (was: Juta Staes) >

[jira] [Commented] (BEAM-8367) Python BigQuery sink should use unique IDs for mode STREAMING_INSERTS

[ https://issues.apache.org/jira/browse/BEAM-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951448#comment-16951448 ] Pablo Estrada commented on BEAM-8367: - https://github.com/apache/beam/pull/9797 out to fix > Python

[jira] [Commented] (BEAM-8367) Python BigQuery sink should use unique IDs for mode STREAMING_INSERTS

[ https://issues.apache.org/jira/browse/BEAM-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951446#comment-16951446 ] Pablo Estrada commented on BEAM-8367: - Working on fixing this > Python BigQuery sink should use

[jira] [Updated] (BEAM-8367) Python BigQuery sink should use unique IDs for mode STREAMING_INSERTS

[ https://issues.apache.org/jira/browse/BEAM-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-8367: Status: Open (was: Triage Needed) > Python BigQuery sink should use unique IDs for mode

[jira] [Resolved] (BEAM-8333) Python SDK Worker should log lulls with progress-reporting thread

[ https://issues.apache.org/jira/browse/BEAM-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-8333. - Fix Version/s: 2.17.0 Resolution: Fixed > Python SDK Worker should log lulls with

<    1   2   3   4   5   >