[jira] [Updated] (BEAM-13182) [Playground] Document in detail the process of a Java pipeline (including handling of the main method)

2021-11-03 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-13182: - Status: Open (was: Triage Needed) > [Playground] Document in detail the process of a Java pipeli

[jira] [Updated] (BEAM-13182) [Playground] Document in detail the process of a Java pipeline (including handling of the main method)

2021-11-03 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-13182: - Labels: beam-playground-backend (was: beam-playground-frontend) > [Playground] Document in detai

[jira] [Updated] (BEAM-13165) Significant code duplication between WriteFn and WriteWithResultsFn

2021-11-03 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-13165: - Resolution: Fixed Status: Resolved (was: Open) > Significant code duplication between Wr

[jira] [Created] (BEAM-13181) FhirIO import functionality does unnecessary sharding of import files

2021-11-03 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-13181: Summary: FhirIO import functionality does unnecessary sharding of import files Key: BEAM-13181 URL: https://issues.apache.org/jira/browse/BEAM-13181 Project: Beam

[jira] [Updated] (BEAM-13181) FhirIO import functionality does unnecessary sharding of import files

2021-11-03 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-13181: - Status: Open (was: Triage Needed) > FhirIO import functionality does unnecessary sharding of imp

[jira] [Created] (BEAM-13165) Significant code duplication between WriteFn and WriteWithResultsFn

2021-11-01 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-13165: Summary: Significant code duplication between WriteFn and WriteWithResultsFn Key: BEAM-13165 URL: https://issues.apache.org/jira/browse/BEAM-13165 Project: Beam

[jira] [Created] (BEAM-13149) JdbcIO.readWithPartitions supports only int ranges

2021-10-29 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-13149: Summary: JdbcIO.readWithPartitions supports only int ranges Key: BEAM-13149 URL: https://issues.apache.org/jira/browse/BEAM-13149 Project: Beam Issue Type: T

[jira] [Created] (BEAM-13144) Update to TextIO to support ValueProviders breaks runner-chosen sharding

2021-10-28 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-13144: Summary: Update to TextIO to support ValueProviders breaks runner-chosen sharding Key: BEAM-13144 URL: https://issues.apache.org/jira/browse/BEAM-13144 Project: Beam

[jira] [Commented] (BEAM-12777) Stable URL for "current" API Documentation

2021-10-05 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17424740#comment-17424740 ] Pablo Estrada commented on BEAM-12777: -- this makes sense. Furthermore, I think that

[jira] [Created] (BEAM-13004) A load test for DebeziumIO that uses postgress as a database

2021-10-04 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-13004: Summary: A load test for DebeziumIO that uses postgress as a database Key: BEAM-13004 URL: https://issues.apache.org/jira/browse/BEAM-13004 Project: Beam Is

[jira] [Created] (BEAM-13003) An integration test for DebeziumIO that connects to PostgresSQL

2021-10-04 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-13003: Summary: An integration test for DebeziumIO that connects to PostgresSQL Key: BEAM-13003 URL: https://issues.apache.org/jira/browse/BEAM-13003 Project: Beam

[jira] [Updated] (BEAM-12781) SDFBoundedSourceReader behaves much slower compared with the original behavior of BoundedSource

2021-10-01 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-12781: - Resolution: Fixed Status: Resolved (was: Open) > SDFBoundedSourceReader behaves much slo

[jira] [Updated] (BEAM-9119) apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].test_large_elements is flaky (sickbayed)

2021-09-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-9119: Resolution: Fixed Status: Resolved (was: Open) > apache_beam.runners.portability.fn_api_run

[jira] [Updated] (BEAM-3097) Allow BigQuerySource to take a ValueProvider as a table input.

2021-09-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-3097: Resolution: Fixed Status: Resolved (was: Open) > Allow BigQuerySource to take a ValueProvid

[jira] [Updated] (BEAM-5517) Update Python BigQuery source to use fastavro module to read exported data

2021-09-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-5517: Resolution: Fixed Status: Resolved (was: Open) > Update Python BigQuery source to use fasta

[jira] [Updated] (BEAM-5654) Race condition in python sdk_worker causing KeyError

2021-09-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-5654: Resolution: Fixed Status: Resolved (was: Open) > Race condition in python sdk_worker causin

[jira] [Updated] (BEAM-1218) De-Googlify Python SDK

2021-09-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-1218: Resolution: Fixed Status: Resolved (was: Open) > De-Googlify Python SDK > -

[jira] [Updated] (BEAM-10707) Separate Python precommit tests from Python docs precommit tests

2021-09-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-10707: - Resolution: Fixed Status: Resolved (was: Open) > Separate Python precommit tests from Py

[jira] [Assigned] (BEAM-3566) Replace Python DirectRunner apply_* hooks with PTransformOverrides

2021-09-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-3566: --- Assignee: Sam Rohde > Replace Python DirectRunner apply_* hooks with PTransformOverrides > --

[jira] [Updated] (BEAM-3566) Replace Python DirectRunner apply_* hooks with PTransformOverrides

2021-09-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-3566: Resolution: Fixed Status: Resolved (was: Open) > Replace Python DirectRunner apply_* hooks

[jira] [Updated] (BEAM-10856) Support NestedValueProvider for Python SDK

2021-09-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-10856: - Resolution: Fixed Status: Resolved (was: Open) > Support NestedValueProvider for Python

[jira] [Commented] (BEAM-2694) Python shim for submitting to GearpumpRunner

2021-09-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17421844#comment-17421844 ] Pablo Estrada commented on BEAM-2694: - is this deprioritized? what's the plan for this

[jira] [Updated] (BEAM-3887) Python SDK harness retrieves element codes from gRPC read/write nodes

2021-09-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-3887: Resolution: Fixed Status: Resolved (was: Open) > Python SDK harness retrieves element codes

[jira] [Updated] (BEAM-3888) Python SDK propagates pipeline options correctly when talking to Job API

2021-09-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-3888: Resolution: Fixed Status: Resolved (was: Open) > Python SDK propagates pipeline options cor

[jira] [Updated] (BEAM-9762) Production-ready BigQuery IOs for Python SDK

2021-09-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-9762: Resolution: Fixed Status: Resolved (was: Open) This has been resolved. > Production-ready

[jira] [Updated] (BEAM-8320) Dataflow runner metric glitch for python streaming

2021-09-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-8320: Resolution: Fixed Status: Resolved (was: Open) i believe this is fixed. Please feel free to

[jira] [Updated] (BEAM-530) Decide where to place the tests and examples for the Python SDK

2021-09-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-530: --- Resolution: Fixed Status: Resolved (was: Open) this has been done. > Decide where to place th

[jira] [Updated] (BEAM-9058) Line-too-long Python lint checks are no longer working.

2021-09-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-9058: Resolution: Fixed Status: Resolved (was: Open) > Line-too-long Python lint checks are no lo

[jira] [Updated] (BEAM-8012) Perf improvements for Python WriteToBigQuery with Streaming Inserts

2021-09-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-8012: Resolution: Fixed Status: Resolved (was: Open) > Perf improvements for Python WriteToBigQue

[jira] [Updated] (BEAM-9029) Two bugs in Python SDK S3 filesystem support

2021-09-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-9029: Resolution: Fixed Status: Resolved (was: Open) > Two bugs in Python SDK S3 filesystem suppo

[jira] [Updated] (BEAM-7768) Formalize Python external transform API

2021-09-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-7768: Resolution: Fixed Status: Resolved (was: Open) > Formalize Python external transform API >

[jira] [Updated] (BEAM-3885) Python SDK Read IO is expressed as Impulse -> ParDo

2021-09-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-3885: Resolution: Fixed Status: Resolved (was: Open) > Python SDK Read IO is expressed as Impulse

[jira] [Updated] (BEAM-6702) GCP dependencies for the Python SDK are too restrictive

2021-09-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-6702: Resolution: Fixed Status: Resolved (was: Open) > GCP dependencies for the Python SDK are to

[jira] [Updated] (BEAM-802) Support Dynamic PipelineOptions for python

2021-09-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-802: --- Resolution: Fixed Status: Resolved (was: Open) > Support Dynamic PipelineOptions for python >

[jira] [Updated] (BEAM-6737) Python dataflow precommit IT failing

2021-09-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-6737: Resolution: Abandoned Status: Resolved (was: Open) > Python dataflow precommit IT failing >

[jira] [Updated] (BEAM-3884) Python SDK supports Impulse as a primitive transform

2021-09-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-3884: Resolution: Fixed Status: Resolved (was: Open) > Python SDK supports Impulse as a primitive

[jira] [Updated] (BEAM-7516) Add a watermark manager for the fn_api_runner

2021-09-23 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-7516: Assignee: Pablo Estrada Resolution: Fixed Status: Resolved (was: Open) > Add a waterm

[jira] [Updated] (BEAM-2855) Implement a Python version of the Nexmark queries

2021-09-23 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-2855: Assignee: Yichi Zhang Resolution: Fixed Status: Resolved (was: Open) > Implement a Py

[jira] [Updated] (BEAM-9640) Track PCollection watermark across bundle executions

2021-09-22 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-9640: Resolution: Fixed Status: Resolved (was: Open) > Track PCollection watermark across bundle

[jira] [Updated] (BEAM-12445) Move Python's BigQuery streaming insert sink to the new BigQuery api client

2021-09-20 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-12445: - Fix Version/s: 2.33.0 Resolution: Fixed Status: Resolved (was: Open) > Move Py

[jira] [Commented] (BEAM-12773) 404 Session not found, when querying Google Cloud Spanner with Python Dataflow.

2021-09-13 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17414500#comment-17414500 ] Pablo Estrada commented on BEAM-12773: -- Does this run as a template? > 404 Session

[jira] [Updated] (BEAM-12497) BigQueryIO should return successfully inserted rows

2021-09-08 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-12497: - Fix Version/s: 2.32.0 Assignee: Pablo Estrada Resolution: Fixed Status:

[jira] [Commented] (BEAM-12781) SDFBoundedSourceReader behaves much slower compared with the original behavior of BoundedSource

2021-08-20 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17402329#comment-17402329 ] Pablo Estrada commented on BEAM-12781: -- Okay, I finally have a reasonable theory of

[jira] [Created] (BEAM-12781) SDFBoundedSourceReader behaves much slower compared with the original behavior of BoundedSource

2021-08-20 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-12781: Summary: SDFBoundedSourceReader behaves much slower compared with the original behavior of BoundedSource Key: BEAM-12781 URL: https://issues.apache.org/jira/browse/BEAM-12781

[jira] [Updated] (BEAM-12525) SDF BoundedSource seems to execute significantly slower than 'normal' BoundedSource

2021-06-22 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-12525: - Priority: P1 (was: P2) > SDF BoundedSource seems to execute significantly slower than 'normal'

[jira] [Created] (BEAM-12525) SDF BoundedSource seems to execute significantly slower than 'normal' BoundedSource

2021-06-22 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-12525: Summary: SDF BoundedSource seems to execute significantly slower than 'normal' BoundedSource Key: BEAM-12525 URL: https://issues.apache.org/jira/browse/BEAM-12525 Pro

[jira] [Created] (BEAM-12497) BigQueryIO should return successfully inserted rows

2021-06-15 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-12497: Summary: BigQueryIO should return successfully inserted rows Key: BEAM-12497 URL: https://issues.apache.org/jira/browse/BEAM-12497 Project: Beam Issue Type:

[jira] [Created] (BEAM-12496) File loads for BigQuery are not working in streaming

2021-06-15 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-12496: Summary: File loads for BigQuery are not working in streaming Key: BEAM-12496 URL: https://issues.apache.org/jira/browse/BEAM-12496 Project: Beam Issue Type:

[jira] [Created] (BEAM-12468) Enable BigQueryIO to receive a project argument so that jobs will run on that project

2021-06-09 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-12468: Summary: Enable BigQueryIO to receive a project argument so that jobs will run on that project Key: BEAM-12468 URL: https://issues.apache.org/jira/browse/BEAM-12468 P

[jira] [Created] (BEAM-12445) Move Python's BigQuery streaming insert sink to the new BigQuery api client

2021-06-02 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-12445: Summary: Move Python's BigQuery streaming insert sink to the new BigQuery api client Key: BEAM-12445 URL: https://issues.apache.org/jira/browse/BEAM-12445 Project: Be

[jira] [Assigned] (BEAM-7514) Support streaming on the Python fn_api_runner

2021-05-11 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-7514: --- Assignee: Pablo Estrada > Support streaming on the Python fn_api_runner > ---

[jira] [Updated] (BEAM-11271) Update BigQuery source to perform datasets.get instead of tables.get to determine location

2021-05-07 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-11271: - Fix Version/s: 2.31.0 Assignee: Pablo Estrada Resolution: Fixed Status:

[jira] [Updated] (BEAM-1891) Java @Autovalue: currently doesn't have a good coder

2021-05-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-1891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-1891: Resolution: Fixed Status: Resolved (was: Open) This is fixed by tagging with `@DefaultSchem

[jira] [Assigned] (BEAM-12266) Add an example for consuming standard twitter streams live

2021-05-03 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-12266: Assignee: Pablo Estrada > Add an example for consuming standard twitter streams live > ---

[jira] [Assigned] (BEAM-12266) Add an example for consuming standard twitter streams live

2021-05-03 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-12266: Assignee: Uday Singh (was: Pablo Estrada) > Add an example for consuming standard twitter

[jira] [Updated] (BEAM-12003) Verify and document the temp_dataset option for new Python BigQuery source

2021-04-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-12003: - Resolution: Fixed Status: Resolved (was: Open) Fixed here:  https://github.com/apache/be

[jira] [Commented] (BEAM-11736) FnApiRunner should pass PipelineOptions to sdk_worker instances

2021-04-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17334894#comment-17334894 ] Pablo Estrada commented on BEAM-11736: -- this is fixed! > FnApiRunner should pass Pi

[jira] [Commented] (BEAM-9917) BigQueryBatchFileLoads dynamic destination

2021-04-15 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17322465#comment-17322465 ] Pablo Estrada commented on BEAM-9917: - making p2 as this is reported on an older versi

[jira] [Updated] (BEAM-9917) BigQueryBatchFileLoads dynamic destination

2021-04-15 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-9917: Priority: P2 (was: P1) > BigQueryBatchFileLoads dynamic destination > -

[jira] [Assigned] (BEAM-9917) BigQueryBatchFileLoads dynamic destination

2021-04-14 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-9917: --- Assignee: Pablo Estrada > BigQueryBatchFileLoads dynamic destination > --

[jira] [Commented] (BEAM-9917) BigQueryBatchFileLoads dynamic destination

2021-04-14 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17321803#comment-17321803 ] Pablo Estrada commented on BEAM-9917: - Is it correct that you've seen this with Beam 2

[jira] [Updated] (BEAM-12164) SpannerIO Change Stream Connector

2021-04-14 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-12164: - Status: Open (was: Triage Needed) > SpannerIO Change Stream Connector >

[jira] [Assigned] (BEAM-12164) SpannerIO Change Stream Connector

2021-04-14 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-12164: Assignee: Thiago Nunes > SpannerIO Change Stream Connector > -

[jira] [Commented] (BEAM-12125) BQ source split for large loads

2021-04-08 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317463#comment-17317463 ] Pablo Estrada commented on BEAM-12125: -- An update is that we expect to have a ReadAP

[jira] [Commented] (BEAM-11271) Update BigQuery source to perform datasets.get instead of tables.get to determine location

2021-04-08 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317430#comment-17317430 ] Pablo Estrada commented on BEAM-11271: -- [~chamikara] do you know where this feedback

[jira] [Created] (BEAM-12125) BQ source split for large loads

2021-04-07 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-12125: Summary: BQ source split for large loads Key: BEAM-12125 URL: https://issues.apache.org/jira/browse/BEAM-12125 Project: Beam Issue Type: Bug Compon

[jira] [Updated] (BEAM-12125) BQ source split for large loads

2021-04-07 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-12125: - Status: Open (was: Triage Needed) > BQ source split for large loads > --

[jira] [Updated] (BEAM-11810) A trigger manager for the FnApiRunner

2021-03-30 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-11810: - Resolution: Fixed Status: Resolved (was: Open) > A trigger manager for the FnApiRunner >

[jira] [Assigned] (BEAM-7514) Support streaming on the Python fn_api_runner

2021-03-30 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-7514: --- Assignee: Pablo Estrada > Support streaming on the Python fn_api_runner > ---

[jira] [Commented] (BEAM-12072) WriteToFiles with a concrete sink can shunt data to a single window

2021-03-30 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17311829#comment-17311829 ] Pablo Estrada commented on BEAM-12072: -- The WriteToFiles sink behaves somewhat diffe

[jira] [Updated] (BEAM-12004) Add pyright to CI

2021-03-23 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-12004: - Component/s: sdk-py-core > Add pyright to CI > - > > Key: BEAM-12

[jira] [Commented] (BEAM-12004) Add pyright to CI

2021-03-23 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17307438#comment-17307438 ] Pablo Estrada commented on BEAM-12004: -- fyi [~udim] > Add pyright to CI > -

[jira] [Updated] (BEAM-12004) Add pyright to CI

2021-03-23 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-12004: - Status: Open (was: Triage Needed) > Add pyright to CI > - > > Ke

[jira] [Commented] (BEAM-11330) BigQueryServicesImpl.insertAll evaluates maxRowBatchSize after a row is added to the batch

2021-03-23 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17307350#comment-17307350 ] Pablo Estrada commented on BEAM-11330: -- Thanks [~liamhaworth01] for looking and find

[jira] [Assigned] (BEAM-11330) BigQueryServicesImpl.insertAll evaluates maxRowBatchSize after a row is added to the batch

2021-03-23 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-11330: Assignee: Pablo Estrada > BigQueryServicesImpl.insertAll evaluates maxRowBatchSize after a

[jira] [Updated] (BEAM-11330) BigQueryServicesImpl.insertAll evaluates maxRowBatchSize after a row is added to the batch

2021-03-23 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-11330: - Status: Open (was: Triage Needed) > BigQueryServicesImpl.insertAll evaluates maxRowBatchSize aft

[jira] [Updated] (BEAM-12026) Support custom window fns on TriggerManager

2021-03-22 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-12026: - Status: Open (was: Triage Needed) > Support custom window fns on TriggerManager > --

[jira] [Assigned] (BEAM-12026) Support custom window fns on TriggerManager

2021-03-22 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-12026: Assignee: Pablo Estrada > Support custom window fns on TriggerManager > --

[jira] [Created] (BEAM-12026) Support custom window fns on TriggerManager

2021-03-22 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-12026: Summary: Support custom window fns on TriggerManager Key: BEAM-12026 URL: https://issues.apache.org/jira/browse/BEAM-12026 Project: Beam Issue Type: Sub-task

[jira] [Assigned] (BEAM-11578) `dataflow_metrics` (python) fails with TypeError (when int overflowing?)

2021-03-16 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-11578: Assignee: Pablo Estrada > `dataflow_metrics` (python) fails with TypeError (when int overf

[jira] [Updated] (BEAM-11578) `dataflow_metrics` (python) fails with TypeError (when int overflowing?)

2021-03-16 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-11578: - Status: Open (was: Triage Needed) > `dataflow_metrics` (python) fails with TypeError (when int o

[jira] [Updated] (BEAM-10511) Allow users to specify the temporary dataset for BQ

2021-03-16 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-10511: - Assignee: Pablo Estrada Resolution: Fixed Status: Resolved (was: Open) > Allow use

[jira] [Commented] (BEAM-10511) Allow users to specify the temporary dataset for BQ

2021-03-16 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302664#comment-17302664 ] Pablo Estrada commented on BEAM-10511: -- this has been added > Allow users to specif

[jira] [Updated] (BEAM-11503) Beam Dependency Update Request: org.rocksdb:rocksdbjni

2021-03-12 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-11503: - Resolution: Fixed Status: Resolved (was: Triage Needed) > Beam Dependency Update Request

[jira] [Updated] (BEAM-11516) Upgrade to pylint 2.6.0

2021-03-12 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-11516: - Status: Open (was: Triage Needed) > Upgrade to pylint 2.6.0 > --- > >

[jira] [Updated] (BEAM-11705) Write to bigquery always assigns unique insert id per row causing performance issue

2021-03-12 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-11705: - Fix Version/s: 2.29.0 Resolution: Fixed Status: Resolved (was: Triage Needed)

[jira] [Deleted] (BEAM-11577) Coktogel

2021-03-12 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada deleted BEAM-11577: - > Coktogel > > > Key: BEAM-11577 > URL: https://issues.apac

[jira] [Deleted] (BEAM-11575) Coktogel

2021-03-12 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada deleted BEAM-11575: - > Coktogel > > > Key: BEAM-11575 > URL: https://issues.apac

[jira] [Updated] (BEAM-11922) org.apache.beam.examples.cookbook.MapClassIntegrationIT.testDataflowMapState has been failing in master

2021-03-12 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-11922: - Status: Open (was: Triage Needed) > org.apache.beam.examples.cookbook.MapClassIntegrationIT.test

[jira] [Commented] (BEAM-11709) Beam BOM produces incorrect variant in Gradle module metadata

2021-03-11 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17299961#comment-17299961 ] Pablo Estrada commented on BEAM-11709: -- is this fixed? > Beam BOM produces incorrec

[jira] [Updated] (BEAM-11884) Deterministic coding enforcement causes BigQueryBatchFieldLoads/GroupFilesByTableDestinations to fail

2021-03-11 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-11884: - Fix Version/s: 2.29.0 > Deterministic coding enforcement causes > BigQueryBatchFieldLoads/GroupF

[jira] [Updated] (BEAM-11709) Beam BOM produces incorrect variant in Gradle module metadata

2021-03-11 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-11709: - Status: Open (was: Triage Needed) > Beam BOM produces incorrect variant in Gradle module metadat

[jira] [Updated] (BEAM-11884) Deterministic coding enforcement causes BigQueryBatchFieldLoads/GroupFilesByTableDestinations to fail

2021-03-11 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-11884: - Resolution: Fixed Status: Resolved (was: Triage Needed) > Deterministic coding enforceme

[jira] [Assigned] (BEAM-11648) Implement new BigQuery sink (Vortex)

2021-03-11 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-11648: Assignee: Reuven Lax > Implement new BigQuery sink (Vortex) >

[jira] [Updated] (BEAM-11648) Implement new BigQuery sink (Vortex)

2021-03-11 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-11648: - Status: Open (was: Triage Needed) > Implement new BigQuery sink (Vortex) > -

[jira] [Updated] (BEAM-11687) Certain exceptions in SDF wrapper should not fail the bundle directly

2021-03-11 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-11687: - Status: Open (was: Triage Needed) > Certain exceptions in SDF wrapper should not fail the bundle

[jira] [Assigned] (BEAM-11544) BQML pattern

2021-03-11 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-11544: Assignee: Matthias Baetens > BQML pattern > > > Key: BEAM-115

[jira] [Work started] (BEAM-11719) Enforce deterministic coding for GroupByKey and Stateful DoFns

2021-03-11 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-11719 started by Robert Bradshaw. -- > Enforce deterministic coding for GroupByKey and Stateful DoFns > -

[jira] [Updated] (BEAM-11719) Enforce deterministic coding for GroupByKey and Stateful DoFns

2021-03-11 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-11719: - Fix Version/s: 2.29.0 Resolution: Fixed Status: Resolved (was: In Progress) >

[jira] [Updated] (BEAM-11719) Enforce deterministic coding for GroupByKey and Stateful DoFns

2021-03-11 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-11719: - Status: Open (was: Triage Needed) > Enforce deterministic coding for GroupByKey and Stateful DoF

<    1   2   3   4   5   6   7   8   9   >