[jira] [Created] (BEAM-10853) Copy jobs for multi-table imports to BQ have duplicated names.

2020-09-03 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-10853: Summary: Copy jobs for multi-table imports to BQ have duplicated names. Key: BEAM-10853 URL: https://issues.apache.org/jira/browse/BEAM-10853 Project: Beam

[jira] [Created] (BEAM-11041) Match job messages and behavior for Java and Python when launching BQ jobs

2020-10-07 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-11041: Summary: Match job messages and behavior for Java and Python when launching BQ jobs Key: BEAM-11041 URL: https://issues.apache.org/jira/browse/BEAM-11041 Project: Bea

[jira] [Updated] (BEAM-11041) Match job messages and behavior for Java and Python when launching BQ jobs

2020-10-07 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-11041: - Status: Resolved (was: Open) > Match job messages and behavior for Java and Python when launchin

[jira] [Updated] (BEAM-7514) Support streaming on the Python fn_api_runner

2020-10-13 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-7514: Priority: P2 (was: P3) > Support streaming on the Python fn_api_runner > --

[jira] [Assigned] (BEAM-7514) Support streaming on the Python fn_api_runner

2020-10-13 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-7514: --- Assignee: Pablo Estrada > Support streaming on the Python fn_api_runner > ---

[jira] [Commented] (BEAM-7514) Support streaming on the Python fn_api_runner

2020-10-13 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213284#comment-17213284 ] Pablo Estrada commented on BEAM-7514: - still working on this. Just slowly : ) > Suppo

[jira] [Created] (BEAM-11069) Performance improvements for ReadFromBigQuery transform

2020-10-16 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-11069: Summary: Performance improvements for ReadFromBigQuery transform Key: BEAM-11069 URL: https://issues.apache.org/jira/browse/BEAM-11069 Project: Beam Issue Ty

[jira] [Updated] (BEAM-11006) Allow Failsafe Handling of BigQuery Streaming Writes

2020-10-17 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-11006: - Status: Resolved (was: Triage Needed) > Allow Failsafe Handling of BigQuery Streaming Writes > -

[jira] [Created] (BEAM-11093) Python BQIO documentation outdated

2020-10-21 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-11093: Summary: Python BQIO documentation outdated Key: BEAM-11093 URL: https://issues.apache.org/jira/browse/BEAM-11093 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-11093) Python BQIO documentation outdated

2020-10-21 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-11093: - Status: Resolved (was: Open) > Python BQIO documentation outdated >

[jira] [Updated] (BEAM-10778) Azure filesystem test to run against Azure service or emulator

2020-08-21 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-10778: - Status: Open (was: Triage Needed) > Azure filesystem test to run against Azure service or emulat

[jira] [Assigned] (BEAM-10778) Azure filesystem test to run against Azure service or emulator

2020-08-23 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-10778: Assignee: Pablo Estrada > Azure filesystem test to run against Azure service or emulator >

[jira] [Commented] (BEAM-10778) Azure filesystem test to run against Azure service or emulator

2020-08-23 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182870#comment-17182870 ] Pablo Estrada commented on BEAM-10778: -- FYI [~Aldair] - we'll try to make this happe

[jira] [Commented] (BEAM-10827) google-cloud-spanner is incompatible with google-cloud-core

2020-08-27 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17186230#comment-17186230 ] Pablo Estrada commented on BEAM-10827: -- Should this be closed? > google-cloud-spann

[jira] [Created] (BEAM-11115) Remove _CustomBigQuerySource implementation to rely on ReadAllFromBigQuery

2020-10-23 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-5: Summary: Remove _CustomBigQuerySource implementation to rely on ReadAllFromBigQuery Key: BEAM-5 URL: https://issues.apache.org/jira/browse/BEAM-5 Project: Bea

[jira] [Assigned] (BEAM-10640) Return ERROR details from apache_beam.io.gcp.bigquery.WriteToBigQuery failed inserts

2020-10-27 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-10640: Assignee: Pablo Estrada > Return ERROR details from apache_beam.io.gcp.bigquery.WriteToBig

[jira] [Updated] (BEAM-10640) Return ERROR details from apache_beam.io.gcp.bigquery.WriteToBigQuery failed inserts

2020-10-27 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-10640: - Status: Open (was: Triage Needed) > Return ERROR details from apache_beam.io.gcp.bigquery.WriteT

[jira] [Updated] (BEAM-10640) Return ERROR details from apache_beam.io.gcp.bigquery.WriteToBigQuery failed inserts

2020-10-27 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-10640: - Priority: P2 (was: P1) > Return ERROR details from apache_beam.io.gcp.bigquery.WriteToBigQuery f

[jira] [Commented] (BEAM-10640) Return ERROR details from apache_beam.io.gcp.bigquery.WriteToBigQuery failed inserts

2020-10-27 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17221769#comment-17221769 ] Pablo Estrada commented on BEAM-10640: -- Hi [~leiterenato] - this makes sense. Would

[jira] [Assigned] (BEAM-11146) Add option to disable copying between Flink runner

2020-10-27 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-11146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-11146: Assignee: Teodor Spæren > Add option to disable copying between Flink runner > --

[jira] [Assigned] (BEAM-10640) Return ERROR details from apache_beam.io.gcp.bigquery.WriteToBigQuery failed inserts

2020-10-27 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-10640: Assignee: (was: Pablo Estrada) > Return ERROR details from apache_beam.io.gcp.bigquery

[jira] [Updated] (BEAM-9763) Make _ReadFromBigQuery public

2020-11-02 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-9763: Status: Resolved (was: Open) > Make _ReadFromBigQuery public > - > >

[jira] [Assigned] (BEAM-9763) Make _ReadFromBigQuery public

2020-11-02 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-9763: --- Assignee: Pablo Estrada > Make _ReadFromBigQuery public > - > >

[jira] [Assigned] (BEAM-9762) Production-ready BigQuery IOs for Python SDK

2020-11-02 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-9762: --- Assignee: Pablo Estrada > Production-ready BigQuery IOs for Python SDK >

[jira] [Assigned] (BEAM-8910) Use AVRO instead of JSON in BigQuery bounded source.

2020-11-05 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-8910: --- Assignee: Pablo Estrada > Use AVRO instead of JSON in BigQuery bounded source. >

[jira] [Updated] (BEAM-8910) Use AVRO instead of JSON in BigQuery bounded source.

2020-11-05 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-8910: Status: Resolved (was: Open) > Use AVRO instead of JSON in BigQuery bounded source. > -

[jira] [Assigned] (BEAM-9650) Add consistent slowly changing side inputs support

2020-11-05 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-9650: --- Assignee: Pablo Estrada > Add consistent slowly changing side inputs support > --

[jira] [Created] (BEAM-11255) Clear up urllib3 upper bound

2020-11-12 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-11255: Summary: Clear up urllib3 upper bound Key: BEAM-11255 URL: https://issues.apache.org/jira/browse/BEAM-11255 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-10511) Allow users to specify the temporary dataset for BQ

2020-07-16 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-10511: - Status: Open (was: Triage Needed) > Allow users to specify the temporary dataset for BQ > --

[jira] [Assigned] (BEAM-6064) Python BigQuery performance much worse than Java

2020-07-24 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-6064: --- Assignee: Pablo Estrada > Python BigQuery performance much worse than Java >

[jira] [Commented] (BEAM-6064) Python BigQuery performance much worse than Java

2020-07-30 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17168138#comment-17168138 ] Pablo Estrada commented on BEAM-6064: - I plan to work on this soon., > Python BigQuer

[jira] [Commented] (BEAM-2767) BigQueryIO result different for REPEATED field between DirectRunner and DataflowRunner

2020-06-25 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17145768#comment-17145768 ] Pablo Estrada commented on BEAM-2767: - A user hit this here:  [https://stackoverflow.c

[jira] [Commented] (BEAM-10333) [Python][beam_PreCommit_Python_Phrase] Job fails to cython compile pandas

2020-06-26 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17146602#comment-17146602 ] Pablo Estrada commented on BEAM-10333: -- cc [~Ardagan] > [Python][beam_PreCommit_Pyt

[jira] [Comment Edited] (BEAM-10333) [Python][beam_PreCommit_Python_Phrase] Job fails to cython compile pandas

2020-06-26 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17146602#comment-17146602 ] Pablo Estrada edited comment on BEAM-10333 at 6/26/20, 7:44 PM: ---

[jira] [Created] (BEAM-10378) Implement an Azure blobstore filesystem for Java SDK

2020-06-29 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-10378: Summary: Implement an Azure blobstore filesystem for Java SDK Key: BEAM-10378 URL: https://issues.apache.org/jira/browse/BEAM-10378 Project: Beam Issue Type:

[jira] [Updated] (BEAM-10378) Implement an Azure blobstore filesystem for Java SDK

2020-06-29 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-10378: - Status: Open (was: Triage Needed) > Implement an Azure blobstore filesystem for Java SDK > -

[jira] [Updated] (BEAM-6928) Make Python SDK custom Sink the default Sink for BigQuery

2020-08-10 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-6928: Status: Resolved (was: Open) > Make Python SDK custom Sink the default Sink for BigQuery >

[jira] [Assigned] (BEAM-6928) Make Python SDK custom Sink the default Sink for BigQuery

2020-08-10 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-6928: --- Assignee: Pablo Estrada > Make Python SDK custom Sink the default Sink for BigQuery > ---

[jira] [Updated] (BEAM-6928) Make Python SDK custom Sink the default Sink for BigQuery

2020-08-10 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-6928: Fix Version/s: 2.24.0 > Make Python SDK custom Sink the default Sink for BigQuery >

[jira] [Created] (BEAM-10680) Give an option to override the default number of shards in BQ streaming inserts

2020-08-11 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-10680: Summary: Give an option to override the default number of shards in BQ streaming inserts Key: BEAM-10680 URL: https://issues.apache.org/jira/browse/BEAM-10680 Project

[jira] [Updated] (BEAM-9119) apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].test_large_elements is flaky

2020-08-13 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-9119: Priority: P3 (was: P1) > apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].te

[jira] [Assigned] (BEAM-9119) apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].test_large_elements is flaky

2020-08-13 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-9119: --- Assignee: Pablo Estrada > apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[

[jira] [Commented] (BEAM-9119) apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].test_large_elements is flaky

2020-08-13 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177403#comment-17177403 ] Pablo Estrada commented on BEAM-9119: - test has been disabled. I've assigned to me to

[jira] [Updated] (BEAM-7382) Bigquery IO: schema autodetection failing

2020-08-13 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-7382: Status: Resolved (was: Open) > Bigquery IO: schema autodetection failing >

[jira] [Created] (BEAM-10707) Separate Python precommit tests from Python docs precommit tests

2020-08-14 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-10707: Summary: Separate Python precommit tests from Python docs precommit tests Key: BEAM-10707 URL: https://issues.apache.org/jira/browse/BEAM-10707 Project: Beam

[jira] [Commented] (BEAM-6064) Python BigQuery performance much worse than Java

2020-08-19 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17180724#comment-17180724 ] Pablo Estrada commented on BEAM-6064: - Some performance improvements for Python BQ ins

[jira] [Assigned] (BEAM-7514) Support streaming on the Python fn_api_runner

2020-06-23 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-7514: --- Assignee: Pablo Estrada > Support streaming on the Python fn_api_runner > ---

[jira] [Commented] (BEAM-7514) Support streaming on the Python fn_api_runner

2020-06-23 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17143302#comment-17143302 ] Pablo Estrada commented on BEAM-7514: - I'm working on this. The latest work item is ad

[jira] [Updated] (BEAM-10027) Support for Kotlin-based Beam Katas

2020-06-03 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-10027: - Fix Version/s: 2.23.0 > Support for Kotlin-based Beam Katas > ---

[jira] [Commented] (BEAM-10027) Support for Kotlin-based Beam Katas

2020-06-03 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17125203#comment-17125203 ] Pablo Estrada commented on BEAM-10027: -- It's technically not a part of the release,

[jira] [Assigned] (BEAM-7624) Missing field support in JsonToRow

2020-06-10 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-7624: --- Assignee: Reuben van Ammers > Missing field support in JsonToRow > --

[jira] [Updated] (BEAM-10068) Modify behavior of Dynamic Destinations

2020-06-11 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-10068: - Status: Open (was: Triage Needed) > Modify behavior of Dynamic Destinations > --

[jira] [Created] (BEAM-10246) FileIO.read + deleteOnCommit functionality

2020-06-11 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-10246: Summary: FileIO.read + deleteOnCommit functionality Key: BEAM-10246 URL: https://issues.apache.org/jira/browse/BEAM-10246 Project: Beam Issue Type: Improveme

[jira] [Created] (BEAM-13846) Add a proper string partitioner for JdbcIO.readWithPartitions

2022-02-07 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-13846: Summary: Add a proper string partitioner for JdbcIO.readWithPartitions Key: BEAM-13846 URL: https://issues.apache.org/jira/browse/BEAM-13846 Project: Beam I

[jira] [Created] (BEAM-13847) Support dynamic partitioning of JdbcIO ranges via SDF

2022-02-07 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-13847: Summary: Support dynamic partitioning of JdbcIO ranges via SDF Key: BEAM-13847 URL: https://issues.apache.org/jira/browse/BEAM-13847 Project: Beam Issue Type

[jira] [Updated] (BEAM-13847) Support dynamic partitioning of JdbcIO ranges via SDF

2022-02-07 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-13847: - Status: Open (was: Triage Needed) > Support dynamic partitioning of JdbcIO ranges via SDF >

[jira] [Assigned] (BEAM-13847) Support dynamic partitioning of JdbcIO ranges via SDF

2022-02-07 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-13847: Assignee: Pablo Estrada > Support dynamic partitioning of JdbcIO ranges via SDF >

[jira] [Created] (BEAM-13865) A generic Beam IO Sink for Java

2022-02-09 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-13865: Summary: A generic Beam IO Sink for Java Key: BEAM-13865 URL: https://issues.apache.org/jira/browse/BEAM-13865 Project: Beam Issue Type: Bug Compon

[jira] [Updated] (BEAM-2888) Runner Comparison / Capability Matrix revamp

2022-02-09 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-2888: Labels: gsod gsod2019 gsod2022 mentor (was: gsod gsod2019) > Runner Comparison / Capability Matrix

[jira] [Commented] (BEAM-2888) Runner Comparison / Capability Matrix revamp

2022-02-09 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17489829#comment-17489829 ] Pablo Estrada commented on BEAM-2888: - Status update for this work: There was work don

[jira] [Created] (BEAM-13931) BigQueryIO is sending rows that are too large to Deadletter Queue even on RETRY_ALWAYS

2022-02-11 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-13931: Summary: BigQueryIO is sending rows that are too large to Deadletter Queue even on RETRY_ALWAYS Key: BEAM-13931 URL: https://issues.apache.org/jira/browse/BEAM-13931

[jira] [Updated] (BEAM-13931) BigQueryIO is sending rows that are too large to Deadletter Queue even on RETRY_ALWAYS

2022-02-11 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-13931: - Priority: P0 (was: P2) > BigQueryIO is sending rows that are too large to Deadletter Queue even

[jira] [Updated] (BEAM-13931) BigQueryIO is sending rows that are too large to Deadletter Queue even on RETRY_ALWAYS

2022-02-11 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-13931: - Status: Open (was: Triage Needed) > BigQueryIO is sending rows that are too large to Deadletter

[jira] [Commented] (BEAM-13931) BigQueryIO is sending rows that are too large to Deadletter Queue even on RETRY_ALWAYS

2022-02-11 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17491221#comment-17491221 ] Pablo Estrada commented on BEAM-13931: -- fix: [https://github.com/apache/beam/pull/16

[jira] [Commented] (BEAM-13931) BigQueryIO is sending rows that are too large to Deadletter Queue even on RETRY_ALWAYS

2022-02-11 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17491220#comment-17491220 ] Pablo Estrada commented on BEAM-13931: -- [~bhulette] - this issue is a release blocke

[jira] [Updated] (BEAM-13931) BigQueryIO is sending rows that are too large to Deadletter Queue even on RETRY_ALWAYS

2022-02-11 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-13931: - Fix Version/s: (was: 2.37.0) > BigQueryIO is sending rows that are too large to Deadletter Qu

[jira] [Updated] (BEAM-13931) BigQueryIO is sending rows that are too large to Deadletter Queue even on RETRY_ALWAYS

2022-02-11 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-13931: - Fix Version/s: 2.37.0 (was: 2.36.0) > BigQueryIO is sending rows that are

[jira] [Updated] (BEAM-13389) Enable JdbcIO expansion service to more easily receive JDBC Driver as a dependency

2022-02-14 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-13389: - Fix Version/s: 2.36.0 Resolution: Fixed Status: Resolved (was: Open) > Enable

[jira] [Updated] (BEAM-3767) A Complex Event Processing (CEP) library/extension for Apache Beam

2022-03-10 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-3767: Labels: gsoc gsoc2022 mentor (was: ) > A Complex Event Processing (CEP) library/extension for Apach

[jira] [Commented] (BEAM-3767) A Complex Event Processing (CEP) library/extension for Apache Beam

2022-03-10 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17504646#comment-17504646 ] Pablo Estrada commented on BEAM-3767: - I'd love to get a proposal from a GSoC student

[jira] [Updated] (BEAM-8258) Implement Nexmark (benchmark suite) in Python and integrate it with Spark and Flink runners

2022-03-10 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-8258: Fix Version/s: Not applicable Resolution: Fixed Status: Resolved (was: Open) > Im

[jira] [Created] (BEAM-14089) CLONE - A generic Beam IO Sink for Java

2022-03-10 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-14089: Summary: CLONE - A generic Beam IO Sink for Java Key: BEAM-14089 URL: https://issues.apache.org/jira/browse/BEAM-14089 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-14090) Run code in examples in Beam's Pydoc

2022-03-10 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-14090: - Labels: gsoc gsoc2022 mentor (was: ) > Run code in examples in Beam's Pydoc > --

[jira] [Created] (BEAM-14090) Run code in examples in Beam's Pydoc

2022-03-10 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-14090: Summary: Run code in examples in Beam's Pydoc Key: BEAM-14090 URL: https://issues.apache.org/jira/browse/BEAM-14090 Project: Beam Issue Type: Bug C

[jira] [Updated] (BEAM-2888) Runner Comparison / Capability Matrix revamp

2022-03-11 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-2888: Labels: gsoc2022 gsod gsod2019 gsod2022 mentor (was: gsod gsod2019 gsod2022 mentor) > Runner Compa

[jira] [Updated] (BEAM-14090) Run code in examples in Beam's Pydoc

2022-03-14 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-14090: - Labels: gsoc gsoc2022 gsod mentor (was: gsoc gsoc2022 mentor) > Run code in examples in Beam's P

[jira] [Updated] (BEAM-14090) Run code in examples in Beam's Pydoc

2022-03-14 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-14090: - Status: Open (was: Triage Needed) > Run code in examples in Beam's Pydoc > -

[jira] [Updated] (BEAM-14090) Run code in examples in Beam's Pydoc

2022-03-15 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-14090: - Labels: gsoc gsoc2022 gsod mentor part-time (was: gsoc gsoc2022 gsod mentor) > Run code in exam

[jira] [Updated] (BEAM-3767) A Complex Event Processing (CEP) library/extension for Apache Beam

2022-03-15 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-3767: Labels: full-time gsoc gsoc2022 mentor (was: gsoc gsoc2022 mentor) > A Complex Event Processing (CE

[jira] [Updated] (BEAM-13865) A generic Beam IO Sink for Java

2022-03-15 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-13865: - Labels: full-time gsoc gsoc2022 mentor (was: gsoc gsoc2022 mentor) > A generic Beam IO Sink for

[jira] [Updated] (BEAM-2888) Runner Comparison / Capability Matrix revamp

2022-03-15 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-2888: Labels: full-time gsoc2022 gsod gsod2019 gsod2022 mentor (was: gsoc2022 gsod gsod2019 gsod2022 ment

[jira] [Created] (BEAM-14127) Timers with same family ids in same stage (but different transforms) are buffered together

2022-03-18 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-14127: Summary: Timers with same family ids in same stage (but different transforms) are buffered together Key: BEAM-14127 URL: https://issues.apache.org/jira/browse/BEAM-14127

[jira] [Created] (BEAM-14137) A Beam runner for AnyScale's Ray

2022-03-21 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-14137: Summary: A Beam runner for AnyScale's Ray Key: BEAM-14137 URL: https://issues.apache.org/jira/browse/BEAM-14137 Project: Beam Issue Type: Bug Compo

[jira] [Updated] (BEAM-14137) A Beam runner for AnyScale's Ray

2022-03-21 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-14137: - Status: Open (was: Triage Needed) > A Beam runner for AnyScale's Ray > -

[jira] [Updated] (BEAM-14137) A Beam runner for Ray

2022-03-21 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-14137: - Summary: A Beam runner for Ray (was: A Beam runner for AnyScale's Ray) > A Beam runner for Ray >

[jira] [Created] (BEAM-14161) Add dynamic splitting to JdbcIO.readWithPartitions

2022-03-23 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-14161: Summary: Add dynamic splitting to JdbcIO.readWithPartitions Key: BEAM-14161 URL: https://issues.apache.org/jira/browse/BEAM-14161 Project: Beam Issue Type: I

[jira] [Updated] (BEAM-14161) Add dynamic splitting to JdbcIO.readWithPartitions

2022-03-23 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-14161: - Description: Now, the JDBC IO is basically a {{DoFn}} executed with a {{{}ParDo{}}}. So, it mean

[jira] [Updated] (BEAM-14161) Add dynamic splitting to JdbcIO.readWithPartitions

2022-03-23 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-14161: - Status: Open (was: Triage Needed) > Add dynamic splitting to JdbcIO.readWithPartitions > ---

[jira] [Commented] (BEAM-14191) CrossLanguageJdbcIOTest broken with "Cannot load JDBC driver class 'com.mysql.cj.jdbc.Driver'"

2022-03-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17513708#comment-17513708 ] Pablo Estrada commented on BEAM-14191: -- I've verified this on a previous commit. The

[jira] [Assigned] (BEAM-14191) CrossLanguageJdbcIOTest broken with "Cannot load JDBC driver class 'com.mysql.cj.jdbc.Driver'"

2022-03-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-14191: Assignee: Deepak Nagaraj (was: Pablo Estrada) > CrossLanguageJdbcIOTest broken with "Cann

[jira] [Commented] (BEAM-14191) CrossLanguageJdbcIOTest broken with "Cannot load JDBC driver class 'com.mysql.cj.jdbc.Driver'"

2022-03-28 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17513709#comment-17513709 ] Pablo Estrada commented on BEAM-14191: -- Assigning back to [~deepix] - are you able t

[jira] [Created] (BEAM-14234) [Beam I/O Standards] Avoid partially-built PTransform objects

2022-04-01 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-14234: Summary: [Beam I/O Standards] Avoid partially-built PTransform objects Key: BEAM-14234 URL: https://issues.apache.org/jira/browse/BEAM-14234 Project: Beam I

[jira] [Updated] (BEAM-14387) DirectRunner does not update reference to currentRestriction when running in SDF

2022-04-29 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-14387: - Status: Open (was: Triage Needed) > DirectRunner does not update reference to currentRestriction

[jira] [Created] (BEAM-14387) DirectRunner does not update reference to currentRestriction when running in SDF

2022-04-29 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-14387: Summary: DirectRunner does not update reference to currentRestriction when running in SDF Key: BEAM-14387 URL: https://issues.apache.org/jira/browse/BEAM-14387 Projec

[jira] [Assigned] (BEAM-14387) DirectRunner does not update reference to currentRestriction when running in SDF

2022-04-29 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-14387: Assignee: Pablo Estrada > DirectRunner does not update reference to currentRestriction whe

[jira] [Assigned] (BEAM-14387) DirectRunner does not update reference to currentRestriction when running in SDF

2022-04-29 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-14387: Assignee: Luke Cwik (was: Pablo Estrada) > DirectRunner does not update reference to curr

[jira] [Commented] (BEAM-14387) DirectRunner does not update reference to currentRestriction when running in SDF

2022-04-29 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17530268#comment-17530268 ] Pablo Estrada commented on BEAM-14387: -- [~lcwik] could you help me with some pouinte

[jira] [Created] (BEAM-14415) WriteToBigQuery with STREAMING_INSERTS needs exception handling tests

2022-05-04 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-14415: Summary: WriteToBigQuery with STREAMING_INSERTS needs exception handling tests Key: BEAM-14415 URL: https://issues.apache.org/jira/browse/BEAM-14415 Project: Beam

[jira] [Updated] (BEAM-14415) WriteToBigQuery with STREAMING_INSERTS needs exception handling tests

2022-05-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-14415: - Status: Open (was: Triage Needed) > WriteToBigQuery with STREAMING_INSERTS needs exception handl

[jira] [Created] (BEAM-14417) JdbcIO.Write needs exception handling tests

2022-05-04 Thread Pablo Estrada (Jira)
Pablo Estrada created BEAM-14417: Summary: JdbcIO.Write needs exception handling tests Key: BEAM-14417 URL: https://issues.apache.org/jira/browse/BEAM-14417 Project: Beam Issue Type: Bug

  1   2   3   4   5   6   7   8   9   >