[jira] [Commented] (BEAM-14015) Add ability to detect table schema changes to BigQueryIO's STORAGE_WRITE_API methods

2022-03-17 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17508344#comment-17508344 ] Chamikara Madhusanka Jayalath commented on BEAM-14015: -- cc: [~reuven

[jira] [Commented] (BEAM-14086) BigQueryIO - Clustered Table - STORAGEWRITEAPI

2022-03-17 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17508346#comment-17508346 ] Chamikara Madhusanka Jayalath commented on BEAM-14086: -- cc: [~reuven

[jira] [Updated] (BEAM-14086) BigQueryIO - Clustered Table - STORAGEWRITEAPI

2022-03-17 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14086: - Status: Open (was: Triage Needed) > BigQueryIO - Clustered Table

[jira] [Updated] (BEAM-14089) CLONE - A generic Beam IO Sink for Java

2022-03-17 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14089: - Status: Open (was: Triage Needed) > CLONE - A generic Beam IO Si

[jira] [Updated] (BEAM-14087) Mapped JOB_STATE_RESOURCE_CLEANING_UP to State.RUNNING

2022-03-17 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14087: - Status: Open (was: Triage Needed) > Mapped JOB_STATE_RESOURCE_CL

[jira] [Updated] (BEAM-14092) pyparsing dependency issues

2022-03-17 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14092: - Status: Open (was: Triage Needed) > pyparsing dependency issues

[jira] [Updated] (BEAM-14024) Support ES 8.x for ElasticsearchIO

2022-03-17 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14024: - Status: Open (was: Triage Needed) > Support ES 8.x for Elasticse

[jira] [Commented] (BEAM-14024) Support ES 8.x for ElasticsearchIO

2022-03-17 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17508348#comment-17508348 ] Chamikara Madhusanka Jayalath commented on BEAM-14024: -- cc: [~egalpi

[jira] [Updated] (BEAM-14095) Beam Dependency Update Request: ipython

2022-03-17 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14095: - Status: Open (was: Triage Needed) > Beam Dependency Update Reque

[jira] [Updated] (BEAM-14096) Beam Dependency Update Request: com.pholser:junit-quickcheck-generators

2022-03-17 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14096: - Status: Open (was: Triage Needed) > Beam Dependency Update Reque

[jira] [Updated] (BEAM-14105) Update multi-language Java quickstart

2022-03-17 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14105: - Status: Open (was: Triage Needed) > Update multi-language Java q

[jira] [Commented] (BEAM-14109) Legacy (SDF wrapper-based) KafkaIO read performance is poor when Kafka poll latency is hign

2022-03-17 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17508352#comment-17508352 ] Chamikara Madhusanka Jayalath commented on BEAM-14109: -- Thanks [~dmi

[jira] [Commented] (BEAM-14110) Legacy (SDF wrapper-based) KafkaIO read performance is poor when Kafka poll latency is hign

2022-03-17 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17508354#comment-17508354 ] Chamikara Madhusanka Jayalath commented on BEAM-14110: -- This seems t

[jira] [Updated] (BEAM-14109) Legacy (SDF wrapper-based) KafkaIO read performance is poor when Kafka poll latency is high

2022-03-17 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14109: - Summary: Legacy (SDF wrapper-based) KafkaIO read performance is po

[jira] [Updated] (BEAM-14110) Legacy (SDF wrapper-based) KafkaIO read performance is poor when Kafka poll latency is high

2022-03-17 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14110: - Fix Version/s: Not applicable Resolution: Fixed

[jira] [Commented] (BEAM-14111) Legacy (SDF wrapper-based) KafkaIO reader degrades when Kafka poll latency is hign

2022-03-17 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17508355#comment-17508355 ] Chamikara Madhusanka Jayalath commented on BEAM-14111: -- Same questio

[jira] [Reopened] (BEAM-14109) Legacy (SDF wrapper-based) KafkaIO read performance is poor when Kafka poll latency is high

2022-03-17 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reopened BEAM-14109: -- > Legacy (SDF wrapper-based) KafkaIO read performance is poor when

[jira] [Updated] (BEAM-14109) Legacy (SDF wrapper-based) KafkaIO read performance is poor when Kafka poll latency is high

2022-03-17 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14109: - Status: Open (was: Triage Needed) > Legacy (SDF wrapper-based) K

[jira] [Commented] (BEAM-14122) Python portable precommit broken: 'get_installed_distributions'

2022-03-18 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17509138#comment-17509138 ] Chamikara Madhusanka Jayalath commented on BEAM-14122: -- Any idea wha

[jira] [Created] (BEAM-14138) Python PostCommit BQ test failures due to NOT_FOUND for Dataset

2022-03-21 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-14138: Summary: Python PostCommit BQ test failures due to NOT_FOUND for Dataset Key: BEAM-14138 URL: https://issues.apache.org/jira/browse/BEAM-14138

[jira] [Commented] (BEAM-14138) Python PostCommit BQ test failures due to NOT_FOUND for Dataset

2022-03-21 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17510027#comment-17510027 ] Chamikara Madhusanka Jayalath commented on BEAM-14138: -- cc: [~kenn]

[jira] [Commented] (BEAM-14138) Python PostCommit BQ test failures due to NOT_FOUND for Dataset

2022-03-21 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17510028#comment-17510028 ] Chamikara Madhusanka Jayalath commented on BEAM-14138: -- Testing a re

[jira] [Commented] (BEAM-7554) datetime and decimal should be logical types

2022-03-21 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17510037#comment-17510037 ] Chamikara Madhusanka Jayalath commented on BEAM-7554: - cc: [~pabloem]

[jira] [Commented] (BEAM-7554) datetime and decimal should be logical types

2022-03-21 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17510040#comment-17510040 ] Chamikara Madhusanka Jayalath commented on BEAM-7554: - Thanks for the

[jira] [Commented] (BEAM-14138) Python PostCommit BQ test failures due to NOT_FOUND for Dataset

2022-03-21 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17510216#comment-17510216 ] Chamikara Madhusanka Jayalath commented on BEAM-14138: -- Test suite p

[jira] [Assigned] (BEAM-14138) Python PostCommit BQ test failures due to NOT_FOUND for Dataset

2022-03-21 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-14138: Assignee: Chun Yang > Python PostCommit BQ test failures d

[jira] [Created] (BEAM-14143) ExternalPythonTransform API for easily invoking Python transforms from Java

2022-03-21 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-14143: Summary: ExternalPythonTransform API for easily invoking Python transforms from Java Key: BEAM-14143 URL: https://issues.apache.org/jira/browse/BEA

[jira] [Commented] (BEAM-14143) ExternalPythonTransform API for easily invoking Python transforms from Java

2022-03-21 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17510228#comment-17510228 ] Chamikara Madhusanka Jayalath commented on BEAM-14143: -- https://gith

[jira] [Commented] (BEAM-14143) ExternalPythonTransform API for easily invoking Python transforms from Java

2022-03-21 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17510229#comment-17510229 ] Chamikara Madhusanka Jayalath commented on BEAM-14143: -- Doc: https:

[jira] [Updated] (BEAM-13852) KafkaIO.read.withDynamicRead() doesn't pick up new TopicPartitions

2022-03-21 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-13852: - Priority: P1 (was: P2) > KafkaIO.read.withDynamicRead() doesn't

[jira] [Commented] (BEAM-13852) KafkaIO.read.withDynamicRead() doesn't pick up new TopicPartitions

2022-03-21 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17510240#comment-17510240 ] Chamikara Madhusanka Jayalath commented on BEAM-13852: -- Thanks John.

[jira] [Created] (BEAM-14147) Log GCS upload ID for Python GCS connector

2022-03-22 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-14147: Summary: Log GCS upload ID for Python GCS connector Key: BEAM-14147 URL: https://issues.apache.org/jira/browse/BEAM-14147 Project: Beam

[jira] [Updated] (BEAM-14147) Log GCS upload ID for Python GCS connector

2022-03-22 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14147: - Status: Open (was: Triage Needed) > Log GCS upload ID for Python

[jira] [Updated] (BEAM-14147) Log GCS upload ID for Python GCS connector

2022-03-22 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14147: - Labels: newbie starter (was: ) > Log GCS upload ID for Python GC

[jira] [Commented] (BEAM-14149) beam_PostCommit_Java BigQueryIOStorageWriteIT.testBigQueryStorageWrite30MProto OOMing

2022-03-22 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17510884#comment-17510884 ] Chamikara Madhusanka Jayalath commented on BEAM-14149: -- It passed fo

[jira] [Commented] (BEAM-14149) beam_PostCommit_Java BigQueryIOStorageWriteIT.testBigQueryStorageWrite30MProto OOMing

2022-03-22 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17510886#comment-17510886 ] Chamikara Madhusanka Jayalath commented on BEAM-14149: -- Ah, it was p

[jira] [Commented] (BEAM-14149) beam_PostCommit_Java BigQueryIOStorageWriteIT.testBigQueryStorageWrite30MProto OOMing

2022-03-22 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17510887#comment-17510887 ] Chamikara Madhusanka Jayalath commented on BEAM-14149: -- This was onl

[jira] [Commented] (BEAM-14149) beam_PostCommit_Java BigQueryIOStorageWriteIT.testBigQueryStorageWrite30MProto OOMing

2022-03-22 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17510889#comment-17510889 ] Chamikara Madhusanka Jayalath commented on BEAM-14149: -- This has to

[jira] [Commented] (BEAM-14149) beam_PostCommit_Java BigQueryIOStorageWriteIT.testBigQueryStorageWrite30MProto OOMing

2022-03-22 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17510890#comment-17510890 ] Chamikara Madhusanka Jayalath commented on BEAM-14149: -- And only run

[jira] [Commented] (BEAM-14149) beam_PostCommit_Java BigQueryIOStorageWriteIT.testBigQueryStorageWrite30MProto OOMing

2022-03-22 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17510892#comment-17510892 ] Chamikara Madhusanka Jayalath commented on BEAM-14149: -- https://gith

[jira] [Created] (BEAM-14150) Spanner CDC tests are consistently failing for PostCommit_Java_Dataflow

2022-03-22 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-14150: Summary: Spanner CDC tests are consistently failing for PostCommit_Java_Dataflow Key: BEAM-14150 URL: https://issues.apache.org/jira/browse/BEAM-14

[jira] [Assigned] (BEAM-14150) Spanner CDC tests are consistently failing for PostCommit_Java_Dataflow

2022-03-22 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-14150: Assignee: Thiago Nunes > Spanner CDC tests are consistentl

[jira] [Commented] (BEAM-14150) Spanner CDC tests are consistently failing for PostCommit_Java_Dataflow

2022-03-22 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17510893#comment-17510893 ] Chamikara Madhusanka Jayalath commented on BEAM-14150: -- [~thiagotnun

[jira] [Assigned] (BEAM-14151) beam_PostCommit_Java_DataflowV1 SpannerChangeStreamOrderedByTimestampAndTransactionIdIT.testTransactionBoundaries and SpannerChangeStreamTransactionBoundariesIT.testTran

2022-03-22 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-14151: Assignee: Thiago Nunes (was: Pablo Estrada) > beam_PostCo

[jira] [Commented] (BEAM-14150) Spanner CDC tests are consistently failing for PostCommit_Java_Dataflow

2022-03-22 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17510897#comment-17510897 ] Chamikara Madhusanka Jayalath commented on BEAM-14150: -- Marking as a

[jira] [Updated] (BEAM-14150) Spanner CDC tests are consistently failing for PostCommit_Java_Dataflow

2022-03-22 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14150: - Fix Version/s: Not applicable Resolution: Fixed

[jira] [Commented] (BEAM-14148) ExternalPythonTransformTest.trivialPythonTransform flaky

2022-03-22 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17510925#comment-17510925 ] Chamikara Madhusanka Jayalath commented on BEAM-14148: -- On mac it fa

[jira] [Commented] (BEAM-14148) ExternalPythonTransformTest.trivialPythonTransform flaky

2022-03-22 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17510926#comment-17510926 ] Chamikara Madhusanka Jayalath commented on BEAM-14148: -- Above was in

[jira] [Commented] (BEAM-14074) BigQueryIO: NullPointerException in BigQueryServicesImpl

2022-03-23 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511524#comment-17511524 ] Chamikara Madhusanka Jayalath commented on BEAM-14074: -- Thanks. Reso

[jira] [Updated] (BEAM-14159) Java expansion service does not recognize filesToStage argument

2022-03-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14159: - Fix Version/s: Not applicable Resolution: Fixed

[jira] [Updated] (BEAM-14158) Java expansion service does not recognize filesToStage argument

2022-03-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14158: - Fix Version/s: Not applicable Resolution: Fixed

[jira] [Updated] (BEAM-14143) ExternalPythonTransform API for easily invoking Python transforms from Java

2022-03-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14143: - Status: Open (was: Triage Needed) > ExternalPythonTransform API

[jira] [Updated] (BEAM-14143) ExternalPythonTransform API for easily invoking Python transforms from Java

2022-03-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14143: - Fix Version/s: 2.39.0 > ExternalPythonTransform API for easily in

[jira] [Assigned] (BEAM-14163) Performance Regressions in streaming python ParDo and GBK Load Tests

2022-03-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-14163: Assignee: Daniel Oliveira > Performance Regressions in str

[jira] [Commented] (BEAM-14163) Performance Regressions in streaming python ParDo and GBK Load Tests

2022-03-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511972#comment-17511972 ] Chamikara Madhusanka Jayalath commented on BEAM-14163: -- [~danoliveir

[jira] [Updated] (BEAM-14112) ReadFromBigQuery cannot be used with the interactive runner

2022-03-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14112: - Status: Open (was: Triage Needed) > ReadFromBigQuery cannot be u

[jira] [Updated] (BEAM-14114) Parsing datetime string with 0 to 6 decimal points for BigQuery

2022-03-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14114: - Status: Open (was: Triage Needed) > Parsing datetime string with

[jira] [Commented] (BEAM-14114) Parsing datetime string with 0 to 6 decimal points for BigQuery

2022-03-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511973#comment-17511973 ] Chamikara Madhusanka Jayalath commented on BEAM-14114: -- [~heejong] i

[jira] [Updated] (BEAM-14135) BigQuery Storage API insert with writeResult retry and write to error table

2022-03-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14135: - Priority: P1 (was: P2) > BigQuery Storage API insert with writeR

[jira] [Updated] (BEAM-14135) BigQuery Storage API insert with writeResult retry and write to error table

2022-03-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14135: - Status: Open (was: Triage Needed) > BigQuery Storage API insert

[jira] [Commented] (BEAM-14135) BigQuery Storage API insert with writeResult retry and write to error table

2022-03-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511975#comment-17511975 ] Chamikara Madhusanka Jayalath commented on BEAM-14135: -- Thanks for r

[jira] [Updated] (BEAM-14160) Java expansion service does not recognize filesToStage argument

2022-03-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14160: - Status: Open (was: Triage Needed) > Java expansion service does

[jira] [Updated] (BEAM-14146) Python Streaming job failing to drain with BigQueryIO write errors

2022-03-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14146: - Status: Open (was: Triage Needed) > Python Streaming job failing

[jira] [Commented] (BEAM-14146) Python Streaming job failing to drain with BigQueryIO write errors

2022-03-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17512002#comment-17512002 ] Chamikara Madhusanka Jayalath commented on BEAM-14146: -- Thanks for r

[jira] [Commented] (BEAM-14148) ExternalPythonTransformTest.trivialPythonTransform flaky

2022-03-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17512028#comment-17512028 ] Chamikara Madhusanka Jayalath commented on BEAM-14148: -- [~bhulette]

[jira] [Comment Edited] (BEAM-14146) Python Streaming job failing to drain with BigQueryIO write errors

2022-03-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17512002#comment-17512002 ] Chamikara Madhusanka Jayalath edited comment on BEAM-14146 at 3/24/22, 6:56 PM: ---

[jira] [Assigned] (BEAM-7554) datetime and decimal should be logical types

2022-03-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-7554: --- Assignee: Pablo Estrada > datetime and decimal should be logi

[jira] [Updated] (BEAM-7554) datetime and decimal should be logical types

2022-03-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-7554: Priority: P1 (was: P2) > datetime and decimal should be logical typ

[jira] [Assigned] (BEAM-13763) Rotate credentials for 'io-datastores' Kubernetes cluster

2022-02-18 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-13763: Assignee: Kerry Donny-Clark (was: Chamikara Madhusanka Jay

[jira] [Updated] (BEAM-12164) SpannerIO Change Stream Connector

2022-02-18 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-12164: - Fix Version/s: 2.37.0 > SpannerIO Change Stream Connector > -

[jira] [Updated] (BEAM-12164) SpannerIO Change Stream Connector

2022-02-18 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-12164: - Priority: P2 (was: P3) > SpannerIO Change Stream Connector > ---

[jira] [Assigned] (BEAM-12164) SpannerIO Change Stream Connector

2022-02-18 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-12164: Assignee: Thiago Nunes > SpannerIO Change Stream Connector

[jira] [Commented] (BEAM-12164) SpannerIO Change Stream Connector

2022-02-18 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-12164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17494857#comment-17494857 ] Chamikara Madhusanka Jayalath commented on BEAM-12164: -- I think we c

[jira] [Updated] (BEAM-13990) BigQueryIO cannot write to DATE and TIMESTAMP columns when using Storage Write API

2022-02-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-13990: - Status: Open (was: Triage Needed) > BigQueryIO cannot write to D

[jira] [Assigned] (BEAM-13990) BigQueryIO cannot write to DATE and TIMESTAMP columns when using Storage Write API

2022-02-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-13990: Assignee: Reuven Lax > BigQueryIO cannot write to DATE and

[jira] [Commented] (BEAM-13990) BigQueryIO cannot write to DATE and TIMESTAMP columns when using Storage Write API

2022-02-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17497621#comment-17497621 ] Chamikara Madhusanka Jayalath commented on BEAM-13990: -- [~reuvenlax]

[jira] [Commented] (BEAM-13987) Adding Regex based subscriptions to KafkaIo Dynamic Read.

2022-02-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17497629#comment-17497629 ] Chamikara Madhusanka Jayalath commented on BEAM-13987: -- [~njohnson22

[jira] [Comment Edited] (BEAM-13987) Adding Regex based subscriptions to KafkaIo Dynamic Read.

2022-02-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17497629#comment-17497629 ] Chamikara Madhusanka Jayalath edited comment on BEAM-13987 at 2/24/22, 6:46 PM: ---

[jira] [Commented] (BEAM-6394) Support for writing protobuf data to parquet

2022-02-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17497717#comment-17497717 ] Chamikara Madhusanka Jayalath commented on BEAM-6394: - Is it not possi

[jira] [Updated] (BEAM-13747) Add integration testing for BQ Storage API write modes

2022-02-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-13747: - Priority: P1 (was: P2) > Add integration testing for BQ Storage

[jira] [Commented] (BEAM-13747) Add integration testing for BQ Storage API write modes

2022-02-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17497719#comment-17497719 ] Chamikara Madhusanka Jayalath commented on BEAM-13747: -- I think this

[jira] [Commented] (BEAM-13763) Rotate credentials for 'io-datastores' Kubernetes cluster

2022-02-26 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17498488#comment-17498488 ] Chamikara Madhusanka Jayalath commented on BEAM-13763: -- Thanks Kerry

[jira] [Updated] (BEAM-14005) Exceptions when reading from Spanner ignored

2022-02-26 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14005: - Fix Version/s: 2.37.0 (was: 2.38.0) > Exce

[jira] [Created] (BEAM-14009) Set sdk_harness_container_images for Dataflow Prime jobs

2022-02-28 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-14009: Summary: Set sdk_harness_container_images for Dataflow Prime jobs Key: BEAM-14009 URL: https://issues.apache.org/jira/browse/BEAM-14009

[jira] [Assigned] (BEAM-13223) Document new features of cross-language transforms

2022-02-28 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-13223: Assignee: Chamikara Madhusanka Jayalath > Document new fea

[jira] [Commented] (BEAM-13223) Document new features of cross-language transforms

2022-02-28 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-13223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17499200#comment-17499200 ] Chamikara Madhusanka Jayalath commented on BEAM-13223: -- Yeah, this i

[jira] [Assigned] (BEAM-14191) CrossLanguageJdbcIOTest broken with "Cannot load JDBC driver class 'com.mysql.cj.jdbc.Driver'"

2022-03-28 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-14191: Assignee: Pablo Estrada (was: Chamikara Madhusanka Jayalat

[jira] [Updated] (BEAM-14191) CrossLanguageJdbcIOTest broken with "Cannot load JDBC driver class 'com.mysql.cj.jdbc.Driver'"

2022-03-28 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14191: - Priority: P1 (was: P2) > CrossLanguageJdbcIOTest broken with "Ca

[jira] [Assigned] (BEAM-14191) CrossLanguageJdbcIOTest broken with "Cannot load JDBC driver class 'com.mysql.cj.jdbc.Driver'"

2022-03-28 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-14191: Assignee: Chamikara Madhusanka Jayalath (was: Pablo Estrad

[jira] [Commented] (BEAM-14191) CrossLanguageJdbcIOTest broken with "Cannot load JDBC driver class 'com.mysql.cj.jdbc.Driver'"

2022-03-28 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17513690#comment-17513690 ] Chamikara Madhusanka Jayalath commented on BEAM-14191: -- [~pabloem] l

[jira] [Commented] (BEAM-14191) CrossLanguageJdbcIOTest broken with "Cannot load JDBC driver class 'com.mysql.cj.jdbc.Driver'"

2022-03-28 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17513691#comment-17513691 ] Chamikara Madhusanka Jayalath commented on BEAM-14191: -- cc: [~heejon

[jira] [Assigned] (BEAM-14191) CrossLanguageJdbcIOTest broken with "Cannot load JDBC driver class 'com.mysql.cj.jdbc.Driver'"

2022-03-28 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-14191: Assignee: Pablo Estrada (was: Chamikara Madhusanka Jayalat

[jira] [Assigned] (BEAM-14191) CrossLanguageJdbcIOTest broken with "Cannot load JDBC driver class 'com.mysql.cj.jdbc.Driver'"

2022-03-28 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-14191: Assignee: Chamikara Madhusanka Jayalath (was: Deepak Nagar

[jira] [Commented] (BEAM-14191) CrossLanguageJdbcIOTest broken with "Cannot load JDBC driver class 'com.mysql.cj.jdbc.Driver'"

2022-03-28 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17513725#comment-17513725 ] Chamikara Madhusanka Jayalath commented on BEAM-14191: -- I think ther

[jira] [Updated] (BEAM-14191) CrossLanguageJdbcIOTest broken with "Cannot load JDBC driver class 'com.mysql.cj.jdbc.Driver'"

2022-03-28 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14191: - Status: Open (was: Triage Needed) > CrossLanguageJdbcIOTest brok

[jira] [Commented] (BEAM-14191) CrossLanguageJdbcIOTest broken with "Cannot load JDBC driver class 'com.mysql.cj.jdbc.Driver'"

2022-03-28 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17513754#comment-17513754 ] Chamikara Madhusanka Jayalath commented on BEAM-14191: -- https://gith

[jira] [Updated] (BEAM-14191) CrossLanguageJdbcIOTest broken with "Cannot load JDBC driver class 'com.mysql.cj.jdbc.Driver'"

2022-03-28 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14191: - Fix Version/s: (was: 2.38.0) > CrossLanguageJdbcIOTest broken

[jira] [Updated] (BEAM-14191) CrossLanguageJdbcIOTest broken with "Cannot load JDBC driver class 'com.mysql.cj.jdbc.Driver'"

2022-03-28 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14191: - Fix Version/s: 2.38.0 > CrossLanguageJdbcIOTest broken with "Cann

[jira] [Updated] (BEAM-14191) CrossLanguageJdbcIOTest broken with "Cannot load JDBC driver class 'com.mysql.cj.jdbc.Driver'"

2022-03-28 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-14191: - Fix Version/s: (was: 2.38.0) > CrossLanguageJdbcIOTest broken

[jira] [Commented] (BEAM-14191) CrossLanguageJdbcIOTest broken with "Cannot load JDBC driver class 'com.mysql.cj.jdbc.Driver'"

2022-03-28 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-14191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17513759#comment-17513759 ] Chamikara Madhusanka Jayalath commented on BEAM-14191: -- It doesn't l

<    1   2   3   4   5   6   7   8   9   10   >