[jira] [Created] (BEAM-8318) Add a num_threads_per_worker pipeline option to Python SDK.

2019-09-26 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-8318: --- Summary: Add a num_threads_per_worker pipeline option to Python SDK. Key: BEAM-8318 URL: https://issues.apache.org/jira/browse/BEAM-8318

[jira] [Assigned] (BEAM-8504) BigQueryIO DIRECT_READ is broken

2019-11-04 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-8504: --- Assignee: Aryan Naraghi > BigQueryIO DIRECT_READ is broken >

[jira] [Resolved] (BEAM-8553) Add a more detailed cross-language transforms roadmap

2019-11-11 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath resolved BEAM-8553. - Fix Version/s: Not applicable Resolution: Fixed > Add a

[jira] [Commented] (BEAM-8376) Add FirestoreIO connector to Java SDK

2019-11-06 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968418#comment-16968418 ] Chamikara Madhusanka Jayalath commented on BEAM-8376: - I don't have specific context

[jira] [Commented] (BEAM-8631) :sdks:python:test-suites:portable:py2:installGcpTest is flaky due to "No such file or directory"

2019-11-12 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16972863#comment-16972863 ] Chamikara Madhusanka Jayalath commented on BEAM-8631: - A different failure but the

[jira] [Resolved] (BEAM-7824) Set a default environment for Python SDK jobs for Dataflow runner

2019-11-11 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath resolved BEAM-7824. - Fix Version/s: Not applicable Resolution: Fixed > Set a

[jira] [Assigned] (BEAM-7850) Make Environment a top level attribute of PTransform

2019-11-11 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-7850: --- Assignee: Chamikara Madhusanka Jayalath > Make Environment a

[jira] [Created] (BEAM-8631) :sdks:python:test-suites:portable:py2:installGcpTest is flaky due to "No such file or directory"

2019-11-12 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-8631: --- Summary: :sdks:python:test-suites:portable:py2:installGcpTest is flaky due to "No such file or directory" Key: BEAM-8631 URL:

[jira] [Assigned] (BEAM-8631) :sdks:python:test-suites:portable:py2:installGcpTest is flaky due to "No such file or directory"

2019-11-12 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-8631: --- Assignee: Mark Liu >

[jira] [Updated] (BEAM-8803) Default behaviour for Python BQ Streaming inserts sink should be to retry always

2019-11-22 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-8803: Issue Type: Bug (was: Improvement) > Default behaviour for Python

[jira] [Commented] (BEAM-8803) Default behaviour for Python BQ Streaming inserts sink should be to retry always

2019-11-22 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16980617#comment-16980617 ] Chamikara Madhusanka Jayalath commented on BEAM-8803: - Made this a blocker for 2.18.0.

[jira] [Updated] (BEAM-8803) Default behaviour for Python BQ Streaming inserts sink should be to retry always

2019-11-22 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-8803: Fix Version/s: 2.18.0 > Default behaviour for Python BQ Streaming

[jira] [Updated] (BEAM-8803) Default behaviour for Python BQ Streaming inserts sink should be to retry always

2019-11-22 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-8803: Priority: Blocker (was: Major) > Default behaviour for Python BQ

[jira] [Commented] (BEAM-8864) BigQueryQueryToTableIT.test_big_query_legacy_sql - fails in post commit tests

2019-12-13 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995808#comment-16995808 ] Chamikara Madhusanka Jayalath commented on BEAM-8864: - We expected to see two records

[jira] [Commented] (BEAM-8953) Extend ParquetIO.Read/ReadFiles.Builder to support Avro GenericData model

2019-12-12 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994905#comment-16994905 ] Chamikara Madhusanka Jayalath commented on BEAM-8953: - Thanks for the JIRA. Sounds

[jira] [Commented] (BEAM-8864) BigQueryQueryToTableIT.test_big_query_legacy_sql - fails in post commit tests

2019-12-16 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997516#comment-16997516 ] Chamikara Madhusanka Jayalath commented on BEAM-8864: - Seems like verify query

[jira] [Commented] (BEAM-3788) Implement a Kafka IO for Python SDK

2019-10-21 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956261#comment-16956261 ] Chamikara Madhusanka Jayalath commented on BEAM-3788: - I believe unbounded SDF support

[jira] [Updated] (BEAM-8367) Python BigQuery sink should use unique IDs for mode STREAMING_INSERTS

2019-10-15 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-8367: Fix Version/s: 2.17.0 > Python BigQuery sink should use unique IDs

[jira] [Updated] (BEAM-8367) Python BigQuery sink should use unique IDs for mode STREAMING_INSERTS

2019-10-15 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-8367: Priority: Blocker (was: Major) > Python BigQuery sink should use

[jira] [Created] (BEAM-8399) Python HDFS implementation should support filenames of the format "hdfs://namenodehost/parent/child"

2019-10-14 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-8399: --- Summary: Python HDFS implementation should support filenames of the format "hdfs://namenodehost/parent/child" Key: BEAM-8399 URL:

[jira] [Commented] (BEAM-5192) Support Elasticsearch 7.x

2019-10-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959068#comment-16959068 ] Chamikara Madhusanka Jayalath commented on BEAM-5192: - [~chet.aldrich] thanks for

[jira] [Commented] (BEAM-8399) Python HDFS implementation should support filenames of the format "hdfs://namenodehost/parent/child"

2019-10-17 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953960#comment-16953960 ] Chamikara Madhusanka Jayalath commented on BEAM-8399: - >From my reading, we get HDFS

[jira] [Commented] (BEAM-6928) Make Python SDK custom Sink the default Sink for BigQuery

2019-11-27 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984055#comment-16984055 ] Chamikara Madhusanka Jayalath commented on BEAM-6928: - Pablo, looks like we are

[jira] [Commented] (BEAM-8653) installGcpTest task is flaky

2019-11-19 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1699#comment-1699 ] Chamikara Madhusanka Jayalath commented on BEAM-8653: - Another occurrence:

[jira] [Assigned] (BEAM-8399) Python HDFS implementation should support filenames of the format "hdfs://namenodehost/parent/child"

2019-11-19 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-8399: --- Assignee: Udi Meiri > Python HDFS implementation should

[jira] [Commented] (BEAM-8399) Python HDFS implementation should support filenames of the format "hdfs://namenodehost/parent/child"

2019-11-19 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977879#comment-16977879 ] Chamikara Madhusanka Jayalath commented on BEAM-8399: - Udi, will you be able to look

[jira] [Commented] (BEAM-8168) Python GCSFileSystem failing with gzip content encoding

2019-10-10 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948993#comment-16948993 ] Chamikara Madhusanka Jayalath commented on BEAM-8168: - Yeah, this is a known issue.

[jira] [Commented] (BEAM-8376) Add FirestoreIO connector to Java SDK

2019-10-10 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948973#comment-16948973 ] Chamikara Madhusanka Jayalath commented on BEAM-8376: - Thanks for filing the JIRA.

[jira] [Created] (BEAM-8367) Python BigQuery sink should use unique IDs for mode STREAMING_INSERTS

2019-10-08 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-8367: --- Summary: Python BigQuery sink should use unique IDs for mode STREAMING_INSERTS Key: BEAM-8367 URL: https://issues.apache.org/jira/browse/BEAM-8367

[jira] [Updated] (BEAM-8367) Python BigQuery sink should use unique IDs for mode STREAMING_INSERTS

2019-10-09 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-8367: Issue Type: Bug (was: Improvement) > Python BigQuery sink should

[jira] [Created] (BEAM-9001) Allow setting environment ID to all transforms in the SDK

2019-12-19 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-9001: --- Summary: Allow setting environment ID to all transforms in the SDK Key: BEAM-9001 URL: https://issues.apache.org/jira/browse/BEAM-9001

[jira] [Commented] (BEAM-9005) Go SDK post-commit failures due to https://github.com/apache/beam/pull/10183

2019-12-20 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17001616#comment-17001616 ] Chamikara Madhusanka Jayalath commented on BEAM-9005: - Regarding Flink and Spark VR

[jira] [Updated] (BEAM-9005) Go SDK post-commit failures due to https://github.com/apache/beam/pull/10183

2019-12-19 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-9005: Summary: Go SDK post-commit failures due to

[jira] [Updated] (BEAM-9005) beam_PostCommit_Go_VR_Flink failure due to https://github.com/apache/beam/pull/10183

2019-12-19 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-9005: Issue Type: Bug (was: Improvement) > beam_PostCommit_Go_VR_Flink

[jira] [Created] (BEAM-9005) beam_PostCommit_Go_VR_Flink failure due to https://github.com/apache/beam/pull/10183

2019-12-19 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-9005: --- Summary: beam_PostCommit_Go_VR_Flink failure due to https://github.com/apache/beam/pull/10183 Key: BEAM-9005 URL:

[jira] [Commented] (BEAM-9005) Go SDK post-commit failures due to https://github.com/apache/beam/pull/10183

2019-12-20 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17001086#comment-17001086 ] Chamikara Madhusanka Jayalath commented on BEAM-9005: - Do you see a Dataflow job ID

[jira] [Commented] (BEAM-9005) Go SDK post-commit failures due to https://github.com/apache/beam/pull/10183

2019-12-20 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17001046#comment-17001046 ] Chamikara Madhusanka Jayalath commented on BEAM-9005: - Looking. BTW I have 

[jira] [Commented] (BEAM-9288) Conscrypt shaded dependency

2020-02-10 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034008#comment-17034008 ] Chamikara Madhusanka Jayalath commented on BEAM-9288: - Is there a way we can upgrade

[jira] [Assigned] (BEAM-9288) Conscrypt shaded dependency

2020-02-10 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-9288: --- Assignee: sunjincheng > Conscrypt shaded dependency >

[jira] [Comment Edited] (BEAM-9288) Conscrypt shaded dependency

2020-02-10 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034008#comment-17034008 ] Chamikara Madhusanka Jayalath edited comment on BEAM-9288 at 2/10/20 11:17 PM:

[jira] [Commented] (BEAM-9288) Conscrypt shaded dependency

2020-02-10 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034007#comment-17034007 ] Chamikara Madhusanka Jayalath commented on BEAM-9288: - cc: [~lcwik] [~medb] >

[jira] [Updated] (BEAM-3788) Implement a Kafka IO for Python SDK

2020-02-13 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-3788: Description: Java KafkaIO will be made available to Python users as

[jira] [Assigned] (BEAM-3788) Implement a Kafka IO for Python SDK

2020-02-13 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-3788: --- Assignee: Chamikara Madhusanka Jayalath > Implement a Kafka

[jira] [Commented] (BEAM-3788) Implement a Kafka IO for Python SDK

2020-02-13 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036376#comment-17036376 ] Chamikara Madhusanka Jayalath commented on BEAM-3788: - We are actively working on

[jira] [Commented] (BEAM-8898) Enable WriteToBigQuery to perform range partitioning

2020-02-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043752#comment-17043752 ] Chamikara Madhusanka Jayalath commented on BEAM-8898: - Thanks Pablo. Assigning to you

[jira] [Assigned] (BEAM-8898) Enable WriteToBigQuery to perform range partitioning

2020-02-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-8898: --- Assignee: Pablo Estrada > Enable WriteToBigQuery to perform

[jira] [Commented] (BEAM-9414) [beam_PostCommit_Python2] build failed

2020-02-28 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048096#comment-17048096 ] Chamikara Madhusanka Jayalath commented on BEAM-9414: - Chad, this seems to be related

[jira] [Assigned] (BEAM-9414) [beam_PostCommit_Python2] build failed

2020-02-28 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-9414: --- Assignee: Chad Dombrova > [beam_PostCommit_Python2] build

[jira] [Commented] (BEAM-9414) [beam_PostCommit_Python2] build failed

2020-02-28 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048095#comment-17048095 ] Chamikara Madhusanka Jayalath commented on BEAM-9414: - apache_beam/__init__.py:82:

[jira] [Assigned] (BEAM-8916) external_test_it.py is not collected by pytest

2020-02-28 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-8916: --- Assignee: Udi Meiri (was: Chamikara Madhusanka Jayalath) >

[jira] [Closed] (BEAM-9414) [beam_PostCommit_Python2] build failed due to "AttributeError: 'PortableRunner' object has no attribute 'create_job_service'"

2020-02-29 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath closed BEAM-9414. --- Fix Version/s: Not applicable Resolution: Fixed >

[jira] [Updated] (BEAM-9414) [beam_PostCommit_Python2] build failed due to "AttributeError: 'PortableRunner' object has no attribute 'create_job_service'"

2020-02-29 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-9414: Summary: [beam_PostCommit_Python2] build failed due to

[jira] [Commented] (BEAM-9414) [beam_PostCommit_Python2] build failed

2020-02-29 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048464#comment-17048464 ] Chamikara Madhusanka Jayalath commented on BEAM-9414: - Thanks. Yeah, you are right.

[jira] [Commented] (BEAM-9304) beam-sdks-java-io-google-cloud-platform imports conflicting versions for BigTable and Spanner

2020-03-04 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051549#comment-17051549 ] Chamikara Madhusanka Jayalath commented on BEAM-9304: - I might be missing something

[jira] [Resolved] (BEAM-9304) beam-sdks-java-io-google-cloud-platform imports conflicting versions for BigTable and Spanner

2020-03-04 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath resolved BEAM-9304. - Resolution: Fixed > beam-sdks-java-io-google-cloud-platform

[jira] [Commented] (BEAM-9304) beam-sdks-java-io-google-cloud-platform imports conflicting versions for BigTable and Spanner

2020-03-04 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051778#comment-17051778 ] Chamikara Madhusanka Jayalath commented on BEAM-9304: - Resolving. [~koloite] please

[jira] [Commented] (BEAM-9304) beam-sdks-java-io-google-cloud-platform imports conflicting versions for BigTable and Spanner

2020-03-04 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051684#comment-17051684 ] Chamikara Madhusanka Jayalath commented on BEAM-9304: - Yeah, seems like this has

[jira] [Assigned] (BEAM-9429) Python PostCommit: wordcount_xlang.py hangs

2020-03-03 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-9429: --- Assignee: Heejong Lee > Python PostCommit:

[jira] [Commented] (BEAM-9429) Python PostCommit: wordcount_xlang.py hangs

2020-03-03 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17050567#comment-17050567 ] Chamikara Madhusanka Jayalath commented on BEAM-9429: - Heejong, this seems to be

[jira] [Commented] (BEAM-8841) Add ability to perform BigQuery file loads using avro

2020-02-26 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045744#comment-17045744 ] Chamikara Madhusanka Jayalath commented on BEAM-8841: - Chun, assigning the Jira to you

[jira] [Assigned] (BEAM-8841) Add ability to perform BigQuery file loads using avro

2020-02-26 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-8841: --- Assignee: Chun Yang > Add ability to perform BigQuery file

[jira] [Resolved] (BEAM-7850) Make Environment a top level attribute of PTransform

2020-01-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath resolved BEAM-7850. - Fix Version/s: 2.19.0 Resolution: Fixed > Make Environment

[jira] [Created] (BEAM-9215) FileBesedSink may suppress exceptions during close

2020-01-28 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-9215: --- Summary: FileBesedSink may suppress exceptions during close Key: BEAM-9215 URL: https://issues.apache.org/jira/browse/BEAM-9215 Project:

[jira] [Resolved] (BEAM-9215) FileBesedSink may suppress exceptions during close

2020-02-14 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath resolved BEAM-9215. - Fix Version/s: 2.20.0 Resolution: Fixed > FileBesedSink

[jira] [Commented] (BEAM-3788) Implement a Kafka IO for Python SDK

2020-02-19 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17040565#comment-17040565 ] Chamikara Madhusanka Jayalath commented on BEAM-3788: - Added a comment to the email

[jira] [Created] (BEAM-9117) Clustering coder does not get used for BQ multi-partitioned tables

2020-01-14 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-9117: --- Summary: Clustering coder does not get used for BQ multi-partitioned tables Key: BEAM-9117 URL: https://issues.apache.org/jira/browse/BEAM-9117

[jira] [Updated] (BEAM-6860) WriteToText crash with "GlobalWindow -> ._IntervalWindowBase"

2020-01-14 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-6860: Priority: Major (was: Critical) > WriteToText crash with

[jira] [Commented] (BEAM-6860) WriteToText crash with "GlobalWindow -> ._IntervalWindowBase"

2020-01-14 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015431#comment-17015431 ] Chamikara Madhusanka Jayalath commented on BEAM-6860: - This was potentially fixed for

[jira] [Commented] (BEAM-6860) WriteToText crash with "GlobalWindow -> ._IntervalWindowBase"

2020-01-17 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17018235#comment-17018235 ] Chamikara Madhusanka Jayalath commented on BEAM-6860: - I'll close this for now. 

[jira] [Resolved] (BEAM-6860) WriteToText crash with "GlobalWindow -> ._IntervalWindowBase"

2020-01-17 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath resolved BEAM-6860. - Fix Version/s: 2.16.0 Resolution: Fixed > WriteToText

[jira] [Commented] (BEAM-9025) beam_PostRelease_NightlySnapshot failure due to .NoSuchMethodError: org.apache.beam.model.pipeline.v1.RunnerApi

2019-12-23 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002503#comment-17002503 ] Chamikara Madhusanka Jayalath commented on BEAM-9025: - cc: [~bhulette] >

[jira] [Created] (BEAM-9025) beam_PostRelease_NightlySnapshot failure due to .NoSuchMethodError: org.apache.beam.model.pipeline.v1.RunnerApi

2019-12-23 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-9025: --- Summary: beam_PostRelease_NightlySnapshot failure due to .NoSuchMethodError: org.apache.beam.model.pipeline.v1.RunnerApi Key: BEAM-9025 URL:

[jira] [Closed] (BEAM-9005) Go SDK post-commit failures due to https://github.com/apache/beam/pull/10183

2019-12-23 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath closed BEAM-9005. --- Fix Version/s: Not applicable Resolution: Fixed > Go SDK

[jira] [Commented] (BEAM-9486) Python 2 PostCommit Failures

2020-03-12 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058091#comment-17058091 ] Chamikara Madhusanka Jayalath commented on BEAM-9486: - Changed to a blocker till we

[jira] [Updated] (BEAM-9486) Python 2 PostCommit Failures

2020-03-12 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-9486: Priority: Blocker (was: Major) > Python 2 PostCommit Failures >

[jira] [Commented] (BEAM-9486) Python 2 PostCommit Failures

2020-03-12 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058090#comment-17058090 ] Chamikara Madhusanka Jayalath commented on BEAM-9486: - Looks like HEAD is also failing

[jira] [Assigned] (BEAM-9486) Python 2 PostCommit Failures

2020-03-12 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-9486: --- Assignee: Pablo Estrada (was: Chamikara Madhusanka Jayalath)

[jira] [Commented] (BEAM-9486) Python 2 PostCommit Failures

2020-03-12 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058087#comment-17058087 ] Chamikara Madhusanka Jayalath commented on BEAM-9486: - Above links did not point to an

[jira] [Updated] (BEAM-9486) Python 2 PostCommit Failures due to BQ IT failures

2020-03-12 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-9486: Summary: Python 2 PostCommit Failures due to BQ IT failures (was:

[jira] [Commented] (BEAM-2810) Consider a faster Avro library in Python

2020-03-10 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056520#comment-17056520 ] Chamikara Madhusanka Jayalath commented on BEAM-2810: - Yes, we use fastavro by default

[jira] [Created] (BEAM-9734) Revert https://github.com/apache/beam/pull/11122 which is a potential regression

2020-04-09 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-9734: --- Summary: Revert https://github.com/apache/beam/pull/11122 which is a potential regression Key: BEAM-9734 URL:

[jira] [Updated] (BEAM-9734) Revert https://github.com/apache/beam/pull/11122 which is a potential regression

2020-04-09 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-9734: Priority: Blocker (was: Major) > Revert

[jira] [Commented] (BEAM-9719) Cross-language test suites failing due to mossing nose plugin

2020-04-08 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078784#comment-17078784 ] Chamikara Madhusanka Jayalath commented on BEAM-9719: - Hannah, can we add nose back to

[jira] [Commented] (BEAM-9719) Cross-language test suites failing due to mossing nose plugin

2020-04-08 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078810#comment-17078810 ] Chamikara Madhusanka Jayalath commented on BEAM-9719: - Sent out 

[jira] [Commented] (BEAM-6860) WriteToText crash with "GlobalWindow -> ._IntervalWindowBase"

2020-04-14 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17083583#comment-17083583 ] Chamikara Madhusanka Jayalath commented on BEAM-6860: - Please file a new Jira and

[jira] [Assigned] (BEAM-6860) WriteToText crash with "GlobalWindow -> ._IntervalWindowBase"

2020-04-16 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-6860: --- Assignee: Udi Meiri (was: Chamikara Madhusanka Jayalath) >

[jira] [Commented] (BEAM-9719) Cross-language test suites failing due to mossing nose plugin

2020-04-07 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17077676#comment-17077676 ] Chamikara Madhusanka Jayalath commented on BEAM-9719: - We can dig around a bit to see

[jira] [Commented] (BEAM-9719) Cross-language test suites failing due to mossing nose plugin

2020-04-07 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17077678#comment-17077678 ] Chamikara Madhusanka Jayalath commented on BEAM-9719: - Heejong, can you take a look

[jira] [Created] (BEAM-9719) Cross-language test suites failing due to mossing nose plugin

2020-04-07 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-9719: --- Summary: Cross-language test suites failing due to mossing nose plugin Key: BEAM-9719 URL: https://issues.apache.org/jira/browse/BEAM-9719

[jira] [Commented] (BEAM-9719) Cross-language test suites failing due to mossing nose plugin

2020-04-07 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17077639#comment-17077639 ] Chamikara Madhusanka Jayalath commented on BEAM-9719: - cc: [~heejong] >

[jira] [Assigned] (BEAM-9719) Cross-language test suites failing due to mossing nose plugin

2020-04-07 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-9719: --- Assignee: Heejong Lee > Cross-language test suites failing

[jira] [Resolved] (BEAM-9734) Revert https://github.com/apache/beam/pull/11122 which is a potential regression

2020-04-12 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath resolved BEAM-9734. - Resolution: Fixed > Revert

[jira] [Created] (BEAM-9790) ClassCastException when using BigQueryIO with readTableRowsWithSchema for DirectRunner

2020-04-20 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-9790: --- Summary: ClassCastException when using BigQueryIO with readTableRowsWithSchema for DirectRunner Key: BEAM-9790 URL:

[jira] [Commented] (BEAM-9620) textio (and fileio in general) takes too long to estimate sizes of large globs

2020-03-26 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068204#comment-17068204 ] Chamikara Madhusanka Jayalath commented on BEAM-9620: - Though it might make the source

[jira] [Comment Edited] (BEAM-9620) textio (and fileio in general) takes too long to estimate sizes of large globs

2020-03-26 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068168#comment-17068168 ] Chamikara Madhusanka Jayalath edited comment on BEAM-9620 at 3/27/20, 12:48 AM:

[jira] [Commented] (BEAM-9620) textio (and fileio in general) takes too long to estimate sizes of large globs

2020-03-26 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068168#comment-17068168 ] Chamikara Madhusanka Jayalath commented on BEAM-9620: - Actually, I think we do have a

[jira] [Commented] (BEAM-9620) textio (and fileio in general) takes too long to estimate sizes of large globs

2020-03-26 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068203#comment-17068203 ] Chamikara Madhusanka Jayalath commented on BEAM-9620: - Yeah, that makes sense. >

[jira] [Commented] (BEAM-9620) textio (and fileio in general) takes too long to estimate sizes of large globs

2020-03-26 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068161#comment-17068161 ] Chamikara Madhusanka Jayalath commented on BEAM-9620: - cc: [~pabloem] [~udim] >

[jira] [Created] (BEAM-9620) textio (and fileio in general) takes too long to estimate sizes of large globs

2020-03-26 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-9620: --- Summary: textio (and fileio in general) takes too long to estimate sizes of large globs Key: BEAM-9620 URL:

[jira] [Commented] (BEAM-9528) Buggy/Slow FileIO.write()/sink implementation

2020-03-30 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071001#comment-17071001 ] Chamikara Madhusanka Jayalath commented on BEAM-9528: - I think this was asked in the

  1   2   3   >