[jira] [Created] (BEAM-9215) FileBesedSink may suppress exceptions during close

2020-01-28 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-9215: --- Summary: FileBesedSink may suppress exceptions during close Key: BEAM-9215 URL: https://issues.apache.org/jira/browse/BEAM-9215 Project:

[jira] [Resolved] (BEAM-7850) Make Environment a top level attribute of PTransform

2020-01-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath resolved BEAM-7850. - Fix Version/s: 2.19.0 Resolution: Fixed > Make Environment

[jira] [Resolved] (BEAM-6860) WriteToText crash with "GlobalWindow -> ._IntervalWindowBase"

2020-01-17 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath resolved BEAM-6860. - Fix Version/s: 2.16.0 Resolution: Fixed > WriteToText

[jira] [Commented] (BEAM-6860) WriteToText crash with "GlobalWindow -> ._IntervalWindowBase"

2020-01-17 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17018235#comment-17018235 ] Chamikara Madhusanka Jayalath commented on BEAM-6860: - I'll close this for now. 

[jira] [Updated] (BEAM-6860) WriteToText crash with "GlobalWindow -> ._IntervalWindowBase"

2020-01-14 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-6860: Priority: Major (was: Critical) > WriteToText crash with

[jira] [Commented] (BEAM-6860) WriteToText crash with "GlobalWindow -> ._IntervalWindowBase"

2020-01-14 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015431#comment-17015431 ] Chamikara Madhusanka Jayalath commented on BEAM-6860: - This was potentially fixed for

[jira] [Created] (BEAM-9117) Clustering coder does not get used for BQ multi-partitioned tables

2020-01-14 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-9117: --- Summary: Clustering coder does not get used for BQ multi-partitioned tables Key: BEAM-9117 URL: https://issues.apache.org/jira/browse/BEAM-9117

[jira] [Commented] (BEAM-9025) beam_PostRelease_NightlySnapshot failure due to .NoSuchMethodError: org.apache.beam.model.pipeline.v1.RunnerApi

2019-12-23 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002503#comment-17002503 ] Chamikara Madhusanka Jayalath commented on BEAM-9025: - cc: [~bhulette] >

[jira] [Created] (BEAM-9025) beam_PostRelease_NightlySnapshot failure due to .NoSuchMethodError: org.apache.beam.model.pipeline.v1.RunnerApi

2019-12-23 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-9025: --- Summary: beam_PostRelease_NightlySnapshot failure due to .NoSuchMethodError: org.apache.beam.model.pipeline.v1.RunnerApi Key: BEAM-9025 URL:

[jira] [Closed] (BEAM-9005) Go SDK post-commit failures due to https://github.com/apache/beam/pull/10183

2019-12-23 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath closed BEAM-9005. --- Fix Version/s: Not applicable Resolution: Fixed > Go SDK

[jira] [Commented] (BEAM-9005) Go SDK post-commit failures due to https://github.com/apache/beam/pull/10183

2019-12-20 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17001616#comment-17001616 ] Chamikara Madhusanka Jayalath commented on BEAM-9005: - Regarding Flink and Spark VR

[jira] [Commented] (BEAM-9005) Go SDK post-commit failures due to https://github.com/apache/beam/pull/10183

2019-12-20 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17001086#comment-17001086 ] Chamikara Madhusanka Jayalath commented on BEAM-9005: - Do you see a Dataflow job ID

[jira] [Commented] (BEAM-9005) Go SDK post-commit failures due to https://github.com/apache/beam/pull/10183

2019-12-20 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17001046#comment-17001046 ] Chamikara Madhusanka Jayalath commented on BEAM-9005: - Looking. BTW I have 

[jira] [Updated] (BEAM-9005) Go SDK post-commit failures due to https://github.com/apache/beam/pull/10183

2019-12-19 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-9005: Summary: Go SDK post-commit failures due to

[jira] [Updated] (BEAM-9005) beam_PostCommit_Go_VR_Flink failure due to https://github.com/apache/beam/pull/10183

2019-12-19 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-9005: Issue Type: Bug (was: Improvement) > beam_PostCommit_Go_VR_Flink

[jira] [Created] (BEAM-9005) beam_PostCommit_Go_VR_Flink failure due to https://github.com/apache/beam/pull/10183

2019-12-19 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-9005: --- Summary: beam_PostCommit_Go_VR_Flink failure due to https://github.com/apache/beam/pull/10183 Key: BEAM-9005 URL:

[jira] [Created] (BEAM-9001) Allow setting environment ID to all transforms in the SDK

2019-12-19 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-9001: --- Summary: Allow setting environment ID to all transforms in the SDK Key: BEAM-9001 URL: https://issues.apache.org/jira/browse/BEAM-9001

[jira] [Commented] (BEAM-8864) BigQueryQueryToTableIT.test_big_query_legacy_sql - fails in post commit tests

2019-12-16 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997516#comment-16997516 ] Chamikara Madhusanka Jayalath commented on BEAM-8864: - Seems like verify query

[jira] [Commented] (BEAM-8864) BigQueryQueryToTableIT.test_big_query_legacy_sql - fails in post commit tests

2019-12-13 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995808#comment-16995808 ] Chamikara Madhusanka Jayalath commented on BEAM-8864: - We expected to see two records

[jira] [Commented] (BEAM-8953) Extend ParquetIO.Read/ReadFiles.Builder to support Avro GenericData model

2019-12-12 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994905#comment-16994905 ] Chamikara Madhusanka Jayalath commented on BEAM-8953: - Thanks for the JIRA. Sounds

[jira] [Commented] (BEAM-6928) Make Python SDK custom Sink the default Sink for BigQuery

2019-11-27 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984055#comment-16984055 ] Chamikara Madhusanka Jayalath commented on BEAM-6928: - Pablo, looks like we are

[jira] [Updated] (BEAM-8803) Default behaviour for Python BQ Streaming inserts sink should be to retry always

2019-11-22 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-8803: Issue Type: Bug (was: Improvement) > Default behaviour for Python

[jira] [Commented] (BEAM-8803) Default behaviour for Python BQ Streaming inserts sink should be to retry always

2019-11-22 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16980617#comment-16980617 ] Chamikara Madhusanka Jayalath commented on BEAM-8803: - Made this a blocker for 2.18.0.

[jira] [Updated] (BEAM-8803) Default behaviour for Python BQ Streaming inserts sink should be to retry always

2019-11-22 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-8803: Fix Version/s: 2.18.0 > Default behaviour for Python BQ Streaming

[jira] [Updated] (BEAM-8803) Default behaviour for Python BQ Streaming inserts sink should be to retry always

2019-11-22 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-8803: Priority: Blocker (was: Major) > Default behaviour for Python BQ

[jira] [Assigned] (BEAM-8399) Python HDFS implementation should support filenames of the format "hdfs://namenodehost/parent/child"

2019-11-19 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-8399: --- Assignee: Udi Meiri > Python HDFS implementation should

[jira] [Commented] (BEAM-8399) Python HDFS implementation should support filenames of the format "hdfs://namenodehost/parent/child"

2019-11-19 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977879#comment-16977879 ] Chamikara Madhusanka Jayalath commented on BEAM-8399: - Udi, will you be able to look

[jira] [Commented] (BEAM-8653) installGcpTest task is flaky

2019-11-19 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1699#comment-1699 ] Chamikara Madhusanka Jayalath commented on BEAM-8653: - Another occurrence:

[jira] [Commented] (BEAM-8631) :sdks:python:test-suites:portable:py2:installGcpTest is flaky due to "No such file or directory"

2019-11-12 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16972863#comment-16972863 ] Chamikara Madhusanka Jayalath commented on BEAM-8631: - A different failure but the

[jira] [Created] (BEAM-8631) :sdks:python:test-suites:portable:py2:installGcpTest is flaky due to "No such file or directory"

2019-11-12 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-8631: --- Summary: :sdks:python:test-suites:portable:py2:installGcpTest is flaky due to "No such file or directory" Key: BEAM-8631 URL:

[jira] [Assigned] (BEAM-8631) :sdks:python:test-suites:portable:py2:installGcpTest is flaky due to "No such file or directory"

2019-11-12 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-8631: --- Assignee: Mark Liu >

[jira] [Resolved] (BEAM-7824) Set a default environment for Python SDK jobs for Dataflow runner

2019-11-11 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath resolved BEAM-7824. - Fix Version/s: Not applicable Resolution: Fixed > Set a

[jira] [Assigned] (BEAM-7850) Make Environment a top level attribute of PTransform

2019-11-11 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-7850: --- Assignee: Chamikara Madhusanka Jayalath > Make Environment a

[jira] [Resolved] (BEAM-8553) Add a more detailed cross-language transforms roadmap

2019-11-11 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath resolved BEAM-8553. - Fix Version/s: Not applicable Resolution: Fixed > Add a

[jira] [Commented] (BEAM-8376) Add FirestoreIO connector to Java SDK

2019-11-06 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968418#comment-16968418 ] Chamikara Madhusanka Jayalath commented on BEAM-8376: - I don't have specific context

[jira] [Assigned] (BEAM-8504) BigQueryIO DIRECT_READ is broken

2019-11-04 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath reassigned BEAM-8504: --- Assignee: Aryan Naraghi > BigQueryIO DIRECT_READ is broken >

[jira] [Commented] (BEAM-5192) Support Elasticsearch 7.x

2019-10-24 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959068#comment-16959068 ] Chamikara Madhusanka Jayalath commented on BEAM-5192: - [~chet.aldrich] thanks for

[jira] [Commented] (BEAM-3788) Implement a Kafka IO for Python SDK

2019-10-21 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956261#comment-16956261 ] Chamikara Madhusanka Jayalath commented on BEAM-3788: - I believe unbounded SDF support

[jira] [Commented] (BEAM-8399) Python HDFS implementation should support filenames of the format "hdfs://namenodehost/parent/child"

2019-10-17 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953960#comment-16953960 ] Chamikara Madhusanka Jayalath commented on BEAM-8399: - >From my reading, we get HDFS

[jira] [Updated] (BEAM-8367) Python BigQuery sink should use unique IDs for mode STREAMING_INSERTS

2019-10-15 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-8367: Fix Version/s: 2.17.0 > Python BigQuery sink should use unique IDs

[jira] [Updated] (BEAM-8367) Python BigQuery sink should use unique IDs for mode STREAMING_INSERTS

2019-10-15 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-8367: Priority: Blocker (was: Major) > Python BigQuery sink should use

[jira] [Created] (BEAM-8399) Python HDFS implementation should support filenames of the format "hdfs://namenodehost/parent/child"

2019-10-14 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-8399: --- Summary: Python HDFS implementation should support filenames of the format "hdfs://namenodehost/parent/child" Key: BEAM-8399 URL:

[jira] [Commented] (BEAM-8168) Python GCSFileSystem failing with gzip content encoding

2019-10-10 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948993#comment-16948993 ] Chamikara Madhusanka Jayalath commented on BEAM-8168: - Yeah, this is a known issue.

[jira] [Commented] (BEAM-8376) Add FirestoreIO connector to Java SDK

2019-10-10 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948973#comment-16948973 ] Chamikara Madhusanka Jayalath commented on BEAM-8376: - Thanks for filing the JIRA.

[jira] [Updated] (BEAM-8367) Python BigQuery sink should use unique IDs for mode STREAMING_INSERTS

2019-10-09 Thread Chamikara Madhusanka Jayalath (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Madhusanka Jayalath updated BEAM-8367: Issue Type: Bug (was: Improvement) > Python BigQuery sink should

[jira] [Created] (BEAM-8367) Python BigQuery sink should use unique IDs for mode STREAMING_INSERTS

2019-10-08 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-8367: --- Summary: Python BigQuery sink should use unique IDs for mode STREAMING_INSERTS Key: BEAM-8367 URL: https://issues.apache.org/jira/browse/BEAM-8367

[jira] [Created] (BEAM-8318) Add a num_threads_per_worker pipeline option to Python SDK.

2019-09-26 Thread Chamikara Madhusanka Jayalath (Jira)
Chamikara Madhusanka Jayalath created BEAM-8318: --- Summary: Add a num_threads_per_worker pipeline option to Python SDK. Key: BEAM-8318 URL: https://issues.apache.org/jira/browse/BEAM-8318

<    1   2   3