[jira] [Resolved] (BEAM-7916) Add ElasticsearchIO query parameter to take a ValueProvider

2019-08-14 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko resolved BEAM-7916. Resolution: Fixed > Add ElasticsearchIO query parameter to take a ValueProvider >

[jira] [Comment Edited] (BEAM-6777) SDK Harness Resilience

2019-08-14 Thread Ankur Goenka (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906964#comment-16906964 ] Ankur Goenka edited comment on BEAM-6777 at 8/14/19 7:11 AM: - Thanks for

[jira] [Commented] (BEAM-6777) SDK Harness Resilience

2019-08-14 Thread Ankur Goenka (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906964#comment-16906964 ] Ankur Goenka commented on BEAM-6777: Yes, that would be useful.   > SDK Harness Resilience >

[jira] [Work logged] (BEAM-7802) Expose a method to make an Avro-based PCollection into an Schema-based one

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7802?focusedWorklogId=294574=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-294574 ] ASF GitHub Bot logged work on BEAM-7802: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7802) Expose a method to make an Avro-based PCollection into an Schema-based one

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7802?focusedWorklogId=294572=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-294572 ] ASF GitHub Bot logged work on BEAM-7802: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7802) Expose a method to make an Avro-based PCollection into an Schema-based one

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7802?focusedWorklogId=294571=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-294571 ] ASF GitHub Bot logged work on BEAM-7802: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7802) Expose a method to make an Avro-based PCollection into an Schema-based one

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7802?focusedWorklogId=294573=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-294573 ] ASF GitHub Bot logged work on BEAM-7802: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-1440) Create a BigQuery source (that implements iobase.BoundedSource) for Python SDK

2019-08-14 Thread Kaustubh Ghole (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907015#comment-16907015 ] Kaustubh Ghole commented on BEAM-1440: -- [~pabloem] Is there any ETA when will be this bugs fix

[jira] [Work logged] (BEAM-7977) DataflowRunner writes to System.out instead of logging

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7977?focusedWorklogId=294689=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-294689 ] ASF GitHub Bot logged work on BEAM-7977: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7977) DataflowRunner writes to System.out instead of logging

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7977?focusedWorklogId=294693=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-294693 ] ASF GitHub Bot logged work on BEAM-7977: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7977) DataflowRunner writes to System.out instead of logging

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7977?focusedWorklogId=294692=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-294692 ] ASF GitHub Bot logged work on BEAM-7977: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7978) ArithmeticExceptions on getting backlog bytes

2019-08-14 Thread Mateusz (JIRA)
Mateusz created BEAM-7978: - Summary: ArithmeticExceptions on getting backlog bytes Key: BEAM-7978 URL: https://issues.apache.org/jira/browse/BEAM-7978 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-7978) ArithmeticExceptions on getting backlog bytes

2019-08-14 Thread Mateusz (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mateusz updated BEAM-7978: -- Description: Hello, Dataflow 2.14.0 (and to be more precise

[jira] [Updated] (BEAM-7978) ArithmeticExceptions on getting backlog bytes

2019-08-14 Thread Mateusz (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mateusz updated BEAM-7978: -- Description: Hello, Dataflow 2.14.0 (and to be more precise

[jira] [Updated] (BEAM-7978) ArithmeticExceptions on getting backlog bytes

2019-08-14 Thread Mateusz (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mateusz updated BEAM-7978: -- Description: Hello, Beam 2.14.0 (and to be more precise

[jira] [Commented] (BEAM-5164) ParquetIOIT fails on Spark and Flink

2019-08-14 Thread Ryan Skraba (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907232#comment-16907232 ] Ryan Skraba commented on BEAM-5164: --- OK -- one huge complication :/ Relocating the parquet library

[jira] [Work logged] (BEAM-7969) Streaming Dataflow worker doesn't report FnAPI metrics.

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7969?focusedWorklogId=295015=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295015 ] ASF GitHub Bot logged work on BEAM-7969: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7969) Streaming Dataflow worker doesn't report FnAPI metrics.

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7969?focusedWorklogId=295016=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295016 ] ASF GitHub Bot logged work on BEAM-7969: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=295037=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295037 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=295036=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295036 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?focusedWorklogId=295170=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295170 ] ASF GitHub Bot logged work on BEAM-7013: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7981) ParDo function wrapper doesn't support Iterable output types

2019-08-14 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907813#comment-16907813 ] Ahmet Altay commented on BEAM-7981: --- Ack. Thank you. > ParDo function wrapper doesn't support Iterable

[jira] [Resolved] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-14 Thread yifan zou (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yifan zou resolved BEAM-7866. - Resolution: Fixed > Python MongoDB IO performance and correctness issues >

[jira] [Commented] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-14 Thread yifan zou (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907646#comment-16907646 ] yifan zou commented on BEAM-7866: - The PR got merged. I mark this ticket as resolved. > Python MongoDB IO

[jira] [Updated] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-14 Thread yifan zou (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yifan zou updated BEAM-7866: Fix Version/s: (was: 2.16.0) 2.15.0 > Python MongoDB IO performance and correctness

[jira] [Work logged] (BEAM-7969) Streaming Dataflow worker doesn't report FnAPI metrics.

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7969?focusedWorklogId=295068=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295068 ] ASF GitHub Bot logged work on BEAM-7969: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7909) Write integration tests to test customized containers

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7909?focusedWorklogId=295094=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295094 ] ASF GitHub Bot logged work on BEAM-7909: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5980) Add load tests for Core Apache Beam opertaions

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5980?focusedWorklogId=295104=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295104 ] ASF GitHub Bot logged work on BEAM-5980: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?focusedWorklogId=295168=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295168 ] ASF GitHub Bot logged work on BEAM-7013: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7981) ParDo function wrapper doesn't support Iterable output types

2019-08-14 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-7981: Summary: ParDo function wrapper doesn't support Iterable output types (was: CallableWrapperDoFn) > ParDo

[jira] [Work logged] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?focusedWorklogId=295087=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295087 ] ASF GitHub Bot logged work on BEAM-7013: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?focusedWorklogId=295086=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295086 ] ASF GitHub Bot logged work on BEAM-7013: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?focusedWorklogId=295171=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295171 ] ASF GitHub Bot logged work on BEAM-7013: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?focusedWorklogId=295172=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295172 ] ASF GitHub Bot logged work on BEAM-7013: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7980) External environment with containerized worker pool

2019-08-14 Thread Thomas Weise (JIRA)
Thomas Weise created BEAM-7980: -- Summary: External environment with containerized worker pool Key: BEAM-7980 URL: https://issues.apache.org/jira/browse/BEAM-7980 Project: Beam Issue Type:

[jira] [Work logged] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?focusedWorklogId=295089=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295089 ] ASF GitHub Bot logged work on BEAM-7013: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7984) [python] The coder returned for typehints.List should be IterableCoder

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7984?focusedWorklogId=295149=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295149 ] ASF GitHub Bot logged work on BEAM-7984: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-7667) report GCS throttling time to Dataflow autoscaler

2019-08-14 Thread Heejong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heejong Lee resolved BEAM-7667. --- Resolution: Fixed Fix Version/s: 2.15.0 > report GCS throttling time to Dataflow autoscaler >

[jira] [Commented] (BEAM-7981) ParDo function wrapper doesn't support Iterable output types

2019-08-14 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907753#comment-16907753 ] Udi Meiri commented on BEAM-7981: - I have not committed to working on it yet. > ParDo function wrapper

[jira] [Work logged] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?focusedWorklogId=295167=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295167 ] ASF GitHub Bot logged work on BEAM-7013: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7934) Dataflow Python SDK logging: step_id is always empty string

2019-08-14 Thread James Hutchison (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Hutchison updated BEAM-7934: -- Description: Using the dataflow runner, log messages always show up in stackdriver with the

[jira] [Commented] (BEAM-7930) bundle_processor log spam using python SDK on dataflow runner

2019-08-14 Thread James Hutchison (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907722#comment-16907722 ] James Hutchison commented on BEAM-7930: --- >From what I can tell this is coming from the grouping

[jira] [Work logged] (BEAM-7742) BigQuery File Loads to work well with load job size limits

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7742?focusedWorklogId=295134=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295134 ] ASF GitHub Bot logged work on BEAM-7742: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7984) [python] The coder returned for typehints.List should be IterableCoder

2019-08-14 Thread Chad Dombrova (JIRA)
Chad Dombrova created BEAM-7984: --- Summary: [python] The coder returned for typehints.List should be IterableCoder Key: BEAM-7984 URL: https://issues.apache.org/jira/browse/BEAM-7984 Project: Beam

[jira] [Work logged] (BEAM-7984) [python] The coder returned for typehints.List should be IterableCoder

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7984?focusedWorklogId=295148=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295148 ] ASF GitHub Bot logged work on BEAM-7984: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7980) External environment with containerized worker pool

2019-08-14 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated BEAM-7980: --- Description: Augment Beam Python docker image and boot.go so that it can be used to launch

[jira] [Created] (BEAM-7981) CallableWrapperDoFn

2019-08-14 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-7981: --- Summary: CallableWrapperDoFn Key: BEAM-7981 URL: https://issues.apache.org/jira/browse/BEAM-7981 Project: Beam Issue Type: Bug Components: sdk-py-core

[jira] [Work logged] (BEAM-3342) Create a Cloud Bigtable IO connector for Python

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3342?focusedWorklogId=295109=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295109 ] ASF GitHub Bot logged work on BEAM-3342: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-3342) Create a Cloud Bigtable IO connector for Python

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3342?focusedWorklogId=295110=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295110 ] ASF GitHub Bot logged work on BEAM-3342: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-3342) Create a Cloud Bigtable IO connector for Python

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3342?focusedWorklogId=295108=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295108 ] ASF GitHub Bot logged work on BEAM-3342: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-3342) Create a Cloud Bigtable IO connector for Python

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3342?focusedWorklogId=295107=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295107 ] ASF GitHub Bot logged work on BEAM-3342: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-3342) Create a Cloud Bigtable IO connector for Python

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3342?focusedWorklogId=295111=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295111 ] ASF GitHub Bot logged work on BEAM-3342: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7975) error syncing pod - failed to start container artifact (python SDK)

2019-08-14 Thread James Hutchison (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Hutchison updated BEAM-7975: -- Description: {code:java} Error syncing pod 5966e59c

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=295022=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295022 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=295023=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295023 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7969) Streaming Dataflow worker doesn't report FnAPI metrics.

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7969?focusedWorklogId=295067=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295067 ] ASF GitHub Bot logged work on BEAM-7969: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?focusedWorklogId=295084=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295084 ] ASF GitHub Bot logged work on BEAM-7013: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?focusedWorklogId=295097=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295097 ] ASF GitHub Bot logged work on BEAM-7013: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7969) Streaming Dataflow worker doesn't report FnAPI metrics.

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7969?focusedWorklogId=295066=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295066 ] ASF GitHub Bot logged work on BEAM-7969: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7982) Dataflow runner needs to identify the new format of metric names for distribution metrics

2019-08-14 Thread David Yan (JIRA)
David Yan created BEAM-7982: --- Summary: Dataflow runner needs to identify the new format of metric names for distribution metrics Key: BEAM-7982 URL: https://issues.apache.org/jira/browse/BEAM-7982 Project:

[jira] [Commented] (BEAM-7049) Merge multiple input to one BeamUnionRel

2019-08-14 Thread sridhar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907689#comment-16907689 ] sridhar Reddy commented on BEAM-7049: - Good idea! I will create one > Merge multiple input to one

[jira] [Created] (BEAM-7983) Template parameters don't work if they are only used in DoFns

2019-08-14 Thread Yunqing Zhou (JIRA)
Yunqing Zhou created BEAM-7983: -- Summary: Template parameters don't work if they are only used in DoFns Key: BEAM-7983 URL: https://issues.apache.org/jira/browse/BEAM-7983 Project: Beam Issue

[jira] [Commented] (BEAM-7981) ParDo function wrapper doesn't support Iterable output types

2019-08-14 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907699#comment-16907699 ] Ahmet Altay commented on BEAM-7981: --- Just for clarification, [~udim] are you planning to work on this?

[jira] [Work logged] (BEAM-7742) BigQuery File Loads to work well with load job size limits

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7742?focusedWorklogId=295161=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295161 ] ASF GitHub Bot logged work on BEAM-7742: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7720) Fix the exception type of InMemoryJobService when job id not found

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7720?focusedWorklogId=295226=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295226 ] ASF GitHub Bot logged work on BEAM-7720: Author: ASF GitHub Bot

[jira] [Assigned] (BEAM-7720) Fix the exception type of InMemoryJobService when job id not found

2019-08-14 Thread Chad Dombrova (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chad Dombrova reassigned BEAM-7720: --- Assignee: Chad Dombrova > Fix the exception type of InMemoryJobService when job id not found

[jira] [Work logged] (BEAM-7720) Fix the exception type of InMemoryJobService when job id not found

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7720?focusedWorklogId=295227=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295227 ] ASF GitHub Bot logged work on BEAM-7720: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7720) Fix the exception type of InMemoryJobService when job id not found

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7720?focusedWorklogId=295231=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295231 ] ASF GitHub Bot logged work on BEAM-7720: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7742) BigQuery File Loads to work well with load job size limits

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7742?focusedWorklogId=295189=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295189 ] ASF GitHub Bot logged work on BEAM-7742: Author: ASF GitHub Bot

[jira] [Issue Comment Deleted] (BEAM-7871) Streaming from PubSub to Firestore doesn't work on Dataflow

2019-08-14 Thread Bruce Arctor (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Arctor updated BEAM-7871: --- Comment: was deleted (was: [~zdenulo], is this due to lack of there being an IO to firebase api

[jira] [Commented] (BEAM-7619) [beam_PostCommit_Py_ValCont] [test_metrics_fnapi_it] KeyError

2019-08-14 Thread Andrew Pilloud (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907578#comment-16907578 ] Andrew Pilloud commented on BEAM-7619: -- Hello, this is marked as "currently-failing". Is this still

[jira] [Commented] (BEAM-7410) Explore possibilities to lower in-use IP address quota footprint.

2019-08-14 Thread Andrew Pilloud (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907576#comment-16907576 ] Andrew Pilloud commented on BEAM-7410: -- This is marked as "currently-failing". Is it actually causing

[jira] [Commented] (BEAM-7225) [beam_PostCommit_Py_ValCont ] [test_metrics_fnapi_it] Unable to match metrics for matcher namespace

2019-08-14 Thread Andrew Pilloud (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907585#comment-16907585 ] Andrew Pilloud commented on BEAM-7225: -- This is marked as 'currently-failing', but the test appears

[jira] [Updated] (BEAM-7225) [beam_PostCommit_Py_ValCont ] [test_metrics_fnapi_it] Unable to match metrics for matcher namespace

2019-08-14 Thread Andrew Pilloud (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Pilloud updated BEAM-7225: - Labels: (was: currently-failing) > [beam_PostCommit_Py_ValCont ] [test_metrics_fnapi_it] Unable

[jira] [Updated] (BEAM-6610) [beam_PostCommit_Python_Verify, beam_PostCommit_Java]ResourceExhausted: 429 Your project has exceeded a limit: (type="topics-per-project", current=10000, maximum=10000)

2019-08-14 Thread Andrew Pilloud (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Pilloud updated BEAM-6610: - Labels: mitigated (was: currently-failing mitigated) > [beam_PostCommit_Python_Verify,

[jira] [Commented] (BEAM-6610) [beam_PostCommit_Python_Verify, beam_PostCommit_Java]ResourceExhausted: 429 Your project has exceeded a limit: (type="topics-per-project", current=10000, maximum=10000)

2019-08-14 Thread Andrew Pilloud (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907586#comment-16907586 ] Andrew Pilloud commented on BEAM-6610: -- It is unlikely that this is both "currently-failing" and

[jira] [Work logged] (BEAM-7670) Flink portable worker gets stuck if one of the task does not get any data

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7670?focusedWorklogId=294986=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-294986 ] ASF GitHub Bot logged work on BEAM-7670: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-5286) [beam_PostCommit_Java_GradleBuild][org.apache.beam.examples.subprocess.ExampleEchoPipelineTest.testExampleEchoPipeline][Flake] .sh script: text file busy.

2019-08-14 Thread Andrew Pilloud (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Pilloud updated BEAM-5286: - Labels: flake (was: currently-failing flake) >

[jira] [Commented] (BEAM-5286) [beam_PostCommit_Java_GradleBuild][org.apache.beam.examples.subprocess.ExampleEchoPipelineTest.testExampleEchoPipeline][Flake] .sh script: text file busy.

2019-08-14 Thread Andrew Pilloud (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907595#comment-16907595 ] Andrew Pilloud commented on BEAM-5286: -- This is marked as both "currently-failing" and "flake". It

[jira] [Work logged] (BEAM-720) Run WindowedWordCount Integration Test in Flink

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-720?focusedWorklogId=295008=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295008 ] ASF GitHub Bot logged work on BEAM-720: --- Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7420) Including the Flink runner causes exceptions unless running in a flink environment

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7420?focusedWorklogId=294658=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-294658 ] ASF GitHub Bot logged work on BEAM-7420: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7420) Including the Flink runner causes exceptions unless running in a flink environment

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7420?focusedWorklogId=294659=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-294659 ] ASF GitHub Bot logged work on BEAM-7420: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-7420) Including the Flink runner causes exceptions unless running in a flink environment

2019-08-14 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels resolved BEAM-7420. -- Resolution: Fixed Fix Version/s: 2.16.0 > Including the Flink runner causes

[jira] [Work logged] (BEAM-7420) Including the Flink runner causes exceptions unless running in a flink environment

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7420?focusedWorklogId=294669=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-294669 ] ASF GitHub Bot logged work on BEAM-7420: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7420) Including the Flink runner causes exceptions unless running in a flink environment

2019-08-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7420?focusedWorklogId=294668=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-294668 ] ASF GitHub Bot logged work on BEAM-7420: Author: ASF GitHub Bot

[jira] [Assigned] (BEAM-7474) Add SDK harness containers for Py 3.6, Py 3.7

2019-08-14 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev reassigned BEAM-7474: - Assignee: Hannah Jiang (was: Frederik Bode) > Add SDK harness containers for Py

[jira] [Commented] (BEAM-7474) Add SDK harness containers for Py 3.6, Py 3.7

2019-08-14 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907162#comment-16907162 ] Valentyn Tymofieiev commented on BEAM-7474: --- It makes sense to consolidate these tasks,

[jira] [Commented] (BEAM-7575) Add Wordcount-on-Flink to Python 3.6 and 3.7 test suite

2019-08-14 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907168#comment-16907168 ] Valentyn Tymofieiev commented on BEAM-7575: --- This may be a good suite to exercise portable

[jira] [Closed] (BEAM-7946) Fix all Dataflow LoadTests sdist task issue

2019-08-14 Thread Kasia Kucharczyk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kasia Kucharczyk closed BEAM-7946. -- Resolution: Fixed Fix Version/s: 2.16.0 > Fix all Dataflow LoadTests sdist task issue >

[jira] [Updated] (BEAM-7962) Drop support for Flink 1.5 and 1.6

2019-08-14 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-7962: - Status: Open (was: Triage Needed) > Drop support for Flink 1.5 and 1.6 >

[jira] [Assigned] (BEAM-5627) Investigate why test_split_at_fraction_exhaustive consistently fails to split after 101 attempts on Python 3

2019-08-14 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev reassigned BEAM-5627: - Assignee: (was: Frederik Bode) > Investigate why

[jira] [Created] (BEAM-7977) DataflowRunner writes to System.out instead of logging

2019-08-14 Thread Sebastian Jambor (JIRA)
Sebastian Jambor created BEAM-7977: -- Summary: DataflowRunner writes to System.out instead of logging Key: BEAM-7977 URL: https://issues.apache.org/jira/browse/BEAM-7977 Project: Beam Issue

[jira] [Updated] (BEAM-7967) Execute portable Flink application jar

2019-08-14 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-7967: - Status: Open (was: Triage Needed) > Execute portable Flink application jar >

[jira] [Updated] (BEAM-7966) Write portable Flink application jar

2019-08-14 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated BEAM-7966: - Status: Open (was: Triage Needed) > Write portable Flink application jar >

[jira] [Commented] (BEAM-7455) Improve Avro IO integration test coverage on Python 3.

2019-08-14 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907167#comment-16907167 ] Valentyn Tymofieiev commented on BEAM-7455: --- There is a PR in flight, taking this over as an

[jira] [Commented] (BEAM-7223) Add ValidatesRunner test suite for Flink on Python 3.

2019-08-14 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907166#comment-16907166 ] Valentyn Tymofieiev commented on BEAM-7223: --- There is a PR in flight, taking this over as an

[jira] [Assigned] (BEAM-7455) Improve Avro IO integration test coverage on Python 3.

2019-08-14 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev reassigned BEAM-7455: - Assignee: Valentyn Tymofieiev (was: Frederik Bode) > Improve Avro IO

[jira] [Updated] (BEAM-5627) Redesign test_split_at_fraction_exhaustive tests for Python 3

2019-08-14 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev updated BEAM-5627: -- Summary: Redesign test_split_at_fraction_exhaustive tests for Python 3 (was:

[jira] [Assigned] (BEAM-7223) Add ValidatesRunner test suite for Flink on Python 3.

2019-08-14 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev reassigned BEAM-7223: - Assignee: Valentyn Tymofieiev (was: Frederik Bode) > Add ValidatesRunner test

[jira] [Updated] (BEAM-7575) Add Wordcount-on-Flink to Python 3.6 and 3.7 test suite

2019-08-14 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev updated BEAM-7575: -- Priority: Minor (was: Major) > Add Wordcount-on-Flink to Python 3.6 and 3.7 test suite

  1   2   >