[jira] [Commented] (BEAM-7978) ArithmeticExceptions on getting backlog bytes

2019-08-15 Thread Mateusz (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16908730#comment-16908730 ] Mateusz commented on BEAM-7978: --- Hello [~chamikara], I guess all the runners that are execut

[jira] [Work logged] (BEAM-7987) WindowingWindmillReader should not start to read from an empty windmill workitem

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7987?focusedWorklogId=296082&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-296082 ] ASF GitHub Bot logged work on BEAM-7987: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7073) AvroUtils converting generic record to Beam Row causes class cast exception

2019-08-15 Thread Vishwas (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16908696#comment-16908696 ] Vishwas commented on BEAM-7073: --- [~ryanskraba] This issue is already fixed as part of below

[jira] [Work logged] (BEAM-7987) WindowingWindmillReader should not start to read from an empty windmill workitem

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7987?focusedWorklogId=296061&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-296061 ] ASF GitHub Bot logged work on BEAM-7987: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7987) WindowingWindmillReader should not start to read from an empty windmill workitem

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7987?focusedWorklogId=296060&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-296060 ] ASF GitHub Bot logged work on BEAM-7987: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-3342) Create a Cloud Bigtable IO connector for Python

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3342?focusedWorklogId=296042&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-296042 ] ASF GitHub Bot logged work on BEAM-3342: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7049) Merge multiple input to one BeamUnionRel

2019-08-15 Thread sridhar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16908680#comment-16908680 ] sridhar Reddy commented on BEAM-7049: - Here is the pull request. As I mentioned in the

[jira] [Work logged] (BEAM-7049) Merge multiple input to one BeamUnionRel

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7049?focusedWorklogId=296035&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-296035 ] ASF GitHub Bot logged work on BEAM-7049: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7989) SparkRunner CacheVisitor counts PCollections from SideInputs

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7989?focusedWorklogId=295999&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295999 ] ASF GitHub Bot logged work on BEAM-7989: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7989) SparkRunner CacheVisitor counts PCollections from SideInputs

2019-08-15 Thread Kyle Winkelman (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16908661#comment-16908661 ] Kyle Winkelman commented on BEAM-7989: -- I first noticed this when I had a pipeline th

[jira] [Updated] (BEAM-7989) SparkRunner CacheVisitor counts PCollections from SideInputs

2019-08-15 Thread Kyle Winkelman (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Winkelman updated BEAM-7989: - Summary: SparkRunner CacheVisitor counts PCollections from SideInputs (was: Spark Runner Caches P

[jira] [Work logged] (BEAM-7987) WindowingWindmillReader should not start to read from an empty windmill workitem

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7987?focusedWorklogId=295968&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295968 ] ASF GitHub Bot logged work on BEAM-7987: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7987) WindowingWindmillReader should not start to read from an empty windmill workitem

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7987?focusedWorklogId=295966&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295966 ] ASF GitHub Bot logged work on BEAM-7987: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7987) WindowingWindmillReader should not start to read from an empty windmill workitem

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7987?focusedWorklogId=295963&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295963 ] ASF GitHub Bot logged work on BEAM-7987: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7989) Spark Runner Caches PCollections from SideInputs

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7989?focusedWorklogId=295948&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295948 ] ASF GitHub Bot logged work on BEAM-7989: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7989) Spark Runner Caches PCollections from SideInputs

2019-08-15 Thread Kyle Winkelman (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Winkelman updated BEAM-7989: - Status: Open (was: Triage Needed) > Spark Runner Caches PCollections from SideInputs > --

[jira] [Assigned] (BEAM-7989) Spark Runner Caches PCollections from SideInputs

2019-08-15 Thread Kyle Winkelman (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Winkelman reassigned BEAM-7989: Assignee: Kyle Winkelman > Spark Runner Caches PCollections from SideInputs > -

[jira] [Work logged] (BEAM-7987) WindowingWindmillReader should not start to read from an empty windmill workitem

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7987?focusedWorklogId=295943&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295943 ] ASF GitHub Bot logged work on BEAM-7987: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7989) Spark Runner Caches PCollections from SideInputs

2019-08-15 Thread Kyle Winkelman (JIRA)
Kyle Winkelman created BEAM-7989: Summary: Spark Runner Caches PCollections from SideInputs Key: BEAM-7989 URL: https://issues.apache.org/jira/browse/BEAM-7989 Project: Beam Issue Type: Bug

[jira] [Work logged] (BEAM-7987) WindowingWindmillReader should not start to read from an empty windmill workitem

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7987?focusedWorklogId=295934&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295934 ] ASF GitHub Bot logged work on BEAM-7987: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7060?focusedWorklogId=295917&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295917 ] ASF GitHub Bot logged work on BEAM-7060: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7060?focusedWorklogId=295918&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295918 ] ASF GitHub Bot logged work on BEAM-7060: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7495) Add support for dynamic worker re-balancing when reading BigQuery data using Cloud Dataflow

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7495?focusedWorklogId=295915&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295915 ] ASF GitHub Bot logged work on BEAM-7495: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7986) Increase minimum grpcio required version

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7986?focusedWorklogId=295914&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295914 ] ASF GitHub Bot logged work on BEAM-7986: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7986) Increase minimum grpcio required version

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7986?focusedWorklogId=295913&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295913 ] ASF GitHub Bot logged work on BEAM-7986: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7924) Failure in Python 2 postcommit: crossLanguagePythonJavaFlink

2019-08-15 Thread Kyle Weaver (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16908583#comment-16908583 ] Kyle Weaver commented on BEAM-7924: --- I just ran into a similar issue. Do either of you k

[jira] [Work logged] (BEAM-7988) Error should include runner name when runner is invalid

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7988?focusedWorklogId=295897&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295897 ] ASF GitHub Bot logged work on BEAM-7988: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7988) Error should include runner name when runner is invalid

2019-08-15 Thread Kyle Weaver (JIRA)
Kyle Weaver created BEAM-7988: - Summary: Error should include runner name when runner is invalid Key: BEAM-7988 URL: https://issues.apache.org/jira/browse/BEAM-7988 Project: Beam Issue Type: Impr

[jira] [Created] (BEAM-7987) WindowingWindmillReader should not start to read from an empty windmill workitem

2019-08-15 Thread Boyuan Zhang (JIRA)
Boyuan Zhang created BEAM-7987: -- Summary: WindowingWindmillReader should not start to read from an empty windmill workitem Key: BEAM-7987 URL: https://issues.apache.org/jira/browse/BEAM-7987 Project: Bea

[jira] [Comment Edited] (BEAM-7986) Increase minimum grpcio required version

2019-08-15 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16908569#comment-16908569 ] Udi Meiri edited comment on BEAM-7986 at 8/16/19 12:19 AM: --- Adde

[jira] [Commented] (BEAM-7986) Increase minimum grpcio required version

2019-08-15 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16908569#comment-16908569 ] Udi Meiri commented on BEAM-7986: - Added in 1.12: https://github.com/grpc/grpc/pull/15254

[jira] [Commented] (BEAM-7986) Increase minimum grpcio required version

2019-08-15 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16908565#comment-16908565 ] Udi Meiri commented on BEAM-7986: - Will upgrade dep to the oldest version that has the abs

[jira] [Assigned] (BEAM-7986) Increase minimum grpcio required version

2019-08-15 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-7986: --- Assignee: Udi Meiri > Increase minimum grpcio required version >

[jira] [Work logged] (BEAM-7909) Write integration tests to test customized containers

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7909?focusedWorklogId=295877&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295877 ] ASF GitHub Bot logged work on BEAM-7909: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=295869&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295869 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Work started] (BEAM-7909) Write integration tests to test customized containers

2019-08-15 Thread Hannah Jiang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-7909 started by Hannah Jiang. -- > Write integration tests to test customized containers > ---

[jira] [Work logged] (BEAM-7909) Write integration tests to test customized containers

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7909?focusedWorklogId=295857&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295857 ] ASF GitHub Bot logged work on BEAM-7909: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7909) Write integration tests to test customized containers

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7909?focusedWorklogId=295858&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295858 ] ASF GitHub Bot logged work on BEAM-7909: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=295851&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295851 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-3342) Create a Cloud Bigtable IO connector for Python

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3342?focusedWorklogId=295847&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295847 ] ASF GitHub Bot logged work on BEAM-3342: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7909) Write integration tests to test customized containers

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7909?focusedWorklogId=295811&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295811 ] ASF GitHub Bot logged work on BEAM-7909: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7528) Save correctly Python Load Tests metrics according to it's namespace

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7528?focusedWorklogId=295809&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295809 ] ASF GitHub Bot logged work on BEAM-7528: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=295808&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295808 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7953) Move LoadTests gradle tasks to test-suites gradle files

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7953: --- Status: Open (was: Triage Needed) > Move LoadTests gradle tasks to test-suites gradle files > ---

[jira] [Updated] (BEAM-7957) Warn at job submit time if a step is named with a / or empty in DataflowRunner

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7957: --- Status: Open (was: Triage Needed) > Warn at job submit time if a step is named with a / or empty in D

[jira] [Updated] (BEAM-7955) Dynamic Writer - combining computed shards' number for late events with window's

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7955: --- Status: Open (was: Triage Needed) > Dynamic Writer - combining computed shards' number for late event

[jira] [Updated] (BEAM-7914) Add python 3 test in crossLanguageValidateRunner task

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7914: --- Status: Open (was: Triage Needed) > Add python 3 test in crossLanguageValidateRunner task > -

[jira] [Updated] (BEAM-7853) PubsubIO and FixedWindows

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7853: --- Status: Open (was: Triage Needed) > PubsubIO and FixedWindows > - > >

[jira] [Updated] (BEAM-7950) Remove the Python 3 warning as it has already been supported

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7950: --- Status: Open (was: Triage Needed) > Remove the Python 3 warning as it has already been supported > --

[jira] [Updated] (BEAM-7951) Allow runner to configure customization WindowedValue coder such as ValueOnlyWindowedValueCoder

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7951: --- Status: Open (was: Triage Needed) > Allow runner to configure customization WindowedValue coder such

[jira] [Updated] (BEAM-7947) Improves the interfaces of classes such as FnDataService, BundleProcessor, ActiveBundle, etc to change the parameter type from WindowedValue to T

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7947: --- Status: Open (was: Triage Needed) > Improves the interfaces of classes such as FnDataService, BundleP

[jira] [Updated] (BEAM-7952) Make the input queue of the input buffer in Python SDK Harness size limited.

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7952: --- Status: Open (was: Triage Needed) > Make the input queue of the input buffer in Python SDK Harness si

[jira] [Updated] (BEAM-7945) Allow runner to configure "semi_persist_dir" which is used in the SDK harness

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7945: --- Status: Open (was: Triage Needed) > Allow runner to configure "semi_persist_dir" which is used in the

[jira] [Updated] (BEAM-7948) Add time-based cache threshold support in the Java data service

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7948: --- Status: Open (was: Triage Needed) > Add time-based cache threshold support in the Java data service >

[jira] [Updated] (BEAM-7949) Add time-based cache threshold support in the data service of the Python SDK harness

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7949: --- Status: Open (was: Triage Needed) > Add time-based cache threshold support in the data service of the

[jira] [Updated] (BEAM-7958) Log message argument missing for stager's .whl extra_package warning

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7958: --- Status: Open (was: Triage Needed) > Log message argument missing for stager's .whl extra_package warn

[jira] [Updated] (BEAM-7961) Add tests for all runner native transforms and some widely used composite transforms to cross-language validates runner test suite

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7961: --- Status: Open (was: Triage Needed) > Add tests for all runner native transforms and some widely used c

[jira] [Assigned] (BEAM-6442) Incomplete JobService API Semantics

2019-08-15 Thread Sam Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Rohde reassigned BEAM-6442: --- Assignee: (was: Sam Rohde) > Incomplete JobService API Semantics > --

[jira] [Commented] (BEAM-6442) Incomplete JobService API Semantics

2019-08-15 Thread Sam Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16908507#comment-16908507 ] Sam Rohde commented on BEAM-6442: - I unfortunately don't have time to work on this. > Inc

[jira] [Updated] (BEAM-7940) beam_Release_Python_NightlySnapshot is broken due to directory not exist

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7940: --- Status: Open (was: Triage Needed) > beam_Release_Python_NightlySnapshot is broken due to directory no

[jira] [Updated] (BEAM-7963) Unnesting with large schema causes error

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7963: --- Status: Open (was: Triage Needed) > Unnesting with large schema causes error > --

[jira] [Commented] (BEAM-7968) UDF case insensitive

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16908505#comment-16908505 ] Ismaël Mejía commented on BEAM-7968: Assigned to you Andrew because you probably have

[jira] [Assigned] (BEAM-7968) UDF case insensitive

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-7968: -- Assignee: Andrew Pilloud (was: Aizhamal Nurmamat kyzy) > UDF case insensitive > --

[jira] [Updated] (BEAM-7968) UDF case insensitive

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7968: --- Status: Open (was: Triage Needed) > UDF case insensitive > > > K

[jira] [Resolved] (BEAM-7806) org.apache.beam.sdk.extensions.sql.meta.provider.pubsub.PubsubJsonIT.testSelectsPayloadContent failed

2019-08-15 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-7806. --- Resolution: Fixed Fix Version/s: Not applicable > org.apache.beam.sdk.extensions.sql.me

[jira] [Updated] (BEAM-7968) UDF case insensitive

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7968: --- Component/s: (was: beam-events) dsl-sql > UDF case insensitive >

[jira] [Updated] (BEAM-7976) Documentation for word count example is unclear about inputFile vs pom.xml

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7976: --- Status: Open (was: Triage Needed) > Documentation for word count example is unclear about inputFile v

[jira] [Updated] (BEAM-7974) Make RowCoder package-private

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7974: --- Status: Open (was: Triage Needed) > Make RowCoder package-private > - > >

[jira] [Updated] (BEAM-7971) Pycharm debugger for apache_beam/*_test.py broken

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7971: --- Status: Open (was: Triage Needed) > Pycharm debugger for apache_beam/*_test.py broken > -

[jira] [Updated] (BEAM-7980) External environment with containerized worker pool

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7980: --- Status: Open (was: Triage Needed) > External environment with containerized worker pool > ---

[jira] [Updated] (BEAM-7973) Python doesn't shut down Flink job server properly

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7973: --- Status: Open (was: Triage Needed) > Python doesn't shut down Flink job server properly >

[jira] [Updated] (BEAM-7972) Portable Python Reshuffle does not work with windowed pcollection

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7972: --- Summary: Portable Python Reshuffle does not work with windowed pcollection (was: Portable Python Resh

[jira] [Updated] (BEAM-7972) Portable Python Reshuffle does not work with windowed pcollection

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7972: --- Status: Open (was: Triage Needed) > Portable Python Reshuffle does not work with windowed pcollection

[jira] [Updated] (BEAM-7977) DataflowRunner writes to System.out instead of logging

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7977: --- Status: Open (was: Triage Needed) > DataflowRunner writes to System.out instead of logging >

[jira] [Updated] (BEAM-7969) Streaming Dataflow worker doesn't report FnAPI metrics.

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7969: --- Status: Open (was: Triage Needed) > Streaming Dataflow worker doesn't report FnAPI metrics. > ---

[jira] [Updated] (BEAM-7982) Dataflow runner needs to identify the new format of metric names for distribution metrics

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7982: --- Status: Open (was: Triage Needed) > Dataflow runner needs to identify the new format of metric names

[jira] [Updated] (BEAM-7983) Template parameters don't work if they are only used in DoFns

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7983: --- Status: Open (was: Triage Needed) > Template parameters don't work if they are only used in DoFns > -

[jira] [Updated] (BEAM-7984) [python] The coder returned for typehints.List should be IterableCoder

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7984: --- Status: Open (was: Triage Needed) > [python] The coder returned for typehints.List should be Iterable

[jira] [Updated] (BEAM-7981) ParDo function wrapper doesn't support Iterable output types

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7981: --- Status: Open (was: Triage Needed) > ParDo function wrapper doesn't support Iterable output types > --

[jira] [Updated] (BEAM-7975) error syncing pod - failed to start container artifact (python SDK)

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7975: --- Status: Open (was: Triage Needed) > error syncing pod - failed to start container artifact (python SD

[jira] [Updated] (BEAM-7986) Increase minimum grpcio required version

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7986: --- Status: Open (was: Triage Needed) > Increase minimum grpcio required version > --

[jira] [Work logged] (BEAM-7969) Streaming Dataflow worker doesn't report FnAPI metrics.

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7969?focusedWorklogId=295788&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295788 ] ASF GitHub Bot logged work on BEAM-7969: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-5980) Add load tests for Core Apache Beam operations

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-5980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-5980: --- Summary: Add load tests for Core Apache Beam operations (was: Add load tests for Core Apache Beam op

[jira] [Updated] (BEAM-7978) ArithmeticExceptions on getting backlog bytes

2019-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7978: --- Status: Open (was: Triage Needed) > ArithmeticExceptions on getting backlog bytes >

[jira] [Work logged] (BEAM-7802) Expose a method to make an Avro-based PCollection into an Schema-based one

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7802?focusedWorklogId=295780&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295780 ] ASF GitHub Bot logged work on BEAM-7802: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-5428) Implement cross-bundle state caching.

2019-08-15 Thread Rakesh Kumar (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Kumar updated BEAM-5428: --- Description: Tech spec:  [https://docs.google.com/document/d/1BOozW0bzBuz4oHJEuZNDOHdzaV5Y56ix58Ozrqm2

[jira] [Assigned] (BEAM-5428) Implement cross-bundle state caching.

2019-08-15 Thread Rakesh Kumar (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Kumar reassigned BEAM-5428: -- Assignee: Rakesh Kumar (was: Robert Bradshaw) > Implement cross-bundle state caching. > --

[jira] [Resolved] (BEAM-7475) Add Python stateful processing example in blog

2019-08-15 Thread Rakesh Kumar (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Kumar resolved BEAM-7475. Resolution: Fixed Fix Version/s: 2.14.0 > Add Python stateful processing example in blog > --

[jira] [Resolved] (BEAM-7737) Microbenchmark script do not work consistently

2019-08-15 Thread Rakesh Kumar (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Kumar resolved BEAM-7737. Resolution: Fixed Fix Version/s: 2.14.0 > Microbenchmark script do not work consistently > -

[jira] [Work logged] (BEAM-7802) Expose a method to make an Avro-based PCollection into an Schema-based one

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7802?focusedWorklogId=295765&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295765 ] ASF GitHub Bot logged work on BEAM-7802: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7802) Expose a method to make an Avro-based PCollection into an Schema-based one

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7802?focusedWorklogId=295759&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295759 ] ASF GitHub Bot logged work on BEAM-7802: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7802) Expose a method to make an Avro-based PCollection into an Schema-based one

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7802?focusedWorklogId=295756&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295756 ] ASF GitHub Bot logged work on BEAM-7802: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7909) Write integration tests to test customized containers

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7909?focusedWorklogId=295757&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295757 ] ASF GitHub Bot logged work on BEAM-7909: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7802) Expose a method to make an Avro-based PCollection into an Schema-based one

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7802?focusedWorklogId=295758&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295758 ] ASF GitHub Bot logged work on BEAM-7802: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7802) Expose a method to make an Avro-based PCollection into an Schema-based one

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7802?focusedWorklogId=295755&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295755 ] ASF GitHub Bot logged work on BEAM-7802: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?focusedWorklogId=295745&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295745 ] ASF GitHub Bot logged work on BEAM-7013: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-3342) Create a Cloud Bigtable IO connector for Python

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3342?focusedWorklogId=295708&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295708 ] ASF GitHub Bot logged work on BEAM-3342: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=295672&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295672 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=295670&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295670 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=295669&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-295669 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

  1   2   >