[jira] [Created] (BEAM-8155) Add PubsubIO.readMessagesWithCoderAndParseFn method

2019-09-04 Thread Claire McGinty (Jira)
Claire McGinty created BEAM-8155: Summary: Add PubsubIO.readMessagesWithCoderAndParseFn method Key: BEAM-8155 URL: https://issues.apache.org/jira/browse/BEAM-8155 Project: Beam Issue Type: Im

[jira] [Work logged] (BEAM-5428) Implement cross-bundle state caching.

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5428?focusedWorklogId=306889&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306889 ] ASF GitHub Bot logged work on BEAM-5428: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5428) Implement cross-bundle state caching.

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5428?focusedWorklogId=306887&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306887 ] ASF GitHub Bot logged work on BEAM-5428: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5428) Implement cross-bundle state caching.

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5428?focusedWorklogId=306888&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306888 ] ASF GitHub Bot logged work on BEAM-5428: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5428) Implement cross-bundle state caching.

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5428?focusedWorklogId=306885&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306885 ] ASF GitHub Bot logged work on BEAM-5428: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5428) Implement cross-bundle state caching.

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5428?focusedWorklogId=306886&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306886 ] ASF GitHub Bot logged work on BEAM-5428: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7909) Write integration tests to test customized containers

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7909?focusedWorklogId=306884&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306884 ] ASF GitHub Bot logged work on BEAM-7909: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=306883&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306883 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7909) Write integration tests to test customized containers

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7909?focusedWorklogId=306847&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306847 ] ASF GitHub Bot logged work on BEAM-7909: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-8152) Provide a way to better control minor+patch versions of Python 3.x interpreters used to run Beam tests locally and on Jenkins.

2019-09-04 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16922973#comment-16922973 ] Ahmet Altay commented on BEAM-8152: --- > 2) which patch versions of Python Beam should cla

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=306806&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306806 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7060?focusedWorklogId=306805&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306805 ] ASF GitHub Bot logged work on BEAM-7060: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7060?focusedWorklogId=306804&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306804 ] ASF GitHub Bot logged work on BEAM-7060: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=306803&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306803 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-8154) IOTypeHints: merge None and ((), {}) into one value

2019-09-04 Thread Udi Meiri (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-8154: Status: Open (was: Triage Needed) > IOTypeHints: merge None and ((), {}) into one value > -

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=306802&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306802 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Created] (BEAM-8154) IOTypeHints: merge None and ((), {}) into one value

2019-09-04 Thread Udi Meiri (Jira)
Udi Meiri created BEAM-8154: --- Summary: IOTypeHints: merge None and ((), {}) into one value Key: BEAM-8154 URL: https://issues.apache.org/jira/browse/BEAM-8154 Project: Beam Issue Type: Improvement

[jira] [Work logged] (BEAM-7600) Spark portable runner: reuse SDK harness

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7600?focusedWorklogId=306799&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306799 ] ASF GitHub Bot logged work on BEAM-7600: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7600) Spark portable runner: reuse SDK harness

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7600?focusedWorklogId=306798&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306798 ] ASF GitHub Bot logged work on BEAM-7600: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-8153) PubSubIntegrationTest failing in post-commit

2019-09-04 Thread Udi Meiri (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16922966#comment-16922966 ] Udi Meiri commented on BEAM-8153: - [~mdarwin] > PubSubIntegrationTest failing in post-com

[jira] [Work logged] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7060?focusedWorklogId=306797&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306797 ] ASF GitHub Bot logged work on BEAM-7060: Author: ASF GitHub Bot

[jira] [Created] (BEAM-8153) PubSubIntegrationTest failing in post-commit

2019-09-04 Thread Udi Meiri (Jira)
Udi Meiri created BEAM-8153: --- Summary: PubSubIntegrationTest failing in post-commit Key: BEAM-8153 URL: https://issues.apache.org/jira/browse/BEAM-8153 Project: Beam Issue Type: Bug Compo

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=306796&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306796 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8111) SchemaCoder broken on DataflowRunner

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8111?focusedWorklogId=306792&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306792 ] ASF GitHub Bot logged work on BEAM-8111: Author: ASF GitHub Bot

[jira] [Assigned] (BEAM-2572) Implement an S3 filesystem for Python SDK

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-2572: --- Assignee: (was: Pablo Estrada) > Implement an S3 filesystem for Python SDK >

[jira] [Work logged] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7060?focusedWorklogId=306788&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306788 ] ASF GitHub Bot logged work on BEAM-7060: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7060?focusedWorklogId=306787&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306787 ] ASF GitHub Bot logged work on BEAM-7060: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306781&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306781 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306779&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306779 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306780&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306780 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7616) urlopen calls could get stuck without a timeout

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7616?focusedWorklogId=306778&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306778 ] ASF GitHub Bot logged work on BEAM-7616: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7909) Write integration tests to test customized containers

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7909?focusedWorklogId=306776&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306776 ] ASF GitHub Bot logged work on BEAM-7909: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-4786) Distinct has bad parallelism characteristics

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-4786: Labels: ccoss2019 (was: ) > Distinct has bad parallelism characteristics >

[jira] [Updated] (BEAM-4490) Contributor's guide needs to document the flow of a Pull Request for new contributors

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-4490: Labels: ccoss2019 (was: ) > Contributor's guide needs to document the flow of a Pull Request for ne

[jira] [Resolved] (BEAM-7862) Local testing utilities for BigQuery pipelines in releases

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-7862. - Fix Version/s: 2.16.0 Resolution: Fixed > Local testing utilities for BigQuery pipelines in

[jira] [Resolved] (BEAM-1459) Dataflow runner has deprecated metricsUpdates in favor of counterUpdates. Add setters.

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-1459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-1459. - Fix Version/s: 2.0.0 Assignee: Pablo Estrada Resolution: Fixed > Dataflow runner h

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306771&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306771 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306770&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306770 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7967) Execute portable Flink application jar

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7967?focusedWorklogId=306742&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306742 ] ASF GitHub Bot logged work on BEAM-7967: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7967) Execute portable Flink application jar

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7967?focusedWorklogId=306746&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306746 ] ASF GitHub Bot logged work on BEAM-7967: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7984) [python] The coder returned for typehints.List should be IterableCoder

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7984?focusedWorklogId=306766&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306766 ] ASF GitHub Bot logged work on BEAM-7984: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306765&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306765 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7984) [python] The coder returned for typehints.List should be IterableCoder

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7984?focusedWorklogId=306764&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306764 ] ASF GitHub Bot logged work on BEAM-7984: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306763&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306763 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306762&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306762 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306761&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306761 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7984) [python] The coder returned for typehints.List should be IterableCoder

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7984?focusedWorklogId=306760&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306760 ] ASF GitHub Bot logged work on BEAM-7984: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7984) [python] The coder returned for typehints.List should be IterableCoder

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7984?focusedWorklogId=306758&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306758 ] ASF GitHub Bot logged work on BEAM-7984: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306739&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306739 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306738&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306738 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306740&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306740 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7967) Execute portable Flink application jar

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7967?focusedWorklogId=306736&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306736 ] ASF GitHub Bot logged work on BEAM-7967: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7967) Execute portable Flink application jar

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7967?focusedWorklogId=306734&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306734 ] ASF GitHub Bot logged work on BEAM-7967: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8148) [python] allow tests to be specified when using tox

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8148?focusedWorklogId=306733&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306733 ] ASF GitHub Bot logged work on BEAM-8148: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7909) Write integration tests to test customized containers

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7909?focusedWorklogId=306731&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306731 ] ASF GitHub Bot logged work on BEAM-7909: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7909) Write integration tests to test customized containers

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7909?focusedWorklogId=306728&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306728 ] ASF GitHub Bot logged work on BEAM-7909: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8148) [python] allow tests to be specified when using tox

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8148?focusedWorklogId=306721&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306721 ] ASF GitHub Bot logged work on BEAM-8148: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7984) [python] The coder returned for typehints.List should be IterableCoder

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7984?focusedWorklogId=306719&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306719 ] ASF GitHub Bot logged work on BEAM-7984: Author: ASF GitHub Bot

[jira] [Comment Edited] (BEAM-8123) Support CloudPickle as pickler for Apache Beam.

2019-09-04 Thread Valentyn Tymofieiev (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16922843#comment-16922843 ] Valentyn Tymofieiev edited comment on BEAM-8123 at 9/4/19 8:37 PM: -

[jira] [Commented] (BEAM-8123) Support CloudPickle as pickler for Apache Beam.

2019-09-04 Thread Valentyn Tymofieiev (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16922843#comment-16922843 ] Valentyn Tymofieiev commented on BEAM-8123: --- Python 3 postcommit suites seem to

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306704&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306704 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306699&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306699 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-2611) Better document and validate arguments of WindowInto

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-2611. - Fix Version/s: 2.14.0 Assignee: Pablo Estrada Resolution: Fixed > Better document

[jira] [Work logged] (BEAM-5428) Implement cross-bundle state caching.

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5428?focusedWorklogId=306698&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306698 ] ASF GitHub Bot logged work on BEAM-5428: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-3377) assert_that not working for streaming

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-3377: Labels: (was: starter) > assert_that not working for streaming > -

[jira] [Updated] (BEAM-3000) No python equivalent of org.apache.beam.sdk.transforms.Sample.any(100)?

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-3000: Labels: ccoss2019 starter (was: starter) > No python equivalent of org.apache.beam.sdk.transforms.S

[jira] [Work logged] (BEAM-5428) Implement cross-bundle state caching.

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5428?focusedWorklogId=306694&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306694 ] ASF GitHub Bot logged work on BEAM-5428: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306691&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306691 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306689&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306689 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306690&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306690 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306688&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306688 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7998) MatchesFiles or MatchAll seems to return seveval time the same element

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-7998: Labels: ccoss2019 (was: ) > MatchesFiles or MatchAll seems to return seveval time the same element

[jira] [Resolved] (BEAM-7463) BigQueryQueryToTableIT is flaky on Direct runner in PostCommit suites: incorrect checksum

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-7463. - Fix Version/s: Not applicable Assignee: Udi Meiri (was: Pablo Estrada) Resolution:

[jira] [Commented] (BEAM-5539) Beam Dependency Update Request: google-cloud-pubsub

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16922815#comment-16922815 ] Pablo Estrada commented on BEAM-5539: - Should we close this? > Beam Dependency Update

[jira] [Resolved] (BEAM-7588) Python BigQuery sink should be able to handle 15TB load job quota

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-7588. - Fix Version/s: 2.16.0 Resolution: Fixed Resolved by [~ttanay] > Python BigQuery sink shoul

[jira] [Assigned] (BEAM-7822) TriggerCopyJobs in BQ file loads is not atmomic in case of failure

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-7822: --- Assignee: Tanay Tummalapalli > TriggerCopyJobs in BQ file loads is not atmomic in case of fai

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306674&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306674 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-7856) BigQuery table creation race condition error when executing pipeline on multiple workers

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-7856. - Fix Version/s: Not applicable Resolution: Fixed > BigQuery table creation race condition er

[jira] [Resolved] (BEAM-7742) BigQuery File Loads to work well with load job size limits

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-7742. - Fix Version/s: 2.16.0 Resolution: Fixed > BigQuery File Loads to work well with load job si

[jira] [Resolved] (BEAM-7822) TriggerCopyJobs in BQ file loads is not atmomic in case of failure

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-7822. - Fix Version/s: 2.16.0 Resolution: Fixed > TriggerCopyJobs in BQ file loads is not atmomic i

[jira] [Updated] (BEAM-7394) Python fileio handles compressed files

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-7394: Labels: ccoss2019 outreachy19dec (was: outreachy19dec) > Python fileio handles compressed files > -

[jira] [Updated] (BEAM-7560) Python local filesystem match does not work without directory separator.

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-7560: Labels: ccoss2019 starter (was: starter) > Python local filesystem match does not work without dire

[jira] [Assigned] (BEAM-7394) Python fileio handles compressed files

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-7394: --- Assignee: (was: Pablo Estrada) > Python fileio handles compressed files > ---

[jira] [Updated] (BEAM-7394) Python fileio handles compressed files

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-7394: Labels: outreachy19dec (was: ) > Python fileio handles compressed files > -

[jira] [Updated] (BEAM-1439) Beam Example(s) exploring public document datasets

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-1439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-1439: Labels: gsoc2017 java mentor outreachy19dec python (was: gsoc2017 java mentor python) > Beam Examp

[jira] [Updated] (BEAM-2572) Implement an S3 filesystem for Python SDK

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-2572: Labels: GSoC2019 gsoc gsoc2019 mentor outreachy19dec (was: GSoC2019 gsoc gsoc2019 mentor) > Implem

[jira] [Updated] (BEAM-6807) Implement an Azure blobstore filesystem for Python SDK

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-6807: Labels: GSoC2019 azure azureblob gsoc gsoc2019 mentor outreachy19dec (was: GSoC2019 azure azureblob

[jira] [Updated] (BEAM-7250) Use annotation based parameters for SDF on Java

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-7250: Labels: outreachy19dec (was: ) > Use annotation based parameters for SDF on Java >

[jira] [Updated] (BEAM-7308) Add determinism checker for Python AvroCoder

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-7308: Labels: outreachy19dec (was: ) > Add determinism checker for Python AvroCoder > ---

[jira] [Commented] (BEAM-7308) Add determinism checker for Python AvroCoder

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16922802#comment-16922802 ] Pablo Estrada commented on BEAM-7308: - What would this entail, [~heejong]? > Add dete

[jira] [Resolved] (BEAM-2857) Create FileIO in Python

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-2857. - Fix Version/s: 2.14.0 Resolution: Fixed > Create FileIO in Python > ---

[jira] [Work logged] (BEAM-8148) [python] allow tests to be specified when using tox

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8148?focusedWorklogId=306635&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306635 ] ASF GitHub Bot logged work on BEAM-8148: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7835) Support Triggered PCollectionView Join Unbounded windowed PCollection in BeamSQL

2019-09-04 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16922776#comment-16922776 ] Rui Wang commented on BEAM-7835: In the short temr, adding this rule sounds good to me as

[jira] [Comment Edited] (BEAM-7835) Support Triggered PCollectionView Join Unbounded windowed PCollection in BeamSQL

2019-09-04 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16922776#comment-16922776 ] Rui Wang edited comment on BEAM-7835 at 9/4/19 7:20 PM: In the sho

[jira] [Created] (BEAM-8152) Provide a way to better control minor+patch versions of Python 3.x interpreters used to run Beam tests locally and on Jenkins.

2019-09-04 Thread Valentyn Tymofieiev (Jira)
Valentyn Tymofieiev created BEAM-8152: - Summary: Provide a way to better control minor+patch versions of Python 3.x interpreters used to run Beam tests locally and on Jenkins. Key: BEAM-8152 URL: https://issue

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306633&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306633 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread Luke Cwik (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-8151: Status: Open (was: Triage Needed) > Allow the Python SDK to use many many threads > ---

[jira] [Created] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread Luke Cwik (Jira)
Luke Cwik created BEAM-8151: --- Summary: Allow the Python SDK to use many many threads Key: BEAM-8151 URL: https://issues.apache.org/jira/browse/BEAM-8151 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-8150) FnApiRunnerSplitTestWithMultipleWorkers fails when having "beam_fn_api" in pipeline option

2019-09-04 Thread Boyuan Zhang (Jira)
Boyuan Zhang created BEAM-8150: -- Summary: FnApiRunnerSplitTestWithMultipleWorkers fails when having "beam_fn_api" in pipeline option Key: BEAM-8150 URL: https://issues.apache.org/jira/browse/BEAM-8150 Pr

[jira] [Commented] (BEAM-7848) Add possibility to manage quantity of instances (threads) per worker in Python SDK

2019-09-04 Thread Luke Cwik (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16922762#comment-16922762 ] Luke Cwik commented on BEAM-7848: - This is available via the worker_threads experiment, se

  1   2   >