[jira] [Work logged] (BEAM-5428) Implement cross-bundle state caching.

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5428?focusedWorklogId=306889=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306889 ] ASF GitHub Bot logged work on BEAM-5428: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5428) Implement cross-bundle state caching.

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5428?focusedWorklogId=306887=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306887 ] ASF GitHub Bot logged work on BEAM-5428: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5428) Implement cross-bundle state caching.

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5428?focusedWorklogId=306888=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306888 ] ASF GitHub Bot logged work on BEAM-5428: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5428) Implement cross-bundle state caching.

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5428?focusedWorklogId=306885=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306885 ] ASF GitHub Bot logged work on BEAM-5428: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5428) Implement cross-bundle state caching.

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5428?focusedWorklogId=306886=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306886 ] ASF GitHub Bot logged work on BEAM-5428: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7909) Write integration tests to test customized containers

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7909?focusedWorklogId=306884=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306884 ] ASF GitHub Bot logged work on BEAM-7909: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=306883=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306883 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7909) Write integration tests to test customized containers

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7909?focusedWorklogId=306847=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306847 ] ASF GitHub Bot logged work on BEAM-7909: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-8152) Provide a way to better control minor+patch versions of Python 3.x interpreters used to run Beam tests locally and on Jenkins.

2019-09-04 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922973#comment-16922973 ] Ahmet Altay commented on BEAM-8152: --- > 2) which patch versions of Python Beam should claim to support.

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=306806=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306806 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7060?focusedWorklogId=306805=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306805 ] ASF GitHub Bot logged work on BEAM-7060: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7060?focusedWorklogId=306804=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306804 ] ASF GitHub Bot logged work on BEAM-7060: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=306803=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306803 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-8154) IOTypeHints: merge None and ((), {}) into one value

2019-09-04 Thread Udi Meiri (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-8154: Status: Open (was: Triage Needed) > IOTypeHints: merge None and ((), {}) into one value >

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=306802=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306802 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Created] (BEAM-8154) IOTypeHints: merge None and ((), {}) into one value

2019-09-04 Thread Udi Meiri (Jira)
Udi Meiri created BEAM-8154: --- Summary: IOTypeHints: merge None and ((), {}) into one value Key: BEAM-8154 URL: https://issues.apache.org/jira/browse/BEAM-8154 Project: Beam Issue Type: Improvement

[jira] [Work logged] (BEAM-7600) Spark portable runner: reuse SDK harness

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7600?focusedWorklogId=306799=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306799 ] ASF GitHub Bot logged work on BEAM-7600: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7600) Spark portable runner: reuse SDK harness

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7600?focusedWorklogId=306798=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306798 ] ASF GitHub Bot logged work on BEAM-7600: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-8153) PubSubIntegrationTest failing in post-commit

2019-09-04 Thread Udi Meiri (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922966#comment-16922966 ] Udi Meiri commented on BEAM-8153: - [~mdarwin] > PubSubIntegrationTest failing in post-commit >

[jira] [Work logged] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7060?focusedWorklogId=306797=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306797 ] ASF GitHub Bot logged work on BEAM-7060: Author: ASF GitHub Bot

[jira] [Created] (BEAM-8153) PubSubIntegrationTest failing in post-commit

2019-09-04 Thread Udi Meiri (Jira)
Udi Meiri created BEAM-8153: --- Summary: PubSubIntegrationTest failing in post-commit Key: BEAM-8153 URL: https://issues.apache.org/jira/browse/BEAM-8153 Project: Beam Issue Type: Bug

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=306796=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306796 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8111) SchemaCoder broken on DataflowRunner

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8111?focusedWorklogId=306792=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306792 ] ASF GitHub Bot logged work on BEAM-8111: Author: ASF GitHub Bot

[jira] [Assigned] (BEAM-2572) Implement an S3 filesystem for Python SDK

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-2572: --- Assignee: (was: Pablo Estrada) > Implement an S3 filesystem for Python SDK >

[jira] [Work logged] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7060?focusedWorklogId=306788=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306788 ] ASF GitHub Bot logged work on BEAM-7060: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7060?focusedWorklogId=306787=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306787 ] ASF GitHub Bot logged work on BEAM-7060: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306781=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306781 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306779=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306779 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306780=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306780 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7616) urlopen calls could get stuck without a timeout

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7616?focusedWorklogId=306778=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306778 ] ASF GitHub Bot logged work on BEAM-7616: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7909) Write integration tests to test customized containers

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7909?focusedWorklogId=306776=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306776 ] ASF GitHub Bot logged work on BEAM-7909: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-4786) Distinct has bad parallelism characteristics

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-4786: Labels: ccoss2019 (was: ) > Distinct has bad parallelism characteristics >

[jira] [Updated] (BEAM-4490) Contributor's guide needs to document the flow of a Pull Request for new contributors

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-4490: Labels: ccoss2019 (was: ) > Contributor's guide needs to document the flow of a Pull Request for

[jira] [Resolved] (BEAM-7862) Local testing utilities for BigQuery pipelines in releases

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-7862. - Fix Version/s: 2.16.0 Resolution: Fixed > Local testing utilities for BigQuery pipelines

[jira] [Resolved] (BEAM-1459) Dataflow runner has deprecated metricsUpdates in favor of counterUpdates. Add setters.

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-1459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-1459. - Fix Version/s: 2.0.0 Assignee: Pablo Estrada Resolution: Fixed > Dataflow runner

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306771=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306771 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306770=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306770 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7967) Execute portable Flink application jar

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7967?focusedWorklogId=306742=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306742 ] ASF GitHub Bot logged work on BEAM-7967: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7967) Execute portable Flink application jar

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7967?focusedWorklogId=306746=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306746 ] ASF GitHub Bot logged work on BEAM-7967: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7984) [python] The coder returned for typehints.List should be IterableCoder

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7984?focusedWorklogId=306766=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306766 ] ASF GitHub Bot logged work on BEAM-7984: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306765=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306765 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7984) [python] The coder returned for typehints.List should be IterableCoder

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7984?focusedWorklogId=306764=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306764 ] ASF GitHub Bot logged work on BEAM-7984: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306763=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306763 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306762=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306762 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306761=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306761 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7984) [python] The coder returned for typehints.List should be IterableCoder

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7984?focusedWorklogId=306760=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306760 ] ASF GitHub Bot logged work on BEAM-7984: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7984) [python] The coder returned for typehints.List should be IterableCoder

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7984?focusedWorklogId=306758=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306758 ] ASF GitHub Bot logged work on BEAM-7984: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306739=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306739 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306738=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306738 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306740=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306740 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7967) Execute portable Flink application jar

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7967?focusedWorklogId=306736=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306736 ] ASF GitHub Bot logged work on BEAM-7967: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7967) Execute portable Flink application jar

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7967?focusedWorklogId=306734=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306734 ] ASF GitHub Bot logged work on BEAM-7967: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8148) [python] allow tests to be specified when using tox

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8148?focusedWorklogId=306733=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306733 ] ASF GitHub Bot logged work on BEAM-8148: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7909) Write integration tests to test customized containers

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7909?focusedWorklogId=306731=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306731 ] ASF GitHub Bot logged work on BEAM-7909: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7909) Write integration tests to test customized containers

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7909?focusedWorklogId=306728=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306728 ] ASF GitHub Bot logged work on BEAM-7909: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8148) [python] allow tests to be specified when using tox

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8148?focusedWorklogId=306721=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306721 ] ASF GitHub Bot logged work on BEAM-8148: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7984) [python] The coder returned for typehints.List should be IterableCoder

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7984?focusedWorklogId=306719=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306719 ] ASF GitHub Bot logged work on BEAM-7984: Author: ASF GitHub Bot

[jira] [Comment Edited] (BEAM-8123) Support CloudPickle as pickler for Apache Beam.

2019-09-04 Thread Valentyn Tymofieiev (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922843#comment-16922843 ] Valentyn Tymofieiev edited comment on BEAM-8123 at 9/4/19 8:37 PM: ---

[jira] [Commented] (BEAM-8123) Support CloudPickle as pickler for Apache Beam.

2019-09-04 Thread Valentyn Tymofieiev (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922843#comment-16922843 ] Valentyn Tymofieiev commented on BEAM-8123: --- Python 3 postcommit suites seem to successfully

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306704=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306704 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306699=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306699 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-2611) Better document and validate arguments of WindowInto

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-2611. - Fix Version/s: 2.14.0 Assignee: Pablo Estrada Resolution: Fixed > Better document

[jira] [Work logged] (BEAM-5428) Implement cross-bundle state caching.

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5428?focusedWorklogId=306698=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306698 ] ASF GitHub Bot logged work on BEAM-5428: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-3377) assert_that not working for streaming

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-3377: Labels: (was: starter) > assert_that not working for streaming >

[jira] [Updated] (BEAM-3000) No python equivalent of org.apache.beam.sdk.transforms.Sample.any(100)?

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-3000: Labels: ccoss2019 starter (was: starter) > No python equivalent of

[jira] [Work logged] (BEAM-5428) Implement cross-bundle state caching.

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5428?focusedWorklogId=306694=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306694 ] ASF GitHub Bot logged work on BEAM-5428: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306691=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306691 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306689=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306689 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306690=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306690 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306688=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306688 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7998) MatchesFiles or MatchAll seems to return seveval time the same element

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-7998: Labels: ccoss2019 (was: ) > MatchesFiles or MatchAll seems to return seveval time the same element

[jira] [Resolved] (BEAM-7463) BigQueryQueryToTableIT is flaky on Direct runner in PostCommit suites: incorrect checksum

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-7463. - Fix Version/s: Not applicable Assignee: Udi Meiri (was: Pablo Estrada)

[jira] [Commented] (BEAM-5539) Beam Dependency Update Request: google-cloud-pubsub

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922815#comment-16922815 ] Pablo Estrada commented on BEAM-5539: - Should we close this? > Beam Dependency Update Request:

[jira] [Resolved] (BEAM-7588) Python BigQuery sink should be able to handle 15TB load job quota

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-7588. - Fix Version/s: 2.16.0 Resolution: Fixed Resolved by [~ttanay] > Python BigQuery sink

[jira] [Assigned] (BEAM-7822) TriggerCopyJobs in BQ file loads is not atmomic in case of failure

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-7822: --- Assignee: Tanay Tummalapalli > TriggerCopyJobs in BQ file loads is not atmomic in case of

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306674=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306674 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-7856) BigQuery table creation race condition error when executing pipeline on multiple workers

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-7856. - Fix Version/s: Not applicable Resolution: Fixed > BigQuery table creation race condition

[jira] [Resolved] (BEAM-7742) BigQuery File Loads to work well with load job size limits

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-7742. - Fix Version/s: 2.16.0 Resolution: Fixed > BigQuery File Loads to work well with load job

[jira] [Resolved] (BEAM-7822) TriggerCopyJobs in BQ file loads is not atmomic in case of failure

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-7822. - Fix Version/s: 2.16.0 Resolution: Fixed > TriggerCopyJobs in BQ file loads is not atmomic

[jira] [Updated] (BEAM-7394) Python fileio handles compressed files

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-7394: Labels: ccoss2019 outreachy19dec (was: outreachy19dec) > Python fileio handles compressed files >

[jira] [Updated] (BEAM-7560) Python local filesystem match does not work without directory separator.

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-7560: Labels: ccoss2019 starter (was: starter) > Python local filesystem match does not work without

[jira] [Assigned] (BEAM-7394) Python fileio handles compressed files

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-7394: --- Assignee: (was: Pablo Estrada) > Python fileio handles compressed files >

[jira] [Updated] (BEAM-7394) Python fileio handles compressed files

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-7394: Labels: outreachy19dec (was: ) > Python fileio handles compressed files >

[jira] [Updated] (BEAM-1439) Beam Example(s) exploring public document datasets

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-1439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-1439: Labels: gsoc2017 java mentor outreachy19dec python (was: gsoc2017 java mentor python) > Beam

[jira] [Updated] (BEAM-2572) Implement an S3 filesystem for Python SDK

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-2572: Labels: GSoC2019 gsoc gsoc2019 mentor outreachy19dec (was: GSoC2019 gsoc gsoc2019 mentor) >

[jira] [Updated] (BEAM-6807) Implement an Azure blobstore filesystem for Python SDK

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-6807: Labels: GSoC2019 azure azureblob gsoc gsoc2019 mentor outreachy19dec (was: GSoC2019 azure

[jira] [Updated] (BEAM-7250) Use annotation based parameters for SDF on Java

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-7250: Labels: outreachy19dec (was: ) > Use annotation based parameters for SDF on Java >

[jira] [Updated] (BEAM-7308) Add determinism checker for Python AvroCoder

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-7308: Labels: outreachy19dec (was: ) > Add determinism checker for Python AvroCoder >

[jira] [Commented] (BEAM-7308) Add determinism checker for Python AvroCoder

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922802#comment-16922802 ] Pablo Estrada commented on BEAM-7308: - What would this entail, [~heejong]? > Add determinism checker

[jira] [Resolved] (BEAM-2857) Create FileIO in Python

2019-09-04 Thread Pablo Estrada (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-2857. - Fix Version/s: 2.14.0 Resolution: Fixed > Create FileIO in Python >

[jira] [Work logged] (BEAM-8148) [python] allow tests to be specified when using tox

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8148?focusedWorklogId=306635=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306635 ] ASF GitHub Bot logged work on BEAM-8148: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7835) Support Triggered PCollectionView Join Unbounded windowed PCollection in BeamSQL

2019-09-04 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922776#comment-16922776 ] Rui Wang commented on BEAM-7835: In the short temr, adding this rule sounds good to me as it mutually

[jira] [Comment Edited] (BEAM-7835) Support Triggered PCollectionView Join Unbounded windowed PCollection in BeamSQL

2019-09-04 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922776#comment-16922776 ] Rui Wang edited comment on BEAM-7835 at 9/4/19 7:20 PM: In the short term, adding

[jira] [Created] (BEAM-8152) Provide a way to better control minor+patch versions of Python 3.x interpreters used to run Beam tests locally and on Jenkins.

2019-09-04 Thread Valentyn Tymofieiev (Jira)
Valentyn Tymofieiev created BEAM-8152: - Summary: Provide a way to better control minor+patch versions of Python 3.x interpreters used to run Beam tests locally and on Jenkins. Key: BEAM-8152 URL:

[jira] [Work logged] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?focusedWorklogId=306633=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-306633 ] ASF GitHub Bot logged work on BEAM-8151: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread Luke Cwik (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-8151: Status: Open (was: Triage Needed) > Allow the Python SDK to use many many threads >

[jira] [Created] (BEAM-8151) Allow the Python SDK to use many many threads

2019-09-04 Thread Luke Cwik (Jira)
Luke Cwik created BEAM-8151: --- Summary: Allow the Python SDK to use many many threads Key: BEAM-8151 URL: https://issues.apache.org/jira/browse/BEAM-8151 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-8150) FnApiRunnerSplitTestWithMultipleWorkers fails when having "beam_fn_api" in pipeline option

2019-09-04 Thread Boyuan Zhang (Jira)
Boyuan Zhang created BEAM-8150: -- Summary: FnApiRunnerSplitTestWithMultipleWorkers fails when having "beam_fn_api" in pipeline option Key: BEAM-8150 URL: https://issues.apache.org/jira/browse/BEAM-8150

[jira] [Commented] (BEAM-7848) Add possibility to manage quantity of instances (threads) per worker in Python SDK

2019-09-04 Thread Luke Cwik (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922762#comment-16922762 ] Luke Cwik commented on BEAM-7848: - This is available via the worker_threads experiment, see more details

[jira] [Resolved] (BEAM-7848) Add possibility to manage quantity of instances (threads) per worker in Python SDK

2019-09-04 Thread Luke Cwik (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-7848. - Fix Version/s: Not applicable Resolution: Fixed > Add possibility to manage quantity of instances

  1   2   >