[jira] [Work logged] (BEAM-7739) Add ValueState in Python sdk

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7739?focusedWorklogId=281523=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281523 ] ASF GitHub Bot logged work on BEAM-7739: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7739) Add ValueState in Python sdk

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7739?focusedWorklogId=281524=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281524 ] ASF GitHub Bot logged work on BEAM-7739: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7739) Add ValueState in Python sdk

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7739?focusedWorklogId=281522=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281522 ] ASF GitHub Bot logged work on BEAM-7739: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7650) Python Portable and HDFS IT need to clean up the docker image after complete

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7650?focusedWorklogId=281499=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281499 ] ASF GitHub Bot logged work on BEAM-7650: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7650) Python Portable and HDFS IT need to clean up the docker image after complete

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7650?focusedWorklogId=281496=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281496 ] ASF GitHub Bot logged work on BEAM-7650: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7650) Python Portable and HDFS IT need to clean up the docker image after complete

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7650?focusedWorklogId=281425=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281425 ] ASF GitHub Bot logged work on BEAM-7650: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7650) Python Portable and HDFS IT need to clean up the docker image after complete

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7650?focusedWorklogId=281424=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281424 ] ASF GitHub Bot logged work on BEAM-7650: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7577) Allow the use of ValueProviders in datastore.v1new.datastoreio.ReadFromDatastore query

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7577?focusedWorklogId=281423=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281423 ] ASF GitHub Bot logged work on BEAM-7577: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7577) Allow the use of ValueProviders in datastore.v1new.datastoreio.ReadFromDatastore query

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7577?focusedWorklogId=281422=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281422 ] ASF GitHub Bot logged work on BEAM-7577: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7577) Allow the use of ValueProviders in datastore.v1new.datastoreio.ReadFromDatastore query

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7577?focusedWorklogId=281421=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281421 ] ASF GitHub Bot logged work on BEAM-7577: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7797) DataflowRunner's upload_graph feature doesn't reduce template file size

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7797?focusedWorklogId=281415=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281415 ] ASF GitHub Bot logged work on BEAM-7797: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7650) Python Portable and HDFS IT need to clean up the docker image after complete

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7650?focusedWorklogId=281414=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281414 ] ASF GitHub Bot logged work on BEAM-7650: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7650) Python Portable and HDFS IT need to clean up the docker image after complete

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7650?focusedWorklogId=281413=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281413 ] ASF GitHub Bot logged work on BEAM-7650: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7650) Python Portable and HDFS IT need to clean up the docker image after complete

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7650?focusedWorklogId=281407=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281407 ] ASF GitHub Bot logged work on BEAM-7650: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7650) Python Portable and HDFS IT need to clean up the docker image after complete

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7650?focusedWorklogId=281402=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281402 ] ASF GitHub Bot logged work on BEAM-7650: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4181) Add ReadFiles transform for TfRecordIO

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4181?focusedWorklogId=281401=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281401 ] ASF GitHub Bot logged work on BEAM-4181: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7797) DataflowRunner's upload_graph feature doesn't reduce template file size

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7797?focusedWorklogId=281400=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281400 ] ASF GitHub Bot logged work on BEAM-7797: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7650) Python Portable and HDFS IT need to clean up the docker image after complete

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7650?focusedWorklogId=281399=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281399 ] ASF GitHub Bot logged work on BEAM-7650: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4181) Add ReadFiles transform for TfRecordIO

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4181?focusedWorklogId=281398=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281398 ] ASF GitHub Bot logged work on BEAM-4181: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7650) Python Portable and HDFS IT need to clean up the docker image after complete

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7650?focusedWorklogId=281396=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281396 ] ASF GitHub Bot logged work on BEAM-7650: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7650) Python Portable and HDFS IT need to clean up the docker image after complete

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7650?focusedWorklogId=281397=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281397 ] ASF GitHub Bot logged work on BEAM-7650: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4181) Add ReadFiles transform for TfRecordIO

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4181?focusedWorklogId=281391=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281391 ] ASF GitHub Bot logged work on BEAM-4181: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7680) synthetic_pipeline_test.py flaky

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7680?focusedWorklogId=281390=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281390 ] ASF GitHub Bot logged work on BEAM-7680: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7680) synthetic_pipeline_test.py flaky

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7680?focusedWorklogId=281389=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281389 ] ASF GitHub Bot logged work on BEAM-7680: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6877) TypeHints Py3 Error: Type inference tests fail on Python 3.6 due to bytecode changes

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6877?focusedWorklogId=281388=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281388 ] ASF GitHub Bot logged work on BEAM-6877: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6877) TypeHints Py3 Error: Type inference tests fail on Python 3.6 due to bytecode changes

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6877?focusedWorklogId=281387=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281387 ] ASF GitHub Bot logged work on BEAM-6877: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6877) TypeHints Py3 Error: Type inference tests fail on Python 3.6 due to bytecode changes

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6877?focusedWorklogId=281386=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281386 ] ASF GitHub Bot logged work on BEAM-6877: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6877) TypeHints Py3 Error: Type inference tests fail on Python 3.6 due to bytecode changes

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6877?focusedWorklogId=281385=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281385 ] ASF GitHub Bot logged work on BEAM-6877: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7060?focusedWorklogId=281384=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281384 ] ASF GitHub Bot logged work on BEAM-7060: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-5428) Implement cross-bundle state caching.

2019-07-23 Thread Rakesh Kumar (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891473#comment-16891473 ] Rakesh Kumar commented on BEAM-5428: Some note from the email thread: {code} This is documented at

[jira] [Commented] (BEAM-7766) Dataflow runner should default to PiplelineState.UNKNOWN when job state received via v1beta3 cannot be recognized.

2019-07-23 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891447#comment-16891447 ] Valentyn Tymofieiev commented on BEAM-7766: --- [~altay] we can remove 2.7.1 fix version once we

[jira] [Comment Edited] (BEAM-7766) Dataflow runner should default to PiplelineState.UNKNOWN when job state received via v1beta3 cannot be recognized.

2019-07-23 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891371#comment-16891371 ] Valentyn Tymofieiev edited comment on BEAM-7766 at 7/23/19 11:08 PM: -

[jira] [Work logged] (BEAM-7798) After changes in type inference, apache_beam.io.gcp.bigquery_io_read_it_test.BigqueryIOReadIT.test_bigquery_read_1M_python is failing in Python 3.5 postcommits

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7798?focusedWorklogId=281380=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281380 ] ASF GitHub Bot logged work on BEAM-7798: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7650) Python Portable and HDFS IT need to clean up the docker image after complete

2019-07-23 Thread Ankur Goenka (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891442#comment-16891442 ] Ankur Goenka commented on BEAM-7650: "I'm thinking of piggy-backing on the inventory job. WDYT?"

[jira] [Commented] (BEAM-7650) Python Portable and HDFS IT need to clean up the docker image after complete

2019-07-23 Thread Ankur Goenka (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891436#comment-16891436 ] Ankur Goenka commented on BEAM-7650: The tests are expected to create their own images so i suppose it

[jira] [Assigned] (BEAM-7650) Python Portable and HDFS IT need to clean up the docker image after complete

2019-07-23 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-7650: --- Assignee: Udi Meiri (was: Ankur Goenka) > Python Portable and HDFS IT need to clean up the docker

[jira] [Commented] (BEAM-7650) Python Portable and HDFS IT need to clean up the docker image after complete

2019-07-23 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891435#comment-16891435 ] Udi Meiri commented on BEAM-7650: - I'm thinking of piggy-backing on the inventory job. WDYT? > Python

[jira] [Commented] (BEAM-7650) Python Portable and HDFS IT need to clean up the docker image after complete

2019-07-23 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891434#comment-16891434 ] Udi Meiri commented on BEAM-7650: - It's a racey command. I wouldn't want to run it more than once per day.

[jira] [Work logged] (BEAM-7667) report GCS throttling time to Dataflow autoscaler

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7667?focusedWorklogId=281367=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281367 ] ASF GitHub Bot logged work on BEAM-7667: Author: ASF GitHub Bot

[jira] [Closed] (BEAM-7800) Make Dataflow container dependencies consistent with setup.py requirements for 2.14.0

2019-07-23 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-7800. - > Make Dataflow container dependencies consistent with setup.py requirements > for 2.14.0 >

[jira] [Resolved] (BEAM-7800) Make Dataflow container dependencies consistent with setup.py requirements for 2.14.0

2019-07-23 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin resolved BEAM-7800. --- Resolution: Fixed > Make Dataflow container dependencies consistent with setup.py requirements > for

[jira] [Work logged] (BEAM-7386) Add Utility BiTemporalStreamJoin

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7386?focusedWorklogId=281353=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281353 ] ASF GitHub Bot logged work on BEAM-7386: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7650) Python Portable and HDFS IT need to clean up the docker image after complete

2019-07-23 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891420#comment-16891420 ] Kenneth Knowles commented on BEAM-7650: --- Can it not be part of the IT itself? > Python Portable and

[jira] [Assigned] (BEAM-7607) Expose withMaxFilesPerBundle in BigQuery IO public API

2019-07-23 Thread Bruce Arctor (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Arctor reassigned BEAM-7607: -- Assignee: Pablo Estrada > Expose withMaxFilesPerBundle in BigQuery IO public API >

[jira] [Work logged] (BEAM-7726) [Go SDK] State Backed Iterables

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7726?focusedWorklogId=281338=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281338 ] ASF GitHub Bot logged work on BEAM-7726: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7495) Add support for dynamic worker re-balancing when reading BigQuery data using Cloud Dataflow

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7495?focusedWorklogId=281336=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281336 ] ASF GitHub Bot logged work on BEAM-7495: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7726) [Go SDK] State Backed Iterables

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7726?focusedWorklogId=281333=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281333 ] ASF GitHub Bot logged work on BEAM-7726: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7800) Make Dataflow container dependencies consistent with setup.py requirements for 2.14.0

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7800?focusedWorklogId=281329=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281329 ] ASF GitHub Bot logged work on BEAM-7800: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7806) org.apache.beam.sdk.extensions.sql.meta.provider.pubsub.PubsubJsonIT.testSelectsPayloadContent failed

2019-07-23 Thread Boyuan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891395#comment-16891395 ] Boyuan Zhang commented on BEAM-7806: Error msg: java.lang.AssertionError: Did not receive signal on

[jira] [Work logged] (BEAM-2103) Document Python 3 support in Beam starting from 2.14.0

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2103?focusedWorklogId=281325=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281325 ] ASF GitHub Bot logged work on BEAM-2103: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7806) org.apache.beam.sdk.extensions.sql.meta.provider.pubsub.PubsubJsonIT.testSelectsPayloadContent failed

2019-07-23 Thread Boyuan Zhang (JIRA)
Boyuan Zhang created BEAM-7806: -- Summary: org.apache.beam.sdk.extensions.sql.meta.provider.pubsub.PubsubJsonIT.testSelectsPayloadContent failed Key: BEAM-7806 URL: https://issues.apache.org/jira/browse/BEAM-7806

[jira] [Updated] (BEAM-7513) [SQL] Row Estimation for BigQueryTable

2019-07-23 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin updated BEAM-7513: -- Summary: [SQL] Row Estimation for BigQueryTable (was: Row Estimation for BigQueryTable) > [SQL] Row

[jira] [Work logged] (BEAM-2103) Document Python 3 support in Beam starting from 2.14.0

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2103?focusedWorklogId=281323=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281323 ] ASF GitHub Bot logged work on BEAM-2103: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7194) [SQL] EXCEPT DISTINCT behavior when right set contains a value is incorrect

2019-07-23 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin updated BEAM-7194: -- Summary: [SQL] EXCEPT DISTINCT behavior when right set contains a value is incorrect (was: EXCEPT

[jira] [Updated] (BEAM-6813) Issues with state + timers in java Direct Runner (state cell is null)

2019-07-23 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin updated BEAM-6813: -- Summary: Issues with state + timers in java Direct Runner (state cell is null) (was: Issues with state

[jira] [Updated] (BEAM-563) DoFn Reuse: Update DirectRunner to support setup and teardown

2019-07-23 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin updated BEAM-563: - Summary: DoFn Reuse: Update DirectRunner to support setup and teardown (was: DoFn Reuse: Update

[jira] [Updated] (BEAM-562) DoFn Reuse: Add new DoFn setup and teardown to python SDK

2019-07-23 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin updated BEAM-562: - Summary: DoFn Reuse: Add new DoFn setup and teardown to python SDK (was: DoFn Reuse: Add new methods to

[jira] [Work logged] (BEAM-2103) Document Python 3 support in Beam starting from 2.14.0

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2103?focusedWorklogId=281320=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281320 ] ASF GitHub Bot logged work on BEAM-2103: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-2103) Document Python 3 support in Beam starting from 2.14.0

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2103?focusedWorklogId=281319=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281319 ] ASF GitHub Bot logged work on BEAM-2103: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-2103) Document Python 3 support in Beam starting from 2.14.0

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2103?focusedWorklogId=281317=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281317 ] ASF GitHub Bot logged work on BEAM-2103: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-6783) byte[] breaks in BeamSQL codegen

2019-07-23 Thread Gleb Kanterov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gleb Kanterov resolved BEAM-6783. - Resolution: Fixed Fix Version/s: 2.15.0 > byte[] breaks in BeamSQL codegen >

[jira] [Closed] (BEAM-6783) byte[] breaks in BeamSQL codegen

2019-07-23 Thread Gleb Kanterov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gleb Kanterov closed BEAM-6783. --- > byte[] breaks in BeamSQL codegen > > > Key: BEAM-6783

[jira] [Work logged] (BEAM-7798) After changes in type inference, apache_beam.io.gcp.bigquery_io_read_it_test.BigqueryIOReadIT.test_bigquery_read_1M_python is failing in Python 3.5 postcommits

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7798?focusedWorklogId=281314=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281314 ] ASF GitHub Bot logged work on BEAM-7798: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7798) After changes in type inference, apache_beam.io.gcp.bigquery_io_read_it_test.BigqueryIOReadIT.test_bigquery_read_1M_python is failing in Python 3.5 postcommits

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7798?focusedWorklogId=281315=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281315 ] ASF GitHub Bot logged work on BEAM-7798: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7766) Dataflow runner should default to PiplelineState.UNKNOWN when job state received via v1beta3 cannot be recognized.

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7766?focusedWorklogId=281313=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281313 ] ASF GitHub Bot logged work on BEAM-7766: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7766) Dataflow runner should default to PiplelineState.UNKNOWN when job state received via v1beta3 cannot be recognized.

2019-07-23 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891371#comment-16891371 ] Valentyn Tymofieiev commented on BEAM-7766: --- [~kenn], would

[jira] [Work logged] (BEAM-7766) Dataflow runner should default to PiplelineState.UNKNOWN when job state received via v1beta3 cannot be recognized.

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7766?focusedWorklogId=281312=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281312 ] ASF GitHub Bot logged work on BEAM-7766: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7680) synthetic_pipeline_test.py flaky

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7680?focusedWorklogId=281310=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281310 ] ASF GitHub Bot logged work on BEAM-7680: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7386) Add Utility BiTemporalStreamJoin

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7386?focusedWorklogId=281307=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281307 ] ASF GitHub Bot logged work on BEAM-7386: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7386) Add Utility BiTemporalStreamJoin

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7386?focusedWorklogId=281304=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281304 ] ASF GitHub Bot logged work on BEAM-7386: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7747) ERROR: test_sink_transform (apache_beam.io.avroio_test.TestFastAvro) Fails on Windows

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7747?focusedWorklogId=281305=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281305 ] ASF GitHub Bot logged work on BEAM-7747: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7386) Add Utility BiTemporalStreamJoin

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7386?focusedWorklogId=281303=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281303 ] ASF GitHub Bot logged work on BEAM-7386: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7386) Add Utility BiTemporalStreamJoin

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7386?focusedWorklogId=281302=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281302 ] ASF GitHub Bot logged work on BEAM-7386: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7797) DataflowRunner's upload_graph feature doesn't reduce template file size

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7797?focusedWorklogId=281300=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281300 ] ASF GitHub Bot logged work on BEAM-7797: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7805) Configure logging level in portable Spark runner

2019-07-23 Thread Kyle Weaver (JIRA)
Kyle Weaver created BEAM-7805: - Summary: Configure logging level in portable Spark runner Key: BEAM-7805 URL: https://issues.apache.org/jira/browse/BEAM-7805 Project: Beam Issue Type:

[jira] [Work logged] (BEAM-7700) Java transform catalog

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7700?focusedWorklogId=281299=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281299 ] ASF GitHub Bot logged work on BEAM-7700: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7079) Run Chicago Taxi Example on Dataflow

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7079?focusedWorklogId=281296=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281296 ] ASF GitHub Bot logged work on BEAM-7079: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7079) Run Chicago Taxi Example on Dataflow

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7079?focusedWorklogId=281297=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281297 ] ASF GitHub Bot logged work on BEAM-7079: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7794) DynamoDBIOTest is blocking forever

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7794?focusedWorklogId=281295=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281295 ] ASF GitHub Bot logged work on BEAM-7794: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7802) Expose a method to make an Avro-based PCollection into an Schema-based one

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7802?focusedWorklogId=281294=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281294 ] ASF GitHub Bot logged work on BEAM-7802: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6783) byte[] breaks in BeamSQL codegen

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6783?focusedWorklogId=281292=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281292 ] ASF GitHub Bot logged work on BEAM-6783: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6783) byte[] breaks in BeamSQL codegen

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6783?focusedWorklogId=281293=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281293 ] ASF GitHub Bot logged work on BEAM-6783: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6783) byte[] breaks in BeamSQL codegen

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6783?focusedWorklogId=281290=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281290 ] ASF GitHub Bot logged work on BEAM-6783: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6783) byte[] breaks in BeamSQL codegen

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6783?focusedWorklogId=281289=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281289 ] ASF GitHub Bot logged work on BEAM-6783: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7802) Expose a method to make an Avro-based PCollection into an Schema-based one

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7802?focusedWorklogId=281285=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281285 ] ASF GitHub Bot logged work on BEAM-7802: Author: ASF GitHub Bot

[jira] [Comment Edited] (BEAM-7724) Codegen should cast(null) to a type to match exact function signature

2019-07-23 Thread Rui Wang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891330#comment-16891330 ] Rui Wang edited comment on BEAM-7724 at 7/23/19 8:03 PM: - I remember the code path

[jira] [Work logged] (BEAM-7794) DynamoDBIOTest is blocking forever

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7794?focusedWorklogId=281283=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281283 ] ASF GitHub Bot logged work on BEAM-7794: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-7785) DirectRunner: watermarks are updated asynchronously from bundle processing

2019-07-23 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-7785. Resolution: Fixed > DirectRunner: watermarks are updated asynchronously from bundle processing >

[jira] [Comment Edited] (BEAM-7724) Codegen should cast(null) to a type to match exact function signature

2019-07-23 Thread Rui Wang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891330#comment-16891330 ] Rui Wang edited comment on BEAM-7724 at 7/23/19 7:59 PM: - I remember the code path

[jira] [Work logged] (BEAM-7785) DirectRunner: watermarks are updated asynchronously from bundle processing

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7785?focusedWorklogId=281280=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281280 ] ASF GitHub Bot logged work on BEAM-7785: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7724) Codegen should cast(null) to a type to match exact function signature

2019-07-23 Thread Rui Wang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891330#comment-16891330 ] Rui Wang commented on BEAM-7724: I remember the code path you used had an issue that if you define two

[jira] [Work logged] (BEAM-7794) DynamoDBIOTest is blocking forever

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7794?focusedWorklogId=281279=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281279 ] ASF GitHub Bot logged work on BEAM-7794: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7794) DynamoDBIOTest is blocking forever

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7794?focusedWorklogId=281277=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281277 ] ASF GitHub Bot logged work on BEAM-7794: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7794) DynamoDBIOTest is blocking forever

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7794?focusedWorklogId=281273=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281273 ] ASF GitHub Bot logged work on BEAM-7794: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7696) If classpath directory contains a directory it causes exception in Spark runner staging

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7696?focusedWorklogId=281269=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281269 ] ASF GitHub Bot logged work on BEAM-7696: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7696) If classpath directory contains a directory it causes exception in Spark runner staging

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7696?focusedWorklogId=281271=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281271 ] ASF GitHub Bot logged work on BEAM-7696: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-7696) If classpath directory contains a directory it causes exception in Spark runner staging

2019-07-23 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-7696. Resolution: Fixed > If classpath directory contains a directory it causes exception in Spark >

[jira] [Updated] (BEAM-7696) If classpath directory contains a directory it causes exception in Spark runner staging

2019-07-23 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7696: --- Summary: If classpath directory contains a directory it causes exception in Spark runner staging

[jira] [Work logged] (BEAM-7802) Expose a method to make an Avro-based PCollection into an Schema-based one

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7802?focusedWorklogId=281259=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281259 ] ASF GitHub Bot logged work on BEAM-7802: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7781) Go SDK PreCommits Failing

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7781?focusedWorklogId=281260=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-281260 ] ASF GitHub Bot logged work on BEAM-7781: Author: ASF GitHub Bot

  1   2   3   >