[jira] [Created] (BEAM-5706) PubSub dependency upgrade causes internal issues for Dataflow

2018-10-10 Thread Charles Chen (JIRA)
Charles Chen created BEAM-5706: -- Summary: PubSub dependency upgrade causes internal issues for Dataflow Key: BEAM-5706 URL: https://issues.apache.org/jira/browse/BEAM-5706 Project: Beam Issue

[jira] [Created] (BEAM-5705) PRs 6557 and 6589 break internal Dataflow tests

2018-10-10 Thread Charles Chen (JIRA)
Charles Chen created BEAM-5705: -- Summary: PRs 6557 and 6589 break internal Dataflow tests Key: BEAM-5705 URL: https://issues.apache.org/jira/browse/BEAM-5705 Project: Beam Issue Type:

[jira] [Created] (BEAM-5531) gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/5000_gaming_data.csv is being periodically deleted

2018-10-01 Thread Charles Chen (JIRA)
Charles Chen created BEAM-5531: -- Summary: gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/5000_gaming_data.csv is being periodically deleted Key: BEAM-5531 URL:

[jira] [Created] (BEAM-5460) Update Dataflow Python API client

2018-09-21 Thread Charles Chen (JIRA)
Charles Chen created BEAM-5460: -- Summary: Update Dataflow Python API client Key: BEAM-5460 URL: https://issues.apache.org/jira/browse/BEAM-5460 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-5414) grpcio-tools 1.15.0 proto generation breaks compatibility with latest protobuf 3.6.1

2018-09-17 Thread Charles Chen (JIRA)
Charles Chen created BEAM-5414: -- Summary: grpcio-tools 1.15.0 proto generation breaks compatibility with latest protobuf 3.6.1 Key: BEAM-5414 URL: https://issues.apache.org/jira/browse/BEAM-5414

[jira] [Updated] (BEAM-4215) Update Python SDK dependencies for next release

2018-09-04 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen updated BEAM-4215: --- Fix Version/s: (was: 2.7.0) 2.8.0 > Update Python SDK dependencies for next

[jira] [Updated] (BEAM-4518) Errors when running Python Game stats with a low fixed_window_duration in the DirectRunner

2018-09-04 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen updated BEAM-4518: --- Fix Version/s: (was: 2.7.0) 2.8.0 > Errors when running Python Game stats with

[jira] [Updated] (BEAM-4750) Beam performance degraded significantly since 2.4

2018-09-04 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen updated BEAM-4750: --- Fix Version/s: (was: 2.7.0) 2.8.0 > Beam performance degraded significantly

[jira] [Updated] (BEAM-5011) Beam Dependency Update Request: org.springframework

2018-09-04 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen updated BEAM-5011: --- Fix Version/s: (was: 2.7.0) 2.8.0 Description: 2018-07-25

[jira] [Updated] (BEAM-4417) BigqueryIO Numeric datatype Support

2018-09-04 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen updated BEAM-4417: --- Fix Version/s: (was: 2.7.0) 2.8.0 > BigqueryIO Numeric datatype Support >

[jira] [Updated] (BEAM-1240) Create RabbitMqIO

2018-09-04 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen updated BEAM-1240: --- Fix Version/s: (was: 2.7.0) 2.8.0 > Create RabbitMqIO > - > >

[jira] [Created] (BEAM-5295) DirectRunner assert_that should work in user state and timers tests

2018-09-04 Thread Charles Chen (JIRA)
Charles Chen created BEAM-5295: -- Summary: DirectRunner assert_that should work in user state and timers tests Key: BEAM-5295 URL: https://issues.apache.org/jira/browse/BEAM-5295 Project: Beam

[jira] [Created] (BEAM-5264) Reference DirectRunner implementation of Python user state and timers API

2018-08-30 Thread Charles Chen (JIRA)
Charles Chen created BEAM-5264: -- Summary: Reference DirectRunner implementation of Python user state and timers API Key: BEAM-5264 URL: https://issues.apache.org/jira/browse/BEAM-5264 Project: Beam

[jira] [Resolved] (BEAM-2277) IllegalArgumentException when using Hadoop file system for WordCount example.

2018-08-24 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen resolved BEAM-2277. Resolution: Fixed Fix Version/s: 2.7.0 Fixed by 

[jira] [Assigned] (BEAM-5180) Broken FileResultCoder via parseSchema change

2018-08-24 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen reassigned BEAM-5180: -- Assignee: Ankur Goenka (was: Charles Chen) > Broken FileResultCoder via parseSchema change >

[jira] [Assigned] (BEAM-5180) Broken FileResultCoder via parseSchema change

2018-08-24 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen reassigned BEAM-5180: -- Assignee: Charles Chen (was: Kenneth Knowles) > Broken FileResultCoder via parseSchema change

[jira] [Resolved] (BEAM-5180) Broken FileResultCoder via parseSchema change

2018-08-24 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen resolved BEAM-5180. Resolution: Fixed Fix Version/s: 2.7.0 > Broken FileResultCoder via parseSchema change >

[jira] [Assigned] (BEAM-4492) Update Python bigquery library to latest version

2018-08-07 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen reassigned BEAM-4492: -- Assignee: Charles Chen (was: Mark Liu) > Update Python bigquery library to latest version >

[jira] [Created] (BEAM-4741) Upgrade Python BigQuery client to latest version

2018-07-07 Thread Charles Chen (JIRA)
Charles Chen created BEAM-4741: -- Summary: Upgrade Python BigQuery client to latest version Key: BEAM-4741 URL: https://issues.apache.org/jira/browse/BEAM-4741 Project: Beam Issue Type:

[jira] [Assigned] (BEAM-1251) Python 3 Support

2018-07-02 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen reassigned BEAM-1251: -- Assignee: Robbe (was: Charles Chen) > Python 3 Support > > >

[jira] [Assigned] (BEAM-1251) Python 3 Support

2018-07-02 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen reassigned BEAM-1251: -- Assignee: Charles Chen > Python 3 Support > > > Key:

[jira] [Created] (BEAM-4715) Have Beam tests running and passing on Python 3

2018-07-02 Thread Charles Chen (JIRA)
Charles Chen created BEAM-4715: -- Summary: Have Beam tests running and passing on Python 3 Key: BEAM-4715 URL: https://issues.apache.org/jira/browse/BEAM-4715 Project: Beam Issue Type:

[jira] [Resolved] (BEAM-4595) Gradle build :beam-sdks-python:docs is flaky in presubmits

2018-06-26 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen resolved BEAM-4595. Resolution: Cannot Reproduce Fix Version/s: Not applicable > Gradle build

[jira] [Resolved] (BEAM-3619) Add tests for Python DirectRunner implementation of PubSub I/O

2018-06-26 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen resolved BEAM-3619. Resolution: Fixed Assignee: Udi Meiri (was: Charles Chen) Fix Version/s: 2.5.0 >

[jira] [Resolved] (BEAM-3644) Speed up Python DirectRunner execution by using the FnApiRunner when possible

2018-06-26 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen resolved BEAM-3644. Resolution: Fixed Fix Version/s: 2.4.0 > Speed up Python DirectRunner execution by using the

[jira] [Closed] (BEAM-3670) DirectRunner: TypeError: 'KeyedWorkItem' object is not iterable

2018-06-26 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen closed BEAM-3670. -- Resolution: Cannot Reproduce Fix Version/s: Not applicable > DirectRunner: TypeError:

[jira] [Updated] (BEAM-3566) Replace Python DirectRunner apply_* hooks with PTransformOverrides

2018-06-26 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen updated BEAM-3566: --- Fix Version/s: 2.4.0 > Replace Python DirectRunner apply_* hooks with PTransformOverrides >

[jira] [Updated] (BEAM-2815) Python DirectRunner is unusable with input files in the 100-250MB range

2018-06-26 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen updated BEAM-2815: --- Fix Version/s: (was: 2.3.0) 2.4.0 > Python DirectRunner is unusable with input

[jira] [Updated] (BEAM-3512) Python PTransform overrides do not completely remove the overriden transform

2018-06-26 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen updated BEAM-3512: --- Fix Version/s: (was: 2.3.0) 2.4.0 > Python PTransform overrides do not

[jira] [Resolved] (BEAM-3537) Remove DirectRunner-specific internal PValue cache, allow more general eager in-process pipeline execution

2018-06-26 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen resolved BEAM-3537. Resolution: Fixed Fix Version/s: 2.4.0 > Remove DirectRunner-specific internal PValue cache,

[jira] [Resolved] (BEAM-3512) Python PTransform overrides do not completely remove the overriden transform

2018-06-26 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen resolved BEAM-3512. Resolution: Fixed Fix Version/s: 2.3.0 > Python PTransform overrides do not completely

[jira] [Updated] (BEAM-3537) Remove DirectRunner-specific internal PValue cache, allow more general eager in-process pipeline execution

2018-06-26 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen updated BEAM-3537: --- Fix Version/s: (was: 2.4.0) 2.3.0 > Remove DirectRunner-specific internal

[jira] [Resolved] (BEAM-2815) Python DirectRunner is unusable with input files in the 100-250MB range

2018-06-26 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen resolved BEAM-2815. Resolution: Fixed Fix Version/s: 2.3.0 > Python DirectRunner is unusable with input files in

[jira] [Created] (BEAM-4648) Remove the unused Python RPC DirectRunner

2018-06-26 Thread Charles Chen (JIRA)
Charles Chen created BEAM-4648: -- Summary: Remove the unused Python RPC DirectRunner Key: BEAM-4648 URL: https://issues.apache.org/jira/browse/BEAM-4648 Project: Beam Issue Type: Improvement

[jira] [Comment Edited] (BEAM-4592) Make Dataflow understand kind:varint as a well known since it already treats beam:coder:varint:v1 as a well known coder kind

2018-06-20 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518707#comment-16518707 ] Charles Chen edited comment on BEAM-4592 at 6/20/18 11:48 PM: -- PR

[jira] [Commented] (BEAM-4592) Make Dataflow understand kind:varint as a well known since it already treats beam:coder:varint:v1 as a well known coder kind

2018-06-20 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518728#comment-16518728 ] Charles Chen commented on BEAM-4592: Thanks, fixed my typo above. > Make Dataflow understand

[jira] [Commented] (BEAM-4592) Make Dataflow understand kind:varint as a well known since it already treats beam:coder:varint:v1 as a well known coder kind

2018-06-20 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518707#comment-16518707 ] Charles Chen commented on BEAM-4592: PR [https://github.com/apache/beam/pull/5589] was reverted by

[jira] [Created] (BEAM-4595) Gradle build :beam-sdks-python:docs is flaky in presubmits

2018-06-19 Thread Charles Chen (JIRA)
Charles Chen created BEAM-4595: -- Summary: Gradle build :beam-sdks-python:docs is flaky in presubmits Key: BEAM-4595 URL: https://issues.apache.org/jira/browse/BEAM-4595 Project: Beam Issue

[jira] [Assigned] (BEAM-4595) Gradle build :beam-sdks-python:docs is flaky in presubmits

2018-06-19 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen reassigned BEAM-4595: -- Assignee: Charles Chen (was: Ahmet Altay) > Gradle build :beam-sdks-python:docs is flaky in

[jira] [Updated] (BEAM-4594) Implement Beam Python User State and Timer API

2018-06-19 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen updated BEAM-4594: --- Issue Type: New Feature (was: Bug) > Implement Beam Python User State and Timer API >

[jira] [Assigned] (BEAM-4594) Implement Beam Python User State and Timer API

2018-06-19 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen reassigned BEAM-4594: -- Assignee: Charles Chen (was: Ahmet Altay) > Implement Beam Python User State and Timer API >

[jira] [Created] (BEAM-4594) Implement Beam Python User State and Timer API

2018-06-19 Thread Charles Chen (JIRA)
Charles Chen created BEAM-4594: -- Summary: Implement Beam Python User State and Timer API Key: BEAM-4594 URL: https://issues.apache.org/jira/browse/BEAM-4594 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-4593) Remove refcounts from the Python SDK

2018-06-19 Thread Charles Chen (JIRA)
Charles Chen created BEAM-4593: -- Summary: Remove refcounts from the Python SDK Key: BEAM-4593 URL: https://issues.apache.org/jira/browse/BEAM-4593 Project: Beam Issue Type: Bug

[jira] [Reopened] (BEAM-4549) Streaming pipelines with multiple side inputs fail on DataflowRunner

2018-06-14 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen reopened BEAM-4549: > Streaming pipelines with multiple side inputs fail on DataflowRunner >

[jira] [Updated] (BEAM-4549) Streaming pipelines with multiple side inputs fail on DataflowRunner

2018-06-14 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen updated BEAM-4549: --- Priority: Blocker (was: Major) Fix Version/s: 2.5.0 > Streaming pipelines with multiple

[jira] [Created] (BEAM-4549) Streaming pipelines with multiple side inputs fail on DataflowRunner

2018-06-12 Thread Charles Chen (JIRA)
Charles Chen created BEAM-4549: -- Summary: Streaming pipelines with multiple side inputs fail on DataflowRunner Key: BEAM-4549 URL: https://issues.apache.org/jira/browse/BEAM-4549 Project: Beam

[jira] [Assigned] (BEAM-4236) Side inputs do not work on Dataflow

2018-05-04 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen reassigned BEAM-4236: -- Assignee: Charles Chen (was: Robert Bradshaw) > Side inputs do not work on Dataflow >

[jira] [Created] (BEAM-4236) Side inputs do not work on Dataflow

2018-05-04 Thread Charles Chen (JIRA)
Charles Chen created BEAM-4236: -- Summary: Side inputs do not work on Dataflow Key: BEAM-4236 URL: https://issues.apache.org/jira/browse/BEAM-4236 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-4037) Add Python streaming wordcount snippets and test

2018-04-09 Thread Charles Chen (JIRA)
Charles Chen created BEAM-4037: -- Summary: Add Python streaming wordcount snippets and test Key: BEAM-4037 URL: https://issues.apache.org/jira/browse/BEAM-4037 Project: Beam Issue Type:

[jira] [Created] (BEAM-4029) Test ValidatesRunner tests for BundleBasedDirectRunner

2018-04-06 Thread Charles Chen (JIRA)
Charles Chen created BEAM-4029: -- Summary: Test ValidatesRunner tests for BundleBasedDirectRunner Key: BEAM-4029 URL: https://issues.apache.org/jira/browse/BEAM-4029 Project: Beam Issue Type:

[jira] [Updated] (BEAM-4024) BundleBasedDirectRunner fails with recent side input changes

2018-04-05 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen updated BEAM-4024: --- Description: Recently, changes were made to support streaming side inputs in the Beam Python

[jira] [Updated] (BEAM-4024) BundleBasedDirectRunner fails with recent side input changes

2018-04-05 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen updated BEAM-4024: --- Description: Recently, changes were made to support streaming side inputs in the Beam Python

[jira] [Created] (BEAM-4024) BundleBasedDirectRunner fails with recent side input changes

2018-04-05 Thread Charles Chen (JIRA)
Charles Chen created BEAM-4024: -- Summary: BundleBasedDirectRunner fails with recent side input changes Key: BEAM-4024 URL: https://issues.apache.org/jira/browse/BEAM-4024 Project: Beam Issue

[jira] [Commented] (BEAM-3453) Allow usage of public Google PubSub topics in Python DirectRunner

2018-04-02 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423201#comment-16423201 ] Charles Chen commented on BEAM-3453: We need to update the google-cloud-pubsub dependency to the latest

[jira] [Created] (BEAM-3898) PTransformOverride does not replace side input usage of replaced transform

2018-03-20 Thread Charles Chen (JIRA)
Charles Chen created BEAM-3898: -- Summary: PTransformOverride does not replace side input usage of replaced transform Key: BEAM-3898 URL: https://issues.apache.org/jira/browse/BEAM-3898 Project: Beam

[jira] [Resolved] (BEAM-3628) Python postcommit broken

2018-03-20 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen resolved BEAM-3628. Resolution: Fixed Fix Version/s: 2.4.0 > Python postcommit broken >

[jira] [Assigned] (BEAM-3628) Python postcommit broken

2018-03-20 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen reassigned BEAM-3628: -- Assignee: Udi Meiri (was: Charles Chen) > Python postcommit broken >

[jira] [Commented] (BEAM-3824) BQ sink fails on Direct Runner for 2.4.0 RC2

2018-03-09 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16393855#comment-16393855 ] Charles Chen commented on BEAM-3824: I found that the root cause is

[jira] [Commented] (BEAM-3824) BQ sink fails on Direct Runner for 2.4.0 RC2

2018-03-09 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16393843#comment-16393843 ] Charles Chen commented on BEAM-3824: It looks like this is not an issue with the new DirectRunner

[jira] [Commented] (BEAM-3824) BQ sink fails on Direct Runner for 2.4.0 RC2

2018-03-09 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16393808#comment-16393808 ] Charles Chen commented on BEAM-3824: Thanks, I will send you a PR to make sure we use the old

[jira] [Commented] (BEAM-1442) Performance improvement of the Python DirectRunner

2018-03-09 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16392670#comment-16392670 ] Charles Chen commented on BEAM-1442: Yes. > Performance improvement of the Python DirectRunner >

[jira] [Updated] (BEAM-1442) Performance improvement of the Python DirectRunner

2018-03-09 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen updated BEAM-1442: --- Fix Version/s: 2.4.0 > Performance improvement of the Python DirectRunner >

[jira] [Created] (BEAM-3759) Add support for PaneInfo descriptor in Python SDK

2018-02-27 Thread Charles Chen (JIRA)
Charles Chen created BEAM-3759: -- Summary: Add support for PaneInfo descriptor in Python SDK Key: BEAM-3759 URL: https://issues.apache.org/jira/browse/BEAM-3759 Project: Beam Issue Type:

[jira] [Commented] (BEAM-3622) DirectRunner memory issue with Python SDK

2018-02-13 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362826#comment-16362826 ] Charles Chen commented on BEAM-3622: Hey Yuri, thank you for reporting this issue.  It does look like

[jira] [Created] (BEAM-3645) Support multi-process execution on the FnApiRunner

2018-02-07 Thread Charles Chen (JIRA)
Charles Chen created BEAM-3645: -- Summary: Support multi-process execution on the FnApiRunner Key: BEAM-3645 URL: https://issues.apache.org/jira/browse/BEAM-3645 Project: Beam Issue Type:

[jira] [Updated] (BEAM-3644) Speed up Python DirectRunner execution by using the FnApiRunner when possible

2018-02-07 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen updated BEAM-3644: --- Summary: Speed up Python DirectRunner execution by using the FnApiRunner when possible (was: Speeding

[jira] [Created] (BEAM-3644) Speeding up Python DirectRunner execution by using the FnApiRunner when possible

2018-02-07 Thread Charles Chen (JIRA)
Charles Chen created BEAM-3644: -- Summary: Speeding up Python DirectRunner execution by using the FnApiRunner when possible Key: BEAM-3644 URL: https://issues.apache.org/jira/browse/BEAM-3644 Project:

[jira] [Created] (BEAM-3642) Support bundle retries in the FnApiRunner

2018-02-07 Thread Charles Chen (JIRA)
Charles Chen created BEAM-3642: -- Summary: Support bundle retries in the FnApiRunner Key: BEAM-3642 URL: https://issues.apache.org/jira/browse/BEAM-3642 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-3641) Clean up logging in the FnApiRunner

2018-02-07 Thread Charles Chen (JIRA)
Charles Chen created BEAM-3641: -- Summary: Clean up logging in the FnApiRunner Key: BEAM-3641 URL: https://issues.apache.org/jira/browse/BEAM-3641 Project: Beam Issue Type: Improvement

[jira] [Resolved] (BEAM-3635) Infer type hints on PTransformOverrides

2018-02-07 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen resolved BEAM-3635. Resolution: Fixed Fix Version/s: 2.4.0 > Infer type hints on PTransformOverrides >

[jira] [Created] (BEAM-3635) Infer type hints on PTransformOverrides

2018-02-06 Thread Charles Chen (JIRA)
Charles Chen created BEAM-3635: -- Summary: Infer type hints on PTransformOverrides Key: BEAM-3635 URL: https://issues.apache.org/jira/browse/BEAM-3635 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-3619) Add tests for Python DirectRunner implementation of PubSub I/O

2018-02-05 Thread Charles Chen (JIRA)
Charles Chen created BEAM-3619: -- Summary: Add tests for Python DirectRunner implementation of PubSub I/O Key: BEAM-3619 URL: https://issues.apache.org/jira/browse/BEAM-3619 Project: Beam Issue

[jira] [Created] (BEAM-3566) Replace Python DirectRunner apply_* hooks with PTransformOverrides

2018-01-29 Thread Charles Chen (JIRA)
Charles Chen created BEAM-3566: -- Summary: Replace Python DirectRunner apply_* hooks with PTransformOverrides Key: BEAM-3566 URL: https://issues.apache.org/jira/browse/BEAM-3566 Project: Beam

[jira] [Created] (BEAM-3537) Remove DirectRunner-specific internal PValue cache, allow more general eager in-process pipeline execution

2018-01-25 Thread Charles Chen (JIRA)
Charles Chen created BEAM-3537: -- Summary: Remove DirectRunner-specific internal PValue cache, allow more general eager in-process pipeline execution Key: BEAM-3537 URL:

[jira] [Created] (BEAM-3512) Python PTransform overrides do not completely remove the overriden transform

2018-01-22 Thread Charles Chen (JIRA)
Charles Chen created BEAM-3512: -- Summary: Python PTransform overrides do not completely remove the overriden transform Key: BEAM-3512 URL: https://issues.apache.org/jira/browse/BEAM-3512 Project: Beam

[jira] [Updated] (BEAM-3511) Eager evaluation of overridden transforms in Python SDK does not work

2018-01-22 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen updated BEAM-3511: --- Affects Version/s: 2.2.0 > Eager evaluation of overridden transforms in Python SDK does not work >

[jira] [Updated] (BEAM-3511) Eager evaluation of overridden transforms in Python SDK does not work

2018-01-22 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen updated BEAM-3511: --- Summary: Eager evaluation of overridden transforms in Python SDK does not work (was: Eager running of

[jira] [Created] (BEAM-3511) Eager running of overridden transforms in Python SDK does not work

2018-01-22 Thread Charles Chen (JIRA)
Charles Chen created BEAM-3511: -- Summary: Eager running of overridden transforms in Python SDK does not work Key: BEAM-3511 URL: https://issues.apache.org/jira/browse/BEAM-3511 Project: Beam

[jira] [Assigned] (BEAM-3510) Python Runner API serialization for CombinePerKey drops arguments to CombineFn

2018-01-22 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen reassigned BEAM-3510: -- Assignee: Charles Chen (was: Ahmet Altay) > Python Runner API serialization for CombinePerKey

[jira] [Created] (BEAM-3510) Python Runner API serialization for CombinePerKey drops arguments to CombineFn

2018-01-22 Thread Charles Chen (JIRA)
Charles Chen created BEAM-3510: -- Summary: Python Runner API serialization for CombinePerKey drops arguments to CombineFn Key: BEAM-3510 URL: https://issues.apache.org/jira/browse/BEAM-3510 Project: Beam

[jira] [Created] (BEAM-3453) Allow usage of public Google PubSub topics in Python DirectRunner

2018-01-10 Thread Charles Chen (JIRA)
Charles Chen created BEAM-3453: -- Summary: Allow usage of public Google PubSub topics in Python DirectRunner Key: BEAM-3453 URL: https://issues.apache.org/jira/browse/BEAM-3453 Project: Beam

[jira] [Assigned] (BEAM-1442) Performance improvement of the Python DirectRunner

2017-11-21 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen reassigned BEAM-1442: -- Assignee: Charles Chen (was: Ahmet Altay) > Performance improvement of the Python DirectRunner

[jira] [Commented] (BEAM-1442) Performance improvement of the Python DirectRunner

2017-11-21 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261797#comment-16261797 ] Charles Chen commented on BEAM-1442: Yes, this is in progress. > Performance improvement of the Python

[jira] [Created] (BEAM-3172) Side input reader exceptions are not properly handled when no elements are emitted

2017-11-10 Thread Charles Chen (JIRA)
Charles Chen created BEAM-3172: -- Summary: Side input reader exceptions are not properly handled when no elements are emitted Key: BEAM-3172 URL: https://issues.apache.org/jira/browse/BEAM-3172 Project:

[jira] [Created] (BEAM-3153) Allow streaming processing time domain timers in Beam Python DirectRunner

2017-11-07 Thread Charles Chen (JIRA)
Charles Chen created BEAM-3153: -- Summary: Allow streaming processing time domain timers in Beam Python DirectRunner Key: BEAM-3153 URL: https://issues.apache.org/jira/browse/BEAM-3153 Project: Beam

[jira] [Created] (BEAM-2988) PubSub subscriptions automatically created in Python DirectRunner not reliably cleaned up

2017-09-25 Thread Charles Chen (JIRA)
Charles Chen created BEAM-2988: -- Summary: PubSub subscriptions automatically created in Python DirectRunner not reliably cleaned up Key: BEAM-2988 URL: https://issues.apache.org/jira/browse/BEAM-2988

[jira] [Resolved] (BEAM-2785) Allow termination of Python DirectRunner execution with Ctrl-C

2017-08-22 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen resolved BEAM-2785. Resolution: Fixed > Allow termination of Python DirectRunner execution with Ctrl-C >

[jira] [Created] (BEAM-2785) Allow termination of Python DirectRunner execution with Ctrl-C

2017-08-21 Thread Charles Chen (JIRA)
Charles Chen created BEAM-2785: -- Summary: Allow termination of Python DirectRunner execution with Ctrl-C Key: BEAM-2785 URL: https://issues.apache.org/jira/browse/BEAM-2785 Project: Beam Issue

[jira] [Created] (BEAM-2519) Record type of state in Python InMemoryUnmergedState

2017-06-26 Thread Charles Chen (JIRA)
Charles Chen created BEAM-2519: -- Summary: Record type of state in Python InMemoryUnmergedState Key: BEAM-2519 URL: https://issues.apache.org/jira/browse/BEAM-2519 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-2518) Support TimestampCombiner in Python streaming mode GroupByKey

2017-06-26 Thread Charles Chen (JIRA)
Charles Chen created BEAM-2518: -- Summary: Support TimestampCombiner in Python streaming mode GroupByKey Key: BEAM-2518 URL: https://issues.apache.org/jira/browse/BEAM-2518 Project: Beam Issue

[jira] [Created] (BEAM-2413) Clean up usage of temporary files in Python SDK tests

2017-06-06 Thread Charles Chen (JIRA)
Charles Chen created BEAM-2413: -- Summary: Clean up usage of temporary files in Python SDK tests Key: BEAM-2413 URL: https://issues.apache.org/jira/browse/BEAM-2413 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-2320) Update DataflowRunner dependency check for Google / Apache Beam Distribution

2017-05-18 Thread Charles Chen (JIRA)
Charles Chen created BEAM-2320: -- Summary: Update DataflowRunner dependency check for Google / Apache Beam Distribution Key: BEAM-2320 URL: https://issues.apache.org/jira/browse/BEAM-2320 Project: Beam