[jira] [Commented] (BEAM-5621) Several tests fail on Python 3 with TypeError: unorderable types: str() < int()

2018-10-15 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16649857#comment-16649857 ] Robert Bradshaw commented on BEAM-5621: --- A proper fix would to not require sortability. (This has

[jira] [Created] (BEAM-5791) Bound the amount of data on the data plane by time.

2018-10-19 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-5791: - Summary: Bound the amount of data on the data plane by time. Key: BEAM-5791 URL: https://issues.apache.org/jira/browse/BEAM-5791 Project: Beam Issue Type:

[jira] [Updated] (BEAM-5791) Bound the amount of data on the data plane by time.

2018-10-19 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-5791: -- Description: This is especially important for Fn API reads, where each element represents a

[jira] [Updated] (BEAM-5776) Using methods in map is broken on Python 3

2018-10-17 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-5776: -- Issue Type: Sub-task (was: Bug) Parent: BEAM-1251 > Using methods in map is broken on

[jira] [Resolved] (BEAM-5720) Default coder breaks with large ints on Python 3

2018-10-17 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw resolved BEAM-5720. --- Resolution: Fixed Fix Version/s: 2.9.0 > Default coder breaks with large ints on

[jira] [Commented] (BEAM-5663) Add tox suites for various Python 3 versions

2018-10-18 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654892#comment-16654892 ] Robert Bradshaw commented on BEAM-5663: --- I don't think 3.4 is important to target (it's already in

[jira] [Closed] (BEAM-5792) Use Impulse + Reshuffle for Create on Fn API

2018-10-23 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw closed BEAM-5792. - Resolution: Fixed Fix Version/s: 2.9.0 > Use Impulse + Reshuffle for Create on Fn API >

[jira] [Assigned] (BEAM-5617) Side inputs don't work on Python 3

2018-10-26 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw reassigned BEAM-5617: - Assignee: Robert Bradshaw (was: Valentyn Tymofieiev) > Side inputs don't work on Python

[jira] [Commented] (BEAM-5322) Finish Python 3 porting for typehints module

2018-10-25 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663407#comment-16663407 ] Robert Bradshaw commented on BEAM-5322: --- Type inference is already best-effort; here returning Any

[jira] [Commented] (BEAM-5617) Side inputs don't work on Python 3

2018-10-26 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16665035#comment-16665035 ] Robert Bradshaw commented on BEAM-5617: --- Shipping without side input is probably infeasible (e.g.

[jira] [Commented] (BEAM-5617) Side inputs don't work on Python 3

2018-10-26 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16665051#comment-16665051 ] Robert Bradshaw commented on BEAM-5617: --- Looks like this is due to incorrect mixing of bytes and

[jira] [Commented] (BEAM-5999) Proto error when running test_pardo_timers of Python PortableValidatesRunner

2018-11-08 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679743#comment-16679743 ] Robert Bradshaw commented on BEAM-5999: --- Yeah, I'll take a look. I suspect it's due to the thread on

[jira] [Created] (BEAM-6019) Portable streaming flink does not preserve original error message

2018-11-08 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-6019: - Summary: Portable streaming flink does not preserve original error message Key: BEAM-6019 URL: https://issues.apache.org/jira/browse/BEAM-6019 Project: Beam

[jira] [Commented] (BEAM-5629) Several typehints tests fail on Python 3 with ValueError: no signature found for builtin

2018-11-16 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689248#comment-16689248 ] Robert Bradshaw commented on BEAM-5629: --- I think this is BEAM-5776. > Several typehints tests fail

[jira] [Created] (BEAM-6008) Propagate errors through portable portable runner

2018-11-07 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-6008: - Summary: Propagate errors through portable portable runner Key: BEAM-6008 URL: https://issues.apache.org/jira/browse/BEAM-6008 Project: Beam Issue Type:

[jira] [Updated] (BEAM-5448) Support running user pipelines with the Java Reference Runner in Python.

2018-11-07 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-5448: -- Summary: Support running user pipelines with the Java Reference Runner in Python. (was:

[jira] [Closed] (BEAM-4097) Python SDK should set the environment in the job submission protos

2019-01-18 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw closed BEAM-4097. - Resolution: Fixed Fix Version/s: 2.9.0 This was fixed as part of the work for

[jira] [Created] (BEAM-6464) PortableRunner should run dockerized SDK workers

2019-01-18 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-6464: - Summary: PortableRunner should run dockerized SDK workers Key: BEAM-6464 URL: https://issues.apache.org/jira/browse/BEAM-6464 Project: Beam Issue Type:

[jira] [Updated] (BEAM-6439) Move Python Flink VR tests to PreCommit

2019-01-15 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-6439: -- Attachment: png.png > Move Python Flink VR tests to PreCommit >

[jira] [Created] (BEAM-6439) Move Python Flink VR tests to PreCommit

2019-01-15 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-6439: - Summary: Move Python Flink VR tests to PreCommit Key: BEAM-6439 URL: https://issues.apache.org/jira/browse/BEAM-6439 Project: Beam Issue Type: New Feature

[jira] [Created] (BEAM-6435) beam_PostCommit_Java_PVR_Flink_Batch regularly failing

2019-01-15 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-6435: - Summary: beam_PostCommit_Java_PVR_Flink_Batch regularly failing Key: BEAM-6435 URL: https://issues.apache.org/jira/browse/BEAM-6435 Project: Beam Issue

[jira] [Commented] (BEAM-6473) Python Flink ValidatesRunner test_flattened_side_input fails

2019-01-21 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16747929#comment-16747929 ] Robert Bradshaw commented on BEAM-6473: --- https://github.com/apache/beam/pull/7581 > Python Flink

[jira] [Created] (BEAM-6208) Use correct URN for side inputs in Java

2018-12-11 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-6208: - Summary: Use correct URN for side inputs in Java Key: BEAM-6208 URL: https://issues.apache.org/jira/browse/BEAM-6208 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-6243) TFX pipelines experience a huge blowup in intermediate data size

2018-12-17 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-6243: -- Issue Type: Bug (was: Sub-task) Parent: (was: BEAM-6015) > TFX pipelines

[jira] [Created] (BEAM-6243) TFX pipelines experience a huge blowup in intermediate data size

2018-12-17 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-6243: - Summary: TFX pipelines experience a huge blowup in intermediate data size Key: BEAM-6243 URL: https://issues.apache.org/jira/browse/BEAM-6243 Project: Beam

[jira] [Created] (BEAM-6294) Use Flink's redistribute for reshuffle.

2018-12-21 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-6294: - Summary: Use Flink's redistribute for reshuffle. Key: BEAM-6294 URL: https://issues.apache.org/jira/browse/BEAM-6294 Project: Beam Issue Type: New Feature

[jira] [Created] (BEAM-6215) FlatMap no longer shows User function name

2018-12-12 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-6215: - Summary: FlatMap no longer shows User function name Key: BEAM-6215 URL: https://issues.apache.org/jira/browse/BEAM-6215 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-6193) Standardize use of insecure vs. secure port in the FnAPI

2018-12-07 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-6193: - Summary: Standardize use of insecure vs. secure port in the FnAPI Key: BEAM-6193 URL: https://issues.apache.org/jira/browse/BEAM-6193 Project: Beam Issue

[jira] [Reopened] (BEAM-4150) Standardize use of PCollection coder proto attribute

2018-12-06 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw reopened BEAM-4150: --- We need to update the SDKs and workers (and remove fallback code). > Standardize use of

[jira] [Created] (BEAM-6199) Remove uses of, and finally definitions of, old combine URNs.

2018-12-10 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-6199: - Summary: Remove uses of, and finally definitions of, old combine URNs. Key: BEAM-6199 URL: https://issues.apache.org/jira/browse/BEAM-6199 Project: Beam

[jira] [Updated] (BEAM-6199) Remove uses of, and finally definitions of, old combine URNs.

2018-12-10 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-6199: -- Issue Type: Sub-task (was: Task) Parent: BEAM-2937 > Remove uses of, and finally

[jira] [Commented] (BEAM-6153) PR 7130 causes transforms/util_test to fail

2018-11-30 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704406#comment-16704406 ] Robert Bradshaw commented on BEAM-6153: --- This passes for me, and passed all precommits as well. I'll

[jira] [Created] (BEAM-6186) Cleanup FnApiRunner optimization phases.

2018-12-06 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-6186: - Summary: Cleanup FnApiRunner optimization phases. Key: BEAM-6186 URL: https://issues.apache.org/jira/browse/BEAM-6186 Project: Beam Issue Type:

[jira] [Created] (BEAM-6120) Support retrieval of large gbk iterables over the state API.

2018-11-23 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-6120: - Summary: Support retrieval of large gbk iterables over the state API. Key: BEAM-6120 URL: https://issues.apache.org/jira/browse/BEAM-6120 Project: Beam

[jira] [Resolved] (BEAM-4524) We should not be using md5 to validate artifact integrity.

2018-11-21 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw resolved BEAM-4524. --- Resolution: Fixed Assignee: Robert Bradshaw Fix Version/s: 2.9.0 > We should

[jira] [Created] (BEAM-6094) Implement External environment for Portable Beam

2018-11-19 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-6094: - Summary: Implement External environment for Portable Beam Key: BEAM-6094 URL: https://issues.apache.org/jira/browse/BEAM-6094 Project: Beam Issue Type:

[jira] [Resolved] (BEAM-5927) FnApiRunner KeyError

2019-01-10 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw resolved BEAM-5927. --- Resolution: Duplicate Fix Version/s: Not applicable > FnApiRunner KeyError >

[jira] [Commented] (BEAM-6294) Use Flink's redistribute for reshuffle.

2019-01-10 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16739383#comment-16739383 ] Robert Bradshaw commented on BEAM-6294: --- I figured out what the issue was:

[jira] [Created] (BEAM-6404) FnAPI translation error

2019-01-10 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-6404: - Summary: FnAPI translation error Key: BEAM-6404 URL: https://issues.apache.org/jira/browse/BEAM-6404 Project: Beam Issue Type: New Feature

[jira] [Created] (BEAM-6327) Don't attempt to fuse subtransforms of primitive/known transforms.

2018-12-28 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-6327: - Summary: Don't attempt to fuse subtransforms of primitive/known transforms. Key: BEAM-6327 URL: https://issues.apache.org/jira/browse/BEAM-6327 Project: Beam

[jira] [Commented] (BEAM-6294) Use Flink's redistribute for reshuffle.

2019-01-09 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16738323#comment-16738323 ] Robert Bradshaw commented on BEAM-6294: --- Basically, I'm letting the existing reshuffle URN transform

[jira] [Commented] (BEAM-4150) Standardize use of PCollection coder proto attribute

2019-01-09 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16738257#comment-16738257 ] Robert Bradshaw commented on BEAM-4150: --- Yes, I also agree. The goal of this bug is to remove that

[jira] [Created] (BEAM-6269) Support mixed-language pipelines.

2018-12-19 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-6269: - Summary: Support mixed-language pipelines. Key: BEAM-6269 URL: https://issues.apache.org/jira/browse/BEAM-6269 Project: Beam Issue Type: New Feature

[jira] [Closed] (BEAM-6588) Error in inferring output typehints for beam.Filter

2019-04-05 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw closed BEAM-6588. - Resolution: Fixed Fix Version/s: 2.13.0 > Error in inferring output typehints for

[jira] [Closed] (BEAM-6979) Make the standard double coder well known within the Java SDK

2019-04-05 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw closed BEAM-6979. - Resolution: Fixed Fix Version/s: 2.13.0 > Make the standard double coder well known within

[jira] [Commented] (BEAM-6723) Reshuffle in streaming pipeline does not work on dataflowrunner python

2019-02-21 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774260#comment-16774260 ] Robert Bradshaw commented on BEAM-6723: --- Thanks for the bug report. In the meantime, try

[jira] [Created] (BEAM-6729) Detect and use PEP-3107 style type annotations for type hints.

2019-02-22 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-6729: - Summary: Detect and use PEP-3107 style type annotations for type hints. Key: BEAM-6729 URL: https://issues.apache.org/jira/browse/BEAM-6729 Project: Beam

[jira] [Commented] (BEAM-6727) Travis deprecated xcode 6.4 (used for wheel files)

2019-02-22 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774932#comment-16774932 ] Robert Bradshaw commented on BEAM-6727: --- It's generally preferable to build on old systems as those

[jira] [Created] (BEAM-6728) Allow sharing of the job and artifact service address.

2019-02-22 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-6728: - Summary: Allow sharing of the job and artifact service address. Key: BEAM-6728 URL: https://issues.apache.org/jira/browse/BEAM-6728 Project: Beam Issue

[jira] [Commented] (BEAM-4822) Beam FileIO should support versioned file systems

2019-02-14 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16768367#comment-16768367 ] Robert Bradshaw commented on BEAM-4822: --- IMHO the MetadataCoder should be written to be easily

[jira] [Created] (BEAM-6655) Support progress reporting over FnAPI

2019-02-12 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-6655: - Summary: Support progress reporting over FnAPI Key: BEAM-6655 URL: https://issues.apache.org/jira/browse/BEAM-6655 Project: Beam Issue Type: New Feature

[jira] [Commented] (BEAM-6617) Release Python 3 wheels with first Beam SDK release that supports Python 3.

2019-02-15 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16769273#comment-16769273 ] Robert Bradshaw commented on BEAM-6617: --- This was https://github.com/apache/beam-wheels/pull/6 >

[jira] [Created] (BEAM-6716) Update trigger documentation to highlight pitfals.

2019-02-20 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-6716: - Summary: Update trigger documentation to highlight pitfals. Key: BEAM-6716 URL: https://issues.apache.org/jira/browse/BEAM-6716 Project: Beam Issue Type:

[jira] [Commented] (BEAM-6544) Python wheel release process must not require inputting credentials to third party sites

2019-01-29 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16755577#comment-16755577 ] Robert Bradshaw commented on BEAM-6544: --- Strongly agree, I thought we had taken care of this.  What

[jira] [Commented] (BEAM-6473) Python Flink ValidatesRunner test_flattened_side_input fails

2019-01-24 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751075#comment-16751075 ] Robert Bradshaw commented on BEAM-6473: --- Yes, I think this is an error in the Java fuser, as the

[jira] [Resolved] (BEAM-4030) Add CombineFn.compact, similar to Java

2019-01-31 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw resolved BEAM-4030. --- Resolution: Fixed Fix Version/s: 2.11.0 > Add CombineFn.compact, similar to Java >

[jira] [Commented] (BEAM-6539) Some Java PostCommits failing: Coder casting error.

2019-02-05 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760591#comment-16760591 ] Robert Bradshaw commented on BEAM-6539: --- Looks like this was due to my attempt to make

[jira] [Updated] (BEAM-6587) Let StringUtf8 be a well-known coder.

2019-02-05 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-6587: -- Description: It doesn't have to be understood by the runner, but it would be good if most/all

[jira] [Created] (BEAM-6587) Let StringUtf8 be a well-known coder in Java.

2019-02-05 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-6587: - Summary: Let StringUtf8 be a well-known coder in Java. Key: BEAM-6587 URL: https://issues.apache.org/jira/browse/BEAM-6587 Project: Beam Issue Type: New

[jira] [Created] (BEAM-6588) Error in inferring output typehints for beam.Filter

2019-02-05 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-6588: - Summary: Error in inferring output typehints for beam.Filter Key: BEAM-6588 URL: https://issues.apache.org/jira/browse/BEAM-6588 Project: Beam Issue Type:

[jira] [Updated] (BEAM-6588) Error in inferring output typehints for beam.Filter

2019-02-05 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-6588: -- Description: If a type hint is specified for an input to beam.Filter, it attempts to infer the

[jira] [Commented] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-04-12 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16816337#comment-16816337 ] Robert Bradshaw commented on BEAM-7060: --- The static typing situation in Java has improved

[jira] [Commented] (BEAM-7474) Add SDK harness containers for Py 3.6, Py 3.7

2019-06-03 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854391#comment-16854391 ] Robert Bradshaw commented on BEAM-7474: --- Point releases are not necessarily fully backwards

[jira] [Commented] (BEAM-7474) Add SDK harness containers for Py 3.6, Py 3.7

2019-06-03 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16854292#comment-16854292 ] Robert Bradshaw commented on BEAM-7474: --- I prefer a parameterized docker file; it prevents

[jira] [Commented] (BEAM-3000) No python equivalent of org.apache.beam.sdk.transforms.Sample.any(100)?

2019-06-07 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16858727#comment-16858727 ] Robert Bradshaw commented on BEAM-3000: --- org.apache.beam.sdk.transforms.Sample.any(N) has the same

[jira] [Commented] (BEAM-5354) Side Inputs seems to be non-working in the sdk-go

2019-05-29 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16850591#comment-16850591 ] Robert Bradshaw commented on BEAM-5354: --- Runner sensitivity to step ordering seems like it's

[jira] [Commented] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-05-29 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16850832#comment-16850832 ] Robert Bradshaw commented on BEAM-7060: --- Consider the case {code:python} (p |

[jira] [Created] (BEAM-7441) Artifact staging filesystem errors swallowed by NullPointerException

2019-05-28 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-7441: - Summary: Artifact staging filesystem errors swallowed by NullPointerException Key: BEAM-7441 URL: https://issues.apache.org/jira/browse/BEAM-7441 Project: Beam

[jira] [Commented] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-05-28 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16849612#comment-16849612 ] Robert Bradshaw commented on BEAM-7060: --- I don't think this will be sufficient. For example, a

[jira] [Commented] (BEAM-4782) Enforce KV coders for MultiMap side inputs

2019-06-12 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16861874#comment-16861874 ] Robert Bradshaw commented on BEAM-4782: --- Yes, probably. > Enforce KV coders for MultiMap side

[jira] [Commented] (BEAM-4288) SplittableDoFn: splitAtFraction() API for Python

2019-06-18 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867127#comment-16867127 ] Robert Bradshaw commented on BEAM-4288: --- This was resolved with 

[jira] [Resolved] (BEAM-4288) SplittableDoFn: splitAtFraction() API for Python

2019-06-18 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw resolved BEAM-4288. --- Resolution: Fixed Fix Version/s: 2.14.0 > SplittableDoFn: splitAtFraction() API for

[jira] [Assigned] (BEAM-7365) apache_beam.io.avroio_test.TestAvro.test_dynamic_work_rebalancing_exhaustive is very slow

2019-05-20 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw reassigned BEAM-7365: - Assignee: Valentyn Tymofieiev >

[jira] [Commented] (BEAM-7365) apache_beam.io.avroio_test.TestAvro.test_dynamic_work_rebalancing_exhaustive is very slow

2019-05-20 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16843860#comment-16843860 ] Robert Bradshaw commented on BEAM-7365: --- I am concerned that this indicates less opportunities for

[jira] [Created] (BEAM-7365) apache_beam.io.avroio_test.TestAvro.test_dynamic_work_rebalancing_exhaustive is very slow

2019-05-20 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-7365: - Summary: apache_beam.io.avroio_test.TestAvro.test_dynamic_work_rebalancing_exhaustive is very slow Key: BEAM-7365 URL: https://issues.apache.org/jira/browse/BEAM-7365

[jira] [Commented] (BEAM-7364) Possible signed overflow for WindowedValue.__hash__

2019-05-20 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16843806#comment-16843806 ] Robert Bradshaw commented on BEAM-7364: --- Any (consistent) overflow behavior should be fine, but some

[jira] [Created] (BEAM-7364) Possible signed overflow for WindowedValue.__hash__

2019-05-20 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-7364: - Summary: Possible signed overflow for WindowedValue.__hash__ Key: BEAM-7364 URL: https://issues.apache.org/jira/browse/BEAM-7364 Project: Beam Issue Type:

[jira] [Created] (BEAM-7367) kafka-clients.jar failure in :sdks:java:container:docker

2019-05-20 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-7367: - Summary: kafka-clients.jar failure in :sdks:java:container:docker Key: BEAM-7367 URL: https://issues.apache.org/jira/browse/BEAM-7367 Project: Beam Issue

[jira] [Updated] (BEAM-7367) kafka-clients.jar failure in :sdks:java:container:docker

2019-05-20 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw updated BEAM-7367: -- Description: E.g. https://builds.apache.org/job/beam_PostCommit_Python_Verify/8261/consoleText

[jira] [Commented] (BEAM-6429) apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest.test_multimap_side_input fails in Python 3.6

2019-05-15 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840320#comment-16840320 ] Robert Bradshaw commented on BEAM-6429: --- Yes, that is probably the root cause. We likely need to

[jira] [Resolved] (BEAM-7157) Allow creation of BinaryCombineFn from lambdas.

2019-04-30 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw resolved BEAM-7157. --- Resolution: Fixed Fix Version/s: 2.13.0 > Allow creation of BinaryCombineFn from

[jira] [Created] (BEAM-7722) Simplify running of Beam Python on Flink

2019-07-11 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-7722: - Summary: Simplify running of Beam Python on Flink Key: BEAM-7722 URL: https://issues.apache.org/jira/browse/BEAM-7722 Project: Beam Issue Type: Test

[jira] [Commented] (BEAM-3595) Normalize URNs across SDKs and runners.

2019-07-12 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883616#comment-16883616 ] Robert Bradshaw commented on BEAM-3595: --- Sounds like there's a version mismatch between Python and

[jira] [Created] (BEAM-7157) Allow creation of BinaryCombineFn from lambdas.

2019-04-26 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-7157: - Summary: Allow creation of BinaryCombineFn from lambdas. Key: BEAM-7157 URL: https://issues.apache.org/jira/browse/BEAM-7157 Project: Beam Issue Type: New

[jira] [Created] (BEAM-8156) Finish migration to standard Python typing

2019-09-05 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-8156: - Summary: Finish migration to standard Python typing Key: BEAM-8156 URL: https://issues.apache.org/jira/browse/BEAM-8156 Project: Beam Issue Type:

[jira] [Commented] (BEAM-8196) Python 3.5 post commit timed out at 100 minutes

2019-09-11 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927886#comment-16927886 ] Robert Bradshaw commented on BEAM-8196: --- Yes, I think we could make this an error if we're sure end

[jira] [Commented] (BEAM-8213) Run and report python tox tasks separately within Jenkins

2019-09-13 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929623#comment-16929623 ] Robert Bradshaw commented on BEAM-8213: --- I would be in favor of splitting these up as well,

[jira] [Resolved] (BEAM-7840) Create MapTuple and FlatMapTuple to ease migration to Python 3.

2019-07-31 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw resolved BEAM-7840. --- Resolution: Fixed > Create MapTuple and FlatMapTuple to ease migration to Python 3. >

[jira] [Commented] (BEAM-7857) Portable Wordcount on Flink runner finishes but does not produce output files in DOCKER execution mode

2019-07-31 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16896951#comment-16896951 ] Robert Bradshaw commented on BEAM-7857: --- This is because the writer writes files to the (local)

[jira] [Created] (BEAM-7840) Create MapTuple and FlatMapTuple to ease migration to Python 3.

2019-07-29 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-7840: - Summary: Create MapTuple and FlatMapTuple to ease migration to Python 3. Key: BEAM-7840 URL: https://issues.apache.org/jira/browse/BEAM-7840 Project: Beam

[jira] [Resolved] (BEAM-7741) Add SetState in Python sdk

2019-08-08 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw resolved BEAM-7741. --- Resolution: Fixed Fix Version/s: 2.16.0 > Add SetState in Python sdk >

[jira] [Commented] (BEAM-7798) After changes in type inference, apache_beam.io.gcp.bigquery_io_read_it_test.BigqueryIOReadIT.test_bigquery_read_1M_python is failing in Python 3.5 postcommits

2019-07-23 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890829#comment-16890829 ] Robert Bradshaw commented on BEAM-7798: --- This was fixed by 

[jira] [Created] (BEAM-7801) Explicit use of init_dockerized_job_server causes wordcount_xlang to hang.

2019-07-23 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-7801: - Summary: Explicit use of init_dockerized_job_server causes wordcount_xlang to hang. Key: BEAM-7801 URL: https://issues.apache.org/jira/browse/BEAM-7801 Project:

[jira] [Commented] (BEAM-8286) Python precommit (:sdks:python:test-suites:tox:py2:docs) failing

2019-09-19 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933751#comment-16933751 ] Robert Bradshaw commented on BEAM-8286: --- Was there a release/version bump of any of the doc building

[jira] [Commented] (BEAM-6896) Beam Dependency Update Request: PyYAML

2019-09-30 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941345#comment-16941345 ] Robert Bradshaw commented on BEAM-6896: --- This should be an easy fix. > Beam Dependency Update

[jira] [Created] (BEAM-8301) Argument inference breaks on incomparable types as defaults.

2019-09-23 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-8301: - Summary: Argument inference breaks on incomparable types as defaults. Key: BEAM-8301 URL: https://issues.apache.org/jira/browse/BEAM-8301 Project: Beam

[jira] [Created] (BEAM-8302) beam_PostCommit_XVR_Flink failing

2019-09-23 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-8302: - Summary: beam_PostCommit_XVR_Flink failing Key: BEAM-8302 URL: https://issues.apache.org/jira/browse/BEAM-8302 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-8305) Cleanup external transform tests

2019-09-23 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-8305: - Summary: Cleanup external transform tests Key: BEAM-8305 URL: https://issues.apache.org/jira/browse/BEAM-8305 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-8332) Expand compatibility matrix to account for portability, etc.

2019-10-01 Thread Robert Bradshaw (Jira)
Robert Bradshaw created BEAM-8332: - Summary: Expand compatibility matrix to account for portability, etc. Key: BEAM-8332 URL: https://issues.apache.org/jira/browse/BEAM-8332 Project: Beam

[jira] [Closed] (BEAM-6896) Beam Dependency Update Request: PyYAML

2019-10-01 Thread Robert Bradshaw (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw closed BEAM-6896. - Resolution: Fixed > Beam Dependency Update Request: PyYAML >

  1   2   3   >