[jira] [Assigned] (BEAM-4058) Removal of replaced MavenInstall jobs

2018-04-12 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-4058: --- Assignee: (was: Luke Cwik) > Removal of replaced MavenInstall jobs >

[jira] [Commented] (BEAM-4058) Removal of replaced MavenInstall jobs

2018-04-12 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16436013#comment-16436013 ] Pablo Estrada commented on BEAM-4058: - Should note that these tests are broken -

[jira] [Created] (BEAM-4059) Make sure Dataflow ValidatesRunner tests pass in Gradle

2018-04-12 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-4059: --- Summary: Make sure Dataflow ValidatesRunner tests pass in Gradle Key: BEAM-4059 URL: https://issues.apache.org/jira/browse/BEAM-4059 Project: Beam Issue Type:

[jira] [Commented] (BEAM-4059) Make sure Dataflow ValidatesRunner tests pass in Gradle

2018-04-12 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16436163#comment-16436163 ] Pablo Estrada commented on BEAM-4059: - Issue tracking same problem, back when Maven timeout was

[jira] [Commented] (BEAM-4059) Make sure Dataflow ValidatesRunner tests pass in Gradle

2018-04-12 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16436158#comment-16436158 ] Pablo Estrada commented on BEAM-4059: - The previous Maven Build ran 283 dataflow jobs, and ran in about

[jira] [Commented] (BEAM-3775) Failure in beam_PostCommit_Java_ValidatesRunner_Dataflow/

2018-04-12 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16436162#comment-16436162 ] Pablo Estrada commented on BEAM-3775: - I've created a subtask for the gradle migration that covers this

[jira] [Commented] (BEAM-4059) Make sure Dataflow ValidatesRunner tests pass in Gradle

2018-04-12 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16436260#comment-16436260 ] Pablo Estrada commented on BEAM-4059: - I think for now the best thing is to increase the timeout, to

[jira] [Comment Edited] (BEAM-4059) Make sure Dataflow ValidatesRunner tests pass in Gradle

2018-04-13 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437583#comment-16437583 ] Pablo Estrada edited comment on BEAM-4059 at 4/13/18 5:04 PM: -- Looking at the

[jira] [Commented] (BEAM-4059) Make sure Dataflow ValidatesRunner tests pass in Gradle

2018-04-13 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437750#comment-16437750 ] Pablo Estrada commented on BEAM-4059: - In my test runs with higher number of parallel forks, I{m seeing

[jira] [Commented] (BEAM-4059) Make sure Dataflow ValidatesRunner tests pass in Gradle

2018-04-13 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437583#comment-16437583 ] Pablo Estrada commented on BEAM-4059: - Looking at the latest passing test, I've grouped the number of

[jira] [Commented] (BEAM-4028) Step / Operation naming should rely on a NameContext class

2018-04-13 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437590#comment-16437590 ] Pablo Estrada commented on BEAM-4028: - Before closing this, this log statement should be removed

[jira] [Created] (BEAM-4075) Verify that the Build works on MacOS

2018-04-13 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-4075: --- Summary: Verify that the Build works on MacOS Key: BEAM-4075 URL: https://issues.apache.org/jira/browse/BEAM-4075 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-4028) Step / Operation naming should rely on a NameContext class

2018-04-06 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-4028: --- Summary: Step / Operation naming should rely on a NameContext class Key: BEAM-4028 URL: https://issues.apache.org/jira/browse/BEAM-4028 Project: Beam Issue

[jira] [Commented] (BEAM-4105) Python Postcommit suite does not start on Jenkins - proto generation failed

2018-04-18 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442725#comment-16442725 ] Pablo Estrada commented on BEAM-4105: - Good : ) > Python Postcommit suite does not start on Jenkins -

[jira] [Commented] (BEAM-3669) Linter error in statesampler_fast

2018-04-16 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16439860#comment-16439860 ] Pablo Estrada commented on BEAM-3669: - Investigation by Boyuan is that this error happens when the

[jira] [Comment Edited] (BEAM-4059) Make sure Dataflow ValidatesRunner tests pass in Gradle

2018-04-16 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16436260#comment-16436260 ] Pablo Estrada edited comment on BEAM-4059 at 4/16/18 9:48 PM: -- I think for now

[jira] [Created] (BEAM-4094) Remove ScopedMetricsContainer from Python SDK

2018-04-16 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-4094: --- Summary: Remove ScopedMetricsContainer from Python SDK Key: BEAM-4094 URL: https://issues.apache.org/jira/browse/BEAM-4094 Project: Beam Issue Type: Sub-task

[jira] [Commented] (BEAM-4105) Python Postcommit suite does not start on Jenkins - proto generation failed

2018-04-17 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16441678#comment-16441678 ] Pablo Estrada commented on BEAM-4105: - I am not 100% sure, but I think this happens because pip install

[jira] [Created] (BEAM-3955) Need a way to translate step names for Beam names and runner names

2018-03-27 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-3955: --- Summary: Need a way to translate step names for Beam names and runner names Key: BEAM-3955 URL: https://issues.apache.org/jira/browse/BEAM-3955 Project: Beam

[jira] [Assigned] (BEAM-3926) Support MetricsPusher in Dataflow Runner

2018-03-26 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-3926: --- Assignee: Pablo Estrada (was: Thomas Groh) > Support MetricsPusher in Dataflow Runner >

[jira] [Commented] (BEAM-3926) Support MetricsPusher in Dataflow Runner

2018-03-26 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414321#comment-16414321 ] Pablo Estrada commented on BEAM-3926: - [~echauchot] I'll start looking at what it takes to support this

[jira] [Assigned] (BEAM-1618) Add Gauge metric type to Python SDK

2018-04-02 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-1618: --- Assignee: Pablo Estrada > Add Gauge metric type to Python SDK >

[jira] [Commented] (BEAM-3926) Support MetricsPusher in Dataflow Runner

2018-03-26 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414599#comment-16414599 ] Pablo Estrada commented on BEAM-3926: - Yes, Scott asked me to look into this : ) > Support

[jira] [Resolved] (BEAM-3563) Revise Fn API metrics protos

2018-03-20 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-3563. - Resolution: Fixed Fix Version/s: 2.3.0 > Revise Fn API metrics protos >

[jira] [Closed] (BEAM-3570) More elegant interface for RuntimeValueProvider

2018-03-20 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada closed BEAM-3570. --- Resolution: Fixed Fix Version/s: 2.3.0 > More elegant interface for RuntimeValueProvider >

[jira] [Commented] (BEAM-4649) Failures in beam_PostCommit_Py_ValCont due to exception in read_log_control_messages

2018-06-28 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16526893#comment-16526893 ] Pablo Estrada commented on BEAM-4649: - Are these logs in Jenkins? Can you point them to me? >

[jira] [Commented] (BEAM-5648) Test failure: test_as_list_and_as_dict_side_inputs (beam_PostCommit_Py_VR_Dataflow)

2018-10-05 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640170#comment-16640170 ] Pablo Estrada commented on BEAM-5648: - Just to be sure, why is this solved by the quota increase? >

[jira] [Created] (BEAM-5679) Beam should report the account used to attempt to submit a job to Dataflow

2018-10-08 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-5679: --- Summary: Beam should report the account used to attempt to submit a job to Dataflow Key: BEAM-5679 URL: https://issues.apache.org/jira/browse/BEAM-5679 Project: Beam

[jira] [Commented] (BEAM-5648) Test failure: test_as_list_and_as_dict_side_inputs (beam_PostCommit_Py_VR_Dataflow)

2018-10-04 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638680#comment-16638680 ] Pablo Estrada commented on BEAM-5648: - Sometimes this sort of error occurs because pypi is flaky. It

[jira] [Created] (BEAM-5684) Need a test that verifies Flattening / not-flattening of BQ nested records

2018-10-08 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-5684: --- Summary: Need a test that verifies Flattening / not-flattening of BQ nested records Key: BEAM-5684 URL: https://issues.apache.org/jira/browse/BEAM-5684 Project: Beam

[jira] [Commented] (BEAM-5685) TopWikipediaSessionsIT is flaky

2018-10-08 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642631#comment-16642631 ] Pablo Estrada commented on BEAM-5685: - Checksum seems to vary. Fixing. > TopWikipediaSessionsIT is

[jira] [Created] (BEAM-5685) TopWikipediaSessionsIT is flaky

2018-10-08 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-5685: --- Summary: TopWikipediaSessionsIT is flaky Key: BEAM-5685 URL: https://issues.apache.org/jira/browse/BEAM-5685 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-5683) [beam_PostCommit_Py_VR_Dataflow] [test_multiple_empty_outputs] Failure summary

2018-10-09 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643661#comment-16643661 ] Pablo Estrada commented on BEAM-5683: - I'll take a look in a bit > [beam_PostCommit_Py_VR_Dataflow]

[jira] [Created] (BEAM-5608) KeyError on Python 3 when checking environment var BEAM_EXPERIMENTAL_PY3

2018-10-02 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-5608: --- Summary: KeyError on Python 3 when checking environment var BEAM_EXPERIMENTAL_PY3 Key: BEAM-5608 URL: https://issues.apache.org/jira/browse/BEAM-5608 Project: Beam

[jira] [Created] (BEAM-5609) Improve Grafana dashboard: Add local testing infrastructure

2018-10-02 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-5609: --- Summary: Improve Grafana dashboard: Add local testing infrastructure Key: BEAM-5609 URL: https://issues.apache.org/jira/browse/BEAM-5609 Project: Beam Issue

[jira] [Created] (BEAM-5712) Need an integration test for Datastore IO in Python

2018-10-10 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-5712: --- Summary: Need an integration test for Datastore IO in Python Key: BEAM-5712 URL: https://issues.apache.org/jira/browse/BEAM-5712 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-5534) AutocompleteIT and WikiTopSessionsIT fail in google testing

2018-10-01 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-5534: --- Summary: AutocompleteIT and WikiTopSessionsIT fail in google testing Key: BEAM-5534 URL: https://issues.apache.org/jira/browse/BEAM-5534 Project: Beam Issue

[jira] [Commented] (BEAM-5683) [beam_PostCommit_Py_VR_Dataflow] [test_multiple_empty_outputs] Fails due to pip download flake

2018-10-09 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644065#comment-16644065 ] Pablo Estrada commented on BEAM-5683: - it's possible to get the output from the subprocess with

[jira] [Created] (BEAM-5693) Python SDK tests failing on Windows

2018-10-09 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-5693: --- Summary: Python SDK tests failing on Windows Key: BEAM-5693 URL: https://issues.apache.org/jira/browse/BEAM-5693 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-5498) Flatten transform error when not passed iterable could be better

2018-09-25 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-5498: --- Summary: Flatten transform error when not passed iterable could be better Key: BEAM-5498 URL: https://issues.apache.org/jira/browse/BEAM-5498 Project: Beam

[jira] [Resolved] (BEAM-4432) Performance tests need a way to generate Synthetic data

2018-09-12 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-4432. - Resolution: Fixed Fix Version/s: 2.7.0 > Performance tests need a way to generate

[jira] [Resolved] (BEAM-5186) Support for NUMERIC data type in BQ

2018-09-12 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-5186. - Resolution: Fixed Fix Version/s: 2.7.0 > Support for NUMERIC data type in BQ >

[jira] [Created] (BEAM-5377) Add better integration test coverage for beam

2018-09-12 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-5377: --- Summary: Add better integration test coverage for beam Key: BEAM-5377 URL: https://issues.apache.org/jira/browse/BEAM-5377 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-5390) Simplify special-casing of TopWikipediaSessions JSON deserializer

2018-09-14 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-5390: --- Summary: Simplify special-casing of TopWikipediaSessions JSON deserializer Key: BEAM-5390 URL: https://issues.apache.org/jira/browse/BEAM-5390 Project: Beam

[jira] [Resolved] (BEAM-4417) BigqueryIO Numeric datatype Support

2018-09-18 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-4417. - Resolution: Fixed Fix Version/s: (was: 2.8.0) 2.7.0 This will be

<    1   2   3