[jira] [Created] (BEAM-1366) Add metrics checks to Python SDK once metrics have been implemented

2017-01-31 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-1366: --- Summary: Add metrics checks to Python SDK once metrics have been implemented Key: BEAM-1366 URL: https://issues.apache.org/jira/browse/BEAM-1366 Project: Beam

[jira] [Created] (BEAM-1442) Performance improvement of the Python DirectRunner

2017-02-08 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-1442: --- Summary: Performance improvement of the Python DirectRunner Key: BEAM-1442 URL: https://issues.apache.org/jira/browse/BEAM-1442 Project: Beam Issue Type:

[jira] [Created] (BEAM-1383) Consistency in the Metrics examples

2017-02-02 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-1383: --- Summary: Consistency in the Metrics examples Key: BEAM-1383 URL: https://issues.apache.org/jira/browse/BEAM-1383 Project: Beam Issue Type: Bug

[jira] [Comment Edited] (BEAM-1442) Performance improvement of the Python DirectRunner

2017-02-22 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879034#comment-15879034 ] Pablo Estrada edited comment on BEAM-1442 at 2/22/17 7:50 PM: -- Before we can

[jira] [Comment Edited] (BEAM-1442) Performance improvement of the Python DirectRunner

2017-02-22 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879034#comment-15879034 ] Pablo Estrada edited comment on BEAM-1442 at 2/22/17 9:43 PM: -- Hi Haoxiang,

[jira] [Comment Edited] (BEAM-1442) Performance improvement of the Python DirectRunner

2017-02-22 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879034#comment-15879034 ] Pablo Estrada edited comment on BEAM-1442 at 2/22/17 9:43 PM: -- Hi Haoxiang,

[jira] [Commented] (BEAM-1442) Performance improvement of the Python DirectRunner

2017-02-22 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879034#comment-15879034 ] Pablo Estrada commented on BEAM-1442: - For a proposal you should include (1) Introduction - Introduce

[jira] [Created] (BEAM-1459) Dataflow runner has deprecated metricsUpdates in favor of counterUpdates. Add setters.

2017-02-10 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-1459: --- Summary: Dataflow runner has deprecated metricsUpdates in favor of counterUpdates. Add setters. Key: BEAM-1459 URL: https://issues.apache.org/jira/browse/BEAM-1459

[jira] [Created] (BEAM-1502) CombinePerKey returns a list of lists when run locally, but something else when run on Dataflow

2017-02-16 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-1502: --- Summary: CombinePerKey returns a list of lists when run locally, but something else when run on Dataflow Key: BEAM-1502 URL: https://issues.apache.org/jira/browse/BEAM-1502

[jira] [Commented] (BEAM-780) Add support for pipeline metrics

2017-02-15 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868816#comment-15868816 ] Pablo Estrada commented on BEAM-780: Should we mark this a resolved? > Add support for pipeline metrics

[jira] [Created] (BEAM-1275) Remove aggregators from Python

2017-01-17 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-1275: --- Summary: Remove aggregators from Python Key: BEAM-1275 URL: https://issues.apache.org/jira/browse/BEAM-1275 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-1275) Remove aggregators from Python

2017-01-17 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15826662#comment-15826662 ] Pablo Estrada commented on BEAM-1275: - I'm working on this. > Remove aggregators from Python >

[jira] [Commented] (BEAM-1442) Performance improvement of the Python DirectRunner

2017-02-27 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886369#comment-15886369 ] Pablo Estrada commented on BEAM-1442: - You can share a draft of your proposal in Google docs with us.

[jira] [Commented] (BEAM-775) Remove Aggregators from the Java SDK

2017-03-21 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935079#comment-15935079 ] Pablo Estrada commented on BEAM-775: Is Flink the only runner missing Metric support? How about the Apex

[jira] [Created] (BEAM-1803) Metrics filters have a missmatch in class-based namespace

2017-03-24 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-1803: --- Summary: Metrics filters have a missmatch in class-based namespace Key: BEAM-1803 URL: https://issues.apache.org/jira/browse/BEAM-1803 Project: Beam Issue

[jira] [Created] (BEAM-1792) Spark runner uses its own filtering logic to match metrics

2017-03-23 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-1792: --- Summary: Spark runner uses its own filtering logic to match metrics Key: BEAM-1792 URL: https://issues.apache.org/jira/browse/BEAM-1792 Project: Beam Issue

[jira] [Commented] (BEAM-775) Remove Aggregators from the Java SDK

2017-03-22 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937244#comment-15937244 ] Pablo Estrada commented on BEAM-775: I have a PR (https://github.com/apache/beam/pull/2291) that changes

[jira] [Commented] (BEAM-780) Add support for pipeline metrics

2017-03-17 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15930705#comment-15930705 ] Pablo Estrada commented on BEAM-780: Yes. > Add support for pipeline metrics >

[jira] [Commented] (BEAM-850) Add Display Data to the Python Transforms, Sinks, Sources, etc.

2017-03-17 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15930707#comment-15930707 ] Pablo Estrada commented on BEAM-850: Yes. > Add Display Data to the Python Transforms, Sinks, Sources,

[jira] [Commented] (BEAM-1555) Python post commits failing

2017-03-17 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15930709#comment-15930709 ] Pablo Estrada commented on BEAM-1555: - Not yet. > Python post commits failing >

[jira] [Resolved] (BEAM-1212) Fix details of using worker_machine_type in Python

2017-03-17 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-1212. - Resolution: Fixed Fix Version/s: 0.5.0 > Fix details of using worker_machine_type in Python

[jira] [Created] (BEAM-1764) Remove aggregators from Flink Runner

2017-03-20 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-1764: --- Summary: Remove aggregators from Flink Runner Key: BEAM-1764 URL: https://issues.apache.org/jira/browse/BEAM-1764 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-1766) Remove Aggregators from Apex runner

2017-03-20 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-1766: --- Summary: Remove Aggregators from Apex runner Key: BEAM-1766 URL: https://issues.apache.org/jira/browse/BEAM-1766 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-1103) Add Tests For Aggregators in Flink Runner

2017-03-20 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933620#comment-15933620 ] Pablo Estrada commented on BEAM-1103: - Perhaps we should close this since aggregators are being

[jira] [Created] (BEAM-1767) Remove Aggregators from Dataflow runner

2017-03-20 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-1767: --- Summary: Remove Aggregators from Dataflow runner Key: BEAM-1767 URL: https://issues.apache.org/jira/browse/BEAM-1767 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-1765) Remove Aggregators from Spark runner

2017-03-20 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-1765: --- Summary: Remove Aggregators from Spark runner Key: BEAM-1765 URL: https://issues.apache.org/jira/browse/BEAM-1765 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-536) Aggregator.py. More misleading documentation. More bad documentation

2017-03-20 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933618#comment-15933618 ] Pablo Estrada commented on BEAM-536: Maybe mark as resolved? > Aggregator.py. More misleading

[jira] [Commented] (BEAM-775) Remove Aggregators from the Java SDK

2017-03-21 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935609#comment-15935609 ] Pablo Estrada commented on BEAM-775: `TestSparkRunner` does check the values of the success/failure

[jira] [Commented] (BEAM-1575) Add ValidatesRunner test to PipelineTest.test_metrics_in_source

2017-04-06 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959427#comment-15959427 ] Pablo Estrada commented on BEAM-1575: - I have not made any progress, because it seems like there's no

[jira] [Created] (BEAM-1898) Need a SerializableThrowable for PAssert to capture the point of an assertion

2017-04-05 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-1898: --- Summary: Need a SerializableThrowable for PAssert to capture the point of an assertion Key: BEAM-1898 URL: https://issues.apache.org/jira/browse/BEAM-1898 Project:

[jira] [Resolved] (BEAM-1381) Implement DataflowMetrics.query method

2017-04-05 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-1381. - Resolution: Fixed Fix Version/s: First stable release > Implement DataflowMetrics.query

[jira] [Resolved] (BEAM-1572) Add per-stage matching of scope in metrics for the DirectRunner

2017-04-05 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-1572. - Resolution: Fixed Fix Version/s: First stable release > Add per-stage matching of scope in

[jira] [Commented] (BEAM-1366) Add metrics checks to Python SDK once metrics have been implemented

2017-04-17 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971138#comment-15971138 ] Pablo Estrada commented on BEAM-1366: - I have not marked as fixed because we don't support querying of

[jira] [Commented] (BEAM-1555) Python post commits failing

2017-04-17 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971140#comment-15971140 ] Pablo Estrada commented on BEAM-1555: - Yes. we can close this issue. > Python post commits failing >

[jira] [Commented] (BEAM-1947) DisplayData raises exception when passed unicode string

2017-04-17 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971142#comment-15971142 ] Pablo Estrada commented on BEAM-1947: - This was fixed in

[jira] [Commented] (BEAM-1618) Add Gauge metric type to Python SDK

2017-04-17 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971147#comment-15971147 ] Pablo Estrada commented on BEAM-1618: - For reference, https://github.com/apache/beam/pull/2151/files

[jira] [Commented] (BEAM-1986) Job ALREADY_EXISTS in post commit

2017-04-17 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15972105#comment-15972105 ] Pablo Estrada commented on BEAM-1986: - Are tests running in parallel here? If they are running in

[jira] [Closed] (BEAM-1270) Display data for ReadFromText/WriteToText is not being shown

2017-04-17 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada closed BEAM-1270. --- > Display data for ReadFromText/WriteToText is not being shown >

[jira] [Closed] (BEAM-1101) Remove inconsistencies in Python PipelineOptions

2017-04-17 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada closed BEAM-1101. --- > Remove inconsistencies in Python PipelineOptions > > >

[jira] [Created] (BEAM-1575) Add ValidatesRunner test to PipelineTest.test_metrics_in_source

2017-02-28 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-1575: --- Summary: Add ValidatesRunner test to PipelineTest.test_metrics_in_source Key: BEAM-1575 URL: https://issues.apache.org/jira/browse/BEAM-1575 Project: Beam

[jira] [Assigned] (BEAM-1555) Python post commits failing

2017-02-28 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-1555: --- Assignee: Pablo Estrada (was: Ahmet Altay) > Python post commits failing >

[jira] [Assigned] (BEAM-1575) Add ValidatesRunner test to PipelineTest.test_metrics_in_source

2017-02-28 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-1575: --- Assignee: Pablo Estrada (was: Ahmet Altay) > Add ValidatesRunner test to

[jira] [Assigned] (BEAM-1555) Python post commits failing

2017-02-28 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-1555: --- Assignee: Ahmet Altay (was: Pablo Estrada) > Python post commits failing >

[jira] [Resolved] (BEAM-1262) Need tests that use metrics in start_bundle / end_bundle functions

2017-04-17 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-1262. - Resolution: Fixed Fix Version/s: 0.6.0 Fixed. > Need tests that use metrics in

[jira] [Created] (BEAM-2708) Support for pbzip2 in IO

2017-08-01 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-2708: --- Summary: Support for pbzip2 in IO Key: BEAM-2708 URL: https://issues.apache.org/jira/browse/BEAM-2708 Project: Beam Issue Type: Bug Components:

[jira] [Created] (BEAM-2724) MSEC counters should support Structured Names in Dataflow

2017-08-03 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-2724: --- Summary: MSEC counters should support Structured Names in Dataflow Key: BEAM-2724 URL: https://issues.apache.org/jira/browse/BEAM-2724 Project: Beam Issue

[jira] [Created] (BEAM-2084) Distribution metrics should be queriable in the Dataflow Runner

2017-04-26 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-2084: --- Summary: Distribution metrics should be queriable in the Dataflow Runner Key: BEAM-2084 URL: https://issues.apache.org/jira/browse/BEAM-2084 Project: Beam

[jira] [Resolved] (BEAM-1575) Add ValidatesRunner test to PipelineTest.test_metrics_in_source

2017-04-27 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-1575. - Resolution: Fixed Fix Version/s: First stable release > Add ValidatesRunner test to

[jira] [Commented] (BEAM-2071) AttributeError in dataflow_metrics

2017-04-27 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986988#comment-15986988 ] Pablo Estrada commented on BEAM-2071: - Followup fix tracked by BEAM-2084 > AttributeError in

[jira] [Commented] (BEAM-2071) AttributeError in dataflow_metrics

2017-04-27 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987110#comment-15987110 ] Pablo Estrada commented on BEAM-2071: - Yes (it won't let me close it but this is ready to be closed).

[jira] [Created] (BEAM-2732) State tracking in Python is inefficient and has duplicated code

2017-08-04 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-2732: --- Summary: State tracking in Python is inefficient and has duplicated code Key: BEAM-2732 URL: https://issues.apache.org/jira/browse/BEAM-2732 Project: Beam

[jira] [Assigned] (BEAM-2732) State tracking in Python is inefficient and has duplicated code

2017-08-04 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-2732: --- Assignee: Pablo Estrada (was: Ahmet Altay) > State tracking in Python is inefficient and has

[jira] [Commented] (BEAM-93) Support Compute Engine Subnetworks

2017-05-15 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-93?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011429#comment-16011429 ] Pablo Estrada commented on BEAM-93: --- It seems that the Pyhton SDK does not support this. I'm working on a

[jira] [Updated] (BEAM-2205) AttributeError when running datastore wordcount

2017-05-07 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-2205: Ugh. Sorry about that. I'll fix that tonight. > AttributeError when running datastore wordcount >

[jira] [Commented] (BEAM-2205) AttributeError when running datastore wordcount

2017-05-08 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001677#comment-16001677 ] Pablo Estrada commented on BEAM-2205: - This can be closed now. > AttributeError when running datastore

[jira] [Closed] (BEAM-1366) Add metrics checks to Python SDK once metrics have been implemented

2017-05-05 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada closed BEAM-1366. --- > Add metrics checks to Python SDK once metrics have been implemented >

[jira] [Resolved] (BEAM-1366) Add metrics checks to Python SDK once metrics have been implemented

2017-05-05 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-1366. - Resolution: Fixed Fix Version/s: First stable release > Add metrics checks to Python SDK

[jira] [Resolved] (BEAM-2084) Distribution metrics should be queriable in the Dataflow Runner

2017-09-21 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-2084. - Resolution: Fixed Fix Version/s: 2.0.0 > Distribution metrics should be queriable in the

[jira] [Created] (BEAM-3013) The Python worker should report lulls

2017-10-03 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-3013: --- Summary: The Python worker should report lulls Key: BEAM-3013 URL: https://issues.apache.org/jira/browse/BEAM-3013 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-3042) Add tracking of bytes read / time spent when reading side inputs

2017-10-10 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-3042: --- Summary: Add tracking of bytes read / time spent when reading side inputs Key: BEAM-3042 URL: https://issues.apache.org/jira/browse/BEAM-3042 Project: Beam

[jira] [Created] (BEAM-3015) Need logging from C threads in Cython

2017-10-04 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-3015: --- Summary: Need logging from C threads in Cython Key: BEAM-3015 URL: https://issues.apache.org/jira/browse/BEAM-3015 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-3023) Python Post commits failing with StateSamplerTest and SlowCoders tests

2017-10-05 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-3023: Priority: Major (was: Critical) > Python Post commits failing with StateSamplerTest and SlowCoders

[jira] [Commented] (BEAM-3023) Python Post commits failing with StateSamplerTest and SlowCoders tests

2017-10-05 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193767#comment-16193767 ] Pablo Estrada commented on BEAM-3023: - That run was for a PR that has not been merged. (I had closed it

[jira] [Updated] (BEAM-3042) Add tracking of bytes read / time spent when reading side inputs

2017-10-10 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-3042: Description: It is difficult for Dataflow users to understand how modifying a pipeline or data set

[jira] [Created] (BEAM-3078) Source split operations do not support metrics reported correctly

2017-10-19 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-3078: --- Summary: Source split operations do not support metrics reported correctly Key: BEAM-3078 URL: https://issues.apache.org/jira/browse/BEAM-3078 Project: Beam

[jira] [Resolved] (BEAM-2724) MSEC counters should support Structured Names in Dataflow

2017-12-12 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-2724. - Resolution: Fixed Fix Version/s: 2.2.0 > MSEC counters should support Structured Names in

[jira] [Created] (BEAM-3148) Templates shouldn't have region option populated

2017-11-06 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-3148: --- Summary: Templates shouldn't have region option populated Key: BEAM-3148 URL: https://issues.apache.org/jira/browse/BEAM-3148 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-2484) Add streaming examples for Python

2017-12-11 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16286816#comment-16286816 ] Pablo Estrada commented on BEAM-2484: - Can we mark this issue as closed? > Add streaming examples for

[jira] [Commented] (BEAM-2265) Python word count with DirectRunner gets stuck during application termination on Windows

2017-12-11 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16286836#comment-16286836 ] Pablo Estrada commented on BEAM-2265: - Should this be closed? > Python word count with DirectRunner

[jira] [Commented] (BEAM-3015) Need logging from C threads in Cython

2017-12-11 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16286849#comment-16286849 ] Pablo Estrada commented on BEAM-3015: - This issue is currently in pause - as for Python logging we'd

[jira] [Commented] (BEAM-2637) Post commit test for mobile gaming examples

2017-12-11 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16286832#comment-16286832 ] Pablo Estrada commented on BEAM-2637: - Is this fixed? > Post commit test for mobile gaming examples >

[jira] [Commented] (BEAM-2814) test_as_singleton_with_different_defaults test is flaky

2017-12-11 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16286830#comment-16286830 ] Pablo Estrada commented on BEAM-2814: - Can this be closed? > test_as_singleton_with_different_defaults

[jira] [Updated] (BEAM-2104) Consider adding interactive notebooks as examples

2017-12-11 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-2104: Labels: community-onboarding (was: ) > Consider adding interactive notebooks as examples >

[jira] [Resolved] (BEAM-3013) The Python worker should report lulls

2017-12-11 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-3013. - Resolution: Fixed Fix Version/s: 2.3.0 > The Python worker should report lulls >

[jira] [Created] (BEAM-4268) Metrics and State Sampler integration is troublesome in Dataflow

2018-05-10 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-4268: --- Summary: Metrics and State Sampler integration is troublesome in Dataflow Key: BEAM-4268 URL: https://issues.apache.org/jira/browse/BEAM-4268 Project: Beam

[jira] [Commented] (BEAM-4268) Metrics and State Sampler integration is troublesome in Dataflow

2018-05-10 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470738#comment-16470738 ] Pablo Estrada commented on BEAM-4268: - Here's a passing postcommit under that PR. It runs streaming

[jira] [Commented] (BEAM-4268) Metrics and State Sampler integration is troublesome in Dataflow

2018-05-10 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470737#comment-16470737 ] Pablo Estrada commented on BEAM-4268: - Here's a passing postcommit under that PR. It runs streaming

[jira] [Updated] (BEAM-4268) Metrics and State Sampler integration is troublesome in Dataflow

2018-05-10 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada updated BEAM-4268: Priority: Blocker (was: Major) > Metrics and State Sampler integration is troublesome in Dataflow >

[jira] [Commented] (BEAM-4268) Metrics and State Sampler integration is troublesome in Dataflow

2018-05-10 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470867#comment-16470867 ] Pablo Estrada commented on BEAM-4268: - Do you have Pubsub topics available that I could borrow to test

[jira] [Created] (BEAM-4273) Combine operations and some others missing context switch

2018-05-10 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-4273: --- Summary: Combine operations and some others missing context switch Key: BEAM-4273 URL: https://issues.apache.org/jira/browse/BEAM-4273 Project: Beam Issue

[jira] [Commented] (BEAM-4268) Metrics and State Sampler integration is troublesome in Dataflow

2018-05-11 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16472175#comment-16472175 ] Pablo Estrada commented on BEAM-4268: - I've tested this. Fixed. > Metrics and State Sampler

[jira] [Resolved] (BEAM-4268) Metrics and State Sampler integration is troublesome in Dataflow

2018-05-11 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-4268. - Resolution: Fixed > Metrics and State Sampler integration is troublesome in Dataflow >

[jira] [Commented] (BEAM-4268) Metrics and State Sampler integration is troublesome in Dataflow

2018-05-11 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16472176#comment-16472176 ] Pablo Estrada commented on BEAM-4268: - PR was https://github.com/apache/beam/pull/5323 > Metrics and

[jira] [Created] (BEAM-4278) User Metrics for Python streaming job are missing in Dataflow

2018-05-11 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-4278: --- Summary: User Metrics for Python streaming job are missing in Dataflow Key: BEAM-4278 URL: https://issues.apache.org/jira/browse/BEAM-4278 Project: Beam

[jira] [Created] (BEAM-4274) Fix Metrics / Runner dependencies

2018-05-10 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-4274: --- Summary: Fix Metrics / Runner dependencies Key: BEAM-4274 URL: https://issues.apache.org/jira/browse/BEAM-4274 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-2850) Add Nexmark to Beam Continuous Integration

2018-05-15 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476231#comment-16476231 ] Pablo Estrada commented on BEAM-2850: - It would be great if this could also export to Bigquery and show

[jira] [Created] (BEAM-4332) Python ValidatesRunner tests seem to be failing

2018-05-17 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-4332: --- Summary: Python ValidatesRunner tests seem to be failing Key: BEAM-4332 URL: https://issues.apache.org/jira/browse/BEAM-4332 Project: Beam Issue Type: Bug

[jira] [Assigned] (BEAM-1755) Python-SDK: Move build specific scripts to a dedicated folder

2018-05-17 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-1755: --- Assignee: Pablo Estrada > Python-SDK: Move build specific scripts to a dedicated folder >

[jira] [Created] (BEAM-4300) Duplicated code for ValidatesRunner / PostCommit tests in Python

2018-05-16 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-4300: --- Summary: Duplicated code for ValidatesRunner / PostCommit tests in Python Key: BEAM-4300 URL: https://issues.apache.org/jira/browse/BEAM-4300 Project: Beam

[jira] [Commented] (BEAM-4298) Perfkit runs are always "official" while running them with Jenkins

2018-05-16 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16477973#comment-16477973 ] Pablo Estrada commented on BEAM-4298: - I would be worried of using this approach because we may end up

[jira] [Created] (BEAM-4534) Errors in the mobile gaming GameStats pipeline

2018-06-11 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-4534: --- Summary: Errors in the mobile gaming GameStats pipeline Key: BEAM-4534 URL: https://issues.apache.org/jira/browse/BEAM-4534 Project: Beam Issue Type:

[jira] [Created] (BEAM-4554) Move sdks/java/core's applyJavaNature back to failOnWarnings: true

2018-06-13 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-4554: --- Summary: Move sdks/java/core's applyJavaNature back to failOnWarnings: true Key: BEAM-4554 URL: https://issues.apache.org/jira/browse/BEAM-4554 Project: Beam

[jira] [Commented] (BEAM-4554) Move sdks/java/core's applyJavaNature back to failOnWarnings: true

2018-06-13 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511697#comment-16511697 ] Pablo Estrada commented on BEAM-4554: - https://issues.apache.org/jira/browse/BEAM-4556 > Move

[jira] [Created] (BEAM-4558) org.apache.beam.runners.direct.portable.ReferenceRunnerTest » pipelineExecution failure in 2.5.0 release branch

2018-06-13 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-4558: --- Summary: org.apache.beam.runners.direct.portable.ReferenceRunnerTest » pipelineExecution failure in 2.5.0 release branch Key: BEAM-4558 URL:

[jira] [Closed] (BEAM-4554) Move sdks/java/core's applyJavaNature back to failOnWarnings: true

2018-06-13 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada closed BEAM-4554. --- Resolution: Duplicate Fix Version/s: Not applicable > Move sdks/java/core's applyJavaNature

[jira] [Assigned] (BEAM-4558) org.apache.beam.runners.direct.portable.ReferenceRunnerTest » pipelineExecution failure in 2.5.0 release branch

2018-06-13 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada reassigned BEAM-4558: --- Assignee: Pablo Estrada (was: Thomas Groh) >

[jira] [Resolved] (BEAM-4558) org.apache.beam.runners.direct.portable.ReferenceRunnerTest » pipelineExecution failure in 2.5.0 release branch

2018-06-14 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pablo Estrada resolved BEAM-4558. - Resolution: Fixed Fix Version/s: 2.5.0 >

[jira] [Created] (BEAM-4432) Performance tests need a way to generate Synthetic data

2018-05-30 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-4432: --- Summary: Performance tests need a way to generate Synthetic data Key: BEAM-4432 URL: https://issues.apache.org/jira/browse/BEAM-4432 Project: Beam Issue Type:

[jira] [Commented] (BEAM-4432) Performance tests need a way to generate Synthetic data

2018-05-31 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16496870#comment-16496870 ] Pablo Estrada commented on BEAM-4432: - Hi Ismael! I understand your concerns. The code for these

[jira] [Comment Edited] (BEAM-4432) Performance tests need a way to generate Synthetic data

2018-05-31 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16496870#comment-16496870 ] Pablo Estrada edited comment on BEAM-4432 at 5/31/18 5:16 PM: -- Hi Ismael! I

  1   2   3   >