[jira] [Comment Edited] (BEAM-2980) BagState.isEmpty needs a tighter spec

[ https://issues.apache.org/jira/browse/BEAM-2980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16487964#comment-16487964 ] Ben Chambers edited comment on BEAM-2980 at 5/23/18 8:15 PM: - I think

[jira] [Commented] (BEAM-2980) BagState.isEmpty needs a tighter spec

[ https://issues.apache.org/jira/browse/BEAM-2980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16487964#comment-16487964 ] Ben Chambers commented on BEAM-2980: I think `StateFuture` was considered, but intentionally not used

[jira] [Resolved] (BEAM-3806) DirectRunner hangs if multiple timers set in the same bundle

[ https://issues.apache.org/jira/browse/BEAM-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers resolved BEAM-3806. Resolution: Fixed Fix Version/s: 2.5.0 Fixed by PR https://github.com/apache/beam/pull/4829

[jira] [Created] (BEAM-3825) Gradle presubmit not running all tests

Ben Chambers created BEAM-3825: -- Summary: Gradle presubmit not running all tests Key: BEAM-3825 URL: https://issues.apache.org/jira/browse/BEAM-3825 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-3806) DirectRunner hangs if multiple timers set in the same bundle

Ben Chambers created BEAM-3806: -- Summary: DirectRunner hangs if multiple timers set in the same bundle Key: BEAM-3806 URL: https://issues.apache.org/jira/browse/BEAM-3806 Project: Beam Issue

[jira] [Created] (BEAM-3159) DoFnTester should be deprecated in favor of TestPipeline

Ben Chambers created BEAM-3159: -- Summary: DoFnTester should be deprecated in favor of TestPipeline Key: BEAM-3159 URL: https://issues.apache.org/jira/browse/BEAM-3159 Project: Beam Issue Type:

[jira] [Commented] (BEAM-2058) BigQuery load job id should be generated at run time, not submission time

[ https://issues.apache.org/jira/browse/BEAM-2058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183303#comment-16183303 ] Ben Chambers commented on BEAM-2058: Reuven -- it looks like the PR went in to fix this. Should it be

[jira] [Created] (BEAM-2996) Metric names should not be null or empty

Ben Chambers created BEAM-2996: -- Summary: Metric names should not be null or empty Key: BEAM-2996 URL: https://issues.apache.org/jira/browse/BEAM-2996 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-2982) PubSubIO.readMessages().fromSubscription(...) doesn't work with ValueProvider

Ben Chambers created BEAM-2982: -- Summary: PubSubIO.readMessages().fromSubscription(...) doesn't work with ValueProvider Key: BEAM-2982 URL: https://issues.apache.org/jira/browse/BEAM-2982 Project: Beam

[jira] [Commented] (BEAM-2577) IO tests should exercise Runtime Values where supported

[ https://issues.apache.org/jira/browse/BEAM-2577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139077#comment-16139077 ] Ben Chambers commented on BEAM-2577: I think that PR demonstrates one place we could do this. This bug

[jira] [Created] (BEAM-2758) ParDo should indicate what "features" are used in DisplayData

Ben Chambers created BEAM-2758: -- Summary: ParDo should indicate what "features" are used in DisplayData Key: BEAM-2758 URL: https://issues.apache.org/jira/browse/BEAM-2758 Project: Beam Issue

[jira] [Updated] (BEAM-2708) Decompressing bzip2 files with multiple "streams" only reads the first stream

[ https://issues.apache.org/jira/browse/BEAM-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers updated BEAM-2708: --- Summary: Decompressing bzip2 files with multiple "streams" only reads the first stream (was: Support

[jira] [Comment Edited] (BEAM-2708) Support for pbzip2 in IO

[ https://issues.apache.org/jira/browse/BEAM-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109703#comment-16109703 ] Ben Chambers edited comment on BEAM-2708 at 8/1/17 8:35 PM: This looks to be a

[jira] [Comment Edited] (BEAM-2708) Support for pbzip2 in IO

[ https://issues.apache.org/jira/browse/BEAM-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109703#comment-16109703 ] Ben Chambers edited comment on BEAM-2708 at 8/1/17 8:35 PM: This looks to be a

[jira] [Comment Edited] (BEAM-2708) Support for pbzip2 in IO

[ https://issues.apache.org/jira/browse/BEAM-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109703#comment-16109703 ] Ben Chambers edited comment on BEAM-2708 at 8/1/17 8:34 PM: This looks to be a

[jira] [Commented] (BEAM-2708) Support for pbzip2 in IO

[ https://issues.apache.org/jira/browse/BEAM-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109703#comment-16109703 ] Ben Chambers commented on BEAM-2708: This looks to be a bug in the CompressedSource support for BZIP2.

[jira] [Assigned] (BEAM-2708) Support for pbzip2 in IO

[ https://issues.apache.org/jira/browse/BEAM-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers reassigned BEAM-2708: -- Assignee: Ben Chambers (was: Chamikara Jayalath) > Support for pbzip2 in IO >

[jira] [Resolved] (BEAM-2059) Implement Metrics support for streaming Dataflow runner

[ https://issues.apache.org/jira/browse/BEAM-2059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers resolved BEAM-2059. Resolution: Fixed > Implement Metrics support for streaming Dataflow runner >

[jira] [Commented] (BEAM-2059) Implement Metrics support for streaming Dataflow runner

[ https://issues.apache.org/jira/browse/BEAM-2059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16084320#comment-16084320 ] Ben Chambers commented on BEAM-2059: This should be fixed in the Dataflow service in the next release.

[jira] [Assigned] (BEAM-2059) Implement Metrics support for streaming Dataflow runner

[ https://issues.apache.org/jira/browse/BEAM-2059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers reassigned BEAM-2059: -- Assignee: Ben Chambers Fix Version/s: 2.1.0 > Implement Metrics support for streaming

[jira] [Commented] (BEAM-2577) IO tests should exercise Runtime Values where supported

[ https://issues.apache.org/jira/browse/BEAM-2577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080633#comment-16080633 ] Ben Chambers commented on BEAM-2577: I looked for other places in the codebase that did this testing to

[jira] [Created] (BEAM-2577) IO tests should exercise Runtime Values where supported

Ben Chambers created BEAM-2577: -- Summary: IO tests should exercise Runtime Values where supported Key: BEAM-2577 URL: https://issues.apache.org/jira/browse/BEAM-2577 Project: Beam Issue Type:

[jira] [Commented] (BEAM-2491) Duplicate org.apache.beam.runners.core.metrics.pachage-info.class

[ https://issues.apache.org/jira/browse/BEAM-2491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057756#comment-16057756 ] Ben Chambers commented on BEAM-2491: That seems OK. I think both of the classes in the

[jira] [Created] (BEAM-2406) NullPointerException when writing an empty table to BigQuery

Ben Chambers created BEAM-2406: -- Summary: NullPointerException when writing an empty table to BigQuery Key: BEAM-2406 URL: https://issues.apache.org/jira/browse/BEAM-2406 Project: Beam Issue

[jira] [Created] (BEAM-2244) Move runner-facing Metrics classes to runners core

Ben Chambers created BEAM-2244: -- Summary: Move runner-facing Metrics classes to runners core Key: BEAM-2244 URL: https://issues.apache.org/jira/browse/BEAM-2244 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-2186) Use Accumulable MetricsContainers in the DirectRunner

Ben Chambers created BEAM-2186: -- Summary: Use Accumulable MetricsContainers in the DirectRunner Key: BEAM-2186 URL: https://issues.apache.org/jira/browse/BEAM-2186 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-2143) (Mis)Running Dataflow Wordcount gives non-helpful errors

[ https://issues.apache.org/jira/browse/BEAM-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997526#comment-15997526 ] Ben Chambers commented on BEAM-2143: I only noticed this when trying to run a Java SDK pipeline, but it

[jira] [Created] (BEAM-2162) Add logging during and after long running BigQuery jobs

Ben Chambers created BEAM-2162: -- Summary: Add logging during and after long running BigQuery jobs Key: BEAM-2162 URL: https://issues.apache.org/jira/browse/BEAM-2162 Project: Beam Issue Type:

[jira] [Commented] (BEAM-32) Consider not emitting empty ON_TIME pane unless requested

[ https://issues.apache.org/jira/browse/BEAM-32?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15995613#comment-15995613 ] Ben Chambers commented on BEAM-32: --

[jira] [Created] (BEAM-2143) (Mis)Running Dataflow Wordcount gives non-helpful errors

Ben Chambers created BEAM-2143: -- Summary: (Mis)Running Dataflow Wordcount gives non-helpful errors Key: BEAM-2143 URL: https://issues.apache.org/jira/browse/BEAM-2143 Project: Beam Issue Type:

[jira] [Resolved] (BEAM-135) Utilities for "batching" elements in a DoFn

[ https://issues.apache.org/jira/browse/BEAM-135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers resolved BEAM-135. --- Resolution: Fixed Fix Version/s: First stable release > Utilities for "batching" elements in a

[jira] [Commented] (BEAM-1261) State API should allow state to be managed in different windows

[ https://issues.apache.org/jira/browse/BEAM-1261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949730#comment-15949730 ] Ben Chambers commented on BEAM-1261: I believe this use case can be handled with a global window (for

[jira] [Commented] (BEAM-324) Improve TypeDescriptor inference of DoFn's created inside a generic PTransform

[ https://issues.apache.org/jira/browse/BEAM-324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949444#comment-15949444 ] Ben Chambers commented on BEAM-324: --- I think the specific work would be using the "infer TypeDescriptor

[jira] [Commented] (BEAM-775) Remove Aggregators from the Java SDK

[ https://issues.apache.org/jira/browse/BEAM-775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935735#comment-15935735 ] Ben Chambers commented on BEAM-775: --- (Note BEAM-1148 originally tracked porting PAssert off of

[jira] [Assigned] (BEAM-775) Remove Aggregators from the Java SDK

[ https://issues.apache.org/jira/browse/BEAM-775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers reassigned BEAM-775: - Assignee: Pablo Estrada (was: Ben Chambers) > Remove Aggregators from the Java SDK >

[jira] [Created] (BEAM-1738) DataflowRunner should override Reshuffle transform

Ben Chambers created BEAM-1738: -- Summary: DataflowRunner should override Reshuffle transform Key: BEAM-1738 URL: https://issues.apache.org/jira/browse/BEAM-1738 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-1656) DirectRunner should not call finalize twice in UnboundedSourceExecutorFactory

[ https://issues.apache.org/jira/browse/BEAM-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers updated BEAM-1656: --- Even then, we shouldn't call finalize before finishing using the restored instance, I think. >

[jira] [Created] (BEAM-1658) DirectRunner should sometimes encode/decode checkpoints

Ben Chambers created BEAM-1658: -- Summary: DirectRunner should sometimes encode/decode checkpoints Key: BEAM-1658 URL: https://issues.apache.org/jira/browse/BEAM-1658 Project: Beam Issue Type:

[jira] [Created] (BEAM-1657) DirectRunner should not call close twice in UnboundedSourceExecutorFactory

Ben Chambers created BEAM-1657: -- Summary: DirectRunner should not call close twice in UnboundedSourceExecutorFactory Key: BEAM-1657 URL: https://issues.apache.org/jira/browse/BEAM-1657 Project: Beam

[jira] [Created] (BEAM-1656) DirectRunner should not call finalize twice in UnboundedSourceExecutorFactory

Ben Chambers created BEAM-1656: -- Summary: DirectRunner should not call finalize twice in UnboundedSourceExecutorFactory Key: BEAM-1656 URL: https://issues.apache.org/jira/browse/BEAM-1656 Project: Beam

[jira] [Created] (BEAM-1655) Evaluate the PubsubUnboundedSource

Ben Chambers created BEAM-1655: -- Summary: Evaluate the PubsubUnboundedSource Key: BEAM-1655 URL: https://issues.apache.org/jira/browse/BEAM-1655 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-1616) Gauge Metric type

[ https://issues.apache.org/jira/browse/BEAM-1616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898267#comment-15898267 ] Ben Chambers commented on BEAM-1616: I believe the other metrics have solved/documented this:

[jira] [Commented] (BEAM-1616) Gauge Metric type

[ https://issues.apache.org/jira/browse/BEAM-1616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15894733#comment-15894733 ] Ben Chambers commented on BEAM-1616: One thing we'll need to document clearly is what the behavior is

[jira] [Closed] (BEAM-351) Add DisplayData to KafkaIO

[ https://issues.apache.org/jira/browse/BEAM-351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers closed BEAM-351. - Resolution: Fixed > Add DisplayData to KafkaIO > -- > > Key:

[jira] [Resolved] (BEAM-370) Remove the .named() methods from PTransforms and sub-classes

[ https://issues.apache.org/jira/browse/BEAM-370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers resolved BEAM-370. --- Resolution: Fixed Fix Version/s: 0.5.0 > Remove the .named() methods from PTransforms and