[jira] [Resolved] (BEAM-117) Implement the API for Static Display Metadata

2016-05-25 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers resolved BEAM-117. --- Resolution: Fixed Fix Version/s: 0.1.0-incubating > Implement the API for Static Display

[jira] [Created] (BEAM-324) Improve TypeDescriptor inference of DoFn's created inside a generic PTransform

2016-06-02 Thread Ben Chambers (JIRA)
Ben Chambers created BEAM-324: - Summary: Improve TypeDescriptor inference of DoFn's created inside a generic PTransform Key: BEAM-324 URL: https://issues.apache.org/jira/browse/BEAM-324 Project: Beam

[jira] [Updated] (BEAM-344) Merge, Split, Delay, and Reorder bundles in the DirectRunner

2016-06-16 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers updated BEAM-344: -- Summary: Merge, Split, Delay, and Reorder bundles in the DirectRunner (was: Merge, Split, Delay, and

[jira] [Commented] (BEAM-366) Support Display Data on Composite Transforms

2016-06-21 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342229#comment-15342229 ] Ben Chambers commented on BEAM-366: --- As mentioned, representing composites explicitly in the Dataflow

[jira] [Created] (BEAM-366) Support Display Data on Composite Transforms

2016-06-21 Thread Ben Chambers (JIRA)
Ben Chambers created BEAM-366: - Summary: Support Display Data on Composite Transforms Key: BEAM-366 URL: https://issues.apache.org/jira/browse/BEAM-366 Project: Beam Issue Type: Bug

[jira] [Closed] (BEAM-359) AvroCoder should be able to handle anonymous classes as schemas

2016-06-22 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers closed BEAM-359. - Resolution: Fixed Fix Version/s: 0.2.0-incubating > AvroCoder should be able to handle anonymous

[jira] [Created] (BEAM-351) Add DisplayData to KafkaIO

2016-06-16 Thread Ben Chambers (JIRA)
Ben Chambers created BEAM-351: - Summary: Add DisplayData to KafkaIO Key: BEAM-351 URL: https://issues.apache.org/jira/browse/BEAM-351 Project: Beam Issue Type: Bug Components:

[jira] [Created] (BEAM-352) Add DisplayData to HDFS Sources

2016-06-16 Thread Ben Chambers (JIRA)
Ben Chambers created BEAM-352: - Summary: Add DisplayData to HDFS Sources Key: BEAM-352 URL: https://issues.apache.org/jira/browse/BEAM-352 Project: Beam Issue Type: Bug Components:

[jira] [Created] (BEAM-372) CoderProperties: Test that the coder doesn't consume more bytes than it produces

2016-06-23 Thread Ben Chambers (JIRA)
Ben Chambers created BEAM-372: - Summary: CoderProperties: Test that the coder doesn't consume more bytes than it produces Key: BEAM-372 URL: https://issues.apache.org/jira/browse/BEAM-372 Project: Beam

[jira] [Created] (BEAM-377) BigQueryIO should validate a table or query to read from

2016-06-25 Thread Ben Chambers (JIRA)
Ben Chambers created BEAM-377: - Summary: BigQueryIO should validate a table or query to read from Key: BEAM-377 URL: https://issues.apache.org/jira/browse/BEAM-377 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-85) DataflowAssert (BeamAssert ;) needs sanity check that it's used correctly

2016-03-01 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-85?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15174750#comment-15174750 ] Ben Chambers commented on BEAM-85: -- One possibility would be to use an `@Rule` instead. for instance:

[jira] [Created] (BEAM-112) Using non-IntervalWindows seems to fail

2016-03-14 Thread Ben Chambers (JIRA)
Ben Chambers created BEAM-112: - Summary: Using non-IntervalWindows seems to fail Key: BEAM-112 URL: https://issues.apache.org/jira/browse/BEAM-112 Project: Beam Issue Type: Bug

[jira] [Closed] (BEAM-36) TimestampedValueInMultipleWindows should use a more compact set representation

2016-03-19 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-36?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers closed BEAM-36. Resolution: Won't Fix As per discussion on https://github.com/apache/incubator-beam/pull/43: "We looked some

[jira] [Created] (BEAM-184) Using Merging Windows and/or Triggers without a downstream aggregation should fail

2016-04-08 Thread Ben Chambers (JIRA)
Ben Chambers created BEAM-184: - Summary: Using Merging Windows and/or Triggers without a downstream aggregation should fail Key: BEAM-184 URL: https://issues.apache.org/jira/browse/BEAM-184 Project: Beam

[jira] [Updated] (BEAM-117) Implement the API for Static Display Metadata

2016-03-19 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers updated BEAM-117: -- Issue Type: New Feature (was: Bug) > Implement the API for Static Display Metadata >

[jira] [Assigned] (BEAM-121) Publish DisplayData from common PTransforms

2016-03-20 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers reassigned BEAM-121: - Assignee: Scott Wegner > Publish DisplayData from common PTransforms >

[jira] [Created] (BEAM-117) Implement the API for Static Display Metadata

2016-03-20 Thread Ben Chambers (JIRA)
Ben Chambers created BEAM-117: - Summary: Implement the API for Static Display Metadata Key: BEAM-117 URL: https://issues.apache.org/jira/browse/BEAM-117 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-135) Utilities for "batching" elements in a DoFn

2016-03-19 Thread Ben Chambers (JIRA)
Ben Chambers created BEAM-135: - Summary: Utilities for "batching" elements in a DoFn Key: BEAM-135 URL: https://issues.apache.org/jira/browse/BEAM-135 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-85) DataflowAssert (BeamAssert ;) needs sanity check that it's used correctly

2016-03-02 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-85?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers updated BEAM-85: - Description: We should validate two things: # DataflowAssert is not added to a pipeline that has already

[jira] [Commented] (BEAM-175) Leak garbage collection timers in GlobalWindow

2016-05-16 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15284759#comment-15284759 ] Ben Chambers commented on BEAM-175: --- I think in general this seems OK. I like that we're making the

[jira] [Created] (BEAM-247) CombineFn's only definable/usable inside sdk.transforms package

2016-05-02 Thread Ben Chambers (JIRA)
Ben Chambers created BEAM-247: - Summary: CombineFn's only definable/usable inside sdk.transforms package Key: BEAM-247 URL: https://issues.apache.org/jira/browse/BEAM-247 Project: Beam Issue

[jira] [Commented] (BEAM-210) Be consistent with emitting final empty panes

2016-04-19 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248490#comment-15248490 ] Ben Chambers commented on BEAM-210: --- No. This is in the weird spot. When we say "empty pane" in terms of

[jira] [Commented] (BEAM-210) Be consistent with emitting final empty panes

2016-04-19 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248532#comment-15248532 ] Ben Chambers commented on BEAM-210: --- Most important, I think, is to get rid of the implicit "if you have a

[jira] [Commented] (BEAM-37) Run DoFnWithContext without conversion to vanilla DoFn

2016-07-15 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-37?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379728#comment-15379728 ] Ben Chambers commented on BEAM-37: -- Notes on remaining tasks to complete this: 1. Modify DoFnRunner to

[jira] [Commented] (BEAM-694) TriggerTester doesn't test timer firings

2016-09-29 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15534161#comment-15534161 ] Ben Chambers commented on BEAM-694: --- I think this is partly intentional with the newer formulation of

[jira] [Commented] (BEAM-726) Standardize naming of PipelineResult objects

2016-10-06 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553367#comment-15553367 ] Ben Chambers commented on BEAM-726: --- Great point. We could consider also choosing a different suffix.

[jira] [Created] (BEAM-726) Standardize naming of PipelineResult objects

2016-10-06 Thread Ben Chambers (JIRA)
Ben Chambers created BEAM-726: - Summary: Standardize naming of PipelineResult objects Key: BEAM-726 URL: https://issues.apache.org/jira/browse/BEAM-726 Project: Beam Issue Type: Bug

[jira] [Closed] (BEAM-661) CalendarWindows#isCompatibleWith should use equals instead of ==

2016-09-21 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers closed BEAM-661. - Resolution: Duplicate Fix Version/s: Not applicable > CalendarWindows#isCompatibleWith should use

[jira] [Created] (BEAM-661) CalendarWindows#isCompatibleWith should use equals instead of ==

2016-09-21 Thread Ben Chambers (JIRA)
Ben Chambers created BEAM-661: - Summary: CalendarWindows#isCompatibleWith should use equals instead of == Key: BEAM-661 URL: https://issues.apache.org/jira/browse/BEAM-661 Project: Beam Issue

[jira] [Assigned] (BEAM-147) Rename Aggregator to [P]Metric

2016-09-22 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers reassigned BEAM-147: - Assignee: Ben Chambers (was: Frances Perry) > Rename Aggregator to [P]Metric >

[jira] [Commented] (BEAM-644) Primitive to shift the watermark while assigning timestamps

2016-09-20 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507379#comment-15507379 ] Ben Chambers commented on BEAM-644: --- Minor note on "A function from TimestampedElement to new timestamp

[jira] [Commented] (BEAM-147) Introduce an easy API pipeline metrics

2016-09-28 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530952#comment-15530952 ] Ben Chambers commented on BEAM-147: --- Repurposing this issue to track the actual goal of having an

[jira] [Updated] (BEAM-147) Introduce an easy API pipeline metrics

2016-09-28 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers updated BEAM-147: -- Description: The existing Aggregators are confusing both because of their name and because they serve

[jira] [Updated] (BEAM-147) Introduce an easy API pipeline metrics

2016-09-28 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers updated BEAM-147: -- Description: The existing Aggregators are confusing both because of their name and because they serve

[jira] [Updated] (BEAM-147) Introduce an easy API pipeline metrics

2016-09-28 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers updated BEAM-147: -- Summary: Introduce an easy API pipeline metrics (was: Rename Aggregator to [P]Metric) > Introduce an

[jira] [Created] (BEAM-696) Side-Inputs non-deterministic with merging main-input windows

2016-09-30 Thread Ben Chambers (JIRA)
Ben Chambers created BEAM-696: - Summary: Side-Inputs non-deterministic with merging main-input windows Key: BEAM-696 URL: https://issues.apache.org/jira/browse/BEAM-696 Project: Beam Issue

[jira] [Created] (BEAM-681) DoFns should be serialized at apply time and deserialized when executing

2016-09-26 Thread Ben Chambers (JIRA)
Ben Chambers created BEAM-681: - Summary: DoFns should be serialized at apply time and deserialized when executing Key: BEAM-681 URL: https://issues.apache.org/jira/browse/BEAM-681 Project: Beam

[jira] [Created] (BEAM-774) Implement Metrics support for Spark runenr

2016-10-18 Thread Ben Chambers (JIRA)
Ben Chambers created BEAM-774: - Summary: Implement Metrics support for Spark runenr Key: BEAM-774 URL: https://issues.apache.org/jira/browse/BEAM-774 Project: Beam Issue Type: Sub-task

[jira] [Closed] (BEAM-458) Support for Flink Metrics

2016-10-18 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers closed BEAM-458. - Resolution: Duplicate Fix Version/s: Not applicable > Support for Flink Metrics >

[jira] [Created] (BEAM-773) Implement Metrics support for Flink runner

2016-10-18 Thread Ben Chambers (JIRA)
Ben Chambers created BEAM-773: - Summary: Implement Metrics support for Flink runner Key: BEAM-773 URL: https://issues.apache.org/jira/browse/BEAM-773 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-772) Implement Metrics support for Dataflow Runner

2016-10-18 Thread Ben Chambers (JIRA)
Ben Chambers created BEAM-772: - Summary: Implement Metrics support for Dataflow Runner Key: BEAM-772 URL: https://issues.apache.org/jira/browse/BEAM-772 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-775) Remove Aggregators from the Java SDK

2016-10-18 Thread Ben Chambers (JIRA)
Ben Chambers created BEAM-775: - Summary: Remove Aggregators from the Java SDK Key: BEAM-775 URL: https://issues.apache.org/jira/browse/BEAM-775 Project: Beam Issue Type: Sub-task

[jira] [Updated] (BEAM-147) Introduce an easy API for pipeline metrics

2016-10-13 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers updated BEAM-147: -- Summary: Introduce an easy API for pipeline metrics (was: Introduce an easy API pipeline metrics) >

[jira] [Created] (BEAM-1122) Change Dataflow profiling options to support saving to GCS

2016-12-09 Thread Ben Chambers (JIRA)
Ben Chambers created BEAM-1122: -- Summary: Change Dataflow profiling options to support saving to GCS Key: BEAM-1122 URL: https://issues.apache.org/jira/browse/BEAM-1122 Project: Beam Issue

[jira] [Resolved] (BEAM-1104) WordCount: Metrics error in the DirectRunner

2016-12-15 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers resolved BEAM-1104. Resolution: Fixed Fix Version/s: 0.4.0-incubating > WordCount: Metrics error in the

[jira] [Commented] (BEAM-1148) Port PAssert away from Aggregators

2016-12-14 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749188#comment-15749188 ] Ben Chambers commented on BEAM-1148: In general: Aggregators are being replaced with Metrics for the

[jira] [Created] (BEAM-1161) Update Javadoc/Examples/etc.

2016-12-14 Thread Ben Chambers (JIRA)
Ben Chambers created BEAM-1161: -- Summary: Update Javadoc/Examples/etc. Key: BEAM-1161 URL: https://issues.apache.org/jira/browse/BEAM-1161 Project: Beam Issue Type: Sub-task

[jira] [Commented] (BEAM-1126) Expose UnboundedSource split backlog in number of events

2016-12-14 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749901#comment-15749901 ] Ben Chambers commented on BEAM-1126: The majority of the work is getting Metrics supported well-enough

[jira] [Created] (BEAM-1169) MetricsTest matchers should loosen expectations on physical values

2016-12-16 Thread Ben Chambers (JIRA)
Ben Chambers created BEAM-1169: -- Summary: MetricsTest matchers should loosen expectations on physical values Key: BEAM-1169 URL: https://issues.apache.org/jira/browse/BEAM-1169 Project: Beam

[jira] [Commented] (BEAM-1169) MetricsTest matchers should loosen expectations on physical values

2016-12-16 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15755377#comment-15755377 ] Ben Chambers commented on BEAM-1169: Alternatively, we may need the Runner to define how Metrics are

[jira] [Updated] (BEAM-1170) Streaming watermark should be easier to read

2016-12-16 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers updated BEAM-1170: --- Component/s: runner-dataflow > Streaming watermark should be easier to read >

[jira] [Resolved] (BEAM-1122) Change Dataflow profiling options to support saving to GCS

2016-12-09 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers resolved BEAM-1122. Resolution: Fixed Fix Version/s: 0.4.0-incubating > Change Dataflow profiling options to