Changing Aggregators to Metrics in capability matrix
Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/0fee1fb1 Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/0fee1fb1 Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/0fee1fb1 Branch: refs/heads/asf-site Commit: 0fee1fb1ea966cf69d79481d200e16ae1cf05cab Parents: 3452477 Author: Pablo <[email protected]> Authored: Fri May 19 10:12:52 2017 -0700 Committer: Dan Halperin <[email protected]> Committed: Thu May 25 14:05:13 2017 -0700 ---------------------------------------------------------------------- src/_data/capability-matrix.yml | 18 +++++++++--------- 1 file changed, 9 insertions(+), 9 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/beam-site/blob/0fee1fb1/src/_data/capability-matrix.yml ---------------------------------------------------------------------- diff --git a/src/_data/capability-matrix.yml b/src/_data/capability-matrix.yml index 565ffba..cd7c9b6 100644 --- a/src/_data/capability-matrix.yml +++ b/src/_data/capability-matrix.yml @@ -202,24 +202,24 @@ categories: l1: 'Yes' l2: fully supported l3: '' - - name: Aggregators + - name: Metrics values: - class: model l1: 'Partially' l2: user-provided metrics - l3: Allow transforms to aggregate simple metrics across bundles in a <tt>DoFn</tt>. Semantically equivalent to using an additional output, but support partial results as the transform executes. Will likely want to augment <tt>Aggregators</tt> to be more useful for processing unbounded data by making them windowed. + l3: Allow transforms to gather simple metrics across bundles in a <tt>PTransform</tt>. Provide a mechanism to obtain both committed and attempted metrics. Semantically similar to using an additional output, but support partial results as the transform executes, and support both committed and attempted values. Will likely want to augment <tt>Metrics</tt> to be more useful for processing unbounded data by making them windowed. - class: dataflow l1: 'Partially' - l2: may miscount in streaming mode - l3: Current model is fully supported in batch mode. In streaming mode, <tt>Aggregators</tt> may under or overcount when bundles are retried. + l2: Batch supports committed Counters and Distributions. No streamming support. + l3: Gauge metrics are not supported. - class: flink l1: 'Partially' - l2: may undercount in streaming - l3: Current model is fully supported in batch. In streaming mode, <tt>Aggregators</tt> may undercount. + l2: All metrics types are supported. + l3: Only attempted values are supported. No committed values for metrics. - class: spark l1: 'Partially' - l2: may overcount when tasks are retried in transformations. - l3: 'supported via <tt>AccumulatorParam</tt> mechanism. If a task retries, and the accumulator is not within a Spark "Action", an overcount is possible.' + l2: All metric types are supported. + l3: Only attempted values are supported. No committed values for metrics. - class: apex l1: 'No' l2: Not implemented in runner. @@ -758,4 +758,4 @@ categories: - class: gearpump l1: 'No' l2: pending model support - l3: '' \ No newline at end of file + l3: ''
