ASF GitHub Bot logged work on BEAM-3741:

                Author: ASF GitHub Bot
            Created on: 12/Mar/18 03:11
            Start Date: 12/Mar/18 03:11
    Worklog Time Spent: 10m 
      Work Description: jkff commented on a change in pull request #4743: 
[BEAM-3741] Proto changes for splitting over Fn API
URL: https://github.com/apache/beam/pull/4743#discussion_r173686781

 File path: model/fn-execution/src/main/proto/beam_fn_api.proto
 @@ -182,6 +182,48 @@ message ProcessBundleDescriptor {
state_api_service_descriptor = 7;
+// Represents a partition of the bundle into two bundles: a "primary" and
+// a "residual", with the following properties:
+// - The work in primary and residual doesn't overlap, and combined, adds up
+//   to the work in the current bundle if the split hadn't happened.
+// - The current bundle, if it keeps executing, will have done none of the
+//   work under residual roots.
+// - The current bundle, if no further splits happen, will have done exactly
+//   the work under primary_roots.
+// For more rigorous definitions see https://s.apache.org/beam-breaking-fusion
+message BundleSplit {
+  // One of the root applications specifying the scope of work for a bundle.
+  message Application {
+    // (Required) The primitive transform to which to pass the element
+    string ptransform_id = 1;
+    // (Required) Name of the transform's input to which to pass the element.
+    string input_id = 2;
+    // (Required) The encoded element to pass to the transform.
+    bytes element = 3;
+    // Approximate lower bounds on timestamps of elements that this PTransform
+    // will produce into each of its output PCollections, when invoked on this
+    // element. Keyed by the transform's local output name.
+    map<string, int64> output_watermarks = 4;
+    // Approximate fraction of all work of the current bundle (before split)
+    // represented by invoking this Application and its downstream 
+    // The sum of fraction_of_work between all primary_roots and residual_roots
+    // must add up to approximately 1.0.
+    DoubleValue fraction_of_work = 5;
 Review comment:
   I decided to use DoubleValue because there is a difference between 
specifying 0 and specifying "I don't know" - if an SDK fails to specify this, 
I'd like to be able to tell whether there's a 0 because the SDK doesn't now, or 
whether it's because the SDK really thinks it's 0.

This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:

Issue Time Tracking

    Worklog Id:     (was: 79324)
    Time Spent: 3h 40m  (was: 3.5h)

> Proto changes for splitting over Fn API
> ---------------------------------------
>                 Key: BEAM-3741
>                 URL: https://issues.apache.org/jira/browse/BEAM-3741
>             Project: Beam
>          Issue Type: Sub-task
>          Components: beam-model
>            Reporter: Eugene Kirpichov
>            Assignee: Eugene Kirpichov
>            Priority: Major
>          Time Spent: 3h 40m
>  Remaining Estimate: 0h

This message was sent by Atlassian JIRA

Reply via email to