JozoVilcek commented on code in PR #33772:
URL: https://github.com/apache/beam/pull/33772#discussion_r1957951707
##########
runners/spark/src/main/java/org/apache/beam/runners/spark/translation/EvaluationContext.java:
##########
@@ -307,6 +308,26 @@ public <K, V> boolean
isCandidateForGroupByKeyAndWindow(GroupByKey<K, V> transfo
return
groupByKeyCandidatesForMemoryOptimizedTranslation.containsKey(transform);
}
+ /**
+ * Get the map of dependent transforms hold by the evaluation context.
+ *
+ * @return The current {@link Map} of dependent transforms.
+ */
+ public Map<PCollection<?>, Integer> getDependentTransforms() {
+ return this.dependentTransforms;
Review Comment:
This map is being updated from visitor while traversing pipeline transforms.
It is following same pattern as cache visitor feature.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
