Hi All,

How about adding visitor like API for DAG in Apex, and an api to
register visitor for the DAG.
Possible use cases are
-  Validator visitor which could validate the dag
-  Visitor to inject properties/attribute in the operator/streams from
some external sources.
-  Platform does not support validation of individual operators.
developer could write a validator visitor which would call validate
function of operator if it implements Validator interface.
- generate output schema based on operator config and input schema,
and set the schema on output stream.

Sample API :

dag.registerVisitor(DAGVisitor visitor);

Call order of visitorFunctions.
- preVisitDAG(Attributes) // dag attributes
  for all operators
  - visitOperator(OperatorMeta meta) // access to operator, name,
attributes, properties
 ports
  - visitStream(StreamMeta meta) // access to
stream/name/attributes/properties/ports
- postVisitDAG()

Regards,
-Tushar.

Reply via email to