Hi Sandesh, Dag changes are handled in Stram, and operators are running in different containers. Are you suggesting an RPC interface or operator request for sending this information from Stram to all partitions of the interested operator?
- Tushar. On Wed, Aug 10, 2016 at 11:28 AM, Sandesh Hegde <[email protected]> wrote: > Hi All, > > As we add more features to support batch use cases, there will be a need to > access more information about the DAG from an operator. One example is the > need > to access the operator name while using Batched StatsListener. > > The idea here is to implement DAG Listener ( similar to StatsListener ), > which can potentially give every information present in the Stram. > Operators will also have visibility into all the major activities in the > DAG. > > Thoughts? > > Thanks
