Hi all, In the process of integrating Siddhi with apache Storm we came across this problem of controlling the scheduling of tasks across a cluster as desired. One of the basic problems we faced is, lack of control over where the spouts and bolts are going to reside.
As solution to this problem we wrote a custom scheduler where we can control which spout/bolt reside in which node in the cluster. In each supervisor node we can specify a component name and the scheduler will make sure that instances of the specified component will run only on that node. This will prevent scattering of different types spouts/bolts across different nodes. Nodes which are not specifying a component can run on any type of spout/bolt. And components which are not having a dedicated node can run on any node. This is only the preliminary version and we are looking forward to fine tune this scheduler to match the requirements of Siddhi-Storm integration. Please provide your feedback and suggestions for possible improvements. Thanks *,Sajith Ravindra* Senior Software Engineer WSO2 Inc.; http://wso2.com lean.enterprise.middleware mobile: +94 77 2273550 blog: http://sajithr.blogspot.com/ <http://lk.linkedin.com/pub/shani-ranasinghe/34/111/ab>
_______________________________________________ Architecture mailing list [email protected] https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture
