I'm assuming you'll be running each rule base in a separate thread simultaneously? There are no dependencies between the rules in the five rule bases? If so, that will work just fine.
If your rules are simple enough you can use sequential mode. It can speed up execution quite a bit. http://downloads.jboss.com/drools/docs/4.0.7.19894.GA/html_single/index.html#d0e1295 This could be used in conjunction with the simultaneous execution above. Finally, you can get some multithreaded benefit in a single rule session if you're using drools 5 and turn on rule base partitioning. As I understand it this works best when the rules have less join conditions in them. (i.e. mostly single object conditions, and less multi-object conditions.) --- On Thu, 11/6/08, techy <[EMAIL PROTECTED]> wrote: > From: techy <[EMAIL PROTECTED]> > Subject: [rules-users] Rule processing for High volume input > To: [email protected] > Date: Thursday, November 6, 2008, 3:41 PM > I have to run rules(1000 rules) against 20-30 million of > record each day. > I guess I would have memory issue If I insert all of > records into working > memory. > > so I'm thinking to have multiple rule base instance and > do batch processing > as given below.so that I can avoid memory issue and quick > rule processing > > > a.Take first 1 million records and distribute 1 millon > across working > memory of 5 rule base. > b.fire rules in all 5 rule base > c.clear working memory of all rule base > d. take next 1 million record and start from step-a till I > process all of > the records. > > > Please advise whether this is possible/recommended way or > not. > > thanks > -- > View this message in context: > http://www.nabble.com/Rule-processing-for-High-volume-input-tp20370272p20370272.html > Sent from the drools - user mailing list archive at > Nabble.com. > > _______________________________________________ > rules-users mailing list > [email protected] > https://lists.jboss.org/mailman/listinfo/rules-users _______________________________________________ rules-users mailing list [email protected] https://lists.jboss.org/mailman/listinfo/rules-users
