>- see footer for list info -< Rich, by "polling service" do you mean a scheduled CF task or a Windows scheduled task that hits a url? Or something else?
Thanks, Gary. On Sun, Aug 22, 2010 at 8:56 AM, Rich Wild <[email protected]> wrote: > >- see footer for list info -< > "There must be a more elegant, robust way?" > > Aye, when inserting the emails into the db, batch code every 1000 or so > with > an identical code. > > Then you have an application flag that indicates whether or not there are > any remaining in the db to send out. On AppStart, you check the db for any > unsent and set the flag accordingly. Then have a simple polling service > that > checks the flag, grabs a batch code and the associated emails for that > batch > and sends them. Rather than update every email on each loop iteration, you > can then set the entire batch to processed in one query. > > Then the polling service checks for any more batches that haven't been sent > and sets the flag accordingly. If some unsent still remain, then next poll > will take care of them, if not, well, nothing need happen. > > Instead of seconds, you can probably give it a minute or so between > batches. > You could also have an in-run app flag to notify one polling call that a > previous one hasn't yet finished and so to die gracefully rather than try > and concurrently run another batch, which could run you into memory or cpu > problems. > > > > On 21 August 2010 19:30, Gary <[email protected]> wrote: > > > >- see footer for list info -< > > @Rich, glad you can confirm that 40K emails is perfectly do-able. I > already > > have the emails in a db so I guess adding a "sent" bit column would let > me > > track what's been sent. I don't like the idea of doing a db update every > > time cfmail is looped. Perhaps it should fire off in batches of 100 > emails > > at time and do 1 db update after each batch. Not so sure about getting > > scheduling to run every few seconds indefinately to check for emails > > waiting > > to be created. There must be a more elegant, robust way? > > > > @Kev, yes CF spools emails to disk. The Postmark service sounds good but > > I've already got some good bounced mail handling code. However, every 6 > > months some ISP or mail provider blocks emails which is a real pain. > > Getting > > it unblocked is hard work. > > > > I'd still like to optimise the java settings. > > > > Thanks for you input, chaps. > > Gary. > > > > > > On Sat, Aug 21, 2010 at 12:00 PM, Kev McCabe <[email protected]> > wrote: > > > > > >- see footer for list info -< > > > I'm guessing you've go the mail settings to spool? > > > > > > If it's important to get the emails sent and you want to track them on > a > > > mailing list, you could look at something like PostMark > > > > > > > > > http://www.bennadel.com/blog/1900-Sending-Mail-And-Monitoring-Bounce-Backs-With-ColdFusion-And-Postmark.htm > > > > > > But of course this costs more money but may be better to ensure the > > emails > > > get where they need to, as your mail server sending say 5k to yahoo may > > get > > > blocked by yahoo. > > > > > > Sending mail is always a pain, and has many stumbling blocks. > > > > > > HTH > > > > > > ---------------------------------------------------------------------- > > > [ ] internal [ ] private [X] ask first [ ] bloggable > > > ---------------------------------------------------------------------- > > > Kev McCabe > > > Adobe Community Professional - ColdFusion > > > UK ColdFusion User Group Manager > > > tel: +44 7751 230 725 > > > email: [email protected] > > > skype: bigmadkev > > > blog: http://bigmadkev.com/blog > > > ---------------------------------------------------------------------- > > > > > > > > > On 21 August 2010 11:44, Rich Wild <[email protected]> wrote: > > > > > > > >- see footer for list info -< > > > > I regularly use CF8 to send 20K - 40K of emails out using just > standard > > > > settings, so wonder if there's something else going here? > > > > > > > > At any rate, why not whack all the emails into a db table, then > > > > periodically > > > > check that table to see if there are any emails in there, and if so, > > send > > > > 1000 out, delete them and stop - wait for the next poll and so on > until > > > > there's nothing left.. > > > > > > > > Cheers, > > > > Rich > > > > > > > > On 21 August 2010 11:15, Gary <[email protected]> wrote: > > > > > > > > > >- see footer for list info -< > > > > > Hi. Does anyone have experience with using cfmail to generate > 30,000+ > > > > > personalised emails? At the moment I'm firing off an asynchronous > > > gateway > > > > > event which uses <cfmail query="recipients"> to do the job. > However, > > as > > > > the > > > > > mailing list grows it's starting to throw Java errors like: > > > > > > > > > > java.lang.OutOfMemoryError: GC overhead limit exceeded > > > > > > > > > > Various blogs mention changing the heap, collection agressiveness > and > > > > stuff > > > > > but there doesn't seem to be a specific figure that I'm supposed to > > > > change > > > > > the settings to. It seems very much "finger in the air" and as this > > is > > > a > > > > > production server I don't want to experiment too much. Has anyone > > found > > > > > settings that work nicely for them to avoid the above error? > > > > > > > > > > I'm wondering if the email job needs to be broken down into smaller > > > > batches > > > > > of 1000 for example? Is there something better than cfmail? > > > > > > > > > > I'm running CF 8.01 x64 on Win 2008 R2 with 2.5GB RAM with a Xeon > > 5530 > > > > > 2.4Ghz cpu. > > > > > > > > > > Thanks in advance for any pointers. I have a very small budget if > > > anyone > > > > > experienced with java settings and/or big mailing lists can give > > advice > > > > or > > > > > code and wants something other than beer tokens. > > > > > > > > > > Gary. > > > > > _______________________________________________ > > > > > > > > > > For details on ALL mailing lists and for joining or leaving lists, > go > > > to > > > > > http://list.cfdeveloper.co.uk/mailman/listinfo > > > > > > > > > > -- > > > > > CFDeveloper Sponsors:- > > > > > >- cfdeveloper Hosting provided by www.cfmxhosting.co.uk -< > > > > > >- Lists hosted by www.Gradwell.com <http://www.gradwell.com/> < > http://www.gradwell.com/> -< > > > > > >- CFdeveloper is run by Russ Michaels, feel free to volunteer your > > > help > > > > -< > > > > > > > > > _______________________________________________ > > > > > > > > For details on ALL mailing lists and for joining or leaving lists, go > > to > > > > http://list.cfdeveloper.co.uk/mailman/listinfo > > > > > > > > -- > > > > CFDeveloper Sponsors:- > > > > >- cfdeveloper Hosting provided by www.cfmxhosting.co.uk -< > > > > >- Lists hosted by www.Gradwell.com <http://www.gradwell.com/> < > http://www.gradwell.com/> -< > > > > >- CFdeveloper is run by Russ Michaels, feel free to volunteer your > > help > > > -< > > > > > > > _______________________________________________ > > > > > > For details on ALL mailing lists and for joining or leaving lists, go > to > > > http://list.cfdeveloper.co.uk/mailman/listinfo > > > > > > -- > > > CFDeveloper Sponsors:- > > > >- cfdeveloper Hosting provided by www.cfmxhosting.co.uk -< > > > >- Lists hosted by www.Gradwell.com <http://www.gradwell.com/> < > http://www.gradwell.com/> -< > > > >- CFdeveloper is run by Russ Michaels, feel free to volunteer your > help > > -< > > > > > _______________________________________________ > > > > For details on ALL mailing lists and for joining or leaving lists, go to > > http://list.cfdeveloper.co.uk/mailman/listinfo > > > > -- > > CFDeveloper Sponsors:- > > >- cfdeveloper Hosting provided by www.cfmxhosting.co.uk -< > > >- Lists hosted by www.Gradwell.com <http://www.gradwell.com/> -< > > >- CFdeveloper is run by Russ Michaels, feel free to volunteer your help > -< > > > _______________________________________________ > > For details on ALL mailing lists and for joining or leaving lists, go to > http://list.cfdeveloper.co.uk/mailman/listinfo > > -- > CFDeveloper Sponsors:- > >- cfdeveloper Hosting provided by www.cfmxhosting.co.uk -< > >- Lists hosted by www.Gradwell.com <http://www.gradwell.com/> -< > >- CFdeveloper is run by Russ Michaels, feel free to volunteer your help -< > _______________________________________________ For details on ALL mailing lists and for joining or leaving lists, go to http://list.cfdeveloper.co.uk/mailman/listinfo -- CFDeveloper Sponsors:- >- cfdeveloper Hosting provided by www.cfmxhosting.co.uk -< >- Lists hosted by www.Gradwell.com -< >- CFdeveloper is run by Russ Michaels, feel free to volunteer your help -<
