Sorry Tim, let me summarize.
Basically, I would like to place a bunch of messages onto a queue and then
process them one by one and, in an alternate reality, write an sql statement
like:
select * from jms where id=x and processing_status = pending
whenever a user visited a web page just to let them know how far along the job
was. Of course, JMS doesn't work this way, but this is the idea.
Now, here are my specific implementation details:
1) Going to be putting 100k+ messages onto a queue
2) Going to be putting the 100k+ messages onto the queue in batches of, say,
1000. Each batch of 1000 is going to be part of a single JMS transaction
3) There are going to be listeners on the queue that will process each of the
messages from the batches one by one
ie. the listeners on the queue will not be optimized to handle mutliple
messages at once, the listeners will handle each message individually (and this
is required, I can't change this)
4) I would like to be able to be able to monitor the overall progress of the
processing of the 100k+ messages
4 was the problem because JMS doesn't act like a RDBMS and can't quickly give
me a count of something based on a criteria, at least through the standard JMS
API, although different implementations could allow for it (through
optimizations, proprietary means etc.).
Of course, I could just have each of the listeners update the database and
increment a counter as they process each message. However, I don't really want
to do this as it takes a lot of processing time for such a fine grained update,
so thats why I was going along the lines of just updating the counter every
1000 messages. As well, in the future, the 100k+ messages could turn out to be
1M+ messages, and when you have multiple clients each running jobs
simultaneously you will end up with a huge number of database hits just to
increment a counter! Just doesn't smell right to me...but, I could be confused
or missing something too.
Any suggestions welcome!
Thanks,
Mark
View the original post :
http://www.jboss.com/index.html?module=bb&op=viewtopic&p=3938149#3938149
Reply to the post :
http://www.jboss.com/index.html?module=bb&op=posting&mode=reply&p=3938149
-------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
_______________________________________________
JBoss-user mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/jboss-user
