Could also avoid the lock contention if each phantom had knowledge of the others, so "phantom 1" could only process @ID 1, 6, 11 etc., phantom 2 would do 2,7,12 & so on
Of course, if you are operating with a select list, this already implies that you have processed the file once, so your "batch process" is actually a re-read, so in the absence of a suitable index, perhaps employing the "Drumheller trick" would be worth consideration .... Ross Ferris Stamina Software Visage > Better by Design! -----Original Message----- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Wjhonson Sent: Wednesday, 3 October 2012 3:42 AM To: u2-users@listserver.u2ug.org Subject: Re: [U2] [u2] Parallel processing in Universe The point of the caching concern is related to the read ahead, and you will still get some benefit from this, if your five phantoms are reading their *portion* of the file in order, which they should. -----Original Message----- From: George Gallen <ggal...@wyanokegroup.com> To: U2 Users List <u2-users@listserver.u2ug.org> Sent: Tue, Oct 2, 2012 10:39 am Subject: Re: [U2] [u2] Parallel processing in Universe If 5 phantoms were running, and read in order but from 5 different starting points, the records would Essentially still be processed in a random order, if you were to layout the record ID's as they get Processed. George -----Original Message----- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Wjhonson Sent: Tuesday, October 02, 2012 1:35 PM To: u2-users@listserver.u2ug.org Subject: Re: [U2] [u2] Parallel processing in Universe The idea of the phantoms would be to read the file in order, not randomly, just inorder from five different starting points. So you should still get the benefit of some caching. _______________________________________________ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users _______________________________________________ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users _______________________________________________ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
