The following module was proposed for inclusion in the Module List: modid: Job::MapReduce DSLIP: MdpOp description: A Map Reduce job launcher userid: KAN (Kan Liu) chapterid: 23 (Miscellaneous_Modules) communities: chatrooms
similar: rationale: Map/Reduce is an approach that collects data in parallel then processes data in serial. A Map/Reduce job has 4 components/steps. Batch : devide the targets into batches. Map : create threads to collect data from/for each batch in parallel. Sort : aggregate collected data by status. Reduce: (optional) process aggregated data serially. It is intended for efficiently process data on a large scale, with fine grained control. enteredby: KAN (Kan Liu) enteredon: Wed Dec 22 04:52:27 2010 GMT The resulting entry would be: Job:: ::MapReduce MdpOp A Map Reduce job launcher KAN Thanks for registering, -- The PAUSE PS: The following links are only valid for module list maintainers: Registration form with editing capabilities: https://pause.perl.org/pause/authenquery?ACTION=add_mod&USERID=92600000_87fdaf7bfc8bf3a0&SUBMIT_pause99_add_mod_preview=1 Immediate (one click) registration: https://pause.perl.org/pause/authenquery?ACTION=add_mod&USERID=92600000_87fdaf7bfc8bf3a0&SUBMIT_pause99_add_mod_insertit=1 Peek at the current permissions: https://pause.perl.org/pause/authenquery?pause99_peek_perms_by=me&pause99_peek_perms_query=Job%3A%3AMapReduce