Dear Wiki user, You have subscribed to a wiki page or wiki category on "Lucene-hadoop Wiki" for change notification.
The following page has been changed by udanax: http://wiki.apache.org/lucene-hadoop/DataProcessingBenchmarks ------------------------------------------------------------------------------ 08/01/08 16:15:35 INFO mapred.JobClient: Reduce input groups=201330 08/01/08 16:15:35 INFO mapred.JobClient: Reduce input records=705771 08/01/08 16:15:35 INFO mapred.JobClient: Reduce output records=201330 + }}} + * Map was used for extract the IP address of the client requesting the web page. + * Reduce was used for summation. + + {{{ * Sort by Connection Time Count Map/Reduce Job start. ---------------------------------------------------------------------- 08/01/08 16:15:35 INFO mapred.FileInputFormat: Total input paths to process : 100 08/01/08 16:15:36 INFO mapred.JobClient: Running job: job_200801081529_0006 08/01/08 16:15:37 INFO mapred.JobClient: map 0% reduce 0% - 08/01/08 16:15:40 INFO mapred.JobClient: map 10% reduce 0% - 08/01/08 16:15:41 INFO mapred.JobClient: map 42% reduce 0% - 08/01/08 16:15:42 INFO mapred.JobClient: map 91% reduce 0% ... 08/01/08 16:33:54 INFO mapred.JobClient: map 100% reduce 100% 08/01/08 16:33:55 INFO mapred.JobClient: Job complete: job_200801081529_0006 @@ -68, +70 @@ 08/01/08 16:33:55 INFO mapred.JobClient: Reduce input groups=19270 08/01/08 16:33:55 INFO mapred.JobClient: Reduce input records=84069 08/01/08 16:33:55 INFO mapred.JobClient: Reduce output records=200 + }}} + * Map/Reduce was used for sort by count. + + {{{ ------------------------------------ * Top 100 connector list : +--------------+-------------------+
