Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification.
The following page has been changed by JeromeCharron: http://wiki.apache.org/nutch/LanguageIdentifierBenchs The comment on the change is: Add graphs ------------------------------------------------------------------------------ These benchmarks were produced by testing the LanguageIdentifierPlugin on a set of 492 french files representing a total size of 171,3 Mo. These files were extracted from the ''[http://people.csail.mit.edu/koehn/publications/europarl/ European Parliament Proceedings Parallel Corpus 1996-2003 Release v2]''. == Raw results == + + The following matrix shows the LanguageIdentifierPlugin processing time in ''ms'' for different configurations. + The ''Data Size'' row is the size of data in bytes used in each file to perform the identification (please notice that each test case reported in this matrix returns a good language identification). + Other rows represent the following configurations: + * ''P.V.'': The Previous Version of the LanguageIdentifierPlugin. + * ''[x-y]'': The new LanguageIdentifierPlugin version using ngrams from size ''x'' to ''y'' to perform identification. ||'''Data Size'''||'''P.V.'''||'''[1-4]'''||'''[2-2]'''||'''[3-3]'''||'''[4-4]'''||'''[2-3]'''||'''[3-4]'''||'''[2-4]'''|| ||'''128'''||8314||5124||1627||2245||1393||3073||2996||4243|| @@ -27, +33 @@ ||'''262144'''||304609||289395||107108||108841||108674||180461||165561||222535|| ||'''524288'''||463008||442028||151086||146601||156372||253797||245313||336378|| + == Graphical Representation == + + [http://frutch.free.fr/images/nutch/langid-benchs01.png] + + == Graphical Representation (log axis) == + + [http://frutch.free.fr/images/nutch/langid-benchs02.png] + + == Discussion == + + ''TODO'' + ------------------------------------------------------- This SF.Net email is sponsored by Yahoo. Introducing Yahoo! Search Developer Network - Create apps using Yahoo! Search APIs Find out how you can build Yahoo! directly into your own Applications - visit http://developer.yahoo.net/?fr=offad-ysdn-ostg-q22005 _______________________________________________ Nutch-cvs mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-cvs
