Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification.
The "SimilarityScoringFilter" page has been changed by SujenShah: https://wiki.apache.org/nutch/SimilarityScoringFilter?action=diff&rev1=1&rev2=2 == How to use == + Required file format of the model - The user should provide the goldstandard document in a text file with all the relevant text and terms, pertaining to the domain, present inside it. + 1. Copy the gold-standard file into the conf directory and enter the name of this file in nutch-site.xml. {{{ <property> <name>scoring.similarity.model.path</name> - <value>pathToFile</value> + <value>goldstandard.txt</value> </property> }}} + + Required file format for the stop words - The user can specify a custom list of stop words in a text file. Each new stopword should be on a new line. + - 2. Copy the stopword.txt file to the conf directory. The file should contain each word on a single line. Now, update the path in the nutch-site.xml file + 2. Copy the stopwords.txt file to the conf directory. Now, update the path in the nutch-site.xml file {{{ <property> <name>scoring.similarity.stopword.file</name> - <value>pathToFile</value> + <value>stopwords.txt</value> </property> }}} - 3. Enable the plugin by entering the following in the nutch-site.xml + + 3. Enable the plugin by enabling scoring-similarity in the plugin.includes property in nutch-site.xml {{{ <property> - <name>plugin.includes</name> + <name>plugin.includes</name> - <value>protocol-http|urlfilter-regex|parse-(text|html|js)|index-basic|query-(basic|site|url)|summary-basic|scoring-opic|urlnormalizer-(pass|regex|basic)</value> + <value>protocol-http|urlfilter-regex|parse-(html|tika)|scoring-similarity|urlnormalizer-(pass|regex|basic)</value> </property> }}}
