Dear Wiki user, You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification.
The "IndexStructure" page has been changed by LewisJohnMcgibbney: http://wiki.apache.org/nutch/IndexStructure?action=diff&rev1=14&rev2=15 ||'''Field Name'''||'''Stored'''||'''Index'''|| '''Plugin''' ||'''Comment'''|| || boost || YES || Not Indexed || scoring-opic/link || Adds a '''score''' value field to a particular document. This is allocated based upon its importance within the webgraph. || - || digest || YES || Not Indexed || /!\ NEEDS COMMENT /!\ || /!\ NEEDS COMMENT /!\ || + || digest || YES || Not Indexed || /!\ NEEDS COMMENT /!\|| Adds a '''message digest''' field to a document. Can be MD5 over content and headers or more sophisticated text profile of the content. || || lang || YES || Un-Tokenized || language-identifier || Add a '''lang''', language field to a document.|| - || segment || YES || Not Indexed || /!\ NEEDS COMMENT /!\ || /!\ NEEDS COMMENT /!\ || - || tstamp || YES || Tokenized || /!\ NEEDS COMMENT /!\ || /!\ NEEDS COMMENT /!\ || + || segment || YES || Not Indexed || /!\ NEEDS COMMENT /!\ || Adds the originating '''segment''' field to the document, used to identify the most recent segment in which this document was fetched. || + || tstamp || YES || Tokenized || /!\ NEEDS COMMENT /!\ || Adds a '''timestamp''' field of the most recent time this document was fetched || || cc:license || YES || Indexed, Tokenized || creativecommons || Adds the entire license as '''cc:license=xxx''' and '''attributes''' extracted of the license url|| || cc:meta || YES || Indexed, Tokenized || creativecommons || Adds the license location as '''cc:meta=xxx''' || || cc:type || YES || Indexed,Tokenized || creativecommons || Adds the work type as '''cc:type=xxx'''||
