- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Альберт
Subject: Re: Индексация только главной страницы.


DBAddr mysql://*:*...@localhost/dbsearch/?dbmode=single&charset=utf8

LocalCharset utf-8

Include stopwords.conf

Include langmap.conf

MaxDocSize 131072

IndexDocSizeLimit 65536


HTTPHeader "User-Agent: Tooby"
HTTPHeader "Accept-Language: ru"
HTTPHeader "From: [email protected]"


Disallow *.b    *.sh   *.md5  *.rpm
Disallow *.arj  *.tar  *.zip  *.tgz  *.gz   *.z     *.bz2 
Disallow *.lha  *.lzh  *.rar  *.zoo  *.ha   *.tar.Z
Disallow *.gif  *.jpg  *.jpeg *.bmp  *.tiff *.tif   *.xpm  *.xbm *.pcx
Disallow *.vdo  *.mpeg *.mpe  *.mpg  *.avi  *.movie *.mov  *.dat
Disallow *.mid  *.mp3  *.rm   *.ram  *.wav  *.aiff  *.ra
Disallow *.vrml *.wrl  *.png  *.psd
Disallow *.exe  *.com  *.cab  *.dll  *.bin  *.class *.ex_
Disallow *.tex  *.texi *.xls  *.doc  *.texinfo
Disallow *.rtf  *.pdf  *.cdf  *.ps
Disallow *.ai   *.eps  *.ppt  *.hqx
Disallow *.cpt  *.bms  *.oda  *.tcl
Disallow *.o    *.a    *.la   *.so 
Disallow *.pat  *.pm   *.m4   *.am   *.css
Disallow *.map  *.aif  *.sit  *.sea
Disallow *.m3u  *.qt   *.mov


Disallow *D=A *D=D *M=A *M=D *N=A *N=D *S=A *S=D *O=A *O=D

Disallow Regex \.r[0-9][0-9]$ \.a[0-9][0-9]$ \.so\.[0-9]$



AddType image/x-xpixmap *.xpm
AddType image/x-xbitmap *.xbm
AddType image/gif       *.gif

AddType text/plain                      *.txt  *.pl *.js *.h *.c *.pm *.e
AddType text/html                       *.html *.htm

AddType text/rtf                        *.rtf
AddType application/pdf                 *.pdf
AddType application/msword              *.doc
AddType application/vnd.ms-excel        *.xls
AddType text/x-postscript               *.ps


AddType application/unknown *.*


ParserTimeOut 300

DefaultLang ru

DetectClones yes

Include sections.conf

RemoteCharset utf-8

PopRankMethod Neo
PopRankPostpone yes
CollectLinks yes 
PopRankNeoIterations 10

Server hrefonly http://site.ru/

Realm regex /$]http://[^/]/$ 

DoStore yes
CheckInsertSQL yes
- - - - - - - - - - - - - - - - - - - - - - - - - - - -

Read the full topic here:
http://dataparksearch.org/cgi-bin/simpleforum.cgi?fid=05;topic_id=1232302008

Ответить