"La Rocca Network, Inc." wrote:
> Hi !
>
> 1) while trying to index nntp://somenewsserver the indexer just crashes
I thought someone said previously that nntp/news searching under windows does
not work anyhow.... (disabled/not implemented)
>
> 2) any user of windows having problems while indexing ... pls. let me know
> it seems I'm the only one since I haven't heard from anyone else even I
> posted the same msg. lot of times. Neither even from the mnogosearch team.
Not played with the windows version so cannot comment here...
>
>
> 3) I would like to know from the creators and experienced users if it would
> be worth to migrate from the windows version to the linux one to get (a)
> better performance
IMHO Sun E420/E450's will give you the best performance, however do you need
that much power is the question...
Currently I run 2 engines - A news engine and a web engine...
The news engine runs off a P Pro 200 Compaq Deskpro with 64M RAM running Linux
Mandrake 8.0... it returns results under 10 seconds even when busy... this time
increases to 30 seconds when indexing large batches of new news.... this is the
reason why I wrote a news listener which passes the news to the local filesystem
and the indexer as it arrives, it then auto splits the news. The idea being that
it will keep the server from busying itself up.... I will post that code to the
developers when I have finished it completely and when I have got rid of the
bugs...Currently it is running but occasionally fails.
The web search engine has 400,000+ documents and it running on a Sparc U10,
1x440M processor with 1G RAM... results are returned in under 2 seconds
regardless of whether it is indexing/splitting or busy.
> (b) best data security in terms of stability.
... *NIX vs NT..... hmmm hard choice there for both stability and security...
> We are
> decided to get paid support, but we would like what to choose from the
> beginning. We plan to index millions of documents and we need performance
> and scability.
> we have Sun equipment with raid-5, 18 Gb. each hard disk to start.
> besides that we have 15 rackable compaq servers with 18Gb. mirrored hd,
> redundant power supply and so on, and enough bandwidth.
You should not have problems but run the *NIX version and take out support with
the developers.
Yours
Matthew
begin:vcard
n:Sullivan;Matthew
tel;cell:+61 (0)414 861 744 (Not for work use)
tel;fax:+61 (0)3 9693 7699
tel;home:+61 (0)3 9397 4859
tel;work:+61 (0)3 9693 7640
x-mozilla-html:TRUE
url:http://people.netscape.com/matthews/
org:<TABLE cols=2 width=350 spacing=0 rows=1><TR><TD width=50><img src="http://people.netscape.com/matthews/penguin.gif"></TD><TD><TABLE width=250 spacing=0 border=0><TR><TD><FONT SIZE=2>Senior Technical Support Engineer<TR><TD><FONT SIZE=2>iPlanet E-Commerce Solutions<TR><TD><FONT SIZE=2>Netscape Communications Australia Pty Ltd<TR><TD><FONT SIZE=2>A division of America On Line Inc.</TABLE></TABLE>
version:2.1
email;internet:[EMAIL PROTECTED]
adr;quoted-printable:;;Netscape Communications Australia=0D=0A;Level 1, The Tea House, 28 Clarendon Street;South Melbourne;VIC 3205;Australia
x-mozilla-cpt:nemesis.netscape.com;-18464
fn:Matthew Sullivan
end:vcard
S/MIME Cryptographic Signature