Approximately 15 minutes... machine is a PIII-500 with IDE drives if that
helps give you a feel for that time frame...
As the usage is climbing everything else becomes upresponsive (apache etc.)
due to the high server load... the percentage of CPU usage bounces between
the swapping process and index itself. Also, the hard drive doesn't pound
very much (as I was expecting when swapping that much). Is it possibly a
problem with the RH 7.1 swapping versus index itself? Also, the 3 IDE
drives are running as a software RAID0 configuration if that makes any
difference...
Thanks for all your help,
Paul
-----Original Message-----
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED]]On Behalf Of Kir Kolyshkin
Sent: Tuesday, July 17, 2001 7:18 AM
To: [EMAIL PROTECTED]
Subject: Re: [aseek-users] Index chewing up lots of RAM
Can you tell how much time it took index to grow to that size?
Paul Stewart �����(�):
>
> Hi there....
>
> My machine "crashes out" now when I run index. I'm not sure why as I
> recently added 5 new entries to my .conf file which were not big sites at
> all.
>
> Here's a capture....
>
> 964 nobody 16 0 960M 169M 100 R 16.8 67.8 2:13 index
>
> As you can see the process is eating up 960MB of memory. The server only
> has 256MB of physical RAM with 1 Gig of swap space. The swap space
actually
> runs out and the process gets killed off.
>
> This is RH 7.1 system. Here's my db stats:
>
> sh-2.04$ ./index -S
> Loading configuration from /usr/local/aspseek/etc/charsets.conf
> Loading configuration from /usr/local/aspseek/etc/ucharset.conf
> Loading configuration from /usr/local/aspseek/etc/stopwords.conf
> Loading configuration from /usr/local/aspseek/etc/aspseek.conf
>
> ASPSeek database statistics
>
> Status Expired Total
> -----------------------------
> 0 447 447 Not indexed yet
> 1 0 2 Unknown status
> 200 0 2553568 OK
> 204 0 9 No content
> 301 0 19283 Moved Permanently
> 302 0 14633 Moved Temporarily
> 401 0 1 Unauthorized
> 403 0 7 Forbidden
> 404 0 1675 Not found
> 503 0 1 Service Unavailable
> 504 0 1 Gateway Timeout
> -----------------------------
> Total 447 2589627
>
> Here's the physical directory dump:
>
> [root@canadian-links aspseek]# ls -l
> total 9802188
> -rw-rw---- 1 root root 8578 Jun 24 06:21 cache.frm
> -rw-rw---- 1 root root 0 Jul 16 20:41 cache.MYD
> -rw-rw---- 1 root root 1024 Jul 16 20:41 cache.MYI
> -rw-rw---- 1 root root 8592 Jun 24 06:21 citation.frm
> -rw-rw---- 1 root root 232841440 Jul 16 20:42 citation.MYD
> -rw-rw---- 1 root root 25406464 Jul 16 20:42 citation.MYI
> -rw-rw---- 1 root root 8638 Jun 24 06:21 countries.frm
> -rw-rw---- 1 root root 0 Jul 16 20:42 countries.MYD
> -rw-rw---- 1 root root 1024 Jul 16 20:42 countries.MYI
> -rw-rw---- 1 root root 8586 Jun 24 06:21 robots.frm
> -rw-rw---- 1 root root 47064 Jul 16 20:42 robots.MYD
> -rw-rw---- 1 root root 13312 Jul 16 20:42 robots.MYI
> -rw-rw---- 1 root root 8584 Jun 24 06:21 sites.frm
> -rw-rw---- 1 root root 6847764 Jul 16 20:42 sites.MYD
> -rw-rw---- 1 root root 5060608 Jul 16 20:42 sites.MYI
> -rw-rw---- 1 root root 8592 Jun 24 06:21 spaces.frm
> -rw-rw---- 1 root root 0 Jul 16 20:42 spaces.MYD
> -rw-rw---- 1 root root 1024 Jul 16 20:42 spaces.MYI
> -rw-rw---- 1 root root 8844 Jun 24 06:21 stat.frm
> -rw-rw---- 1 root root 1427640 Jul 17 06:21 stat.MYD
> -rw-rw---- 1 root root 1024 Jul 17 06:21 stat.MYI
> -rw-rw---- 1 root root 8588 Jun 24 06:21 subsets.frm
> -rw-rw---- 1 root root 0 Jul 16 20:42 subsets.MYD
> -rw-rw---- 1 root root 1024 Jul 16 20:42 subsets.MYI
> -rw-rw---- 1 root root 8586 Jun 24 06:21 tmpurl.frm
> -rw-rw---- 1 root root 6327 Jul 16 20:42 tmpurl.MYD
> -rw-rw---- 1 root root 1024 Jul 16 20:42 tmpurl.MYI
> -rw-rw---- 1 root root 8980 Jun 24 06:21 urlword.frm
> -rw-rw---- 1 root root 478827356 Jul 16 21:19 urlword.MYD
> -rw-rw---- 1 root root 192397312 Jul 16 21:30 urlword.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords00.frm
> -rw-rw---- 1 root root 547116188 Jul 16 21:32 urlwords00.MYD
> -rw-rw---- 1 root root 1209344 Jul 16 21:32 urlwords00.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords01.frm
> -rw-rw---- 1 root root 544095952 Jul 16 21:35 urlwords01.MYD
> -rw-rw---- 1 root root 1212416 Jul 16 21:35 urlwords01.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords02.frm
> -rw-rw---- 1 root root 544935196 Jul 16 21:38 urlwords02.MYD
> -rw-rw---- 1 root root 1209344 Jul 16 21:38 urlwords02.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords03.frm
> -rw-rw---- 1 root root 546948192 Jul 16 21:41 urlwords03.MYD
> -rw-rw---- 1 root root 1211392 Jul 16 21:41 urlwords03.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords04.frm
> -rw-rw---- 1 root root 543631744 Jul 16 21:44 urlwords04.MYD
> -rw-rw---- 1 root root 1211392 Jul 16 21:44 urlwords04.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords05.frm
> -rw-rw---- 1 root root 543227408 Jul 16 21:47 urlwords05.MYD
> -rw-rw---- 1 root root 1213440 Jul 16 21:47 urlwords05.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords06.frm
> -rw-rw---- 1 root root 549843600 Jul 16 21:50 urlwords06.MYD
> -rw-rw---- 1 root root 1212416 Jul 16 21:50 urlwords06.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords07.frm
> -rw-rw---- 1 root root 544697260 Jul 16 21:53 urlwords07.MYD
> -rw-rw---- 1 root root 1209344 Jul 16 21:53 urlwords07.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords08.frm
> -rw-rw---- 1 root root 550598180 Jul 16 21:56 urlwords08.MYD
> -rw-rw---- 1 root root 1210368 Jul 16 21:56 urlwords08.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords09.frm
> -rw-rw---- 1 root root 544674708 Jul 16 21:58 urlwords09.MYD
> -rw-rw---- 1 root root 1211392 Jul 16 21:58 urlwords09.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords10.frm
> -rw-rw---- 1 root root 544108812 Jul 16 22:01 urlwords10.MYD
> -rw-rw---- 1 root root 1210368 Jul 16 22:01 urlwords10.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords11.frm
> -rw-rw---- 1 root root 546674256 Jul 16 22:04 urlwords11.MYD
> -rw-rw---- 1 root root 1211392 Jul 16 22:04 urlwords11.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords12.frm
> -rw-rw---- 1 root root 546288040 Jul 16 22:07 urlwords12.MYD
> -rw-rw---- 1 root root 1206272 Jul 16 22:07 urlwords12.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords13.frm
> -rw-rw---- 1 root root 541582236 Jul 16 22:10 urlwords13.MYD
> -rw-rw---- 1 root root 1212416 Jul 16 22:10 urlwords13.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords14.frm
> -rw-rw---- 1 root root 555024980 Jul 16 22:13 urlwords14.MYD
> -rw-rw---- 1 root root 1210368 Jul 16 22:13 urlwords14.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords15.frm
> -rw-rw---- 1 root root 544165408 Jul 16 22:16 urlwords15.MYD
> -rw-rw---- 1 root root 1209344 Jul 16 22:16 urlwords15.MYI
> -rw-rw---- 1 root root 8580 Jun 24 06:21 wordsite.frm
> -rw-rw---- 1 root root 5234384 Jul 16 22:16 wordsite.MYD
> -rw-rw---- 1 root root 1495040 Jul 16 22:16 wordsite.MYI
> -rw-rw---- 1 root root 8676 Jun 24 06:21 wordurl1.frm
> -rw-rw---- 1 root root 0 Jul 16 22:25 wordurl1.MYD
> -rw-rw---- 1 root root 1024 Jul 16 22:25 wordurl1.MYI
> -rw-rw---- 1 root root 8676 Jun 24 06:21 wordurl.frm
> -rw-rw---- 1 root root 165680800 Jul 16 22:18 wordurl.MYD
> -rw-rw---- 1 root root 154699776 Jul 16 22:25 wordurl.MYI
>
> Any ideas?
>
> thanks,
>
> Paul Stewart
-- [EMAIL PROTECTED] http://kir.sever.net ICQ 7551596 --
Bend the facts to fit the conclusion. It's easier that way.
-- |_ | |\| |_| >< -- |_| |\| | >< -- | ) |\/| --
