Can you tell how much time it took index to grow to that size?
Paul Stewart �����(�):
>
> Hi there....
>
> My machine "crashes out" now when I run index. I'm not sure why as I
> recently added 5 new entries to my .conf file which were not big sites at
> all.
>
> Here's a capture....
>
> 964 nobody 16 0 960M 169M 100 R 16.8 67.8 2:13 index
>
> As you can see the process is eating up 960MB of memory. The server only
> has 256MB of physical RAM with 1 Gig of swap space. The swap space actually
> runs out and the process gets killed off.
>
> This is RH 7.1 system. Here's my db stats:
>
> sh-2.04$ ./index -S
> Loading configuration from /usr/local/aspseek/etc/charsets.conf
> Loading configuration from /usr/local/aspseek/etc/ucharset.conf
> Loading configuration from /usr/local/aspseek/etc/stopwords.conf
> Loading configuration from /usr/local/aspseek/etc/aspseek.conf
>
> ASPSeek database statistics
>
> Status Expired Total
> -----------------------------
> 0 447 447 Not indexed yet
> 1 0 2 Unknown status
> 200 0 2553568 OK
> 204 0 9 No content
> 301 0 19283 Moved Permanently
> 302 0 14633 Moved Temporarily
> 401 0 1 Unauthorized
> 403 0 7 Forbidden
> 404 0 1675 Not found
> 503 0 1 Service Unavailable
> 504 0 1 Gateway Timeout
> -----------------------------
> Total 447 2589627
>
> Here's the physical directory dump:
>
> [root@canadian-links aspseek]# ls -l
> total 9802188
> -rw-rw---- 1 root root 8578 Jun 24 06:21 cache.frm
> -rw-rw---- 1 root root 0 Jul 16 20:41 cache.MYD
> -rw-rw---- 1 root root 1024 Jul 16 20:41 cache.MYI
> -rw-rw---- 1 root root 8592 Jun 24 06:21 citation.frm
> -rw-rw---- 1 root root 232841440 Jul 16 20:42 citation.MYD
> -rw-rw---- 1 root root 25406464 Jul 16 20:42 citation.MYI
> -rw-rw---- 1 root root 8638 Jun 24 06:21 countries.frm
> -rw-rw---- 1 root root 0 Jul 16 20:42 countries.MYD
> -rw-rw---- 1 root root 1024 Jul 16 20:42 countries.MYI
> -rw-rw---- 1 root root 8586 Jun 24 06:21 robots.frm
> -rw-rw---- 1 root root 47064 Jul 16 20:42 robots.MYD
> -rw-rw---- 1 root root 13312 Jul 16 20:42 robots.MYI
> -rw-rw---- 1 root root 8584 Jun 24 06:21 sites.frm
> -rw-rw---- 1 root root 6847764 Jul 16 20:42 sites.MYD
> -rw-rw---- 1 root root 5060608 Jul 16 20:42 sites.MYI
> -rw-rw---- 1 root root 8592 Jun 24 06:21 spaces.frm
> -rw-rw---- 1 root root 0 Jul 16 20:42 spaces.MYD
> -rw-rw---- 1 root root 1024 Jul 16 20:42 spaces.MYI
> -rw-rw---- 1 root root 8844 Jun 24 06:21 stat.frm
> -rw-rw---- 1 root root 1427640 Jul 17 06:21 stat.MYD
> -rw-rw---- 1 root root 1024 Jul 17 06:21 stat.MYI
> -rw-rw---- 1 root root 8588 Jun 24 06:21 subsets.frm
> -rw-rw---- 1 root root 0 Jul 16 20:42 subsets.MYD
> -rw-rw---- 1 root root 1024 Jul 16 20:42 subsets.MYI
> -rw-rw---- 1 root root 8586 Jun 24 06:21 tmpurl.frm
> -rw-rw---- 1 root root 6327 Jul 16 20:42 tmpurl.MYD
> -rw-rw---- 1 root root 1024 Jul 16 20:42 tmpurl.MYI
> -rw-rw---- 1 root root 8980 Jun 24 06:21 urlword.frm
> -rw-rw---- 1 root root 478827356 Jul 16 21:19 urlword.MYD
> -rw-rw---- 1 root root 192397312 Jul 16 21:30 urlword.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords00.frm
> -rw-rw---- 1 root root 547116188 Jul 16 21:32 urlwords00.MYD
> -rw-rw---- 1 root root 1209344 Jul 16 21:32 urlwords00.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords01.frm
> -rw-rw---- 1 root root 544095952 Jul 16 21:35 urlwords01.MYD
> -rw-rw---- 1 root root 1212416 Jul 16 21:35 urlwords01.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords02.frm
> -rw-rw---- 1 root root 544935196 Jul 16 21:38 urlwords02.MYD
> -rw-rw---- 1 root root 1209344 Jul 16 21:38 urlwords02.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords03.frm
> -rw-rw---- 1 root root 546948192 Jul 16 21:41 urlwords03.MYD
> -rw-rw---- 1 root root 1211392 Jul 16 21:41 urlwords03.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords04.frm
> -rw-rw---- 1 root root 543631744 Jul 16 21:44 urlwords04.MYD
> -rw-rw---- 1 root root 1211392 Jul 16 21:44 urlwords04.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords05.frm
> -rw-rw---- 1 root root 543227408 Jul 16 21:47 urlwords05.MYD
> -rw-rw---- 1 root root 1213440 Jul 16 21:47 urlwords05.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords06.frm
> -rw-rw---- 1 root root 549843600 Jul 16 21:50 urlwords06.MYD
> -rw-rw---- 1 root root 1212416 Jul 16 21:50 urlwords06.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords07.frm
> -rw-rw---- 1 root root 544697260 Jul 16 21:53 urlwords07.MYD
> -rw-rw---- 1 root root 1209344 Jul 16 21:53 urlwords07.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords08.frm
> -rw-rw---- 1 root root 550598180 Jul 16 21:56 urlwords08.MYD
> -rw-rw---- 1 root root 1210368 Jul 16 21:56 urlwords08.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords09.frm
> -rw-rw---- 1 root root 544674708 Jul 16 21:58 urlwords09.MYD
> -rw-rw---- 1 root root 1211392 Jul 16 21:58 urlwords09.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords10.frm
> -rw-rw---- 1 root root 544108812 Jul 16 22:01 urlwords10.MYD
> -rw-rw---- 1 root root 1210368 Jul 16 22:01 urlwords10.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords11.frm
> -rw-rw---- 1 root root 546674256 Jul 16 22:04 urlwords11.MYD
> -rw-rw---- 1 root root 1211392 Jul 16 22:04 urlwords11.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords12.frm
> -rw-rw---- 1 root root 546288040 Jul 16 22:07 urlwords12.MYD
> -rw-rw---- 1 root root 1206272 Jul 16 22:07 urlwords12.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords13.frm
> -rw-rw---- 1 root root 541582236 Jul 16 22:10 urlwords13.MYD
> -rw-rw---- 1 root root 1212416 Jul 16 22:10 urlwords13.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords14.frm
> -rw-rw---- 1 root root 555024980 Jul 16 22:13 urlwords14.MYD
> -rw-rw---- 1 root root 1210368 Jul 16 22:13 urlwords14.MYI
> -rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords15.frm
> -rw-rw---- 1 root root 544165408 Jul 16 22:16 urlwords15.MYD
> -rw-rw---- 1 root root 1209344 Jul 16 22:16 urlwords15.MYI
> -rw-rw---- 1 root root 8580 Jun 24 06:21 wordsite.frm
> -rw-rw---- 1 root root 5234384 Jul 16 22:16 wordsite.MYD
> -rw-rw---- 1 root root 1495040 Jul 16 22:16 wordsite.MYI
> -rw-rw---- 1 root root 8676 Jun 24 06:21 wordurl1.frm
> -rw-rw---- 1 root root 0 Jul 16 22:25 wordurl1.MYD
> -rw-rw---- 1 root root 1024 Jul 16 22:25 wordurl1.MYI
> -rw-rw---- 1 root root 8676 Jun 24 06:21 wordurl.frm
> -rw-rw---- 1 root root 165680800 Jul 16 22:18 wordurl.MYD
> -rw-rw---- 1 root root 154699776 Jul 16 22:25 wordurl.MYI
>
> Any ideas?
>
> thanks,
>
> Paul Stewart
-- [EMAIL PROTECTED] http://kir.sever.net ICQ 7551596 --
Bend the facts to fit the conclusion. It's easier that way.
-- |_ | |\| |_| >< -- |_| |\| | >< -- | ) |\/| --
