Hi there....
My machine "crashes out" now when I run index. I'm not sure why as I
recently added 5 new entries to my .conf file which were not big sites at
all.
Here's a capture....
964 nobody 16 0 960M 169M 100 R 16.8 67.8 2:13 index
As you can see the process is eating up 960MB of memory. The server only
has 256MB of physical RAM with 1 Gig of swap space. The swap space actually
runs out and the process gets killed off.
This is RH 7.1 system. Here's my db stats:
sh-2.04$ ./index -S
Loading configuration from /usr/local/aspseek/etc/charsets.conf
Loading configuration from /usr/local/aspseek/etc/ucharset.conf
Loading configuration from /usr/local/aspseek/etc/stopwords.conf
Loading configuration from /usr/local/aspseek/etc/aspseek.conf
ASPSeek database statistics
Status Expired Total
-----------------------------
0 447 447 Not indexed yet
1 0 2 Unknown status
200 0 2553568 OK
204 0 9 No content
301 0 19283 Moved Permanently
302 0 14633 Moved Temporarily
401 0 1 Unauthorized
403 0 7 Forbidden
404 0 1675 Not found
503 0 1 Service Unavailable
504 0 1 Gateway Timeout
-----------------------------
Total 447 2589627
Here's the physical directory dump:
[root@canadian-links aspseek]# ls -l
total 9802188
-rw-rw---- 1 root root 8578 Jun 24 06:21 cache.frm
-rw-rw---- 1 root root 0 Jul 16 20:41 cache.MYD
-rw-rw---- 1 root root 1024 Jul 16 20:41 cache.MYI
-rw-rw---- 1 root root 8592 Jun 24 06:21 citation.frm
-rw-rw---- 1 root root 232841440 Jul 16 20:42 citation.MYD
-rw-rw---- 1 root root 25406464 Jul 16 20:42 citation.MYI
-rw-rw---- 1 root root 8638 Jun 24 06:21 countries.frm
-rw-rw---- 1 root root 0 Jul 16 20:42 countries.MYD
-rw-rw---- 1 root root 1024 Jul 16 20:42 countries.MYI
-rw-rw---- 1 root root 8586 Jun 24 06:21 robots.frm
-rw-rw---- 1 root root 47064 Jul 16 20:42 robots.MYD
-rw-rw---- 1 root root 13312 Jul 16 20:42 robots.MYI
-rw-rw---- 1 root root 8584 Jun 24 06:21 sites.frm
-rw-rw---- 1 root root 6847764 Jul 16 20:42 sites.MYD
-rw-rw---- 1 root root 5060608 Jul 16 20:42 sites.MYI
-rw-rw---- 1 root root 8592 Jun 24 06:21 spaces.frm
-rw-rw---- 1 root root 0 Jul 16 20:42 spaces.MYD
-rw-rw---- 1 root root 1024 Jul 16 20:42 spaces.MYI
-rw-rw---- 1 root root 8844 Jun 24 06:21 stat.frm
-rw-rw---- 1 root root 1427640 Jul 17 06:21 stat.MYD
-rw-rw---- 1 root root 1024 Jul 17 06:21 stat.MYI
-rw-rw---- 1 root root 8588 Jun 24 06:21 subsets.frm
-rw-rw---- 1 root root 0 Jul 16 20:42 subsets.MYD
-rw-rw---- 1 root root 1024 Jul 16 20:42 subsets.MYI
-rw-rw---- 1 root root 8586 Jun 24 06:21 tmpurl.frm
-rw-rw---- 1 root root 6327 Jul 16 20:42 tmpurl.MYD
-rw-rw---- 1 root root 1024 Jul 16 20:42 tmpurl.MYI
-rw-rw---- 1 root root 8980 Jun 24 06:21 urlword.frm
-rw-rw---- 1 root root 478827356 Jul 16 21:19 urlword.MYD
-rw-rw---- 1 root root 192397312 Jul 16 21:30 urlword.MYI
-rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords00.frm
-rw-rw---- 1 root root 547116188 Jul 16 21:32 urlwords00.MYD
-rw-rw---- 1 root root 1209344 Jul 16 21:32 urlwords00.MYI
-rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords01.frm
-rw-rw---- 1 root root 544095952 Jul 16 21:35 urlwords01.MYD
-rw-rw---- 1 root root 1212416 Jul 16 21:35 urlwords01.MYI
-rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords02.frm
-rw-rw---- 1 root root 544935196 Jul 16 21:38 urlwords02.MYD
-rw-rw---- 1 root root 1209344 Jul 16 21:38 urlwords02.MYI
-rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords03.frm
-rw-rw---- 1 root root 546948192 Jul 16 21:41 urlwords03.MYD
-rw-rw---- 1 root root 1211392 Jul 16 21:41 urlwords03.MYI
-rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords04.frm
-rw-rw---- 1 root root 543631744 Jul 16 21:44 urlwords04.MYD
-rw-rw---- 1 root root 1211392 Jul 16 21:44 urlwords04.MYI
-rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords05.frm
-rw-rw---- 1 root root 543227408 Jul 16 21:47 urlwords05.MYD
-rw-rw---- 1 root root 1213440 Jul 16 21:47 urlwords05.MYI
-rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords06.frm
-rw-rw---- 1 root root 549843600 Jul 16 21:50 urlwords06.MYD
-rw-rw---- 1 root root 1212416 Jul 16 21:50 urlwords06.MYI
-rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords07.frm
-rw-rw---- 1 root root 544697260 Jul 16 21:53 urlwords07.MYD
-rw-rw---- 1 root root 1209344 Jul 16 21:53 urlwords07.MYI
-rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords08.frm
-rw-rw---- 1 root root 550598180 Jul 16 21:56 urlwords08.MYD
-rw-rw---- 1 root root 1210368 Jul 16 21:56 urlwords08.MYI
-rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords09.frm
-rw-rw---- 1 root root 544674708 Jul 16 21:58 urlwords09.MYD
-rw-rw---- 1 root root 1211392 Jul 16 21:58 urlwords09.MYI
-rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords10.frm
-rw-rw---- 1 root root 544108812 Jul 16 22:01 urlwords10.MYD
-rw-rw---- 1 root root 1210368 Jul 16 22:01 urlwords10.MYI
-rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords11.frm
-rw-rw---- 1 root root 546674256 Jul 16 22:04 urlwords11.MYD
-rw-rw---- 1 root root 1211392 Jul 16 22:04 urlwords11.MYI
-rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords12.frm
-rw-rw---- 1 root root 546288040 Jul 16 22:07 urlwords12.MYD
-rw-rw---- 1 root root 1206272 Jul 16 22:07 urlwords12.MYI
-rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords13.frm
-rw-rw---- 1 root root 541582236 Jul 16 22:10 urlwords13.MYD
-rw-rw---- 1 root root 1212416 Jul 16 22:10 urlwords13.MYI
-rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords14.frm
-rw-rw---- 1 root root 555024980 Jul 16 22:13 urlwords14.MYD
-rw-rw---- 1 root root 1210368 Jul 16 22:13 urlwords14.MYI
-rw-rw---- 1 root root 8952 Jun 24 06:21 urlwords15.frm
-rw-rw---- 1 root root 544165408 Jul 16 22:16 urlwords15.MYD
-rw-rw---- 1 root root 1209344 Jul 16 22:16 urlwords15.MYI
-rw-rw---- 1 root root 8580 Jun 24 06:21 wordsite.frm
-rw-rw---- 1 root root 5234384 Jul 16 22:16 wordsite.MYD
-rw-rw---- 1 root root 1495040 Jul 16 22:16 wordsite.MYI
-rw-rw---- 1 root root 8676 Jun 24 06:21 wordurl1.frm
-rw-rw---- 1 root root 0 Jul 16 22:25 wordurl1.MYD
-rw-rw---- 1 root root 1024 Jul 16 22:25 wordurl1.MYI
-rw-rw---- 1 root root 8676 Jun 24 06:21 wordurl.frm
-rw-rw---- 1 root root 165680800 Jul 16 22:18 wordurl.MYD
-rw-rw---- 1 root root 154699776 Jul 16 22:25 wordurl.MYI
Any ideas?
thanks,
Paul Stewart
