Hi, Is there anything your mysql errog log? Did MySQL crashed or stopped unexpectedly while the script was running? I guess it is probably something with your memory usage configuration - please send your my.cnf file and on what machine you are running your MySQL server.
-- Dobromir Velev [EMAIL PROTECTED] http://www.websitepulse.com/ On Tuesday 02 November 2004 12:45, John Smith wrote: > Hi All, > > I have built a search application in php/libcurl and I store its results in > MySQL. > > The problem is that I am not used to dealing with the sizes of tables my > search application produces, roughly around 400,000 rows in a table the > last time I got ran it correctly. > > Right to my problem. > > I fork 20 versions of my spider at a time, these forks all have a > connection to the database and do selects, inserts and updates on the same > table at once. When its going at full steam I can be inserts 1000s of rows > a minute. > > I am using MyISAM as I need its fulltext search cabablities. I remove the > fulltext index before I start any changes to the table. > > I am finding that my php script is not being able to select from the > database at random points, I have tracked this down to a 127 erros, the > table it corrupt. > > Before I start my spiders (before it forks) I run myisamck -r on my .MYI > file but it corrupts during the scripts execution time and this means it is > no longer able to select from the DB (Curcial to know if its needing > updated or inserted as a new record) > > Any hints, any more information needed from me etc would be great. > > My table struture is: > > CREATE TABLE thetable ( > id int(11) NOT NULL auto_increment, > sid int(11) NOT NULL default '1', > pid varchar(14) NOT NULL default '0', > tid varchar(255) NOT NULL default '', > cid varchar(255) NOT NULL default '', > location text NOT NULL, > number int(14) NOT NULL default '0', > image text NOT NULL, > description text NOT NULL, > link text NOT NULL, > uo tinyint(1) NOT NULL default '0', > sd tinyint(1) NOT NULL default '0', > added int(14) NOT NULL default '0', > new tinyint(4) NOT NULL default '1', > old tinyint(4) NOT NULL default '0', > PRIMARY KEY (id), > KEY sid (sid), > KEY old (old), > KEY new (new), > KEY sd (sd), > KEY uo (uo), > KEY pid (pid), > KEY tid (tid), > KEY cid (cid) > ) > > Ta, > John > > ___________________________________________________ > Have your own email and web address for life. > > http://www.homemaster.net - Homemaster. Come Together. Online. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe: http://lists.mysql.com/[EMAIL PROTECTED]