MySQL Gurus:
 
I am working on a process to import data from a VMS database (SJ2) to
MySQL.
The table that I am importing has 10378507 (over 10 million) records in
it.  I have the records
exported to a comma-delimited text file, as the fields within the
database do not
contain any commas at all.
 
The command I am using to do the import is:
    mysql> LOAD DATA LOCAL INFILE '/home/warehouse/importfile.txt'
           -> INTO TABLE importtable
           -> FIELDS TERINATED BY ','
           -> ENCLOSED BY '"';
 
The process runs through (it takes about an hour into a non-indexed
MyISAM table).
At the end I get the following message:
    Query OK, 5184509 rows affected
    Records: 5184509    Deleted: 0    Skipped: 0    Warnings 13376589
 
I have logging turned on, but the log file only shows the MySQL commands
that I entered without showing me what
all the warnings are.
 
Now my questions:
    How can I see what the errors are that are occuring that cause half
of the records not to import?
    Has anyone every done an import of over 10 million records before?
Is there a limitation in MySQL?
 
Thank you in advance for you assistance with this issue.
 
Lorenzo Curtis
Dead River Company
[EMAIL PROTECTED]
www.deadriver.com



---------------------------------------------------------------------
Before posting, please check:
   http://www.mysql.com/manual.php   (the manual)
   http://lists.mysql.com/           (the list archive)

To request this thread, e-mail <[EMAIL PROTECTED]>
To unsubscribe, e-mail <[EMAIL PROTECTED]>
Trouble unsubscribing? Try: http://lists.mysql.com/php/unsubscribe.php

Reply via email to