try csplit to break the files into small chunks On Fri, Jun 13, 2008 at 12:21 PM, Ananda Kumar <[EMAIL PROTECTED]> wrote:
> How do i split file during ENABLE KEYS > > > On 6/13/08, Krishna Chandra Prajapati <[EMAIL PROTECTED]> wrote: >> >> increase bulk_insert_buffer_size and if possible split the bigger file >> into small chunks. It will help you. >> >> On Thu, Jun 12, 2008 at 1:51 PM, Ananda Kumar <[EMAIL PROTECTED]> wrote: >> >>> Hi All, >>> We are doing load data into a table using LOAD DATA INFILE process. Below >>> is >>> the method we are following. >>> >>> 1. create empty table with all the indexes. >>> 2. disable keys >>> 3. Load data using LOAD DATA INFILE, close to 99 Million records which >>> takes >>> around 3 hrs >>> 4 . Enable keys >>> >>> Table size is around 19.5 gb >>> >>> There is one primary key, 2 non unique indexes and one FULLTEXT INDEX. >>> >>> Enable kyes goes fine for couple of hrs with "REPAIR BY TMP", but then >>> switches to "REPAIR BY KEYCACHE" and writes a log in the error log >>> file "Warning: >>> Enabling keys got errno 28, retrying" >>> >>> What could be the problem. >>> >>> System has 8 cpu and 16GB RAM >>> >>> I have set myisam_max_sort_file_size=98GB >>> myisam_sort_buffer_size=750MB. >>> >>> /tmp folder has 16GB free space. >>> >>> please let me know, this problem is causing lot of dealy for other >>> process >>> to run. >>> >>> regards >>> anandkl >>> >> >> >> >> -- >> Krishna Chandra Prajapati >> MySQL DBA, >> Ed Ventures e-Learning Pvt.Ltd. >> 1-8-303/48/15, Sindhi Colony >> P.G.Road, Secunderabad. >> Pin Code: 500003 >> Office Number: 040-66489771 >> Mob: 9912924044 >> URL: ed-ventures-online.com >> Email-id: [EMAIL PROTECTED] > > > -- Krishna Chandra Prajapati MySQL DBA, Ed Ventures e-Learning Pvt.Ltd. 1-8-303/48/15, Sindhi Colony P.G.Road, Secunderabad. Pin Code: 500003 Office Number: 040-66489771 Mob: 9912924044 URL: ed-ventures-online.com Email-id: [EMAIL PROTECTED]
