Hi all,

 

I want to load a Master table millions of rows for other sources with a
unique index on e.g. ssn social sec number.

If  inserted records have a duplicate SSN I don't want to insert those
but put  them in a duplicate table or flag them.

.

The primary key will be an auto-increment field. There will be  other
indexes such as zipcode..

 

What is the fastest way to load these rows and remove duplicates ?

Assume I load the rows to be inserted into another table.

 

1.      Check if the ssn already exists before inserting the row ?

 

2.  Insert the row and ignore duplicate using 

insert into master ( .)  

      select .. From loaddata 

 

I have lots of  files with data that can be saved to load tables and
then inserted into the master table.

 

 

Regards, Paul

 

 

Reply via email to