I would always stick with the oracle tools for speed. Sqlloader behaves
strangely
Sometimes but unless you need to use perl for a specific reason I would
stick with
It.
Another option is to split the data into parts and run multiple parallel
loads. This
Depends on you having an SMP system and assumes that storage is not
bottlenecking before
Cpu/memory. This method can also be used with sql loader.
In terms of speeding up the perl side of things:
1.) Run the script locally with the database connections using named
pipes not tcp/ip.
You can check for this by doing a ps -aef | grep $ORACLE_SID
| grep LOCAL
and looking for your connection in here. It shoud say
LOCAL=YES
2.) Use bind variables for the inserts
3.) Parse your insert statement once only at the beginning
If you still think the performance of your perl code is poor then post an
example
Of it to the list and then people can comment in the perl side of it.
I would suggest reading the "DBI Advanced Talk" by Tim Bunce available here:
http://www.cpan.org/modules/by-authors/id/TIMB/DBI_AdvancedTalk_200307.tar.g
z
It contains numerous performance hints.
Cheers
Andy
> -----Original Message-----
> From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]
> Sent: 26 February 2004 10:57
> To: [EMAIL PROTECTED]
> Subject: Oracle Direct Pass
>
> Hello,
> Sorry if it is FAQ.
>
> So called "Direct Pass" can be used by DBD::Oracle?
>
> I ususally load data by my script made with DBI/DBD::Oracle.
> But sometimes when the data is so big I wonder if I should use
> my script or use SQL*LOADER.
> I like Perl so much but I can't wait so long.
> I like to know perl script is how fast than SQL*LOADER.
> Any hint on speeding up perl script when loading mass data?
__________________________
This email and any files transmitted with it are confidential and intended solely for
the use of the individual or entity to whom they are addressed. The contents are
confidential and may be privileged.
Any views or opinions expressed are those of the sender and may not reflect the views
or opinions of the company and the company accepts no liability in respect thereof.
If you have received this email in error please notify [EMAIL PROTECTED] immediately.
________________________________________________________________________
This e-mail has been scanned for all viruses by Star Internet. The
service is powered by MessageLabs. For more information on a proactive
anti-virus service working around the clock, around the globe, visit:
http://www.star.net.uk
________________________________________________________________________
