Thanks Mladen, I was just gonna ask that question. Didn't know that particular trick.
Jared On Saturday 31 May 2003 19:48, Mladen Gogala wrote: > How do you set pipes accross the network? Using rsh/remsh, of course! > dd if=expdat.dmp|rsh node2 dd of=/tmp/expdat.dmp > > It doesn't matter if "expdat.dmp" files on both nodes are pipes. > > On 2003.05.31 19:04 Babette Turner-Underwood wrote: > > Sorry about the late response - - - Catching up > > > > Do you remember the syntax to do this? > > How do you set up UNIX pipes across a network? > > > > Thanks > > Babette > > > > -----Original Message----- > > Greenfield > > Sent: Thursday, May 15, 2003 2:02 PM > > To: Multiple recipients of list ORACLE-L > > > > > > For a two terabyte data transfer at one client, we wrote a > > C extractor, ran it in four-plicate on partitioned data, sent > > the output directly to pipes, sent those pipes zooming across > > the 400 Mbit network into waiting pipes that served as the > > input files for direct path SQL Loader. > > > > That was amazingly fast, and loads of fun, sort of like a data > > warehouse rube goldberg device. > > > > Actually, it was blazingly fast in test, I left the project > > before it hit production... > > > > > -----Original Message----- > > > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Behalf Of Mladen > > > Gogala > > > Sent: Thursday, May 15, 2003 12:27 AM > > > To: Multiple recipients of list ORACLE-L > > > Subject: Re: quickest method > > > > > > > > > Essentially, yes, that's precisely the way to do it. You do an array > > > fetch > > > into a C/C++ array and write it out. As for setbuf, setvbuf > > > and printf, > > > in > > > my opinion, the best thing to do is to use mmap to map the file to a > > > buffer > > > and then use sprintf to populate the output buffer. If you > > > don't want to > > > play with mmap/munpap you can always use just a simple and > > > unpretentious > > > write call, just like printf does. > > > > > > On 2003.05.14 23:17 Ryan wrote: > > > > I know C/C++ moderately well. I thought PRO*C just added pragmas to > > > > embed > > > > SQL? Why is it faster? So your just doing some selects into > > > > > > variables > > > > > > > and > > > > Printf() to a file? > > > > ----- Original Message ----- > > > > To: "Multiple recipients of list ORACLE-L" <[EMAIL PROTECTED]> > > > > Sent: Wednesday, May 14, 2003 10:22 PM > > > > > > > > > PRO*C using array fetches. Nothing's faster than a simple > > > > > > > > "printf()", > > > > > > > > > especially if you increase output buffer settings with > > > > > > "setbuf()"... > > > > > > > > on 5/14/03 6:01 PM, Ryan at [EMAIL PROTECTED] wrote: > > > > > > If SQLLOADER is the faster to load data, what is the fastest to > > > > > > > > unload > > > > it? > > > > > > > > > > UTL_FILE is notoriously slow. > > > > > > ----- Original Message ----- > > > > > > To: "Multiple recipients of list ORACLE-L" > > > > > > <[EMAIL PROTECTED]> > > > > > > > > > Sent: Wednesday, May 14, 2003 7:01 PM > > > > > > > > > > > >> Carol, > > > > > >> > > > > > >> Hands down, SQL Loader is the fastest. > > > > > >> > > > > > >> Export/Import is rather slow. > > > > > >> > > > > > >> SQL and PL/SQL commands can be on either side of exp/imp, > > > > > > > > depending > > > > > > > > > >> on what you are doing and how well the code is written. > > > > > >> > > > > > >> e.g. SQL statements are fairly fast, PL/SQL for loops are not. > > > > > > > > Pl/SQL > > > > > > > > > >> bulk > > > > > >> processing is fast. > > > > > >> > > > > > >> > > > > > >> Unless you need the programatic abilities of PL/SQL, use SQL > > > > > > > > Loader. > > > > > > > > > >> Exp/Imp can still be useful, even with SQL Loader. Use exp/imp > > > > > > > > to > > > > build > > > > > > > > > >> your tables, then the indexes and constraints after the data is > > > > > > > > loader. > > > > > > > > > >> No pat answer as to how to load data, depends on your > > > > > > > > requirements. > > > > > > > > > >> There's probably no point in messing with SQL Loader > > > > > > if the data > > > > > > > sets > > > > > > > > > >> are small, and you can easily export from another database and > > > > > > > > then > > > > > > > > > >> import. > > > > > >> > > > > > >> If the data is in CSV or flat files though, and/or is > > > > > > very large, > > > > > > > SQL > > > > > > > > > >> Loader > > > > > >> is very fast. > > > > > >> > > > > > >> HTH > > > > > >> > > > > > >> Jared > > > > > >> > > > > > >> > > > > > >> > > > > > >> > > > > > >> > > > > > >> > > > > > >> "Carol Legros" <[EMAIL PROTECTED]> > > > > > >> Sent by: [EMAIL PROTECTED] > > > > > >> 05/14/2003 02:57 PM > > > > > >> Please respond to ORACLE-L > > > > > >> > > > > > >> > > > > > >> To: Multiple recipients of list ORACLE-L > > > > > > > > > > > > <[EMAIL PROTECTED]> > > > > > > > > > > > >> cc: > > > > > >> Subject: quickest method > > > > > >> > > > > > >> > > > > > >> I'm curious to know whether anyone out there has seen a > > > > > > > > comparison > > > > > > > > > >> discussing the pros and cons and/or results of any simulation > > > > > > > > tests > > > > that > > > > > > > > > >> compare the speed with which data can be loaded into a target > > > > > > > > database > > > > > > > > > >> from > > > > > >> a source (database or flat file) using the following 3 > > > > > > methods : > > > > > >> (i) Export (from source), Import (to target) > > > > > >> (ii) SQL*Loader (to target) > > > > > >> (iii) SQL or PL/SQL commands (insert to target) > > > > > >> using a Database Link between source & > > > > > >> target > > > > > >> > > > > > >> I'm working on a data loading strategy and since there > > > > > > are "many > > > > > > > ways > > > > to > > > > > > > > > >> skin a cat", I'm considering these as options. Of > > > > > > course, there > > > > > > > are > > > > other > > > > > > > > > >> criteria that impact the method chosen, but assuming all things > > > > > > > > are > > > > equal > > > > > > > > > >> (ie network bandwidth is good, access to both source and target > > > > > > > > are not > > > > an > > > > > > > > > >> issue etc.), which of these methods would be quickest ? > > > > > >> > > > > > >> Thanks, > > > > > >> Carol > > > > > > _________________________________________________________________ > > > > > > > > >> Add photos to your e-mail with MSN 8. Get 2 months FREE*. > > > > > >> http://join.msn.com/?page=features/featuredemail > > > > > >> > > > > > >> -- > > > > > >> Please see the official ORACLE-L FAQ: http://www.orafaq.net > > > > > >> -- > > > > > >> Author: Carol Legros > > > > > >> INET: [EMAIL PROTECTED] > > > > > >> > > > > > >> Fat City Network Services -- 858-538-5051 > > > > > > > > http://www.fatcity.com > > > > > > > > > >> San Diego, California -- Mailing list and web hosting > > > > > > > > services > > > > > > --------------------------------------------------------------------- > > > > > > > > >> To REMOVE yourself from this mailing list, send an > > > > > > E-Mail message > > > > > > > > >> to: [EMAIL PROTECTED] (note EXACT spelling of > > > > > > 'ListGuru') and > > > > > > > in > > > > > > > > > >> the message BODY, include a line containing: UNSUB ORACLE-L > > > > > >> (or the name of mailing list you want to be removed from). You > > > > > > > > may > > > > > > > > > >> also send the HELP command for other information (like > > > > > > > > subscribing). > > > > > > > > > >> -- > > > > > >> Please see the official ORACLE-L FAQ: http://www.orafaq.net > > > > > >> -- > > > > > >> Author: > > > > > >> INET: [EMAIL PROTECTED] > > > > > >> > > > > > >> Fat City Network Services -- 858-538-5051 > > > > > > > > http://www.fatcity.com > > > > > > > > > >> San Diego, California -- Mailing list and web hosting > > > > > > > > services > > > > > > --------------------------------------------------------------------- > > > > > > > > >> To REMOVE yourself from this mailing list, send an > > > > > > E-Mail message > > > > > > > > >> to: [EMAIL PROTECTED] (note EXACT spelling of > > > > > > 'ListGuru') and > > > > > > > in > > > > > > > > > >> the message BODY, include a line containing: UNSUB ORACLE-L > > > > > >> (or the name of mailing list you want to be removed from). You > > > > > > > > may > > > > > > > > > >> also send the HELP command for other information (like > > > > > > > > subscribing). > > > > > > > > > -- > > > > > Please see the official ORACLE-L FAQ: http://www.orafaq.net > > > > > -- > > > > > Author: Tim Gorman > > > > > INET: [EMAIL PROTECTED] > > > > > > > > > > Fat City Network Services -- 858-538-5051 > > > > http://www.fatcity.com > > > > > > San Diego, California -- Mailing list and web hosting > > > > > > services > > > > > > --------------------------------------------------------------------- > > > > > > > To REMOVE yourself from this mailing list, send an E-Mail message > > > > to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in > > > > the message BODY, include a line containing: UNSUB ORACLE-L > > > > (or the name of mailing list you want to be removed from). You may > > > > also send the HELP command for other information (like subscribing). > > > > > > -- > > > Please see the official ORACLE-L FAQ: http://www.orafaq.net > > > -- > > > Author: Ryan > > > INET: [EMAIL PROTECTED] > > > > > > Fat City Network Services -- 858-538-5051 http://www.fatcity.com > > > San Diego, California -- Mailing list and web hosting services > > > --------------------------------------------------------------------- > > > To REMOVE yourself from this mailing list, send an E-Mail message > > > to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in > > > the message BODY, include a line containing: UNSUB ORACLE-L > > > (or the name of mailing list you want to be removed from). You may > > > also send the HELP command for other information (like subscribing). > > > > -- > > Mladen Gogala > > -- > > Please see the official ORACLE-L FAQ: http://www.orafaq.net > > -- > > Author: Mladen Gogala > > INET: [EMAIL PROTECTED] > > > > Fat City Network Services -- 858-538-5051 http://www.fatcity.com > > San Diego, California -- Mailing list and web hosting services > > --------------------------------------------------------------------- > > To REMOVE yourself from this mailing list, send an E-Mail message > > to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in > > the message BODY, include a line containing: UNSUB ORACLE-L > > (or the name of mailing list you want to be removed from). You may > > also send the HELP command for other information (like subscribing). > > > > -- > > Please see the official ORACLE-L FAQ: http://www.orafaq.net > > -- > > Author: Yosi Greenfield > > INET: [EMAIL PROTECTED] > > > > Fat City Network Services -- 858-538-5051 http://www.fatcity.com > > San Diego, California -- Mailing list and web hosting services > > --------------------------------------------------------------------- > > To REMOVE yourself from this mailing list, send an E-Mail message > > to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in > > the message BODY, include a line containing: UNSUB ORACLE-L > > (or the name of mailing list you want to be removed from). You may > > also send the HELP command for other information (like subscribing). > > > > -- > > Please see the official ORACLE-L FAQ: http://www.orafaq.net > > -- > > Author: Babette Turner-Underwood > > INET: [EMAIL PROTECTED] > > > > Fat City Network Services -- 858-538-5051 http://www.fatcity.com > > San Diego, California -- Mailing list and web hosting services > > --------------------------------------------------------------------- > > To REMOVE yourself from this mailing list, send an E-Mail message > > to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in > > the message BODY, include a line containing: UNSUB ORACLE-L > > (or the name of mailing list you want to be removed from). You may > > also send the HELP command for other information (like subscribing). -- Please see the official ORACLE-L FAQ: http://www.orafaq.net -- Author: Jared Still INET: [EMAIL PROTECTED] Fat City Network Services -- 858-538-5051 http://www.fatcity.com San Diego, California -- Mailing list and web hosting services --------------------------------------------------------------------- To REMOVE yourself from this mailing list, send an E-Mail message to: [EMAIL PROTECTED] (note EXACT spelling of 'ListGuru') and in the message BODY, include a line containing: UNSUB ORACLE-L (or the name of mailing list you want to be removed from). You may also send the HELP command for other information (like subscribing).
