using pipes worked out. The only problem I had was it never gets an EOF marker I changed my program so that when it just gets a "*EOF*" it treats it as an EOF
I start off my program with: CMD='(cat /datafiles/DATA_20100902data.csv ; echo "*EOF*") > /datafiles/bigfile.csv &' EXECUTE "SH -c '":CMD:"'" CAPTURING JUNK FILENAME="/datafiles/bigfile.csv" OPENSEQ FILENAME TO F.BIG ELSE STOP "Can't open bigfile.csv" LOOP READSEQ LINEIN FROM F.BIG ELSE EXIT IF LINEIN="*" THEN PRINT "EXITING ON *" ; EXIT REPEAT Where bigfile.csv is defined as a FIFO file in unix Only issue here is I will have to establish a locking system so only 1 process can run it at a time, or use a round robin on FIFO's.... > > -----Original Message----- > > From: [email protected] [mailto:u2-users- > > [email protected]] On Behalf Of Augusto Alonso > > Sent: Friday, September 03, 2010 1:38 PM > > To: U2 Users List > > Subject: Re: [U2] Is there a file limit size to OPENSEQ? > > > > The only workaround I've found is using pipes and gzip. (Maybe it > could > > be > > useful for you...) > > Regards > > -- > > Augusto Alonso _______________________________________________ U2-Users mailing list [email protected] http://listserver.u2ug.org/mailman/listinfo/u2-users
