This goes along with my previous post on abusing FTP. What I did in the past was basically:
cat <<ENDFTP | ftp zOS cd 'high.level' get lower.qualifiers quit ENDFTP ./do-some-process.sh lower.qualifiers rm lower.qualifiers to download, process, and delete some data after processing it. I don't know why I didn't think of: rm -rf lower.qualifiers.pipe mkfifo lower.qualifiers.pipe ./do-some-process.sh lower.qualifiers.pipe cat <<ENDFTP | ftp zOS cd 'high.level' get lower.qualifiers lower.qualifiers.pipe quit ENDFTP rm -rf lower.qualifiers.pipe It is "better" to do it this way? The data being downloaded is around 150 Gig. The "do-some-process.sh" uses "tee" to direct the data into three separate commands, using Process Substitution, to do some sub-setting into various other files, and then pipes that into bzip2 to compress all the data. It compresses down to about 50 Meg. Yeah, highly compressible text. I can't help but feel that using the named pipe will be both faster (elapsed time) and use less resource (especially disk). Am I being wise or foolish, just ignorantly stupid? -- Maranatha! <>< John McKown ---------------------------------------------------------------------- For LINUX-390 subscribe / signoff / archive access instructions, send email to [email protected] with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390 ---------------------------------------------------------------------- For more information on Linux on System z, visit http://wiki.linuxvm.org/
