Re: [Declude.JunkMail] OT - Copying 200,000 plus files
Actually the question was whether zipping would help them...but copying the data into RAM, zipping it, and copying it back to the USB drive before copying to an internal drive kind of defeats the purpose...and would take more time that just copying. That aside, my experience over the past 20 years with image compression is significantly different. That's why I went into my mini discourse...wanting to point out that a generalization didn't really work when image formats vary significantly in how they respond to zip compression. I see significantly higher compression than you indicate on uncompressed formats. Generally around 1/3 of the original size, so comparable to the Word documents you mentioned. Since compression rates can vary so widely with different formats, I think a discussion of the differences was warranted...especially since the discussion was around a particular format, TIFF, which is most often uncompressed, or perhaps run length compressed with palette color images. Darin. - Original Message - From: Michael Graveen [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Wednesday, October 20, 2004 11:16 PM Subject: Re: [Declude.JunkMail] OT - Copying 200,000 plus files I think the question was about zipping graphic files, which as a general rule, don't get much smaller after they're zipped (as compared to text files, etc.). I wasn't taking about the compression contained in a particular graphic format. I get about 15%-25% reduction zipping the uncompressed BMP file vs about 70% from a Word doc (using the stock Winzip settings). I should have been clearer in my first response. Mike At 06:43 PM 10/20/2004, you wrote: Huh? The logic flaw in trying to zip first, then copy aside (since the file would have to first be copied into RAM, then zipped, then stored back onto the USB drive...better just to copy)... uncompressed TIFFs (TIFFs have had an option for LZW compression since the mid 90s) compress pretty well as they contain raw raster data, as do BMPs and many other uncompressed formats. If you're referring to JPEGs and GIFs, that's because they are already compressed. JPEGs have built-in lossy compression, but high quality JPEGs (low compression) can still see decent compression, and GIFs are already LZW compressed, which means more LZW compression generally doesn't yield much. So, it depends on the type of image, but TIFFs are generally uncompressed these days due to the LZW copyright fiasco, or may have run-length encoding which still compresses reasonably well with LZW. Darin. - Original Message - From: Michael Graveen [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Wednesday, October 20, 2004 6:11 PM Subject: Re: [Declude.JunkMail] OT - Copying 200,000 plus files Graphic files as a general rule don't compress well. Mike At 03:26 PM 10/20/2004, you wrote: Jeff Pereira wrote: What's killing me is not so much the amount of data, but the fact that there are so many small files. I'm gonna have to try XCOPY on the next folder and see how that works. I can't remember but do TIFF files compress well? Might be worth it to ZIP them and copy that over. Jim --- [This E-mail scanned for viruses by Declude Virus] --- [This E-mail was scanned for viruses by Declude Virus (http://www.declude.com)] --- This E-mail came from the Declude.JunkMail mailing list. To unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type unsubscribe Declude.JunkMail. The archives can be found at http://www.mail-archive.com. --- [This E-mail was scanned for viruses by Declude Virus (http://www.declude.com)] --- This E-mail came from the Declude.JunkMail mailing list. To unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type unsubscribe Declude.JunkMail. The archives can be found at http://www.mail-archive.com. --- [This E-mail scanned for viruses by Declude Virus] --- [This E-mail scanned for viruses by Declude Virus] --- [This E-mail was scanned for viruses by Declude Virus (http://www.declude.com)] --- This E-mail came from the Declude.JunkMail mailing list. To unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type unsubscribe Declude.JunkMail. The archives can be found at http://www.mail-archive.com. --- [This E-mail was scanned for viruses by Declude Virus (http://www.declude.com)] --- This E-mail came from the Declude.JunkMail mailing list. To unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type unsubscribe Declude.JunkMail. The archives can be found at http://www.mail-archive.com.
[Declude.JunkMail] OT - Copying 200,000 plus files
Hi - Sorry for the OT post, but I am in need of assistance. I have 200,000 + TIFF (70 GB Worth)images on an external USB 2.0 hard drive that I need to copy to my local hard drive. It is taking forever. Does anyone know what the fastest way to do this is ? Drag and Drop ?? Cut and Paste ?? Drop to a command prompt ?? Xcopy ?? Please help. TIA jeff --- [This E-mail was scanned for viruses by Declude Virus (http://www.declude.com)] --- This E-mail came from the Declude.JunkMail mailing list. To unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type unsubscribe Declude.JunkMail. The archives can be found at http://www.mail-archive.com.
RE: [Declude.JunkMail] OT - Copying 200,000 plus files
I don't know the answer you are specifically looking for, but you might take the drive out of the USB case and mount it directly into the PC as a slave drive. Copying (regardless of method) should go much more quickly then. Paul Navarre -Original Message- From: [EMAIL PROTECTED] [mailto:Declude.JunkMail- [EMAIL PROTECTED] On Behalf Of Jeff Pereira Sent: Wednesday, October 20, 2004 12:00 PM To: [EMAIL PROTECTED] Subject: [Declude.JunkMail] OT - Copying 200,000 plus files Hi - Sorry for the OT post, but I am in need of assistance. I have 200,000 + TIFF (70 GB Worth)images on an external USB 2.0 hard drive that I need to copy to my local hard drive. It is taking forever. Does anyone know what the fastest way to do this is ? Drag and Drop ?? Cut and Paste ?? Drop to a command prompt ?? Xcopy ?? Please help. TIA jeff --- [This E-mail was scanned for viruses by Declude Virus (http://www.declude.com)] --- This E-mail came from the Declude.JunkMail mailing list. To unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type unsubscribe Declude.JunkMail. The archives can be found at http://www.mail-archive.com. --- [This E-mail was scanned for viruses by Declude Virus (http://www.declude.com)] --- This E-mail came from the Declude.JunkMail mailing list. To unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type unsubscribe Declude.JunkMail. The archives can be found at http://www.mail-archive.com.
Re: [Declude.JunkMail] OT - Copying 200,000 plus files
Depending upon the drive there may not be a great way. Got this from a web page on USB2: Unfortunately, the phrase USB 2.0 does not necessarily mean 480Mbps of throughput. USB 2.0 now has three different signaling rates: Low Speed (1.5Mbps), Full Speed (12Mbps), and Hi-Speed (480Mbps). The marketing and advertising departments of product manufacturers like to put the words USB 2.0 on all of their product packages. This can be really deceptive since most consumers will see USB 2.0 and compare it to an older product with the USB 1.1 moniker and think USB2 must be better than USB 1.1! Naturally, the consumer is unaware of the difference between Full Speed and High Speed (this is something akin to the old naming snafu with floppy disks: does double density or high density hold more?). And naturally those specs are in 'bits per second' and your images are in gigabytes ... so unless you're getting the 480mbps speed the math's not on your side ... @ 1.5mbps it'd take approximately 103 hours to transfer 70Gbytes (560 gigabits) of data @ 12mbps it'd take approximately 13 hours @ 480mbps it'd take approximately 20 minutes Just guessing but that may be more of an issue than the method you use. As suggested, the quickest way is to remove the drive from the USB package and connect it directly to your IDE interface. Larry Craddock - Original Message - From: Jeff Pereira [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Wednesday, October 20, 2004 1:59 PM Subject: [Declude.JunkMail] OT - Copying 200,000 plus files Hi - Sorry for the OT post, but I am in need of assistance. I have 200,000 + TIFF (70 GB Worth)images on an external USB 2.0 hard drive that I need to copy to my local hard drive. It is taking forever. Does anyone know what the fastest way to do this is ? Drag and Drop ?? Cut and Paste ?? Drop to a command prompt ?? Xcopy ?? Please help. TIA jeff --- [This E-mail was scanned for viruses by Declude Virus (http://www.declude.com)] --- This E-mail came from the Declude.JunkMail mailing list. To unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type unsubscribe Declude.JunkMail. The archives can be found at http://www.mail-archive.com. --- [This E-mail was scanned for viruses by Declude Virus (http://www.declude.com)] --- This E-mail came from the Declude.JunkMail mailing list. To unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type unsubscribe Declude.JunkMail. The archives can be found at http://www.mail-archive.com.
Re: [Declude.JunkMail] OT - Copying 200,000 plus files
Does the computer/server you're connecting your external hard drive to have USB 2.0 ports? I usually get about 650MB/minute with this kind of setup. A 70GB should take about 2 hours. Mike At 01:59 PM 10/20/2004, you wrote: Hi - Sorry for the OT post, but I am in need of assistance. I have 200,000 + TIFF (70 GB Worth)images on an external USB 2.0 hard drive that I need to copy to my local hard drive. It is taking forever. Does anyone know what the fastest way to do this is ? Drag and Drop ?? Cut and Paste ?? Drop to a command prompt ?? Xcopy ?? Please help. TIA jeff --- [This E-mail was scanned for viruses by Declude Virus (http://www.declude.com)] --- This E-mail came from the Declude.JunkMail mailing list. To unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type unsubscribe Declude.JunkMail. The archives can be found at http://www.mail-archive.com. --- [This E-mail scanned for viruses by Declude Virus] --- [This E-mail scanned for viruses by Declude Virus] --- [This E-mail was scanned for viruses by Declude Virus (http://www.declude.com)] --- This E-mail came from the Declude.JunkMail mailing list. To unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type unsubscribe Declude.JunkMail. The archives can be found at http://www.mail-archive.com.
Re: [Declude.JunkMail] OT - Copying 200,000 plus files
Jeff Pereira wrote: What's killing me is not so much the amount of data, but the fact that there are so many small files. I'm gonna have to try XCOPY on the next folder and see how that works. I can't remember but do TIFF files compress well? Might be worth it to ZIP them and copy that over. Jim --- [This E-mail was scanned for viruses by Declude Virus (http://www.declude.com)] --- This E-mail came from the Declude.JunkMail mailing list. To unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type unsubscribe Declude.JunkMail. The archives can be found at http://www.mail-archive.com.
RE: [Declude.JunkMail] OT - Copying 200,000 plus files
I can't remember but do TIFF files compress well? Might be worth it to ZIP them and copy that over. In this case that won't work. To zip them will require copying them over the USB 2.0 connection anyway and that appears to be the bottleneck. Using xcopy should be the most efficient, but the huge number of files is really the limiting factor. Brad --- [This E-mail was scanned for viruses by Declude Virus (http://www.declude.com)] --- This E-mail came from the Declude.JunkMail mailing list. To unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type unsubscribe Declude.JunkMail. The archives can be found at http://www.mail-archive.com.
Re: [Declude.JunkMail] OT - Copying 200,000 plus files
Graphic files as a general rule don't compress well. Mike At 03:26 PM 10/20/2004, you wrote: Jeff Pereira wrote: What's killing me is not so much the amount of data, but the fact that there are so many small files. I'm gonna have to try XCOPY on the next folder and see how that works. I can't remember but do TIFF files compress well? Might be worth it to ZIP them and copy that over. Jim --- [This E-mail scanned for viruses by Declude Virus] --- [This E-mail was scanned for viruses by Declude Virus (http://www.declude.com)] --- This E-mail came from the Declude.JunkMail mailing list. To unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type unsubscribe Declude.JunkMail. The archives can be found at http://www.mail-archive.com.
Re: [Declude.JunkMail] OT - Copying 200,000 plus files
Huh? The logic flaw in trying to zip first, then copy aside (since the file would have to first be copied into RAM, then zipped, then stored back onto the USB drive...better just to copy)... uncompressed TIFFs (TIFFs have had an option for LZW compression since the mid 90s) compress pretty well as they contain raw raster data, as do BMPs and many other uncompressed formats. If you're referring to JPEGs and GIFs, that's because they are already compressed. JPEGs have built-in lossy compression, but high quality JPEGs (low compression) can still see decent compression, and GIFs are already LZW compressed, which means more LZW compression generally doesn't yield much. So, it depends on the type of image, but TIFFs are generally uncompressed these days due to the LZW copyright fiasco, or may have run-length encoding which still compresses reasonably well with LZW. Darin. - Original Message - From: Michael Graveen [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Wednesday, October 20, 2004 6:11 PM Subject: Re: [Declude.JunkMail] OT - Copying 200,000 plus files Graphic files as a general rule don't compress well. Mike At 03:26 PM 10/20/2004, you wrote: Jeff Pereira wrote: What's killing me is not so much the amount of data, but the fact that there are so many small files. I'm gonna have to try XCOPY on the next folder and see how that works. I can't remember but do TIFF files compress well? Might be worth it to ZIP them and copy that over. Jim --- [This E-mail scanned for viruses by Declude Virus] --- [This E-mail was scanned for viruses by Declude Virus (http://www.declude.com)] --- This E-mail came from the Declude.JunkMail mailing list. To unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type unsubscribe Declude.JunkMail. The archives can be found at http://www.mail-archive.com. --- [This E-mail was scanned for viruses by Declude Virus (http://www.declude.com)] --- This E-mail came from the Declude.JunkMail mailing list. To unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type unsubscribe Declude.JunkMail. The archives can be found at http://www.mail-archive.com.
Re: [Declude.JunkMail] OT - Copying 200,000 plus files
I think the question was about zipping graphic files, which as a general rule, don't get much smaller after they're zipped (as compared to text files, etc.). I wasn't taking about the compression contained in a particular graphic format. I get about 15%-25% reduction zipping the uncompressed BMP file vs about 70% from a Word doc (using the stock Winzip settings). I should have been clearer in my first response. Mike At 06:43 PM 10/20/2004, you wrote: Huh? The logic flaw in trying to zip first, then copy aside (since the file would have to first be copied into RAM, then zipped, then stored back onto the USB drive...better just to copy)... uncompressed TIFFs (TIFFs have had an option for LZW compression since the mid 90s) compress pretty well as they contain raw raster data, as do BMPs and many other uncompressed formats. If you're referring to JPEGs and GIFs, that's because they are already compressed. JPEGs have built-in lossy compression, but high quality JPEGs (low compression) can still see decent compression, and GIFs are already LZW compressed, which means more LZW compression generally doesn't yield much. So, it depends on the type of image, but TIFFs are generally uncompressed these days due to the LZW copyright fiasco, or may have run-length encoding which still compresses reasonably well with LZW. Darin. - Original Message - From: Michael Graveen [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Wednesday, October 20, 2004 6:11 PM Subject: Re: [Declude.JunkMail] OT - Copying 200,000 plus files Graphic files as a general rule don't compress well. Mike At 03:26 PM 10/20/2004, you wrote: Jeff Pereira wrote: What's killing me is not so much the amount of data, but the fact that there are so many small files. I'm gonna have to try XCOPY on the next folder and see how that works. I can't remember but do TIFF files compress well? Might be worth it to ZIP them and copy that over. Jim --- [This E-mail scanned for viruses by Declude Virus] --- [This E-mail was scanned for viruses by Declude Virus (http://www.declude.com)] --- This E-mail came from the Declude.JunkMail mailing list. To unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type unsubscribe Declude.JunkMail. The archives can be found at http://www.mail-archive.com. --- [This E-mail was scanned for viruses by Declude Virus (http://www.declude.com)] --- This E-mail came from the Declude.JunkMail mailing list. To unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type unsubscribe Declude.JunkMail. The archives can be found at http://www.mail-archive.com. --- [This E-mail scanned for viruses by Declude Virus] --- [This E-mail scanned for viruses by Declude Virus] --- [This E-mail was scanned for viruses by Declude Virus (http://www.declude.com)] --- This E-mail came from the Declude.JunkMail mailing list. To unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type unsubscribe Declude.JunkMail. The archives can be found at http://www.mail-archive.com.
