Good Afternoon Joseph: Our filesystem is a compressed filesystem, but its real size is similar to what you see from the rsync. compressed size vs real size from the hgdownload server for the hg18 directory:
$ du -hsc hg18 261G hg18 261G total $ du --apparent-size -hsc hg18 771G hg18 771G total $ find ./hg18 -type f | wc -l 19249 --Hiram joseph hargitai wrote: > Hi, > > I am syncing up the > > rsync -nah --stats rsync://hgdownload.cse.ucsc.edu/mysql/hg18 > > tree. The test shows: > > Number of files: 19250 > Number of files transferred: 0 > Total file size: 827.23G bytes > Total transferred file size: 0 bytes > Literal data: 0 bytes > Matched data: 0 bytes > File list size: 815076 > File list generation time: 0.845 seconds > File list transfer time: 0.000 seconds > Total bytes sent: 34 > Total bytes received: 815.12K > > sent 34 bytes received 815.12K bytes 232.90K bytes/sec > total size is 827.23G speedup is 1014811.59 > > > However, the current local directory size is already larger than the UCSC > size, and only up to 16334 files out of the 19250. > > 999G /mysql/hg18 > > The sync is still ongoing. Is yours a compressed file-system? > > best, > joseph _______________________________________________ Genome maillist - [email protected] https://lists.soe.ucsc.edu/mailman/listinfo/genome
