Hi Robert,
On Fri, Nov 21, 2008 at 2:07 AM, Kramer, Robert W <[EMAIL PROTECTED]> wrote: > I have a very large imagery set (~1 million files). When running > VirtualPlanetBuilder 0.9.9, I am limited to about 482 -t imagery files > for a given vpbmaster command before I get "ERROR 4: Failed to open file > /mp2/osg/file482.tif" for each -t file listed after the 482nd file > listed in the script and the *.ive files are not created. VPB can handle hundres of thousands of input files, but OS's consoles can't so it's very likely that you've just hit the limit of what your command line can delivery. The best way to handle large number of input files is to use the -t <directory> or -d <directory> support, osgdem/vpbmaster will automatically detect the use of directory and go a collect all the files contained within it. The ERROR 4 is a GDAL warning, so perhaps there is something else wrong with the files. Perhaps the files are corrupted. > Secondly, a test of a small VPB database of 1.34GB of CADRG imagery > produced 14.941GB of *.ive files using VPB 0.9.7 in 23 minutes time. > The same test with VPB Version 0.9.9 produced 14.826GB of *.ive files in > 32 minutes. I was not expecting the newer VPB to only produce a tiny > (<1%) amount of compression, while taking about 40% more time. > Furthermore, I'm perplexed that my resulting output files are 11 times > the input imagery (1m black and white Controlled Imagery Base). Using > the --compressed option made no difference to the resulting *.ive sizes. > I require all levels of detail, so expect some increase in database > size, but can anybody help me reduce this to a smaller multiple as I'm > running out of disk space! What do I need to do to turn on Heightfield > compression, for example. The HeightField compression will now be on by default and is what is giving you the 1% improvement - not great, but then most of the data is elsewhere. The --compression option only hints to use OpenGL compressed textures, but this has been on by default anyway - so this is why it's not made any difference. To enable the .ive compression you'll need to add an extra ReaderWriter::Options string using the -O "compression" to hint to the .ive plugin to use zlib compression. Later on I'll refine the command line options in VPB so that all the compression options are under one roof. Another tool for compression is to switch off mipmapping (--no-mip-mapping) and to tell the build that it can use non power of two textures (--npot). But in the end, if you are having disk space problems the solution is to buy more disk space, as running out of disk space is one good way to give yourself corrupted files, and disk space is cheap. Robert. _______________________________________________ osg-users mailing list [email protected] http://lists.openscenegraph.org/listinfo.cgi/osg-users-openscenegraph.org
