[gdal-dev] Re: Fastest vector format for combining shapefiles

2009-10-07 Thread Rahkonen Jukka
Jukka Rahkonen writes: Hi, I am combining some GIS data where each layer is divided to around thousand separare shapefiles by mapsheets. Now I would like to store all the 35000 shapefiles to something that is more easy to handle. At first pushing each layer to own Spatialite database

Re: [gdal-dev] Re: Fastest vector format for combining shapefiles

2009-10-07 Thread Guillaume Sueur
Hi, Interesting topic ! The most efficient way is the one which will fit your needs the best. Forget the OneShape idea, but I think you can either have a database approach (either PostGIS or Oracle) or a file approach (your thousands of shapefiles). It depends on what you have to do with data and

VS: [gdal-dev] Re: Fastest vector format for combining shapefiles

2009-10-07 Thread Rahkonen Jukka
Hi, Maybe I need to clarify a bit my aim. This is huge dataset with hundreds of layers and we do not use actively all of them. The layers we need we will insert to Oracle database but it is a managed, hosted production system and it is far too expensive to use it as a backyard storage shed.

Re: VS: [gdal-dev] Re: Fastest vector format for combining shapefiles

2009-10-07 Thread Peter J Halls
Perhaps, although not yet supported by GDAL because publication of the format is not due until 2010, the new ESRI File geodatabase might be something to explore. This is limited only be any operating system restrictions on size and appears to be replacing the shapefile in due course. However,

Re: [gdal-dev] Re: Fastest vector format for combining shapefiles

2009-10-07 Thread Frank Warmerdam
Frank Warmerdam wrote: Rahkonen Jukka wrote: I can tell now that shapefile format is not suitable at all. The shp part can obviously not go over 2 GB limit because after that ogr2ogr throws these error messages: ERROR 1: Error in psSHP-sHooks.FSeek() or fwrite() writing object to .shp file.