If somebody can prove with real numbers on very large files that LOAD DATA INFILE is much faster than the current osmosis approach of doing normal inserts (ie. not just a few per cent) I'll add it to osmosis. I just haven't done so because my efforts have been focused elsewhere.
Andreas Kalsch wrote: > I decompress the data before putting them into Osmosis, but it's still slow. > So back to my question -- ;) > (The best would be raw dump files for MySQL's "LOAD DATA INFILE" - I can > imagine that it would be pretty quick) > > Stefan de Konink schrieb: > >> Frederik Ramm wrote: >> >>> The Java implementations of gzip/bzip are notoriuosly slow. If you >>> are working with compressed data, you might see an improvement if you >>> first uncompress the file and then use osmosis to process it in raw >>> form; later use an external utility to compress the output if >>> applicable. >>> >> But if he first uncompresses the data basically osmosis looses its >> main argument to be superior to any other approach. >> >> (Yes I think this point should be made) >> >> >> Stefan >> >> >> > > > _______________________________________________ > dev mailing list > [email protected] > http://lists.openstreetmap.org/listinfo/dev > _______________________________________________ dev mailing list [email protected] http://lists.openstreetmap.org/listinfo/dev
