Re: [OSM-talk] Bulk Uploading GPX files on the OSM website
On Tue, Aug 21, 2012 at 6:22 PM, Ben Robbins ben_robbi...@hotmail.com wrote: A few of my issues with uploading gpx Files to OSM which I'd like to discuss, and put forward some suggestions. This may have a specific place to be discussed? I'm really not on top of mailing lists. What I usually do is uploading them using a command line script found here: http://wiki.openstreetmap.org/wiki/Batch_Upload#CURL curl -u user:password -H Expect: -F file=@file.gpx -F description=description \ -F tags=tags -F visibility=public http://www.openstreetmap.org/api/0.6/gpx/create this can easily be automated, and you can set different tags for each one of the gpx. So far I've uploaded more than 1000 GPX: http://www.openstreetmap.org/user/simone/traces -- -S ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Bulk Uploading GPX files on the OSM website
(Copying to hot + dev because there are certainly many similar cases as I describe in hot's regions that would benefit more-than-average-places of more traces dev as that's where the brains/skills to fix this problem are. Replies to dev only?) I'll just +1 this post, its remarks and suggestions. As a similarly positioned tech savvy but not a coding-capable person I can only hope that someone with dev capabilities would pick up on the task. Another data point from behind bad connections of Haiti: I've been here now nearly two years and have caught myself uploading GPS traces only twice (en masse, a few other uploads of single tracks other than that). This has been due to what Ben describes and looking at the bigger picture--a recent quick analysis I did of the GPS traces downloaded for all the territory of Haiti--I am tempted to guess that this difficulty of uploading GPS traces leaves many traces unuploaded, which is a clear loss to the project. Why do I think so: a simple comparison of my Haiti GPS trace folder size with the size of all GPS traces for Haiti shows that I've uploaded almost half of the tad over 400mb of traces. Additionally the number of traces uploaded by someone else than me vs total (tagged with Haiti or haiti) is/was perhaps 40-50 (for the total history), iirc. .. And there have been hundreds of OSM contributors going around with GPSs here. Now, it's most certain that the technical inconvenience of uploading is only a part of the problem. .. But it _is_ part of the problem... I know that it's not a secret that the GPS trace functions of OSM both up- downloading are not as developed as data editing, map renderings available, etc and since can't really fix this problem I can only hope that someone else will (one day). Cheers from Haiti, -Jaakko Sent from my BlackBerry® device from Digicel -- Mobile: +509-37-26 91 54, Skype/GoogleTalk: jhelleranta -Original Message- From: Ben Robbins ben_robbi...@hotmail.com Date: Tue, 21 Aug 2012 17:22:31 To: talk@openstreetmap.org Subject: [OSM-talk] Bulk Uploading GPX files on the OSM website ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Bulk Uploading
On Sun, Jul 19, 2009 at 06:58, Andrew Ayrea...@britishideas.com wrote: I am converting public domain data into OSM files for bulk upload. This is data that currently is not in OSM. JOSM is a nightmare for uploading large amounts of data. I have a OSM file with 30k nodes (5Mb) and JOSM tells me it will take 15 hours... I tried bulk_upload.py and it fails with error 404 - no further information. I tried bulk_upload.php and it also failed with an error - can't remember the details now. Recently I've used the following in order to upload some converted data to osm... Data were generated from State's SHP using: http://svn.openstreetmap.org/applications/utils/import/shp2osm/polyshp2osm.py then: http://svn.openstreetmap.org/applications/utils/import/bulk_upload_06 Used a wrap-around to do directory traverse. -S ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Bulk Uploading
Hey, (just noticed your mail on the list) 2009/7/19 Andrew Ayre a...@britishideas.com: JOSM is a nightmare for uploading large amounts of data. I have a OSM file with 30k nodes (5Mb) and JOSM tells me it will take 15 hours... I tried bulk_upload.py and it fails with error 404 - no further information. I tried bulk_upload.php and it also failed with an error - can't remember the details now. I'm now trying the scripts at http://www.openstreetmap.pl/balrog/bulkupload/. However I don't want to upload incorrect or partial data to the public server. So I tried uploading to api06.dev.openstreetmap.org and mysql.dev.openstreetmap.org. Both servers returned the following error: 500: Internal Server Error (h2Application error/h2Rails application failed to start properly) All I want is a (moderately) fast and reliable way of uploading data. I have plenty of it ready to go. Can anyone help? I'm afraid the scripts won't be any faster than JOSM, all the scripts as well as JOSM use the same API and there's likely not going to be much difference in speed or in reliability. The 15h was probably a little pessimistic, though (depending on your connectivity, but it definitely should be less than that for 30k nodes). And reliability is assured by the API too. Cheers ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk