Re: [OSM-dev] Python XML Parser on Windows
On Wed, Aug 07, 2019 at 06:39:14AM -0700, Spencer Gardner wrote: > Thanks. I'm aware of PyOsmium, which appears to work on Windows but not > without installing a number of additional packages related to the > libosmium. I may go that route in the absence of easier alternatives, but > installation of libosmium doesn't seem very straightforward on Windows. Or > perhaps the problem is the documentation doesn't provide much information > on how to install on Windows short of building from source, which is a > nonstarter for most users. What I'm really hoping for is an isolated Python > solution that can be installed via a simple pip command. We do provide precomiled binaries for Windows (64bit), so you should be able to just 'pip install osmium' without building libosmium yourself. I admit that this is not well tested because we don't have a maintainer with a Windows development platform (and experience with it). If you run into trouble, feel free to file an issue and we see what we can do. Sarah > > Have I misunderstood something about PyOsmium and libosmium? > > On Wed, Aug 7, 2019 at 1:03 AM Jochen Topf wrote: > > > On Wed, Aug 07, 2019 at 08:30:07AM +0100, Sarah Hoffmann wrote: > > > On Wed, Aug 07, 2019 at 07:16:07AM +0200, Jochen Topf wrote: > > > > Hi! > > > > > > > > PyOsmium https://osmcode.org/pyosmium/ should work on Windows. > > > > > > Just stay away from bz2 compressed xml. That's known to be > > > broken on Windows. Uncompressed xml should be fine though. > > > > Or, even better, use the PBF file format which should be much faster > > than XML. > > > > Jochen > > -- > > Jochen Topf joc...@remote.org https://www.jochentopf.com/ > > +49-351-31778688 > > ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Python XML Parser on Windows
Thanks. I'm aware of PyOsmium, which appears to work on Windows but not without installing a number of additional packages related to the libosmium. I may go that route in the absence of easier alternatives, but installation of libosmium doesn't seem very straightforward on Windows. Or perhaps the problem is the documentation doesn't provide much information on how to install on Windows short of building from source, which is a nonstarter for most users. What I'm really hoping for is an isolated Python solution that can be installed via a simple pip command. Have I misunderstood something about PyOsmium and libosmium? On Wed, Aug 7, 2019 at 1:03 AM Jochen Topf wrote: > On Wed, Aug 07, 2019 at 08:30:07AM +0100, Sarah Hoffmann wrote: > > On Wed, Aug 07, 2019 at 07:16:07AM +0200, Jochen Topf wrote: > > > Hi! > > > > > > PyOsmium https://osmcode.org/pyosmium/ should work on Windows. > > > > Just stay away from bz2 compressed xml. That's known to be > > broken on Windows. Uncompressed xml should be fine though. > > Or, even better, use the PBF file format which should be much faster > than XML. > > Jochen > -- > Jochen Topf joc...@remote.org https://www.jochentopf.com/ > +49-351-31778688 > ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Python XML Parser on Windows
On Wed, Aug 07, 2019 at 08:30:07AM +0100, Sarah Hoffmann wrote: > On Wed, Aug 07, 2019 at 07:16:07AM +0200, Jochen Topf wrote: > > Hi! > > > > PyOsmium https://osmcode.org/pyosmium/ should work on Windows. > > Just stay away from bz2 compressed xml. That's known to be > broken on Windows. Uncompressed xml should be fine though. Or, even better, use the PBF file format which should be much faster than XML. Jochen -- Jochen Topf joc...@remote.org https://www.jochentopf.com/ +49-351-31778688 ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Python XML Parser on Windows
On Wed, Aug 07, 2019 at 07:16:07AM +0200, Jochen Topf wrote: > Hi! > > PyOsmium https://osmcode.org/pyosmium/ should work on Windows. Just stay away from bz2 compressed xml. That's known to be broken on Windows. Uncompressed xml should be fine though. Sarah > On Tue, Aug 06, 2019 at 09:20:39PM -0700, Spencer Gardner wrote: > > Date: Tue, 6 Aug 2019 21:20:39 -0700 > > From: Spencer Gardner > > To: dev@openstreetmap.org > > Subject: [OSM-dev] Python XML Parser on Windows > > > > I'm sort of resurrecting an old thread I started last year. I find > > Martijn's Overpass Python library to be very useful for small queries but I > > frequently run into usage limits. I'd like to query an XML download > > directly to save bandwidth and reduce consumption of Overpass resources, > > but I can't find any suitable Python libraries that are WIndows-ready. Is > > there something I'm missing? Has anyone else found a solution that works? > > > > By way of example, Geoff Boeing's excellent osmnx package appears to use a > > home-grown OSM parser due to lack of a cross-platform option. > > https://github.com/gboeing/osmnx/blob/eebbca0ed1d59a6dfe07c90493d54c0beab45145/osmnx/utils.py#L1181 > > > > Thanks for any help > > > ___ > > dev mailing list > > dev@openstreetmap.org > > https://lists.openstreetmap.org/listinfo/dev > > > -- > Jochen Topf joc...@remote.org https://www.jochentopf.com/ +49-351-31778688 > > ___ > dev mailing list > dev@openstreetmap.org > https://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Python XML Parser on Windows
Hi! PyOsmium https://osmcode.org/pyosmium/ should work on Windows. Jochen On Tue, Aug 06, 2019 at 09:20:39PM -0700, Spencer Gardner wrote: > Date: Tue, 6 Aug 2019 21:20:39 -0700 > From: Spencer Gardner > To: dev@openstreetmap.org > Subject: [OSM-dev] Python XML Parser on Windows > > I'm sort of resurrecting an old thread I started last year. I find > Martijn's Overpass Python library to be very useful for small queries but I > frequently run into usage limits. I'd like to query an XML download > directly to save bandwidth and reduce consumption of Overpass resources, > but I can't find any suitable Python libraries that are WIndows-ready. Is > there something I'm missing? Has anyone else found a solution that works? > > By way of example, Geoff Boeing's excellent osmnx package appears to use a > home-grown OSM parser due to lack of a cross-platform option. > https://github.com/gboeing/osmnx/blob/eebbca0ed1d59a6dfe07c90493d54c0beab45145/osmnx/utils.py#L1181 > > Thanks for any help > ___ > dev mailing list > dev@openstreetmap.org > https://lists.openstreetmap.org/listinfo/dev -- Jochen Topf joc...@remote.org https://www.jochentopf.com/ +49-351-31778688 ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Python XML Parser on Windows
Hi Spencer, I'd definitely recommend lxml: https://lxml.de/. One of the benefits of lxml is that it is cross platform. You can find Windows binaries for lxml and many other Python libraries here: https://www.lfd.uci.edu/~gohlke/pythonlibs/#lxml Regards, Frank On 07-08-2019 06:20, Spencer Gardner wrote: I'm sort of resurrecting an old thread I started last year. I find Martijn's Overpass Python library to be very useful for small queries but I frequently run into usage limits. I'd like to query an XML download directly to save bandwidth and reduce consumption of Overpass resources, but I can't find any suitable Python libraries that are WIndows-ready. Is there something I'm missing? Has anyone else found a solution that works? By way of example, Geoff Boeing's excellent osmnx package appears to use a home-grown OSM parser due to lack of a cross-platform option. https://github.com/gboeing/osmnx/blob/eebbca0ed1d59a6dfe07c90493d54c0beab45145/osmnx/utils.py#L1181 Thanks for any help ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
[OSM-dev] Python XML Parser on Windows
I'm sort of resurrecting an old thread I started last year. I find Martijn's Overpass Python library to be very useful for small queries but I frequently run into usage limits. I'd like to query an XML download directly to save bandwidth and reduce consumption of Overpass resources, but I can't find any suitable Python libraries that are WIndows-ready. Is there something I'm missing? Has anyone else found a solution that works? By way of example, Geoff Boeing's excellent osmnx package appears to use a home-grown OSM parser due to lack of a cross-platform option. https://github.com/gboeing/osmnx/blob/eebbca0ed1d59a6dfe07c90493d54c0beab45145/osmnx/utils.py#L1181 Thanks for any help ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
