Re: [Qgis-user] Geocoding with MMQGIS - Web service geocode
Thank you for the update Nyall. It is great to hear that Geocoding will be improved in future versions! -Erich On Thu, May 27, 2021 at 11:20 PM krishna Ayyala wrote: > Nyall, > Again thanks for your reply. I have upgraded to 3.18 version and was able > to install google maps geocoder in zipped version. At the time of > installation, it asked me to enter the api key. I did enter but that did > not make any difference. I tried to run the tool as shown below. I got the > temporary layer as shown in the table below. But that did not plot any > points on the map. It just produced a table. As I gave in my previous > email, the csv file's address column has only street number and street > name. The city name and state names are in separate columns. I am not sure > how the tool will correctly geocode just by choosing the address column. > Please guide me. > [image: image.png] > > [image: image.png] > > > On Thu, May 27, 2021 at 5:59 PM Nyall Dawson > wrote: > >> On Fri, 28 May 2021 at 09:31, krishna Ayyala >> wrote: >> > >> > Nyall, >> > Thanks for the reply. I have qgis3.16 version. I tried install this >> plugin via install from zip. I am getting the following error . >> > >> > https://plugins.qgis.org/plugins/google_maps_geocoder/ >> >> Yes, you need 3.18 for the plugin -- it relies on newer functionality >> introduced in that version. >> >> Nyall >> >> > >> > >> > >> > On Thu, May 27, 2021 at 4:13 PM Nyall Dawson >> wrote: >> >> >> >> On Fri, 28 May 2021 at 06:08, krishna Ayyala >> wrote: >> >> > >> >> > Hello, >> >> > I have a csv file with the columns "Address", "City", "State" and >> "Country". I have 40 rows each row representing one address. All the >> addresses are from the United States. I have the API key which I purchased >> through subscription. For the web service option, I have chosen Google. >> >> > >> >> > When I try to geocode, I am getting an empty shape file? Can anyone >> help me fix this problem? >> >> >> >> There's some great solutions available these days! Here's what I >> suggest. >> >> >> >> 1. Since you already have a Google Maps API key, you can use this >> >> plugin (so long as you are on QGIS 3.18!) >> >> https://plugins.qgis.org/plugins/google_maps_geocoder/ . It adds a new >> >> processing batch geocoder using Google maps, and since it's a >> >> Processing algorithm it's very flexible to run (and can be used in >> >> models, from the command line, etc). It also adds a new locator bar >> >> shortcut for directly navigating to places on the map using Google >> >> maps locations. >> >> >> >> 2. If you download a nightly pre-release of QGIS 3.20, then there's an >> >> out-of-the-box "Batch Nominatim geocoder" tool in the Processing >> >> toolbox which geocodes using OpenStreetMap data. This is super >> >> convenient, because you don't need ANY api keys or plugins... it's >> >> just ready to go! The one catch is that it's rate-limited, so will be >> >> slow if you need to geocode a lot of results. >> >> >> >> All in all, the QGIS geocoding situation is MUCH improved since >> previous years! >> >> >> >> Hope that helps! >> >> >> >> Nyall >> >> >> >> >> >> >> >> > >> >> > Regards. >> >> > ___ >> >> > Qgis-user mailing list >> >> > Qgis-user@lists.osgeo.org >> >> > List info: https://lists.osgeo.org/mailman/listinfo/qgis-user >> >> > Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user >> > ___ > Qgis-user mailing list > Qgis-user@lists.osgeo.org > List info: https://lists.osgeo.org/mailman/listinfo/qgis-user > Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user > ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] Geocoding with MMQGIS - Web service geocode
I know I'm going off topic here, and I think any further discussion on this should be in another thread, but I'll respond here just to fill in a bit of a knowledge gap that there seems to be. I share the sentiment on fair data usage policy and am also frustrated by the promotion of "incorrect" data utilisation to some extent, but I think if we look at things objectively, the QGIS community is actually typically quite well behaved in this regard, and undeserving of our anger. Most Geocoding tools support multiple services, and this limitation of the "Google API" is an arbitrary/ non-obvious concept that I would not expect anybody (developer or client) to reasonably know about (this is a legal consideration in many jurisdictions). You could easily build tools for a service you don't utilise so expecting the developers to handle this sort of limitation effectively (especially since it would involve additional technical challenges) is probably rather unrealistic. In this particular instance, since it is a Google specific plugin, I agree more could be done to communicate the policies, but in the vast majority of cases this is simply not the case. In terms of the nominatim integration, the extent of the utilisation and prevention of the abuse of that service has been discussed on the QGIS mailing lists, with the developers actively integrating rate limiting in QGIS, not on the service, amongst other protection measures. In addition, the PSC Chair sent out correspondence to the OSMF detailing the implementation in order to receive permission to integrate the nominatim into QGIS in a fair and responsible manner. In terms of remaining "ethical", I'd say QGIS as a community does do an excellent job by default. Whilst there is always room for improvement, as much of the work done is volunteer work it is difficult to justify screening community content such as plugins for ethical violations. If anyone has suggestions on how to better approach the issue as a project and a community, raising it as a query on the mailing list is a good place to start. On Fri, 28 May 2021 at 06:00, Tobias Wendorff < tobias.wendo...@tu-dortmund.de> wrote: > Am 28.05.2021 um 00:13 schrieb Nyall Dawson: > > > > 1. Since you already have a Google Maps API key, you can use this > > plugin (so long as you are on QGIS 3.18!) > > https://plugins.qgis.org/plugins/google_maps_geocoder/ . It adds a new > > processing batch geocoder using Google maps, and since it's a > > Processing algorithm it's very flexible to run (and can be used in > > models, from the command line, etc). It also adds a new locator bar > > shortcut for directly navigating to places on the map using Google > > maps locations. > > I am really angry that QGIS still has this plugin. The Google APIs > (Places, etc.) clearly prohibit geometries from being exported and > stored permanently. The only thing that is allowed to be stored > permanently is the Google Places-ID. > > We always should tell unexperienced users that rights of use and > copyright might be violated by the use of such plugins. Google has also > just licensed most of its data from third parties and is subject to > restrictions on sharing it. Even if it does not violate copyrights in > some countries, it is against Google's terms of use. > > The same is true for OpenStreetMap. Although the data is free, the use > of the geocoder "nominatim" is subject to a right of use with > restrictions to use it. The conditions must be followed. > > Sure, everyone is responsible for themselves when they obtain a Google > API key. They agree to exactly these usage rights. But especially > inexperienced users are simply told: just get an API key, then you can > automatically georeference your geodata collection via QGIS. This sends > a bad signal and is unethical. > ___ > Qgis-user mailing list > Qgis-user@lists.osgeo.org > List info: https://lists.osgeo.org/mailman/listinfo/qgis-user > Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user > ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] Geocoding with MMQGIS - Web service geocode
Am 28.05.2021 um 00:13 schrieb Nyall Dawson: > 1. Since you already have a Google Maps API key, you can use this plugin (so long as you are on QGIS 3.18!) https://plugins.qgis.org/plugins/google_maps_geocoder/ . It adds a new processing batch geocoder using Google maps, and since it's a Processing algorithm it's very flexible to run (and can be used in models, from the command line, etc). It also adds a new locator bar shortcut for directly navigating to places on the map using Google maps locations. I am really angry that QGIS still has this plugin. The Google APIs (Places, etc.) clearly prohibit geometries from being exported and stored permanently. The only thing that is allowed to be stored permanently is the Google Places-ID. We always should tell unexperienced users that rights of use and copyright might be violated by the use of such plugins. Google has also just licensed most of its data from third parties and is subject to restrictions on sharing it. Even if it does not violate copyrights in some countries, it is against Google's terms of use. The same is true for OpenStreetMap. Although the data is free, the use of the geocoder "nominatim" is subject to a right of use with restrictions to use it. The conditions must be followed. Sure, everyone is responsible for themselves when they obtain a Google API key. They agree to exactly these usage rights. But especially inexperienced users are simply told: just get an API key, then you can automatically georeference your geodata collection via QGIS. This sends a bad signal and is unethical. ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] Geocoding with MMQGIS - Web service geocode
Nyall, Again thanks for your reply. I have upgraded to 3.18 version and was able to install google maps geocoder in zipped version. At the time of installation, it asked me to enter the api key. I did enter but that did not make any difference. I tried to run the tool as shown below. I got the temporary layer as shown in the table below. But that did not plot any points on the map. It just produced a table. As I gave in my previous email, the csv file's address column has only street number and street name. The city name and state names are in separate columns. I am not sure how the tool will correctly geocode just by choosing the address column. Please guide me. [image: image.png] [image: image.png] On Thu, May 27, 2021 at 5:59 PM Nyall Dawson wrote: > On Fri, 28 May 2021 at 09:31, krishna Ayyala > wrote: > > > > Nyall, > > Thanks for the reply. I have qgis3.16 version. I tried install this > plugin via install from zip. I am getting the following error . > > > > https://plugins.qgis.org/plugins/google_maps_geocoder/ > > Yes, you need 3.18 for the plugin -- it relies on newer functionality > introduced in that version. > > Nyall > > > > > > > > > On Thu, May 27, 2021 at 4:13 PM Nyall Dawson > wrote: > >> > >> On Fri, 28 May 2021 at 06:08, krishna Ayyala > wrote: > >> > > >> > Hello, > >> > I have a csv file with the columns "Address", "City", "State" and > "Country". I have 40 rows each row representing one address. All the > addresses are from the United States. I have the API key which I purchased > through subscription. For the web service option, I have chosen Google. > >> > > >> > When I try to geocode, I am getting an empty shape file? Can anyone > help me fix this problem? > >> > >> There's some great solutions available these days! Here's what I > suggest. > >> > >> 1. Since you already have a Google Maps API key, you can use this > >> plugin (so long as you are on QGIS 3.18!) > >> https://plugins.qgis.org/plugins/google_maps_geocoder/ . It adds a new > >> processing batch geocoder using Google maps, and since it's a > >> Processing algorithm it's very flexible to run (and can be used in > >> models, from the command line, etc). It also adds a new locator bar > >> shortcut for directly navigating to places on the map using Google > >> maps locations. > >> > >> 2. If you download a nightly pre-release of QGIS 3.20, then there's an > >> out-of-the-box "Batch Nominatim geocoder" tool in the Processing > >> toolbox which geocodes using OpenStreetMap data. This is super > >> convenient, because you don't need ANY api keys or plugins... it's > >> just ready to go! The one catch is that it's rate-limited, so will be > >> slow if you need to geocode a lot of results. > >> > >> All in all, the QGIS geocoding situation is MUCH improved since > previous years! > >> > >> Hope that helps! > >> > >> Nyall > >> > >> > >> > >> > > >> > Regards. > >> > ___ > >> > Qgis-user mailing list > >> > Qgis-user@lists.osgeo.org > >> > List info: https://lists.osgeo.org/mailman/listinfo/qgis-user > >> > Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user > ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] Geocoding with MMQGIS - Web service geocode
On Fri, 28 May 2021 at 09:31, krishna Ayyala wrote: > > Nyall, > Thanks for the reply. I have qgis3.16 version. I tried install this plugin > via install from zip. I am getting the following error . > > https://plugins.qgis.org/plugins/google_maps_geocoder/ Yes, you need 3.18 for the plugin -- it relies on newer functionality introduced in that version. Nyall > > > > On Thu, May 27, 2021 at 4:13 PM Nyall Dawson wrote: >> >> On Fri, 28 May 2021 at 06:08, krishna Ayyala wrote: >> > >> > Hello, >> > I have a csv file with the columns "Address", "City", "State" and >> > "Country". I have 40 rows each row representing one address. All the >> > addresses are from the United States. I have the API key which I purchased >> > through subscription. For the web service option, I have chosen Google. >> > >> > When I try to geocode, I am getting an empty shape file? Can anyone help >> > me fix this problem? >> >> There's some great solutions available these days! Here's what I suggest. >> >> 1. Since you already have a Google Maps API key, you can use this >> plugin (so long as you are on QGIS 3.18!) >> https://plugins.qgis.org/plugins/google_maps_geocoder/ . It adds a new >> processing batch geocoder using Google maps, and since it's a >> Processing algorithm it's very flexible to run (and can be used in >> models, from the command line, etc). It also adds a new locator bar >> shortcut for directly navigating to places on the map using Google >> maps locations. >> >> 2. If you download a nightly pre-release of QGIS 3.20, then there's an >> out-of-the-box "Batch Nominatim geocoder" tool in the Processing >> toolbox which geocodes using OpenStreetMap data. This is super >> convenient, because you don't need ANY api keys or plugins... it's >> just ready to go! The one catch is that it's rate-limited, so will be >> slow if you need to geocode a lot of results. >> >> All in all, the QGIS geocoding situation is MUCH improved since previous >> years! >> >> Hope that helps! >> >> Nyall >> >> >> >> > >> > Regards. >> > ___ >> > Qgis-user mailing list >> > Qgis-user@lists.osgeo.org >> > List info: https://lists.osgeo.org/mailman/listinfo/qgis-user >> > Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] Geocoding with MMQGIS - Web service geocode
Nyall, Thanks for the reply. I have qgis3.16 version. I tried install this plugin via install from zip. I am getting the following error . https://plugins.qgis.org/plugins/google_maps_geocoder/ [image: image.png] On Thu, May 27, 2021 at 4:13 PM Nyall Dawson wrote: > On Fri, 28 May 2021 at 06:08, krishna Ayyala > wrote: > > > > Hello, > > I have a csv file with the columns "Address", "City", "State" and > "Country". I have 40 rows each row representing one address. All the > addresses are from the United States. I have the API key which I purchased > through subscription. For the web service option, I have chosen Google. > > > > When I try to geocode, I am getting an empty shape file? Can anyone help > me fix this problem? > > There's some great solutions available these days! Here's what I suggest. > > 1. Since you already have a Google Maps API key, you can use this > plugin (so long as you are on QGIS 3.18!) > https://plugins.qgis.org/plugins/google_maps_geocoder/ . It adds a new > processing batch geocoder using Google maps, and since it's a > Processing algorithm it's very flexible to run (and can be used in > models, from the command line, etc). It also adds a new locator bar > shortcut for directly navigating to places on the map using Google > maps locations. > > 2. If you download a nightly pre-release of QGIS 3.20, then there's an > out-of-the-box "Batch Nominatim geocoder" tool in the Processing > toolbox which geocodes using OpenStreetMap data. This is super > convenient, because you don't need ANY api keys or plugins... it's > just ready to go! The one catch is that it's rate-limited, so will be > slow if you need to geocode a lot of results. > > All in all, the QGIS geocoding situation is MUCH improved since previous > years! > > Hope that helps! > > Nyall > > > > > > > Regards. > > ___ > > Qgis-user mailing list > > Qgis-user@lists.osgeo.org > > List info: https://lists.osgeo.org/mailman/listinfo/qgis-user > > Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user > ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] Geocoding with MMQGIS - Web service geocode
On Fri, 28 May 2021 at 06:08, krishna Ayyala wrote: > > Hello, > I have a csv file with the columns "Address", "City", "State" and "Country". > I have 40 rows each row representing one address. All the addresses are from > the United States. I have the API key which I purchased through subscription. > For the web service option, I have chosen Google. > > When I try to geocode, I am getting an empty shape file? Can anyone help me > fix this problem? There's some great solutions available these days! Here's what I suggest. 1. Since you already have a Google Maps API key, you can use this plugin (so long as you are on QGIS 3.18!) https://plugins.qgis.org/plugins/google_maps_geocoder/ . It adds a new processing batch geocoder using Google maps, and since it's a Processing algorithm it's very flexible to run (and can be used in models, from the command line, etc). It also adds a new locator bar shortcut for directly navigating to places on the map using Google maps locations. 2. If you download a nightly pre-release of QGIS 3.20, then there's an out-of-the-box "Batch Nominatim geocoder" tool in the Processing toolbox which geocodes using OpenStreetMap data. This is super convenient, because you don't need ANY api keys or plugins... it's just ready to go! The one catch is that it's rate-limited, so will be slow if you need to geocode a lot of results. All in all, the QGIS geocoding situation is MUCH improved since previous years! Hope that helps! Nyall > > Regards. > ___ > Qgis-user mailing list > Qgis-user@lists.osgeo.org > List info: https://lists.osgeo.org/mailman/listinfo/qgis-user > Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] Geocoding with MMQGIS - Web service geocode
On Fri, 28 May 2021 at 06:22, Erich Purpur wrote: > > For what it's worth, Geocoding is one thing I have not found a good solution > for in QGIS (including trying the MMQGIS plugin tool). In my experience, none > of the geocoding plugins in QGIS work very well. I am lucky to have access to > an ESRI license as well and do geocoding in ArcPro. > > I know that is not a solution for you, but if anyone else has a good > geocoding solution in QGIS I'd love to hear it! > > -Erich Purpur > > On Thu, May 27, 2021 at 4:05 PM krishna Ayyala > wrote: >> >> Hello, >> I have a csv file with the columns "Address", "City", "State" and "Country". >> I have 40 rows each row representing one address. All the addresses are from >> the United States. I have the API key which I purchased through >> subscription. For the web service option, I have chosen Google. >> >> When I try to geocode, I am getting an empty shape file? Can anyone help me >> fix this problem? >> >> Regards. >> ___ >> Qgis-user mailing list >> Qgis-user@lists.osgeo.org >> List info: https://lists.osgeo.org/mailman/listinfo/qgis-user >> Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user > > ___ > Qgis-user mailing list > Qgis-user@lists.osgeo.org > List info: https://lists.osgeo.org/mailman/listinfo/qgis-user > Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] Geocoding with MMQGIS - Web service geocode
I am herewith attaching the sample data with only 5 addresses for the below question. Hello, I have a csv file with the columns "Address", "City", "State" and "Country". I have 40 rows each row representing one address. All the addresses are from the United States. I have the API key which I purchased through subscription. For the web service option, I have chosen Google. When I try to geocode, I am getting an empty shape file? Can anyone help me fix this problem? Regards. Sample_Address.csv Description: MS-Excel spreadsheet ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] Geocoding with MMQGIS - Web service geocode
I recently tried the hqgis plugin which leverages the here api and it seemed to work fine for my purposes. I used the free tier so your number of API calls will be limited but if you are using above that you should probably be using a commercial service anyway and you can just upgrade as needed. In terms of resolving the issues with mmqgis it may be worth sharing a small sample set (even with incorrect/ dummy data but similar formatting) and the specific configuration settings that are being used so that other community members can more easily test and troubleshoot. On Thu, 27 May 2021 at 22:19, Erich Purpur wrote: > For what it's worth, Geocoding is one thing I have not found a good > solution for in QGIS (including trying the MMQGIS plugin tool). In my > experience, none of the geocoding plugins in QGIS work very well. I am > lucky to have access to an ESRI license as well and do geocoding in ArcPro. > > I know that is not a solution for you, but if anyone else has a good > geocoding solution in QGIS I'd love to hear it! > > -Erich Purpur > > On Thu, May 27, 2021 at 4:05 PM krishna Ayyala > wrote: > >> Hello, >> I have a csv file with the columns "Address", "City", "State" and >> "Country". I have 40 rows each row representing one address. All the >> addresses are from the United States. I have the API key which I purchased >> through subscription. For the web service option, I have chosen Google. >> >> When I try to geocode, I am getting an empty shape file? Can anyone help >> me fix this problem? >> >> Regards. >> ___ >> Qgis-user mailing list >> Qgis-user@lists.osgeo.org >> List info: https://lists.osgeo.org/mailman/listinfo/qgis-user >> Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user >> > ___ > Qgis-user mailing list > Qgis-user@lists.osgeo.org > List info: https://lists.osgeo.org/mailman/listinfo/qgis-user > Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user > ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] Geocoding with MMQGIS - Web service geocode
For what it's worth, Geocoding is one thing I have not found a good solution for in QGIS (including trying the MMQGIS plugin tool). In my experience, none of the geocoding plugins in QGIS work very well. I am lucky to have access to an ESRI license as well and do geocoding in ArcPro. I know that is not a solution for you, but if anyone else has a good geocoding solution in QGIS I'd love to hear it! -Erich Purpur On Thu, May 27, 2021 at 4:05 PM krishna Ayyala wrote: > Hello, > I have a csv file with the columns "Address", "City", "State" and > "Country". I have 40 rows each row representing one address. All the > addresses are from the United States. I have the API key which I purchased > through subscription. For the web service option, I have chosen Google. > > When I try to geocode, I am getting an empty shape file? Can anyone help > me fix this problem? > > Regards. > ___ > Qgis-user mailing list > Qgis-user@lists.osgeo.org > List info: https://lists.osgeo.org/mailman/listinfo/qgis-user > Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user > ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
[Qgis-user] Geocoding with MMQGIS - Web service geocode
Hello, I have a csv file with the columns "Address", "City", "State" and "Country". I have 40 rows each row representing one address. All the addresses are from the United States. I have the API key which I purchased through subscription. For the web service option, I have chosen Google. When I try to geocode, I am getting an empty shape file? Can anyone help me fix this problem? Regards. ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
