Re: [OSM-dev] tagtransform for OSM - An effort make tagging and using OSM data easier; bridging different worlds together

[Imre Samu]

OSM_tags_for_routing/Maxspeed )
-   injecting 3rd party data  ( for example Wikidata labels , driving side
, country admin code  )
-   validating 3rd party links ( wikipedia links  ,  wikidata id-s; website
urls , facebook links  )
-   validating osm "values" from the lookup tables / regexp   (  example:
"building:color" )
-   removing nested relations ( role=subarea)
https://github.com/osmcode/osmium-tool/issues/169


For an *ad-hoc transformation* ( osm.pbf -> osm.pbf ) we can use
- https://osmcode.org/opl-file-format/
- osm xml format
   osmium cat  input.osm.pbf -f xml --no-progress  -o -  |   sed ...  |
osmium cat - --input-format xml  -o output.osm.pbf
- https://osmcode.org/pyosmium/  ( python )
- https://github.com/osmcode/node-osmium ( Javascript )
- ( osm.pbf ) Golang libs  ...
- 

Regards,
 Imre


Sören Reinecke  ezt írta (időpont: 2019. dec. 6.,
P, 13:33):

> There are some available options I see:
> a) Not working on this further.
> b) Using `tagtransform for OSM` to create an own transformation
> specification.
> c) Writing converters which convert from a format to the format of
> `tagtransform for OSM` and writing converters to convert from the format of
> `tagtransform for OSM` to another format programs can work with. Using my
> specification which needs to be extended to create conpactibility among
> different formats while ensuring that my spec can be used on its own.
>
> What do you prefer or do you have another options to add?
>
> Cheers
>
> Sören Reinecke alias Valor Naram
>
>
>  Original Message 
> Subject: Re: [OSM-dev] tagtransform for OSM - A effort make tagging and
> using OSM data easier; bridging different worlds together
> From: Imre Samu
> To: Sören Reinecke
> CC: OSM-Dev Openstreetmap
>
>
> > I currently write a specification for tranforming tags in OpenStreetMap
> to make life of data customers easier.
>
> imho:  we can import some good ideas from
> https://wiki.openstreetmap.org/wiki/Osmosis/TagTransform schema ..
> *"The tag transform Osmosis plugin allows arbitrary tag transforms to be
> applied to OSM data as a preprocessing step before using other tools. This
> allows other tools to concentrate on doing what ever they do, without
> having to handle numerous different tagging schemes and error corrections."*
> imho:   regexp is useful.
>
> probably the "lua" is good glue/meta language - for writing "business
> rules".
> some examples:
> Valhalla (routing)  admin.lua (
> https://github.com/valhalla/valhalla/blob/master/lua/admin.lua )
> Valhalla (routing) graph.lua (
> https://github.com/valhalla/valhalla/blob/master/lua/graph.lua )
>
> osm2gsql - openstreetmap-carto.lua
>
> https://github.com/gravitystorm/openstreetmap-carto/blob/master/openstreetmap-carto.lua
>
> Regards,
>  Imre
>
>
>
>
>
>
>
> Sören Reinecke via dev  ezt írta (időpont: 2019.
> dec. 5., Cs, 15:59):
>
>> Hey all,
>>
>> I currently write a specification for tranforming tags in OpenStreetMap
>> to make life of data customers easier. Different tagging schemes have
>> emerged since the existence of OpenStreetMap, same are existing in parallel
>> and a newer one deprecated an old one. Data customers without knowing the
>> OSM community much get lost. This project aims to help developers who want
>> to take advantage of the OpenStreetMap great database which is by the way a
>> brilliant project. This project can also help to make tagging in OSM more
>> orthogonal and more hassle free.
>>
>> I saw conflicting interests between OSM community, OSM developers like
>> the iD developers and data customers. A renderer might need data in another
>> way as the community contributes. The community might need another tagging
>> scheme than a renderer. I thought how we can resolve this, how we can get
>> all sites on "one table" and that is the idea I had come up with:
>>
>> A more readable version can be found here:
>> https://github.com/ValorNaram/transformation-table-osmtags/blob/master/README.md
>> and the principles can be found at
>> https://github.com/ValorNaram/transformation-table-osmtags/blob/master/principles.md
>>
>>
>> --
>>
>> Example 1: They want to have the phone number of a POI. There are some
>> problems with this:
>>
>> 1. They need to know both contact:phone and phone to get them all.
>> 2. They need to support them both.
>> 3. They need to remove one in case both keys are mapped on one POI.
>> This really happens, see http://overpass-turbo.eu/s/OI2.
>>
>> Example 2: They want to know how many POI's have changin

Re: [OSM-dev] tagtransform for OSM - A effort make tagging and using OSM data easier; bridging different worlds together

[Imre Samu]

> I currently write a specification for tranforming tags in OpenStreetMap
to make life of data customers easier.

imho:  we can import some good ideas from
https://wiki.openstreetmap.org/wiki/Osmosis/TagTransform schema ..
*"The tag transform Osmosis plugin allows arbitrary tag transforms to be
applied to OSM data as a preprocessing step before using other tools. This
allows other tools to concentrate on doing what ever they do, without
having to handle numerous different tagging schemes and error corrections."*
imho:   regexp is useful.

probably the "lua" is good glue/meta language - for writing "business
rules".
some examples:
Valhalla (routing)  admin.lua (
https://github.com/valhalla/valhalla/blob/master/lua/admin.lua )
Valhalla (routing) graph.lua (
https://github.com/valhalla/valhalla/blob/master/lua/graph.lua )

osm2gsql - openstreetmap-carto.lua
https://github.com/gravitystorm/openstreetmap-carto/blob/master/openstreetmap-carto.lua

Regards,
 Imre







Sören Reinecke via dev  ezt írta (időpont: 2019.
dec. 5., Cs, 15:59):

> Hey all,
>
> I currently write a specification for tranforming tags in OpenStreetMap to
> make life of data customers easier. Different tagging schemes have emerged
> since the existence of OpenStreetMap, same are existing in parallel and a
> newer one deprecated an old one. Data customers without knowing the OSM
> community much get lost. This project aims to help developers who want to
> take advantage of the OpenStreetMap great database which is by the way a
> brilliant project. This project can also help to make tagging in OSM more
> orthogonal and more hassle free.
>
> I saw conflicting interests between OSM community, OSM developers like the
> iD developers and data customers. A renderer might need data in another way
> as the community contributes. The community might need another tagging
> scheme than a renderer. I thought how we can resolve this, how we can get
> all sites on "one table" and that is the idea I had come up with:
>
> A more readable version can be found here:
> https://github.com/ValorNaram/transformation-table-osmtags/blob/master/README.md
> and the principles can be found at
> https://github.com/ValorNaram/transformation-table-osmtags/blob/master/principles.md
>
>
> --
>
> Example 1: They want to have the phone number of a POI. There are some
> problems with this:
>
> 1. They need to know both contact:phone and phone to get them all.
> 2. They need to support them both.
> 3. They need to remove one in case both keys are mapped on one POI.
> This really happens, see http://overpass-turbo.eu/s/OI2.
>
> Example 2: They want to know how many POI's have changing tables (general:
> facilities for changing a nappy of a baby). There are some problems with
> this too:
>
> 1. They need to know both changing_table and the deprecated diaper to
> get them all.
> 2. They need to support them both. Difficult because they're highly
> different tagging schemes.
> 3. They need to remove one in case both keys are mapped on one POI.
> This really happens, see http://overpass-turbo.eu/s/OI5.
>
> Example 3: They want to develop a mapping tool and want to correct wrong
> typed in tags. There are some problems with that:
>
> 1. They need to know all possible tagging schemes existing for one
> purpose (e.g. mapping facilities for changing the nappy of a baby).
> 2. They need to know the right/approved/more logical scheme.
> 3. They need to know how to convert:
>
>  diaper=yes
>  diaper:female=yes
>
> becomes after the transformation:
>
> changing_table=yes
> changing_table:location=female_toilet
>
>
> --
>
> Basically it bridges the OSM community and developers together, it might
> even resolve the conflict between iD developers and the community.
>
> The project bridges different worlds and is therefore a bridge. As bridge
> this project should not just connect different worlds together and by
> ensuring peace between those but also support exchange between those to
> develop a social economy of  "send and receive" This project should support
> the "come together" of (OSM) developers and mappers.
>
>
> *I want to hear your opinions on this and also feel not to shame to ask
> questions. My answers will be part of the clarification of the project
> "tagtransform for OSM".*
>
> Cheers
>
> Sören Reinecke alias ValorNaram
>
> ___
> dev mailing list
> dev@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/dev
>
___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev

Re: [Taginfo-dev] Getting matching maps on Taginfo gb

[Imre Samu]

>Thank you, these figures have done the trick.

good news :)
( I see : https://taginfo.openstreetmap.org.uk/taginfo/config )

some small comments:
#1.
  you can add a configturbo.wizard_area =  "in 'United Kingdom'"

https://github.com/ImreSamu/dockerized-taginfo/blob/sotm2018/service/eu/gb/taginfo-config.json#L71
   but this is containing Northern Ireland
  ( I have checked the  "Great Britain" relation, but this is smaller
https://www.openstreetmap.org/relation/6038068 , a lot of islands not
included )

#2.
with high precision extracting - you can remove the extra tags in Ireland
( ~ south coastline )  or in France
* https://taginfo.openstreetmap.org.uk/keys/natural#map  vs.
http://207.180.196.156:20142/keys/natural#map
I am running an extra "osmium extract --strategy simple" on the input
data:
https://github.com/taginfo/dockerized-taginfo/blob/master/sh/osm_split.sh#L47

Imre





Shaun McDonald  ezt írta (időpont: 2019. ápr.
22., H, 0:27):

> Hi Imre,
>
> Thank you, these figures have done the trick.
>
> The coordinates are in a different order to which Taginfo uses, however
> swapping the middle 2 numbers produces a good map.
>
> Shaun
>
> On 20 Apr 2019, at 17:04, Imre Samu  wrote:
>
> Hi Shaun,
>
> sorry, now I can't debug your values - but as I remember it is not easy.
>
> I am calculating with this ugly SQL function - for every country.
> *
> https://github.com/taginfo/dockerized-taginfo/blob/master/setup/setup_xtaginfo_admin.sql#L42
>
> and my result for GB  - this.
>
> https://github.com/ImreSamu/dockerized-taginfo/blob/sotm2018/service/eu/gb/taginfo-config.json
>  - but this is smaller than yours
> ( ~ 2-3 day online: http://207.180.196.156:20142/keys/highway#map )
>  included : https://en.wikipedia.org/wiki/Rockall - so it is strange ..
>
> ---
> and calling with your coordinate - my result.
> ===
> osm=# select get_xtaginfo('gb', -12.35,2.98, 49.47, 61.2) ;
> NOTICE:  OK   R# = gb, 18 , 279.000 , 216.000 ,0.170 ,0.270
> get_xtaginfo
> -
>  {279,216,-12.35,3.150,49.47,61.470}
> (1 row)
> ==
> so the geneated image:  279 x 216  pixel
> and the coordinates=  -12.35,3.150,49.47,61.470
> but  I can't test ..
>
> Imre
>
>
>
>
>
>
> Shaun McDonald  ezt írta (időpont: 2019. ápr.
> 20., Szo, 11:20):
>
>> Hi,
>>
>>
>> I’m trying to get the background map to match the Taginfo generated map
>> for the GB Taginfo. I seem to be missing something from the instructions on
>> the OSM wiki, as the background maps. With an earlier version I was getting
>> too much included vertically.
>>
>>
>> https://wiki.openstreetmap.org/wiki/Taginfo/Installation#Adapting_the_map_view
>>
>> My working is in
>> https://docs.google.com/spreadsheets/d/1rnO5jqZAirsFankimavetobulNE2f5MJi4Z0PA8h0Dc/edit?usp=sharing
>>
>> I’ve followed
>> https://switch2osm.org/manually-building-a-tile-server-18-04-lts/ to
>> produce a map DB.
>>
>> Map image script:
>> cat create_taginfo_map.py
>> import mapnik
>>
>> m=mapnik.Map(330,345)
>> mapnik.load_map(m, 'openstreetmap-carto/taginfo_outline.xml')
>>
>> bbox = mapnik.Box2d(-9,49.8,2.5,60.8)
>> m.zoom_to_box(bbox)
>>
>> im = mapnik.Image(330,345)
>> mapnik.render(m,im)
>> im.save('gb_map.png', 'png256’)
>>
>> The highway map is a good example showing the issue:
>> https://taginfo.openstreetmap.org.uk/keys/highway#map
>>
>> head openstreetmap-carto/taginfo_outline.xml
>> 
>> 
>> 
>>  
>>1
>>2
>>
>>
>>> name="bounds">-180,-85.05112877980659,180,85.05112877980659
>>0,0,4
>>
>>
>> Taginfo config segment:
>>// For the geodistribution map. See the wiki documentation about these
>> settings.
>>"geodistribution": {
>>"left": -9,
>>"bottom": 49.8,
>>"right": 2.5,
>>"top": 60.8,
>>"width": 345,
>>"height": 330,
>>"scale_image": 1,
>>"scale_compare_image" : 1,
>>//"background_image": "/img/mapbg/world.png",
>>"background_image": "/img/mapbg/gb_map.png",
>>// optional attribution for base image, will show up below all maps
>>"image_attribution": ""
>>},
>>
>> I can’t quite figure out what I’m doing wrong to get the maps to line up
>> correctly while following the instructions on the wiki. I’m so close now.
>> Would anyone be able to provide some pointers on how to fix?
>>
>> Shaun
>>
>>
>> ___
>> Taginfo-dev mailing list
>> Taginfo-dev@openstreetmap.org
>> https://lists.openstreetmap.org/listinfo/taginfo-dev
>>
>
>
___
Taginfo-dev mailing list
Taginfo-dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/taginfo-dev

Re: [Taginfo-dev] Getting matching maps on Taginfo gb

[Imre Samu]

Hi Shaun,

sorry, now I can't debug your values - but as I remember it is not easy.

I am calculating with this ugly SQL function - for every country.
*
https://github.com/taginfo/dockerized-taginfo/blob/master/setup/setup_xtaginfo_admin.sql#L42

and my result for GB  - this.
https://github.com/ImreSamu/dockerized-taginfo/blob/sotm2018/service/eu/gb/taginfo-config.json
 - but this is smaller than yours
( ~ 2-3 day online: http://207.180.196.156:20142/keys/highway#map )
 included : https://en.wikipedia.org/wiki/Rockall - so it is strange ..

---
and calling with your coordinate - my result.
===
osm=# select get_xtaginfo('gb', -12.35,2.98, 49.47, 61.2) ;
NOTICE:  OK   R# = gb, 18 , 279.000 , 216.000 ,0.170 ,0.270
get_xtaginfo
-
 {279,216,-12.35,3.150,49.47,61.470}
(1 row)
==
so the geneated image:  279 x 216  pixel
and the coordinates=  -12.35,3.150,49.47,61.470
but  I can't test ..

Imre






Shaun McDonald  ezt írta (időpont: 2019. ápr.
20., Szo, 11:20):

> Hi,
>
>
> I’m trying to get the background map to match the Taginfo generated map
> for the GB Taginfo. I seem to be missing something from the instructions on
> the OSM wiki, as the background maps. With an earlier version I was getting
> too much included vertically.
>
>
> https://wiki.openstreetmap.org/wiki/Taginfo/Installation#Adapting_the_map_view
>
> My working is in
> https://docs.google.com/spreadsheets/d/1rnO5jqZAirsFankimavetobulNE2f5MJi4Z0PA8h0Dc/edit?usp=sharing
>
> I’ve followed
> https://switch2osm.org/manually-building-a-tile-server-18-04-lts/ to
> produce a map DB.
>
> Map image script:
> cat create_taginfo_map.py
> import mapnik
>
> m=mapnik.Map(330,345)
> mapnik.load_map(m, 'openstreetmap-carto/taginfo_outline.xml')
>
> bbox = mapnik.Box2d(-9,49.8,2.5,60.8)
> m.zoom_to_box(bbox)
>
> im = mapnik.Image(330,345)
> mapnik.render(m,im)
> im.save('gb_map.png', 'png256’)
>
> The highway map is a good example showing the issue:
> https://taginfo.openstreetmap.org.uk/keys/highway#map
>
> head openstreetmap-carto/taginfo_outline.xml
> 
> 
> 
>  
>1
>2
>
>
> name="bounds">-180,-85.05112877980659,180,85.05112877980659
>0,0,4
>
>
> Taginfo config segment:
>// For the geodistribution map. See the wiki documentation about these
> settings.
>"geodistribution": {
>"left": -9,
>"bottom": 49.8,
>"right": 2.5,
>"top": 60.8,
>"width": 345,
>"height": 330,
>"scale_image": 1,
>"scale_compare_image" : 1,
>//"background_image": "/img/mapbg/world.png",
>"background_image": "/img/mapbg/gb_map.png",
>// optional attribution for base image, will show up below all maps
>"image_attribution": ""
>},
>
> I can’t quite figure out what I’m doing wrong to get the maps to line up
> correctly while following the instructions on the wiki. I’m so close now.
> Would anyone be able to provide some pointers on how to fix?
>
> Shaun
>
>
> ___
> Taginfo-dev mailing list
> Taginfo-dev@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/taginfo-dev
>
___
Taginfo-dev mailing list
Taginfo-dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/taginfo-dev

Re: [OSM-dev] My own iD editor - OSM in a nutshell

[Imre Samu]

>I would also like the result to be "exportable" to OSM real infrastructure
>so that the whole system would be OSM in a nutshell but whitout losing
data that can be handled as contribution.

Check the POSM (Portable OpenStreetMap) project.
(  http://posm.io/docs/posm/intro/  ; https://github.com/posm/posm )[
offline OpenStreetMap + editing (using iD, JOSM, and other parts of the OSM
ecosystem) ]
*"This means that any or all parts of a mapping workflow can happen
offline. A user can pre-download files for an area of interest and then
transport POSM to the area. Mappers can do any and all of the following:
fly a drone, process the imagery, use that to conduct a mapathon and create
a base map, conduct a phone-based survey, add local detail to the base map
with either paper-based or mobile phone-based methods, and pull the
resulting data from the phones onto a local server. This cycle can be
repeated over and over again to build off of previous efforts. When a
project finishes, users take POSM back to an area with internet and push
the data to OpenStreetMap and other relevant places."*
Cloud Installation:  http://posm.io/docs/posm/cloud/

best,
Imre

Julien Cochennec  ezt írta (időpont: 2019. márc. 28., Cs,
16:16):

> Hi, I'd like to have my own iD editor on a server, to develop additional
> features or plugins.
> I'd like to connect it to different virtual servers "emulating" the whole
> OSM architecture, not to interfere with contributors.
> I would also like the result to be "exportable" to OSM real infrastructure
> so that the whole system would be OSM in a nutshell but whitout losing data
> that can be handled as contribution.
>
> - Do you think it's possible?
> - If it's possible, which servers do I need to emulate?
> - Which file in iD source would I have to change so the APIs are local and
> not worldwide?
>
> Thanks.
>
> ___
> dev mailing list
> dev@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/dev
>
___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev

[Taginfo-dev] 1week test: taginfo-dev.opengeodata.hu - 622 areas - every country and some new experimental features

[Imre Samu]

This is a Proof of Concept of my vision -  about customizing taginfo for
countries, regions ...

dev site: http://taginfo-dev.opengeodata.hu
1 week test:   shutdown time:  *~ 2018-aug-20*


Main changes:

*-  620 areas  - not refreshing *
  ( = 620 docker services running in a simple cloud machine.
32Gb RAM,   slow CPU :  Intel(R) Atom(TM) CPU  C2750  @
2.40GHz,   8 core ,  ~ 600Gb Disk )

*-  2 new experimental reports*:

  "QA-Normalized name differences (Experimental)"
example:
http://eu-at.taginfo-dev.opengeodata.hu/reports/normalized_names
( I hope - this will be useful for the localized
https://github.com/osmlab/name-suggestion-index
 ( see
https://github.com/osmlab/name-suggestion-index/issues/11 )
The result can be download as an xlsx file:
http://eu-at.taginfo-dev.opengeodata.hu/download/normalized_names.xlsx

  "QA-Problematic tags (Experimental)" [ still a lot of bugs,   for
example:  checking access type of tags  is not perfect yet, sorry ]
 example:
http://eu-at.taginfo-dev.opengeodata.hu/reports/problematic_tags
 .xlsx result:
http://eu-at.taginfo-dev.opengeodata.hu/download/problematic_tags.xlsx

*- `name` support for tags  ( Experimental )  *

 example:
http://eu-at.taginfo-dev.opengeodata.hu/tags/amenity=fast_food#tagnames_lang1

 or Spain   amenity=place_of_worship
 name   =
http://eu-es.taginfo-dev.opengeodata.hu/tags/amenity=place_of_worship#tagnames_lang1
 name:es  =
http://eu-es.taginfo-dev.opengeodata.hu/tags/amenity=place_of_worship#tagnames_lang2
 name:eu  =
http://eu-es.taginfo-dev.opengeodata.hu/tags/amenity=place_of_worship#tagnames_lang3
 name:ca  =
http://eu-es.taginfo-dev.opengeodata.hu/tags/amenity=place_of_worship#tagnames_lang4
 name:gl   =
http://eu-es.taginfo-dev.opengeodata.hu/tags/amenity=place_of_worship#tagnames_lang5

   or Switzerland   amenity=bank
 name   =
http://eu-ch.taginfo-dev.opengeodata.hu/tags/amenity=bank#tagnames_lang1
 name:en  =
http://eu-ch.taginfo-dev.opengeodata.hu/tags/amenity=bank#tagnames_lang2
 name:de  =
http://eu-ch.taginfo-dev.opengeodata.hu/tags/amenity=bank#tagnames_lang3
 name:fr=
http://eu-ch.taginfo-dev.opengeodata.hu/tags/amenity=bank#tagnames_lang4
 name:it=
http://eu-ch.taginfo-dev.opengeodata.hu/tags/amenity=bank#tagnames_lang5

-
source code - for the dockerization:
https://github.com/taginfo/dockerized-taginfo
taginfo changes:
https://github.com/taginfo/taginfo/compare/master...ImreSamu:name_tabs_v2

This is an experimental - and not official changes,   probably some
changes will be converted as a "taginfo plug-in".
The 2 experimental reports implemented in Julia language (
https://julialang.org/ )

-

Regards,
   Imre
___
Taginfo-dev mailing list
Taginfo-dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/taginfo-dev

Re: [OSM-dev] [OSM-talk] Nominatim - censorship at github pages

[Imre Samu]

Hi Mariusz,

> I criticized that this important service is being neglected and is
maintained in a way which makes it quite impossible to contribute to.
>...
>Can somebody tell me why it is that?
> ...

imho:

my favorite on this topics:  https://en.wikipedia.org/wiki/
Nonviolent_Communication
and according to my experience  - moralistic judgments and diagnoses can't
help solve the problems.
on the other hand, Empathy ( for the project )  can be very powerful.

And If you want to understand the other side, read this:"Why I didn’t
fix your bug"   http://magnusmanske.de/wordpress/?p=518
so "Be nice" and give a positive surprise   ( for example add a picture of
a cute animal for your issue;   example:  https://github.com/moby/moby/
pull/36630 )

disclaimer:
- I have 1 accepted contributions:  https://github.com/openstreetmap/
Nominatim/pull/690


Regards,
 Imre


2018-03-26 12:43 GMT+02:00 cm-sani...@wp.pl :

> Hi,
> Some time ago on this mailing list I expressed concern about the way
> Nominatim is being maintained. In short, I criticized that this important
> service is being neglected and is maintained in a way which makes it quite
> impossible to contribute to. My opinion meet with hostility (which I don't
> really mind). But what I mind is censorship. Lately somebody else noticed
> [1] that having pull request opened for 6 years without any explanation why
> it's not merged doesn't look good. I contributed to the discussion,
> explained the reasoning for having it opened (which was presented to me
> during last time I took part in discussion here). Now I look at the pull
> request 's discussion and turns out my comment was removed.
>
> Can somebody tell me why it is that? In my opinion the fact I am not liked
> by the maintainers, shouldn't result in deleting my on topic comments. Is
> there some oversight over moderation? Can I somehow repeal the decision? Or
> at least get some explanation why my comment was removed?
>
> [1] - https://github.com/openstreetmap/Nominatim/pull/
> 27#issuecomment-370127296
>
> Thanks,
> Mariusz
>
> ___
> talk mailing list
> t...@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/talk
>
>
___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev

Re: [Taginfo-dev] dockerized-taginfo - for every country

[Imre Samu]

I have added some new areas ( no daily refresh )

Asia:http://taginfo-dev.opengeodata.hu/asia/   (  5
area:  Indonesia, Sri Lanka, Myanmar, Mongolia, Nepal )
Australia-Oceania:  http://taginfo-dev.opengeodata.hu/australia-oceania/  (
8 area )
Europe :  http://taginfo-dev.opengeodata.hu/europe/  ( 5
area :   Romania, Berlin, Iceland, Istanbul )
North America http://taginfo-dev.opengeodata.hu/north-america/   (
British Columbia, Greenland, Mexico, California, Mississippi )
South Americahttp://taginfo-dev.opengeodata.hu/south-america/  (
Bolivia, Columbia, Peru, Paraguay )
Russia:http://taginfo-dev.opengeodata.hu/russia/ (
Altai Rep, Komi Rep, Saint Petersburg, Republic of Mordovia, Tatarstan )

if somebody wants to test some special area -please write me!


My biggest problem:
-  Antimeridian  -  example:   New Zealand Maps  not working (
http://ao-nz.taginfo-dev.opengeodata.hu/keys/highway#map )
Planned Quick solution:I will  modify the New Zealand  ( and
other countries ) Polygons   - so it will not touch the  Antimeridian(
but the statistics will be worse )

And there are a lot of small problems ..
-  small area background map is not perfect ( now I am using natural earth
raster data,  )
-  job processing is not perfect, detecting errors is not always easy.

Current Status:
- 131 running taginfo container ( alpine linux + ruby )  + proxy +
webserver ...   (  my dev system = 15Gb RAM , 6 core )

now the memory:
root@scw-343bdf:/mnt/data/dockerized-taginfo# free -m
  totalusedfree  shared  buff/cache
 available
Mem:  150192990 974 174   11054
 11535
Swap: 0   0   0

For refreshing the data ( taginfo processing)  at least 5-10 GB Free RAM
need ...  but for the big countries, probably more ...  ( Canada, US,
France, Germany )

For detecting "Long tail" errors I am using the high  detail settings,
*"min_count_tags": 1,*
// Tag combinations not appearing this often are not written to
database.
*"min_tag_combination_count": 1,*
// Minimum number of tag occurances for creating a map
*"min_count_for_map": 1,*
// Minimum number of relations per type to make this
// relation type "interesting", ie. to make it show
// up as a relation type.
*"min_count_relations_per_type": 1,*

With some "basic"   source code customisation  ( some is not optimal yet )

 && sed -i 's/100/10/g'
 /osm/taginfo/sources/master/master.sql \
 && sed -i 's/(default 1)/(default 10)/g'
 /osm/taginfo/web/lib/api/v4/keys.rb \
 && sed -i 's/min_count = 1/min_count = 10/g'
 /osm/taginfo/web/lib/api/v4/keys.rb \
 && sed -i 's/count_all_common >= 1/count_all_common >= 10/g'
/osm/taginfo/web/lib/api/v4/keys.rb \



For the future I have 2 plan:
A: Finding a sponsor and running 200-300  important  areas in a container

B: Creating about ~4000 config files ( in the github repo ) and with a
simple quickstart everybody can run the selected local taginfo.

the planned process for the "B"   ( not working yet )

git clone https://github.com/taginfo/dockerized-taginfo.git
cd dockerized-taginfo
make build
cd ./service/eu// select Europe
make taginfo-eu-de-be //  Create "Berlin" taginfo with downloading and
processing osm data, and start the web frontend

and open the browser: 127.0.0.1:20132


Regards,
 Imre





2018-03-13 23:17 GMT+01:00 Imre Samu <pella.s...@gmail.com>:

> Hi,
>
> If you have some time,
> please help testing my development taginfo service.
>
>
> 3 test continent:
> ==
> http://taginfo-dev.opengeodata.hu/africa/  ~ 65 Taginfo
> service
> http://taginfo-dev.opengeodata.hu/antarctica/   ~  1 Taginfo
> service
> http://taginfo-dev.opengeodata.hu/central-america/  ~ 33 Taginfo service
> 
> = 99 Test taginfo service ( Dockerized - on the same server )
>
> for example:
> * in Antartica   http://aq-aq.taginfo-dev.opengeodata.hu/keys/amenity#
> values
> We have
> - 5 toilets
> - 2 Bank
> - 1 Atm
> - 2 cafe
> ( The Overpass link from Taginfo is not working for Antartica:
>   https://github.com/drolbr/Overpass-API/issues/421 )
>
> or other countries:
> * South Africa  :  http://af-za.taginfo-dev.opengeodata.hu/
> * Costa Rica : http://ca-cr.taginfo-dev.opengeodata.hu/
> * Morocco : http://af-ma.taginfo-dev.opengeodata.hu/
> * ...
>
> Github: https://github.com/taginfo/dockerized-taginfo
>
> Regards,
>  Imre
>
___
Taginfo-dev mailing list
Taginfo-dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/taginfo-dev

[Taginfo-dev] dockerized-taginfo - for every country

[Imre Samu]

Hi,

If you have some time,
please help testing my development taginfo service.


3 test continent:
==
http://taginfo-dev.opengeodata.hu/africa/  ~ 65 Taginfo
service
http://taginfo-dev.opengeodata.hu/antarctica/   ~  1 Taginfo service
http://taginfo-dev.opengeodata.hu/central-america/  ~ 33 Taginfo service

= 99 Test taginfo service ( Dockerized - on the same server )

for example:
* in Antartica   http://aq-aq.taginfo-dev.opengeodata.hu/keys/amenity#values
We have
- 5 toilets
- 2 Bank
- 1 Atm
- 2 cafe
( The Overpass link from Taginfo is not working for Antartica:
  https://github.com/drolbr/Overpass-API/issues/421 )

or other countries:
* South Africa  :  http://af-za.taginfo-dev.opengeodata.hu/
* Costa Rica : http://ca-cr.taginfo-dev.opengeodata.hu/
* Morocco : http://af-ma.taginfo-dev.opengeodata.hu/
* ...

Github: https://github.com/taginfo/dockerized-taginfo

Regards,
 Imre
___
Taginfo-dev mailing list
Taginfo-dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/taginfo-dev

Re: [OSM-dev] Wikipedia Matching

[Imre Samu]

>We want to push even a bit further and find wiki articles that had not
been assigned
>to an OSM item by tag yet. For that we want to query geo-referenced
wikipedia articles
>in the proximity and find articles that have a similar name.

maybe you will find interesting this project:
"Match OSM entities with Wikidata items": http://osm.wikidata.link/
https://github.com/EdwardBetts/osm-wikidata
* One-to-one between OSM and Wikidata
* English language Wikipedia categories are used for matching
Example: Gibraltar https://osm.wikidata.link/candidates/1278736 Items
with no match found in OSM: 198 items

Best regards,
 Imre



2017-05-19 11:11 GMT+02:00 Christoph Lingg :

> Hello guys,
>
> your feedback was very helpful a few days ago, so I am eager to know your
> ideas about this task we have:
>
> We want to show OSM content to our users. The quality and quantity of OSM
> is awesome, however for our use case some background information is very
> useful. That’s why we want to show information from wikipedia where
> possible. A small abstract basically. TagInfo states around 1 Million
> wikipedia/wikidata tags which is a great start.
>
> We want to push even a bit further and find wiki articles that had not
> been assigned to an OSM item by tag yet. For that we want to query
> geo-referenced wikipedia articles in the proximity and find articles that
> have a similar name. We figured out three approaches to get wiki articles
> nearby an osm item:
>  - querying wiki api [1]
>  - using nominatim’s wiki dump [2]
>  - using dump from georeference project of wikipedia [3]
>
> We are currently evaluating these option, we would be glad if you made
> some experience you could share with us. Or even better, are there even
> some precompiled matchings between OSM objects and wikipedia articles?
>
> Or even better better, have there been some efforts to connect OSM objects
> to some knowledge graph which gives access to even a wider range of
> contents, such as flickr images or yelp ratings?
>
> Thanks you for your time!
> Christoph
>
> [1] https://www.mediawiki.org/wiki/Extension:GeoData
> [2] http://wiki.openstreetmap.org/wiki/Nominatim/Installation#
> Wikipedia_rankings
> [3] https://de.wikipedia.org/wiki/Wikipedia:WikiProjekt_
> Georeferenzierung/Hauptseite/Wikipedia-World/en
> ___
> dev mailing list
> dev@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/dev
>
___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] Wikipedia/OSM integration - round trip?

[Imre Samu]

>I'm interested in working across Wikipedia and OSM, e.g. fixing Wikidata
tags in OSM, and coordinates in Wikipedia, etc.
> I've also found this very useful in terms of ensuring that data is
correct on both.
>Does anybody have suggestions for faster linking from Wikipedia to OSM?

I have found an interesting project:
*  "Match OSM entities with Wikidata items":  http://osm.wikidata.link/
*   source:  https://github.com/EdwardBetts/osm-wikidata

example:

Sassari ( Italy ) :  https://osm.wikidata.link/matcher/40683:  view
match candidates :  16 items found
Link for "view match candidates"   ;  And you will find the matches ..
*  7 candidates found
*  Items with no match found in OSM :  9 items

Best,
 Imre


2017-04-26 17:03 GMT+02:00 Bjoern Hassler :

> Hello all,
>
> I'm interested in working across Wikipedia and OSM, e.g. fixing Wikidata
> tags in OSM, and coordinates in Wikipedia, etc. I've also found this very
> useful in terms of ensuring that data is correct on both.
>
> Does anybody have suggestions for faster linking from Wikipedia to OSM?
>
> To explain:
>
> The wikipedia coordinates link (on a wikipedia page) is something like:
> https://tools.wmflabs.org/geohack/geohack.php?pagename=
> Nuraghe_Santu_Antine=40.4865_N_8.7698_E_
> which then lets you go to OSM (by coordinates) - but obviously, you have
> to click that link first, then pick OSM from the list on that page. On OSM,
> you then have to click edit to identify the object referred to in OSM (if
> there is one). So it's not too bad, but if you do this regularly, it's a
> bit tedious.
>
> A better way would be if the wmflabs url could be rewritten (clientside,
> e.g. greasemonkey/tampermonkey), to have a direct link from the wikipedia
> page to OSM.
>
> Even better would be if the url contained the wikidata item
> https://tools.wmflabs.org/geohack/geohack.php?pagename=
> Nuraghe_Santu_Antine=40.4865_N_8.7698_E_=Q925624
> (could be done on the wmflabs side, or also with greasmonkey, as it's
> embedded on the wikipedia page).
>
> Greasemonkey could add a link from the wikipedia page to a resolving
> service, say
> https://WikidataToOSM/?pagename=Nuraghe_Santu_Antine;
> params=40.4865_N_8.7698_E_=Q925624
> which would allow redirect to the actual object on OSM:
> http://www.openstreetmap.org/way/258094245
>
> That would mean that with one click on a Wikipedia page, you'd see the
> corresponding object in OSM.
>
> The other way is straight forward: Because that listing on OSM rewrites
> wikidata/wikipedia tags to URLs, it's just one click to go back from there
> to wikidata/wikipedia, so that's straight forward.
>
> (Ideally, Greasemonkey would also add a direct link to remote control.)
>
> (Also, the OSM search doesn't return anything for the wikidata object
> http://www.openstreetmap.org/search?query=Q925624 - would be great if it
> did.)
>
> Does anybody have any thoughts on this, know of a tool, or coded something
> in the past?
>
> Many thanks,
> Bjoern
>
> ___
> dev mailing list
> dev@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/dev
>
>
___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] Detect editions in an area

[Imre Samu]

>The town hall where I live has decided to upload all the information they
have referring to streets, streets numbers and buildings. Good news!!


check the New York City’s GIS department solution:
*
https://www.mapbox.com/blog/nyc-and-openstreetmap-cooperating-through-open-data/
  (Change detection)   https://github.com/osmlab/changewithin
*  http://www.openstreetmap.org/user/lxbarth/diary/23588
double check the licensing issue *"OpenStreetMap's share alike license
means that OpenStreetMap data can't be taken over directly*
*  into New York City public domain datasets but we can use
OpenStreetMap to find out where changes happened. "*

or you can use:
* the overpass api/turbo :
**  see:  "newer:3day in girona"http://overpass-turbo.eu/s/mXm  (
https://wiki.openstreetmap.org/wiki/Overpass_turbo/Wizard )
**  see:  “(amenity=* or shop=* ) and newer:30day in girona”
http://overpass-turbo.eu/s/mXu
* or you can use the osmium tool to detect changes  (
http://osmcode.org/osmium-tool/manual.html )

And you can use some specialized tools like :
*  https://osm.expandable.dk/ (
https://github.com/MichaelVL/osm-analytic-tracker )( you can install
for your area )
*  https://wiki.openstreetmap.org/wiki/Detect_Vandalism#Tools
*  https://wiki.openstreetmap.org/wiki/Quality_assurance#Monitoring_Tools

or other tools for detecting errors:
*  OSM inspector for addresses :
https://tools.geofabrik.de/osmi/?view=addresses=2.82247=41.96773=12
 ( Select  view: "Addresses" )
   ( see https://wiki.openstreetmap.org/wiki/OSM_Inspector )
* ...

This is not a full list, ...

if you want, I can help creating   "Taginfo for Girona"  instance ( docker
image )

regards,
Imre



2017-02-23 9:03 GMT+01:00 toni hernández :

> Hello guys,
>
> The town hall where I live has decided to upload all the information they
> have referring to streets, streets numbers and buildings. Good news!!
>
> Once they have uploaded all this information, they need to keep this
> information up-to-date. That's why they want some tool that allows them to
> detect any new edition in the municipality.
>
> In your expert opinion, what is the best tool/approach to achieve that?
>
> thanks all.
>
> --
> *Toni Hernández Vallès*
> Servei de Sistemes d'Informació Geogràfica i Teledetecció
> -
> Universitat de Girona
> *SIGTE*
> -
> Pl. Ferrater Mora 1
> 17071 Girona
> Tel +34 972 418 039 <+34%20972%2041%2080%2039> (7026 intern)
> t...@sigte.udg.edu 
>
> http://www.sigte.udg.edu
> Twitter http://twitter.com/SIGTE_UDG
>
>
> ___
> dev mailing list
> dev@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/dev
>
>
___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] tag implication database/library

[Imre Samu]

>Is there some way of doing this just once; for example with some parseable
implication database, and library?
>...
>1. normalizing a database before usage, for example changing
>  "highway=ford" to "ford=yes" and moving to modern lifecycle tags

The iD Editor has some JSON metadata about this ..
see : https://github.com/openstreetmap/iD/blob/master/data/deprecated.json
example:

{
"old": { "highway": "ford" },
"replace": {
"ford": "yes"
}
},
{
"old": { "highway": "stile" },
"replace": {
"barrier": "stile"
}
},
{
"old": { "highway": "incline" },
"replace": {
"highway": "road",
"incline": "up"
}
},

[  +  Wiki  deprecated list  :
https://wiki.openstreetmap.org/wiki/Deprecated_features  ]




And the iD Editor has a lot of presets metadata :

For example:   Homeless Shelter ===  amenity=social_facility  +
social_facility=shelter  +   social_facility:for=homeless
https://github.com/openstreetmap/iD/blob/master/data/presets/presets/amenity/social_facility/homeless_shelter.json

{
"fields": [
"operator",
"address",
"building_area",
"opening_hours",
"wheelchair",
"social_facility_for",
"internet_access",
"internet_access/fee",
"internet_access/ssid"
],
"geometry": [
"point",
"area"
],
"terms": [
"houseless",
"unhoused",
"displaced"
],
"tags": {
"amenity": "social_facility",
"social_facility": "shelter",
"social_facility:for": "homeless"
},
"name": "Homeless Shelter"
}


Imho:
- The only problem, that they only accept general tags, for general mappers
.. ( see https://github.com/openstreetmap/iD/pull/3600 )


Probably the other editors has a similar metadata  ..


Best,
  Imre

2016-11-17 11:51 GMT+01:00 Per Eric Rosén :

> Hi!
>
> I have been making a few maps and applications using OSM data, mostly
> stored in postgis. In all cases, I have had to make custom carto rules /
> database post-processing / application rules to compensate for multiple
> ways of expressing the same information in OSM. Also, in some cases,
> for taking care of which tag implies which information.
>
>
___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev

[Taginfo-dev] started working on : Taginfo Dockerizing + Automatic configurations ( for every country )

[Imre Samu]

TLDR:
-  just you know about this   ( and avoid parallel working )
-  https://github.com/ImreSamu/osmdtaginfo  ( temporary home  ;   temporary
project name )
-  I have a *dockerized working prototype *for  all  "Central-America "
countries  ( Haiti, Cuba, .. )
-  [in a next 4-8-12-*  weeks] I hope :
   -  We have a  taginfo customization for every country   ( and a script
for a quick  :  "Region" / "City" / "District" / "HOTtask" / "POSM"  /
"Mapping Party"   setup )
   -  I hope I can send an online test link ... [  but I don't have a
financial resources for hosting for a long time ]

===
Hi,

One of my favorite tool is the osm Taginfo, and my dream:  creating a
Taginfo instance for every country in the Earth.
And on the "State of the Map 2016"  -  Taginfo -  Birds of Feather meeting
 - we discussed something about this  ~
so I have started working on this topic.
- Current *_temporary_ * repository :   https://github.com/ImreSamu/os
mdtaginfo
- The license is the same  ~  Taginfo  (GPL 3.0)
- And I hope later I can move to this  ->  to the  taginfo repo  [
https://github.com/taginfo ]

Status:

*- The automatic config file / map / generations is working* ( basic level
, and need more test and optimization )
   and for* Central-America*  I uploaded to the repository.
   for example Haiti : https://github.com/ImreSamu/
osmdtaginfo/tree/master/taginfo_data/ht

- I* have created 2 Docker Images  *( https://github.com/ImreSamu
/osmdtaginfo/tree/master/docker )
  -  *taginfo_view*  ( for only for view - Alpine based,configured for
: max 60Mb RAM )
  - * taginfo_job*( for taginfo setup & taginfo data processing jobs &
development  )

so for the every country  ( in theory )  a 32 Gb RAM is enough
-  *taginfo_view docker : *:  RAM =   (  220 country x 60Mb  )   ~  14 - 20
Gb RAM
-  serial batch processing *taginfo_job ( 1 x 4Gb RAM )   *

T*he reverse proxy settings and a lot of other things is missing ...*

My vision ( but the links not exist yet )
   

https://cr.taginfo.openstreetmap.org // taginfo for : "Costa Rica"
https://cu.taginfo.openstreetmap.org // taginfo for : "Cuba"
https://dm.taginfo.openstreetmap.org // taginfo for : "Dominica"
https://do.taginfo.openstreetmap.org // taginfo for : "Dominican Republic"
https://gd.taginfo.openstreetmap.org // taginfo for : "Grenada"
https://hn.taginfo.openstreetmap.org // taginfo for : "Honduras"
https://ht.taginfo.openstreetmap.org // taginfo for : "Haiti"

   


 status:  *this is only a Proof of Concept * ==

if you have a (latest)   *docker* and *docker-compose* installed,  you can
test yourself.

*git clone https://github.com/ImreSamu/osmdtaginfo.git
*
*cd osmdtaginfo*
*./test.sh* ( download Geofabrik
central-america-latest.osm.pbf ~ 246 Mb ,  Build 2 docker containers,  +
Minimal tests ..)

and

*make test_ht  * (   test for Haiti)


check/adapt  the container ip  , ( docker inspect )  and open with the
browser :   ~ http://172.21.0.2:4567/


*Available (all) Central-America configurations: *

[ if you are testing multiple countries, be aware *the browser caching*
( customized background image, and logo sometimes not refreshed ..  I will
change this in the next version.
 on: Chrome: *Hold down Ctrl and click the Reload button! *   ]


make test_ag # test taginfo for: "Antigua and Barbuda"
make test_ai # test taginfo for: "Anguilla"
make test_bb # test taginfo for: "Barbados"
make test_bs # test taginfo for: "The Bahamas"
make test_cr # test taginfo for: "Costa Rica"
make test_cu # test taginfo for: "Cuba"
make test_dm # test taginfo for: "Dominica"
make test_do # test taginfo for: "Dominican Republic"
make test_gd # test taginfo for: "Grenada"
make test_hn # test taginfo for: "Honduras"
*make test_ht # test taginfo for: "Haiti"*
make test_jm # test taginfo for: "Jamaica"
make test_kn # test taginfo for: "Saint Kitts and Nevis"
make test_ky # test taginfo for: "Cayman Islands"
make test_lc # test taginfo for: "Saint Lucia"
make test_ms # test taginfo for: "Montserrat"
make test_ni # test taginfo for: "Nicaragua"
make test_nl # test taginfo for: "The Netherlands"
make test_pa # test taginfo for: "Panama"
make test_sv # test taginfo for: "El Salvador"
make test_tc # test taginfo for: "Turks and Caicos Islands"
make test_tt # test taginfo for: "Trinidad and Tobago"
make test_vc # test taginfo for: "Saint Vincent and the Grenadines"
make test_vg # test taginfo for: "British Virgin Islands"


Ps.
- probably  the 2  letter country code is not enough ...  ( for example -
there is a "The Netherlands" in the Central America  and in the Europe,
 and it is 'bad' for the geographical distribution maps ..
 so later probably I will add a 'continent' prefix or postfix
 like
 - ca - central-america ( ca-ht =Haiti   , ca-nl  = The Nederlands in the
Central 

Re: [OSM-dev] Tag-info: Tag descriptons

[Imre Samu]

Hi Dave,

> From where does tag-info derive the descriptions for each tag?

from the osm wiki
https://wiki.openstreetmap.org/wiki/Taginfo/Sources#Wiki

>place=farm is "Individually named farm (but not isolated)." which I
believe is incorrect.

see "Description"  on the wiki page :
http://wiki.openstreetmap.org/wiki/Tag:place%3Dfarm

wiki source:

{{ValueDescription

|key=place

|value=farm

|description=*Individually named farm (but not isolated).*

|onNode=yes

|onWay=no

|onArea=yes

|status=In use



Best,
 Imre


2016-09-13 18:07 GMT+02:00 Dave F :

> Hi
>
> From where does tag-info derive the descriptions for each tag?
>
> place=farm is "Individually named farm (but not isolated)." which I
> believe is incorrect. It should be used (very rarely, I assume) where a
> group of dwellings (hamlet) have taken the name of a nearby farm. To tag
> the area surrounding farm buildings, landuse=farmyard should be used.
>
> This, along with mapnik carto rendering them, has led to an increase in
> the misuse of this tag combination.
>
> Fill out this tool for evidence:
> http://taghistory.raifer.tech/
>
>  Could it be amended please.
>
> Cheers
> Dave F.
>
> ___
> dev mailing list
> dev@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/dev
>
___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] Wanted: OBF file format description

[Imre Samu]

>  I'm looking for the .obf file format description

maybe:
- https://github.com/osmandapp/OsmAnd-resources/blob/master/protos/OBF.proto
- https://groups.google.com/forum/#!searchin/osmand/obf$20protobuf



2016-07-06 7:06 GMT+02:00 Bernhard R. Fischer :

> Dear list!
>
> I'm looking for the .obf file format description?
> Any suggestions?
>
>
> Regards,
> Bernhard
>
> ___
> dev mailing list
> dev@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/dev
>
___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] Diagrams

[Imre Samu]

Hi Ramneek,

...  ER diagram of open street map ?

maybe you can use:

OpenStreetMap's core rails app:
   A detailed ER Diagram of the schema supporting the RailsPort can be
found here (created 12/2014):
   http://chrisnatali.github.io/osm_notes/osm_schema.html
   more:  http://wiki.openstreetmap.org/wiki/Rails_port/Database_schema


If you want process osm data :

OSM XML :  ( osm data)
   http://wiki.openstreetmap.org/wiki/OSM_XML
   http://wiki.openstreetmap.org/wiki/Elements

OSM XML - osm2pgsql -  PostgreSQL  schema :
http://wiki.openstreetmap.org/wiki/Osm2pgsql/schema

Cheers,
   Imre

2015-04-23 20:20 GMT+02:00 Ramneek Paul Singh ramneekpaulsi...@gmail.com:

 Can i get the site from where i could get the the exact Structure charts ,
 ER diagram of open street map ?
 --
 Ramneek Paul Singh
 http://ramneekpaulsingh.wordpress.com
  Failure is the opportunity to begin again more intelligently 

 ___
 dev mailing list
 dev@openstreetmap.org
 https://lists.openstreetmap.org/listinfo/dev


___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] OSM with Hadoop

[Imre Samu]

An obvious evaluation target for me would be
http://en.wikipedia.org/wiki/Greenplum

from the news:

Pivotal open sources its Hadoop and *Greenplum tech*, and then some
 (  February 17, 2015  )

Pivotal announced today groundbreaking product enhancements to Pivotal Big
Data Suite, including plans to create the world’s first open sourced
enterprise data portfolio, by open sourcing* HAWQ,* Pivotal GemFire
and *Greenplum
Database*. In addition, the new release provides greater cloud deployment
options with support for bare metal commodity hardware, appliance-based
delivery, virtualized instances, and now public, private, and hybrid cloud
support

http://pivotal.io/big-data/press-release/pivotal-introduces-first-open-source-enterprise-grade-big-data-product-suite
http://blog.pivotal.io/big-data-pivotal/news-2/pivotal-big-data-suite-open-agile-cloud-ready

Gigaom: Pivotal open sources its Hadoop and Greenplum tech, and then some

https://gigaom.com/2015/02/17/pivotal-open-sources-its-hadoop-and-greenplum-tech-and-then-some/



*Greenplum PostGIS Extension*( postgis 2.0.3  ; Geos 3.3.8 ; Proj
4.8.0 )
+ check PostGIS Extension Limitations :(
 http://gpdb.docs.pivotal.io/4340/ref_guide/postGIS.html



Some links:
   WE JUST IMPORTED THE WORLD. AND ITS HISTORY. IN 47 MINUTES.   [ 30
novembre 2013 ]
   [ Greenplum cluster ;  OSM XML - CSV -  Greenplum ]

http://squidsolutions.com/we-just-imported-the-world-and-its-history-in-47-minutes/
   http://squidsolutions.com/we-just-imported-the-world-part-ii/


Imre


2015-02-12 15:56 GMT+01:00 Stefan Keller sfkel...@gmail.com:

 Hi Stephen,

 Though being biased(*)  I'm observing alternatives to PostgreSQL all the
 time.
 An obvious evaluation target for me would be
 http://en.wikipedia.org/wiki/Greenplum
 And on a higher level I would reflect about different architectures,
 e.g. like applying this architecture design pattern
 http://martinfowler.com/bliki/CQRS.html (which to is already in used
 by OSM infrastructure).

 -S.

 (*) Disclaimer: I'm one of the organizers of the Swiss Postgres Conference.

 ___
 dev mailing list
 dev@openstreetmap.org
 https://lists.openstreetmap.org/listinfo/dev

___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] Blue Planet

[Imre Samu]

Status ...
  https://github.com/gravitystorm/openstreetmap-carto/issues/1294


2015-02-06 22:31 GMT+01:00 John F. Eldredge j...@jfeldredge.com:

 On February 6, 2015 3:23:36 PM CST, Michael Maier 
 michael.ma...@student.tugraz.at wrote:

 Hello,

 Today, the Earth is completely blue in OpenStreetMap¹ (at least in the
 openstreetmap-carto on osm.org) - All the oceans drained into the land.

 [1] https://wiki.openstreetmap.org/wiki/File:Blue_planet.png

 I guess the coastlines are broken?

 Greetings,
 Michael


 Since this seems to have hit the entire planet at one time, it probably
 indicates a bug in the rendering logic. It doesn't seem likely that all of
 the coastlines would develop gaps simultaneously.

 --
 John F. Eldredge -- j...@jfeldredge.com
 Darkness cannot drive out darkness: only light can do that. Hate cannot
 drive out hate: only love can do that. -- Martin Luther King, Jr.

 ___
 dev mailing list
 dev@openstreetmap.org
 https://lists.openstreetmap.org/listinfo/dev


___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] Automated map of contributions

[Imre Samu]

a) Does a tool exist which can create a static map of a single country for
a given time period in the manner of the video (my PNG created by magic)

maybe you have to check the *OpenStreetMap History Renderer *

https://github.com/MaZderMind/osm-history-renderer
https://github.com/MaZderMind/osm-history-renderer/blob/master/TUTORIAL.md


example video  : http://vimeo.com/78784071  ; http://vimeo.com/45714694
+ https://help.openstreetmap.org/questions/17838/time-lapses


-- Imre


2015-01-15 18:27 GMT+01:00 Jóhannes Birgir Jensson j...@betra.is:

  For a few months I've made static maps by looking at changesets and
 putting down a marker on PNG roughly based on the centerpoint of changeset
 on a map. I've done this for Iceland and Botswana, both sparsely populated
 countries so the volume has been manageable.

 4 examples here from Botswana:
 http://www.openstreetmap.org/user/Mapping%20Botswana/diary

 Now the 1 year of edits video http://vimeo.com/83164362 is of course
 really inspiring.

 My query is thus:

 a) Does a tool exist which can create a static map of a single country for
 a given time period in the manner of the video (my PNG created by magic)
 b) If not then what would be the vital components in creating one
 (comparing GeoFabrik dumps?).

 --Jói

 ___
 dev mailing list
 dev@openstreetmap.org
 https://lists.openstreetmap.org/listinfo/dev


___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] OSM Development

[Imre Samu]

if OSM code =  OpenStreetMap Platform
  check this wiki : http://wiki.openstreetmap.org/wiki/Develop

Imre

2014-11-19 11:20 GMT+01:00 Shafaat Hussain Bhilavade 
shafaathussai...@gmail.com:

 Hello,
 I am new to OSM , would like to know about OSM , what are the accessing
 tools for OSM code?, How to use the OSM code?
 thanks,
 Shafaat

 ___
 dev mailing list
 dev@openstreetmap.org
 https://lists.openstreetmap.org/listinfo/dev


___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] Latest full-history planet

[Imre Samu]

Hi,

The current Planet History created 8 month ago. [
http://planet.osm.org/planet/full-history/ ]
Anybody knows, when is the next full history dump planned?

Thank you for any help you can provide in this situation,
  Imre




2013/2/8 Matt Amos zerebub...@gmail.com

 now available from:

 http://planet.openstreetmap.org/planet/full-history/

 get it while it's hot :-) and please let me know if you find any errors
 with it.

 cheers,

 matt

 ___
 dev mailing list
 dev@openstreetmap.org
 http://lists.openstreetmap.org/listinfo/dev

___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev