Thanks Devdatta. Some of the geoserver scraping code is based on your's and Gurudatta's GeoRSS parsing code. A very unkempt version of the geoserver scraping code can be seen here <https://github.com/ramSeraph/staging_opendata/blob/main/maps/punjabgis/scrape.py>
And I have a modified version of pyesridump <https://github.com/ramSeraph/pyesridump> and a wrapper <https://github.com/ramSeraph/esriscraper> around it which I use for heavy duty ESRI server scraping. In general most of the code used to get the data out and the urls can be found here <https://github.com/ramSeraph/staging_opendata/blob/main/maps> I hope at some point in time we will have a setup similar to what the OSMUS/openaddresses folks have, of continuously updating the data. But for now I am happy with just having the data out in the open. On Wed, Dec 4, 2024 at 12:54 PM Devdatta Tengshe <[email protected]> wrote: > Wonderful Job Sreeram! > > > I usually point people to your repositories for any data requirements that > they have, and most of the time, you have scraped data which they need! > > Regards, > Devdatta > > > On Wed, 4 Dec 2024 at 12:49, sreeram kandimalla < > [email protected]> wrote: > >> One more update to the collections. >> >> Indian Administrative Boundaries: >> - Urban: Slum boundaries have been added for major cities and other >> smaller cities ( where the data could be found ) - >> https://github.com/ramSeraph/indian_admin_boundaries/releases/tag/urban >> - Police: Police Station jurisdiction boundaries were added for states >> where the data could be found - >> https://github.com/ramSeraph/indian_admin_boundaries/releases/tag/police >> - If anybody has access to(/seen) police jurisdiction boundaries >> for other states, do drop the links to websites. I will try to add them. >> - Coastal Regulation Zone: CRZ polygons and lines from NCSCM have been >> added - >> https://github.com/ramSeraph/indian_admin_boundaries/releases/tag/coastal >> - Forests: Recorded Forest Area data from FSI/Bharatmaps has been added >> - >> https://github.com/ramSeraph/indian_admin_boundaries/releases/tag/forest >> >> Indian Water Features: >> - Canals/Drains/Dams/Wells/Tubewells etc data from various sources >> have been added - >> https://github.com/ramSeraph/indian_water_features/releases/tag/irrigation >> - Tanks/Reservoirs/Lakes etc data from various sources has been added >> - >> https://github.com/ramSeraph/indian_water_features/releases/tag/waterbodies >> <https://github.com/ramSeraph/indian_water_features/releases/tag/waterbodies> >> - Springs/Waterfalls data from SOI has been added - >> https://github.com/ramSeraph/indian_water_features/releases/tag/natural >> - Waterway related data from SOI and WRIS has been added - >> https://github.com/ramSeraph/indian_water_features/releases/tag/inland-waterways >> - Urban Storm water drain data has been added where available( data >> quality is questionable ) - >> https://github.com/ramSeraph/indian_water_features/releases/tag/urban-water-features >> >> Indian Power Infrastructure: >> - Some data related to Rural Transformers/Power Substations/Power Lines >> has been added - https://github.com/ramSeraph/indian_power_infra/releases >> >> Indian Communications: >> - More data about OFCs/ONTs/OLTs from Bharatnet/BBNL has been added - >> https://github.com/ramSeraph/indian_communications/releases/tag/bharatnet >> >> Indian Sanitation Facilities: >> - Urban: Data related Sanitation facilities( Public toilets/Dump >> Sites/Garbage Collection points etc ) in cities have been added - >> https://github.com/ramSeraph/indian_facilities/releases/tag/urban-sanitation >> - Rural: Some data from SBM related Solid Waste Management and Grey >> Water Management is expected to be added here. >> >> Indian Buildings: >> - Some buildings data for various cities has been added - >> https://github.com/ramSeraph/indian_buildings/releases/tag/urban >> >> Indian Cadastral data: >> - cadastral data for various states has been added - >> https://github.com/ramSeraph/indian_cadastrals >> - Most of sources are the state gis sites, only the Kerala bhunaksha >> could be scraped, even for that it is not clear what the projection used >> is. >> If anyone knows what projection bhunaksha uses for its data, do >> drop a message. >> - It is likely that a FMB version of Tamil Nadu data and >> Rajasthan's cadastral data will be added to this collection. >> >> Some attempt at listing and categorization of all the data has been added >> here - https://indianopenmaps.fly.dev/ >> >> >> >> On Sat, Jan 27, 2024 at 12:53 PM sreeram kandimalla < >> [email protected]> wrote: >> >>> An update to the collection: >>> >>> A License has been picked - CC0 1.0 >>> >>> The following data has been added: >>> Indian Administrative Boundaries: >>> Pincode boundaries - >>> https://github.com/ramSeraph/indian_admin_boundaries/releases/tag/postal >>> Urban Local Bodies - >>> https://github.com/ramSeraph/indian_admin_boundaries/releases/tag/urban >>> - urban local body boundaries >>> - urban local body ward boundaries >>> - urban local body area boundaries >>> Reserved and Protected Forest Boundaries: >>> https://github.com/ramSeraph/indian_admin_boundaries/releases/tag/forest >>> SOI Human Settlements data: >>> https://github.com/ramSeraph/indian_admin_boundaries/releases/tag/habitations >>> >>> Indian Water Features: >>> https://github.com/ramSeraph/indian_water_features/releases >>> >>> Indian Railways: https://github.com/ramSeraph/indian_railways/releases >>> >>> Indian Buildings: >>> - https://github.com/ramSeraph/ms_buildings_india >>> - https://github.com/ramSeraph/google_buildings_india >>> >>> Indian POIs: https://github.com/ramSeraph/overture_places_india >>> >>> >>> On Wednesday 27 December 2023 at 17:04:24 UTC+5:30 Sharad Lele wrote: >>> >>>> Amazing work, Sreeram! Many many thanks ! >>>> >>>> Sharad >>>> >>>> On Tuesday, December 26, 2023 at 7:52:53 PM UTC+5:30 sreeram kandimalla >>>> wrote: >>>> >>>>> >>>>> Indian Administrative Boundaries: >>>>> https://github.com/ramSeraph/indian_admin_boundaries >>>>> >>>>> Indian Roads: >>>>> https://github.com/ramSeraph/indian_roads >>>>> >>>>> Indian Celltower Locations: >>>>> >>>>> https://github.com/ramSeraph/indian_communications/releases/tag/cell-towers >>>>> >>>>> Hope people find them useful. >>>>> >>>>> Thanks, >>>>> Sreeram K >>>>> >>>>> >>>>> >>>>> -- >>> Datameet is a community of Data Science enthusiasts in India. Know more >>> about us by visiting http://datameet.org >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "datameet" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected]. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/datameet/7968e449-2a6d-483b-8625-81ee5fac6648n%40googlegroups.com >>> <https://groups.google.com/d/msgid/datameet/7968e449-2a6d-483b-8625-81ee5fac6648n%40googlegroups.com?utm_medium=email&utm_source=footer> >>> . >>> >> -- >> Datameet is a community of Data Science enthusiasts in India. Know more >> about us by visiting http://datameet.org >> --- >> You received this message because you are subscribed to the Google Groups >> "datameet" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected]. >> To view this discussion visit >> https://groups.google.com/d/msgid/datameet/CAMgvHC6rNfjms_O8ZErADDSyM5MnTKBJ3nx_Q%3D6VmJvNB09KJg%40mail.gmail.com >> <https://groups.google.com/d/msgid/datameet/CAMgvHC6rNfjms_O8ZErADDSyM5MnTKBJ3nx_Q%3D6VmJvNB09KJg%40mail.gmail.com?utm_medium=email&utm_source=footer> >> . >> > -- > Datameet is a community of Data Science enthusiasts in India. Know more > about us by visiting http://datameet.org > --- > You received this message because you are subscribed to the Google Groups > "datameet" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion visit > https://groups.google.com/d/msgid/datameet/CAOQOUMunu6MKUFQ7998LZ3BTUbfWFNXz1vji6g8VKMQjC6Gi6Q%40mail.gmail.com > <https://groups.google.com/d/msgid/datameet/CAOQOUMunu6MKUFQ7998LZ3BTUbfWFNXz1vji6g8VKMQjC6Gi6Q%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion visit https://groups.google.com/d/msgid/datameet/CAMgvHC42_t_ipUhSp0ZXPX25pK39o%3DWMdy4aCvgdm0aLpppNOg%40mail.gmail.com.
