Re: [datameet] Any guide on how to scrape from leaflet maps

2022-12-12 Thread Vaidya 
Found it, thanks!

On Mon, Dec 12, 2022 at 2:43 PM Devdatta Tengshe 
wrote:

> Hi Vaidya,
>
> There isn't a single way to send data to a map built with leaflet, and
> there could be several different ways this could be done.
>
> Looking at the page you have mentioned, they have hardcoded the data in
> hidden input tags in the HTML itself, it should be straightforward to copy
> the data to a text file, and get the locations.
>
> Look in the source code for hidden input tags with names such as hid_1,
> hid_2 and so on.
>
>
> Regards,
> Devdatta
>
>
> On Mon, 12 Dec 2022 at 14:36, Vaidya  wrote:
>
>> Am trying to get data of STP locations from this site:
>> http://stpp.bwssb.gov.in/default.aspx
>>
>> Has anyone tried scraping from leaflet maps into shape files and written
>> a guide?
>>
>> Thanks,
>> Vaidya
>>
>> --
>> Datameet is a community of Data Science enthusiasts in India. Know more
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to datameet+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/datameet/CAHVy6PEnvZ%2Bt4qhODXmRgrrXrhHR5aAQR9OP3e_6TFauPvB3pg%40mail.gmail.com
>> 
>> .
>>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CAOQOUMtegTzKe%3DUaUdw34JTNO%2BnjxD9BVRDODQDo1jqddD_h%3Dg%40mail.gmail.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAHVy6PFER0LzTy-9qs0gv94GvyiZanEAM91Lp1ZkV9U23tzARw%40mail.gmail.com.

Re: [datameet] Any guide on how to scrape from leaflet maps

2022-12-12 Thread Devdatta Tengshe 
Hi Vaidya,

There isn't a single way to send data to a map built with leaflet, and
there could be several different ways this could be done.

Looking at the page you have mentioned, they have hardcoded the data in
hidden input tags in the HTML itself, it should be straightforward to copy
the data to a text file, and get the locations.

Look in the source code for hidden input tags with names such as hid_1,
hid_2 and so on.


Regards,
Devdatta


On Mon, 12 Dec 2022 at 14:36, Vaidya  wrote:

> Am trying to get data of STP locations from this site:
> http://stpp.bwssb.gov.in/default.aspx
>
> Has anyone tried scraping from leaflet maps into shape files and written a
> guide?
>
> Thanks,
> Vaidya
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CAHVy6PEnvZ%2Bt4qhODXmRgrrXrhHR5aAQR9OP3e_6TFauPvB3pg%40mail.gmail.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAOQOUMtegTzKe%3DUaUdw34JTNO%2BnjxD9BVRDODQDo1jqddD_h%3Dg%40mail.gmail.com.

[datameet] Any guide on how to scrape from leaflet maps

2022-12-12 Thread Vaidya 
Am trying to get data of STP locations from this site:
http://stpp.bwssb.gov.in/default.aspx

Has anyone tried scraping from leaflet maps into shape files and written a
guide?

Thanks,
Vaidya

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAHVy6PEnvZ%2Bt4qhODXmRgrrXrhHR5aAQR9OP3e_6TFauPvB3pg%40mail.gmail.com.

Re: [datameet] Rivers of India shape files

2022-12-12 Thread Gaurav Meena 
https://www.diva-gis.org/gdata

just found above. Not sure about authenticity or quality comparison with
other dataset.

On Mon, 5 Dec 2022 at 13:41, sreeram kandimalla <
kandimalla.sree...@gmail.com> wrote:

> I have found the pyesridump  python
> package quite useful for scraping arcgis servers.
>
> In this particular case, when opening the url
> https://indiawris.gov.in/wris/#/riverBasins  in a browser, one can
> observe that the arcgis rest services endpoint is
> https://arc.indiawris.gov.in/server/rest/services by looking at the
> network calls being made by the webpage.
>
> This URL can be directly used in the browser to locate the individual
> layers available on the server.. In this case the rivers layer was found at
> https://arc.indiawris.gov.in/server/rest/services/Common/River_WRP/MapServer/1
>
>
> On a machine with python and pip installed, you can run the following
> commands to get the rivers data
>
> One time installation of esridump:
> *pip install esridump*
>
> Retrieval of the Rivers Layer:
>
> *esri2geojson -m 100 --jsonlines
> https://arc.indiawris.gov.in/server/rest/services/Common/River_WRP/MapServer/1
> 
> rivers.geojsonl*
>
> The timeouts, batch size ( -m ) command line arguments can be adjusted if
> the default settings fail.
>
> The layer is retrieved here into the geojsonl file *rivers.geojsonl. *
>
> Other layers can be similarly retrieved.
>
>
>
>
>
> On Fri, Dec 2, 2022 at 10:44 AM Vaidya  wrote:
>
>> Hello,
>>
>> Has anyone got the shapefiles for IndaWris river basins map?
>> https://indiawris.gov.in/wris/#/riverBasins
>> More than the basins, trying to find the map of rivers themselves.
>>
>> Thanks,
>> Vaidya
>>
>> --
>> Datameet is a community of Data Science enthusiasts in India. Know more
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to datameet+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/datameet/CAHVy6PE2%3DN-PV_ZjzMyD_VB5aV59nXgHM1BJEB81JjKBHg8qJA%40mail.gmail.com
>> 
>> .
>>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CAMgvHC58EBX3Sngavq97ycfhk2m2QMsdLMSkcQac-FQECN0jBw%40mail.gmail.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAEqZKg_n7x2N1WRYsv5nwQhp47KF9mqwowX7ZAefm3HM3F6Q-g%40mail.gmail.com.

Re: [datameet] Re: Rivers of India shape files

2022-12-12 Thread Vaidya 
This is awesome! Will check these out. Thanks!

-Vaidya

On Thu, Dec 8, 2022 at 8:40 AM Nikhil VJ  wrote:

> Hi Vaibhav,
>
> That hydrosheds.org site has some pretty nice data! Thanks for sharing!
>
> Data from https://www.hydrosheds.org/ downloaded, filtered for India
> (roughly, lot of neighboring regions included in the rectangle) and
> published as vector tiles that can be imported in QGIS, OSM iD editor etc:
>
> Lakes polygons:
> vector tile layer:
> https://server.nikhilvj.co.in/tileserver/data/hydrosheds.org-HydroLAKES_polys_v10_India/{z}/{x}/{y}.pbf
> preview:
> https://server.nikhilvj.co.in/tileserver/data/hydrosheds.org-HydroLAKES_polys_v10_India/#5.17/19.971/74.424
>
> Lake pour points: (I'm not really sure what this is but may be useful)
> vector tile layer:
> https://server.nikhilvj.co.in/tileserver/data/hydrosheds.org-HydroLAKES_points_v10_India/{z}/{x}/{y}.pbf
> preview:
> https://server.nikhilvj.co.in/tileserver/data/hydrosheds.org-HydroLAKES_points_v10_India/#10.3/10.0524/78.8019
>
> Rivers:
> vector tile layer:
> https://server.nikhilvj.co.in/tileserver/data/hydrosheds.org-HydroRIVERS_v10_India/{z}/{x}/{y}.pbf
> preview:
> https://server.nikhilvj.co.in/tileserver/data/hydrosheds.org-HydroRIVERS_v10_India/#7.35/21.079/72.904
>
> Basins Level 8:
> vector tile layer:
> https://server.nikhilvj.co.in/tileserver/data/hydrosheds.org-HydroBASINS_lev08_India/{z}/{x}/{y}.pbf
> preview:
> https://server.nikhilvj.co.in/tileserver/data/hydrosheds.org-HydroBASINS_lev08_India/#5.49/19.365/75.282
>
> Basins Level 12:
> vector tile layer:
> https://server.nikhilvj.co.in/tileserver/data/hydrosheds.org-HydroBASINS_lev12_India/{z}/{x}/{y}.pbf
> preview:
> https://server.nikhilvj.co.in/tileserver/data/hydrosheds.org-HydroBASINS_lev12_India/#6.96/20.54/73.371
>
> GloRiC river classification:
> vector tile layer:
> https://server.nikhilvj.co.in/tileserver/data/hydrosheds.org-GloRiC_v10_India/{z}/{x}/{y}.pbf
> preview:
> https://server.nikhilvj.co.in/tileserver/data/hydrosheds.org-GloRiC_v10_India/#8/21.088/72.371
>
> Please see the respective sections on https://www.hydrosheds.org/ for
> understanding about the attributes in the data.
> I'm not getting into that; just wanted to make the data accessible for
> people as the huge datasets will probably not open on budget laptops.
>
> Commands for converting the data and publishing as vector tiles shared
> here: https://gist.github.com/answerquest/72e26f11d3da1069cbb02032633a71df
>
> --
> Cheers,
> Nikhil VJ
> https://nikhilvj.co.in
>
>
> On Tue, Dec 6, 2022 at 10:51 AM sashik...@gmail.com <
> sashikuma...@gmail.com> wrote:
>
>> Hi Vaidya,
>> If you are  fine to use Google Earth Engine, please check the following
>> catalog links
>> https://developers.google.com/earth-engine/datasets/tags/hydrosheds
>>
>> with regards
>> Sashi
>>
>> On Monday, December 5, 2022 at 8:33:19 PM UTC+5:30 vaibhav...@cropin.com
>> wrote:
>>
>>> Hi Vaidya,
>>>
>>> Hydrosheds database, primarily from WWF - World Wildlife Fund is
>>> available at the following link -
>>> https://www.hydrosheds.org/products/gloric
>>>
>>> Here, you can find the vector files of all the rivers in the world.
>>>
>>> On Friday, December 2, 2022 at 10:44:03 AM UTC+5:30 vaidyan...@gmail.com
>>> wrote:
>>>
 Hello,

 Has anyone got the shapefiles for IndaWris river basins map?
 https://indiawris.gov.in/wris/#/riverBasins
 More than the basins, trying to find the map of rivers themselves.

 Thanks,
 Vaidya

>>>
>>> --
>>> Please note that this email and all files, information, intents and
>>> effects contained herein, and conveyed hereby, shall be construed as
>>> strictly and absolutely confidential intellectual property of CropIn,
>>> intended solely for use by the addressee. Notwithstanding anything
>>> contained herein, this email shall not be construed to give rise to any
>>> implied contractual relationship between CropIn and/or its representatives
>>> and the recipient/s. In spite of due diligence exercised by CropIn to
>>> ensure that this email and all attachments herewith are free from
>>> viruses/defects, it will be the sole responsibility of the recipient to
>>> proceed with caution, and CropIn and/ or its representatives shall not in
>>> any way be liable for any unforeseen security breach arising thereof. If
>>> this email has reached you in error, or you are not the intended recipient
>>> of such email, you should delete this email along with any attachments from
>>> your system, after notification to the sender. Any unauthorised
>>> dissemination, disclosure and/ or use of the contents of this communication
>>> to anyone for any purpose whatsoever, is strictly prohibited and punishable
>>> in law.
>>>
>> --
>> Datameet is a community of Data Science enthusiasts in India. Know more
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "datameet" group.
>> To