Re: [datameet] Block Boundary

2024-03-04 Thread Deepak Sharda
Shape file is missing.

On Tue, Mar 5, 2024 at 2:58 AM Arulalan T  wrote:

> Hai,
>
> Please see it here
>
> https://github.com/India-Meteorological-Department/India-BlockLevel-SubDistricts-Shape-File
>
> On Tue, 27 Feb 2024 at 02:25, Nishant Kumar  wrote:
>
>> Hi, I'm looking for block boundaries shapefiles at India level. This
>> request has been made many times in this forum but I couldn't find any any
>> data regarding this. It anyone can tag me to similar conversations, it will
>> be helpful.
>>
>> Thanks!
>> -nishant
>>
>> --
>> Datameet is a community of Data Science enthusiasts in India. Know more
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to datameet+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/datameet/19290f11-4d8d-462f-b835-b88846856913n%40googlegroups.com
>> 
>> .
>>
>
>
> --
> Thanks & Regards,
> Arulalan.T (Scientist - C),
> Numerical Weather Prediction (NWP) Division,
> O/o Director General of Meteorology,
> India Meteorological Department (IMD),
> Ministry of Earth Sciences (MoES),
> Mausam Bhavan, New Delhi-110003.
> Tel. No: 011-24344481
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CAK1T7EuWUOBaXC7401aVnKKHQBnm-T1KvYbBguXtuX6QHB97aQ%40mail.gmail.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CA%2B4SsQDPRv0Hmcj2fKUtn%3Dir8yo9tRae4Dvg2Rc%2BN_ao-zTcoA%40mail.gmail.com.


[datameet] India boundary and Inland waters

2022-10-14 Thread Deepak Sharda
Hello GUys,

Could anyone lead to the best source where most updated India country 
polygon with Inland waters can be sourced. 

Thank you.

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/275856fb-c6e5-4cc7-88f2-7d9886c34fb5n%40googlegroups.com.


Re: [datameet] Reverse Geocoding

2022-10-04 Thread Deepak Sharda
You can directly get it working from a postgres table. Use pincode layer
available with datameet GitHub and run a query point in polygon.


it will work

So steps

1. get pincode layer
2. update in any postgres install postgis
3. run a query ST_intersects(polygon.geom ,
ST_SetSrid(ST_Make_point(long,lat),4326)

3. use any language python , javascript to make a connection



On Tue, 4 Oct, 2022, 12:07 pm Dammalapati Sai Krishna, <
saikrishnadammalap...@gmail.com> wrote:

> Hey Shivangi,
>
> I was thinking on creating an API for this. Let me know if you would be
> interested to work together on this! Or share if you get to know this
> service already exists :)
>
> Regards,
> Sai
>
> Sent from my iPhone
>
> On 04-Oct-2022, at 11:47 AM, Shivangi Desai 
> wrote:
>
> 
> Hey All,
>
> Wanted to check with you all what is the general consensus on doing
> Reverse Geocoding (for points in mostly rural parts of India)?
>
> Should we create a self hosted geo server (which exposes REST API) to do
> this? or
> Is it better to use any already available and reliable online REST API
> service?
>
> We would need boundary hierarchy to be returned, i.e. State, District,
> Block, Village/City etc.
>
> Any recommendations?
>
> Thanks & Regards,
> Shivangi
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CAB%3DRKFvq9_tNkArdNQqjuf9BKihCY_ub4bBHws0P6jYXJH0JzA%40mail.gmail.com
> 
> .
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/5F3D41F8-12FF-4A13-92DF-85BFBBAB691F%40gmail.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CA%2B4SsQB1YKpN8LWUmMjDFSkxz8nL-rjsdcJ4jajtjF8XmB9c_A%40mail.gmail.com.


Re: [datameet] Re: NEW DISTRICTS OF INDIA SHAPEFILE

2022-08-06 Thread Deepak Sharda
Thanks for connecting. I spoke with Justin and he has been mapping Indian
villages with data available on LGD. Please check his GitHub profile you
can help him over there. I already shared all the updated data I have with
me

On Sat, 6 Aug 2022 at 1:16 AM, sreeram kandimalla <
kandimalla.sree...@gmail.com> wrote:

> Hey Deepak,
>
> I am very much interested in this project.
>
> I haven't looked into your data yet.
>
> But, In general I am looking for an approach where the sources for all the
> geometries are noted and so are the corrections made.. So that everything
> is reproducible starting from the sources.
>
> This along with the LGD data archived daily at
> https://ramseraph.github.io/opendata/lgd/ will be helpful in creating a
> map of India as of a given date.
>
> Thanks,
> Sreeram k
>
>
>
> On Wed, Jul 13, 2022 at 2:39 PM Deepak Sharda 
> wrote:
>
>> Great Work  Dutta. You have always helping with your hard work on this
>> platform. Is there a place where we can get updated villages shape files as
>> well.
>>
>> I tried merging updated village data from multiple sources. Not sure how
>> accurate it is. Sharing sith you if you could help improving it on open
>> platform.
>>
>>
>> https://drive.google.com/drive/folders/1R6XOwqKKQFgOkTEzIP14u36kaWdxCifs?usp=sharing
>>
>> On Tuesday, July 12, 2022 at 10:28:11 PM UTC+5:30 akula.g...@gmail.com
>> wrote:
>>
>>> Hi Sai Krishna,
>>>
>>> I made this myself by gathering various resources.
>>> Thanks for your info on new district Tamulpur was missing. I will add it
>>> soon.
>>>
>>> Regards,
>>> Akula Guru Datta
>>> akuladatta.github.io
>>> On Tue, Jul 12, 2022 at 6:35 PM Dammalapati Sai Krishna <
>>> saikrishna...@gmail.com> wrote:
>>>
>>>> Hello Guru Datta, Thank you very much for this effort!
>>>>
>>>> Would you be able to share the source of this data? That would help us
>>>> in using this data with proper quotes.
>>>>
>>>> Also, as per the Local Government Directory
>>>> <https://lgdirectory.gov.in/> there are 756 districts. Just want to
>>>> bring it to your notice if you haven't come across this yet.
>>>>
>>>> Thanks again!
>>>> Sai Krishna
>>>>
>>>> On Tuesday, July 12, 2022 at 12:01:11 AM UTC+5:30 akula.g...@gmail.com
>>>> wrote:
>>>>
>>>>> Hi all,
>>>>>
>>>>> I have updated  INDIAN-DISTRICTS shapefile with all new districts even
>>>>> including newly formed Andhra Pradesh districts counting  a total of 755
>>>>> districts.
>>>>>
>>>>>
>>>>> https://github.com/datta07/INDIAN-SHAPEFILES/blob/master/INDIA/INDIA_DISTRICTS.geojson
>>>>>
>>>>> Regards,
>>>>> Akula Guru Datta
>>>>> akuladatta.github.io
>>>>>
>>>> --
>>>> Datameet is a community of Data Science enthusiasts in India. Know more
>>>> about us by visiting http://datameet.org
>>>> ---
>>>> You received this message because you are subscribed to a topic in the
>>>> Google Groups "datameet" group.
>>>> To unsubscribe from this topic, visit
>>>> https://groups.google.com/d/topic/datameet/4kuQecxfEv8/unsubscribe.
>>>> To unsubscribe from this group and all its topics, send an email to
>>>> datameet+u...@googlegroups.com.
>>>> To view this discussion on the web visit
>>>> https://groups.google.com/d/msgid/datameet/4dcde696-df5a-4868-8ae4-3fd5e389ba3dn%40googlegroups.com
>>>> <https://groups.google.com/d/msgid/datameet/4dcde696-df5a-4868-8ae4-3fd5e389ba3dn%40googlegroups.com?utm_medium=email_source=footer>
>>>> .
>>>
>>>
>>>> --
>> Datameet is a community of Data Science enthusiasts in India. Know more
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to datameet+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/datameet/2571c93c-96f0-4e03-90d2-a7d31b997900n%40googlegroups.com
>> <https://groups.google.com/d/msgid/datameet/2571c93c-96f0-4e03-90d2-a7d31b997900n%40googlegroups.com?utm_medium=email_source=footer>
>> .
>>
> --

Re: [datameet] Re: NEW DISTRICTS OF INDIA SHAPEFILE

2022-07-13 Thread Deepak Sharda
Great Work  Dutta. You have always helping with your hard work on this 
platform. Is there a place where we can get updated villages shape files as 
well. 

I tried merging updated village data from multiple sources. Not sure how 
accurate it is. Sharing sith you if you could help improving it on open 
platform.

https://drive.google.com/drive/folders/1R6XOwqKKQFgOkTEzIP14u36kaWdxCifs?usp=sharing

On Tuesday, July 12, 2022 at 10:28:11 PM UTC+5:30 akula.g...@gmail.com 
wrote:

> Hi Sai Krishna,
>
> I made this myself by gathering various resources.
> Thanks for your info on new district Tamulpur was missing. I will add it 
> soon.
>
> Regards,
> Akula Guru Datta
> akuladatta.github.io
> On Tue, Jul 12, 2022 at 6:35 PM Dammalapati Sai Krishna <
> saikrishna...@gmail.com> wrote:
>
>> Hello Guru Datta, Thank you very much for this effort!
>>
>> Would you be able to share the source of this data? That would help us in 
>> using this data with proper quotes.
>>
>> Also, as per the Local Government Directory  
>> there are 756 districts. Just want to bring it to your notice if you 
>> haven't come across this yet.
>>
>> Thanks again!
>> Sai Krishna
>>
>> On Tuesday, July 12, 2022 at 12:01:11 AM UTC+5:30 akula.g...@gmail.com 
>> wrote:
>>
>>> Hi all,
>>>
>>> I have updated  INDIAN-DISTRICTS shapefile with all new districts even 
>>> including newly formed Andhra Pradesh districts counting  a total of 755 
>>> districts.
>>>
>>>
>>> https://github.com/datta07/INDIAN-SHAPEFILES/blob/master/INDIA/INDIA_DISTRICTS.geojson
>>>
>>> Regards,
>>> Akula Guru Datta
>>> akuladatta.github.io
>>>
>> -- 
>> Datameet is a community of Data Science enthusiasts in India. Know more 
>> about us by visiting http://datameet.org
>> --- 
>> You received this message because you are subscribed to a topic in the 
>> Google Groups "datameet" group.
>> To unsubscribe from this topic, visit 
>> https://groups.google.com/d/topic/datameet/4kuQecxfEv8/unsubscribe.
>> To unsubscribe from this group and all its topics, send an email to 
>> datameet+u...@googlegroups.com.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/datameet/4dcde696-df5a-4868-8ae4-3fd5e389ba3dn%40googlegroups.com
>>  
>> 
>> .
>>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/2571c93c-96f0-4e03-90d2-a7d31b997900n%40googlegroups.com.


Re: [datameet] Need lat long of 7935 towns of India

2022-07-08 Thread Deepak Sharda
When you say town or city what you refer too?

you can get all districts (735+ ) +  (6500+) sub district from many sources.

Or if have the list of town names i will provide you with the coordinates.

Kindly share.

On Fri, 8 Jul, 2022, 1:32 pm Dammalapati Sai Krishna, <
saikrishnadammalap...@gmail.com> wrote:

> I'm just curious, do you have the list of 7935 towns and cities? Seems an
> easy task to get the geospatial coordinates if we have this list (Which
> every e-commerce firm generally has, I assume).
>
> Regards,
> Sai Krishna.
>
>
> On Fri, Jul 8, 2022 at 1:26 PM Deepak Sharda  wrote:
>
>> Try geo sadak platform for habitation. You need to parse the information
>> you require.
>>
>> On Fri, 8 Jul, 2022, 12:27 pm Ravi Chopra,  wrote:
>>
>>> Hi All,
>>> I am looking for lat-long or point data of ~8000 cities/towns of India.
>>>
>>> Thanks and regards,
>>> Ravi
>>>
>>> --
>>> Datameet is a community of Data Science enthusiasts in India. Know more
>>> about us by visiting http://datameet.org
>>> ---
>>> You received this message because you are subscribed to the Google
>>> Groups "datameet" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to datameet+unsubscr...@googlegroups.com.
>>> To view this discussion on the web visit
>>> https://groups.google.com/d/msgid/datameet/CAPBY68K_ChP-_WUSOB53pXtX7PYztQNWNpDe7%3DdomHNfRV-Mmw%40mail.gmail.com
>>> <https://groups.google.com/d/msgid/datameet/CAPBY68K_ChP-_WUSOB53pXtX7PYztQNWNpDe7%3DdomHNfRV-Mmw%40mail.gmail.com?utm_medium=email_source=footer>
>>> .
>>>
>> --
>> Datameet is a community of Data Science enthusiasts in India. Know more
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to datameet+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/datameet/CA%2B4SsQAetM-8C01_DBsvRYR8QU%2B%2BU9EsFP7Te8LAr%2BdGifpYTw%40mail.gmail.com
>> <https://groups.google.com/d/msgid/datameet/CA%2B4SsQAetM-8C01_DBsvRYR8QU%2B%2BU9EsFP7Te8LAr%2BdGifpYTw%40mail.gmail.com?utm_medium=email_source=footer>
>> .
>>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CAK0JssZqPM%3D8-G3ZSeaB_fn7LZPStbc4ACO8_wGrLEde6umQLQ%40mail.gmail.com
> <https://groups.google.com/d/msgid/datameet/CAK0JssZqPM%3D8-G3ZSeaB_fn7LZPStbc4ACO8_wGrLEde6umQLQ%40mail.gmail.com?utm_medium=email_source=footer>
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CA%2B4SsQBaRXfpPmTYOvHwJW-1yNtHLp__T-9a3Yi3HZVXtTAtLQ%40mail.gmail.com.


Re: [datameet] Need lat long of 7935 towns of India

2022-07-08 Thread Deepak Sharda
Try geo sadak platform for habitation. You need to parse the information
you require.

On Fri, 8 Jul, 2022, 12:27 pm Ravi Chopra,  wrote:

> Hi All,
> I am looking for lat-long or point data of ~8000 cities/towns of India.
>
> Thanks and regards,
> Ravi
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CAPBY68K_ChP-_WUSOB53pXtX7PYztQNWNpDe7%3DdomHNfRV-Mmw%40mail.gmail.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CA%2B4SsQAetM-8C01_DBsvRYR8QU%2B%2BU9EsFP7Te8LAr%2BdGifpYTw%40mail.gmail.com.


Re: [datameet] india building footprints

2022-05-30 Thread Deepak Sharda
Thanks Nikhil for doing good work for community.

You can make building in 3d view.

There are two ways to do that
1. Adding building height data from contour and using deck gl or three gs
to show in 3d.

2. 3d building view with vector styling. It gives 3d view but all building
will be similar height. Although it is really nice when you look into a
mobile or web app

Note . Nit lit of work for 2nd option. You just need to make few changes in
style file.

Regards

On Mon, 30 May, 2022, 1:33 pm Nikhil VJ,  wrote:

> Hi All,
>
> India data from Microsoft's ML Buildings Footprints data release is
> deployed on both vector and raster tile layers:
> https://server.nikhilvj.co.in/buildings1/
> This is a TileServer GL instance.
>
> Recipe for how this was done and the configs etc reqd is shared here:
> https://github.com/answerquest/maptiles_recipe_buildings
> This process may be useful for working with other large datasets also.
>
> To overlay on JOSM, pls use this PNG layer:
> https://server.nikhilvj.co.in/buildings1/styles/basic/{z}/{x}/{y}.png
>
> For raster overlay in browser, pls use webp format which is smaller and
> faster:
> https://server.nikhilvj.co.in/buildings1/styles/basic/{z}/{x}/{y}.webp
>
> For vector tiles (will work in QGIS also), pls use this:
>
> https://server.nikhilvj.co.in/buildings1/data/india_buildings_z14/{z}/{x}/{y}.pbf
>
> There was a lot of troubleshooting needed for getting the raster output
> working - big thanks to Deepak Sharda for help in that.
>
> Meanwhile, I've also completed importing the data to a postgis DB. If
> anyone wants data for a limited region, pls reach me on nikhil.js [at]
> gmail.com
>
> --
> Cheers,
> Nikhil VJ
> https://nikhilvj.co.in
>
>
> On Thu, May 26, 2022 at 7:07 PM Deepak Sharda 
> wrote:
>
>> To make folder structure mbtile you might need to add ''-e''   in the
>> recipe.
>>
>> or tile is made you can use Mbutil to create folder structure from single
>> file.
>>
>>
>> To your second query to create building footprints with rater tiles there
>> are two ways two approach it.
>>
>> You can create raster tiles from geotiff by using tiles2py in folder
>> structure.
>>
>> But in your case you can use Tileserver-gl what it does is it can host
>> vector tiles but serve them as raster.
>>
>> You can check config file and change as per your requirements such as
>> 256x256 or 512x512.
>>
>>
>> let me know if you still face issue.
>>
>> Note - Go by vector tiles its fast and you can give 3D effect  as you
>> have seen in our app.
>>
>>
>> Thanks and Regards
>>
>> On Thu, 26 May, 2022, 6:39 pm Nikhil VJ,  wrote:
>>
>>> Hi Deepak,
>>>
>>> Thanks for the suggestion.
>>>
>>> I came across tippecanoe again : https://github.com/mapbox/tippecanoe
>>> and finally seeing a use case for it. So, while the DB is still being
>>> loaded, started off tippecanoe program on the original .geojsonl.
>>>
>>> The program was quite fast - in about 6 hrs it had generated a 1.4GB
>>> .mbtiles file and it didn't even take too much RAM.
>>>
>>> Then, with the help of https://github.com/maptiler/tileserver-php:
>>> This vector tiles URL is working at my end in QGIS:
>>>
>>> https://server.nikhilvj.co.in/buildings/tileserver-php/tileserver.php?/index.json?/buildings-z13/{z}/{x}/{y}.pbf
>>>
>>> I was looking for options to generate raster .png etc tiles, but haven't
>>> found one yet.
>>>
>>> I also saw an option in tippecanoe to output .pbf tiles to a folder
>>> instead of a single .mbtiles file. Did a couple of runs, but that hasn't
>>> worked out.
>>>
>>> Meanwhile, Sreeram-K posted in OSM-India telegram group: folks at
>>> mapwith.ai have incorporated the data and are now showing it in their
>>> rapID editor alongwith the AI roads data, as suggestions for openstreetmap
>>> editing. One link:
>>>
>>> https://mapwith.ai/rapid#background=none=fbRoads,msBuildings_features=boundaries=16.17/13.09066/80.27361
>>>
>>>
>>> --
>>> Cheers,
>>> Nikhil VJ
>>> https://nikhilvj.co.in
>>>
>>>
>>>
>>> On Tue, May 24, 2022 at 1:48 PM Deepak Sharda 
>>> wrote:
>>>
>>>> Hello Nikhil,
>>>>
>>>> I would definitely love to collobrate. The best i would suggest is to
>>>> make Mbtiles and host them as data is not going to change a lot so most of
>>>> the time static.
>>>>
>>>>

Re: [datameet] india building footprints

2022-05-26 Thread Deepak Sharda
To make folder structure mbtile you might need to add ''-e''   in the
recipe.

or tile is made you can use Mbutil to create folder structure from single
file.


To your second query to create building footprints with rater tiles there
are two ways two approach it.

You can create raster tiles from geotiff by using tiles2py in folder
structure.

But in your case you can use Tileserver-gl what it does is it can host
vector tiles but serve them as raster.

You can check config file and change as per your requirements such as
256x256 or 512x512.


let me know if you still face issue.

Note - Go by vector tiles its fast and you can give 3D effect  as you have
seen in our app.


Thanks and Regards

On Thu, 26 May, 2022, 6:39 pm Nikhil VJ,  wrote:

> Hi Deepak,
>
> Thanks for the suggestion.
>
> I came across tippecanoe again : https://github.com/mapbox/tippecanoe
> and finally seeing a use case for it. So, while the DB is still being
> loaded, started off tippecanoe program on the original .geojsonl.
>
> The program was quite fast - in about 6 hrs it had generated a 1.4GB
> .mbtiles file and it didn't even take too much RAM.
>
> Then, with the help of https://github.com/maptiler/tileserver-php:
> This vector tiles URL is working at my end in QGIS:
>
> https://server.nikhilvj.co.in/buildings/tileserver-php/tileserver.php?/index.json?/buildings-z13/{z}/{x}/{y}.pbf
>
> I was looking for options to generate raster .png etc tiles, but haven't
> found one yet.
>
> I also saw an option in tippecanoe to output .pbf tiles to a folder
> instead of a single .mbtiles file. Did a couple of runs, but that hasn't
> worked out.
>
> Meanwhile, Sreeram-K posted in OSM-India telegram group: folks at
> mapwith.ai have incorporated the data and are now showing it in their
> rapID editor alongwith the AI roads data, as suggestions for openstreetmap
> editing. One link:
>
> https://mapwith.ai/rapid#background=none=fbRoads,msBuildings_features=boundaries=16.17/13.09066/80.27361
>
>
> --
> Cheers,
> Nikhil VJ
> https://nikhilvj.co.in
>
>
>
> On Tue, May 24, 2022 at 1:48 PM Deepak Sharda 
> wrote:
>
>> Hello Nikhil,
>>
>> I would definitely love to collobrate. The best i would suggest is to
>> make Mbtiles and host them as data is not going to change a lot so most of
>> the time static.
>>
>> Rendering from hosted Mbtiles will not only fast but easy to handle on
>> small web server.
>>
>> How to proceed.
>>
>> First creation of Mbtiles
>> second Hosting of Mbtiles
>> Third  Styling at client side.
>>
>>
>> Thanks
>>
>>
>>
>> On Tue, 24 May, 2022, 1:03 pm Nikhil VJ,  wrote:
>>
>>> Hi Bhibhash,
>>>
>>> Short answer: No.
>>> There is no metadata. I took the top 1000 lines and visualized it : the
>>> shapes were spread all over the country and there wasn't any order in them.
>>>
>>> With an intern's help I've started import of them into a portable
>>> postgresql DB (dockerized with a persistent volume) on my webserver.
>>> Started yesterday and it's 10 million shapes in; from size comparisons
>>> it'll probably be around 79 million shapes, so should be imported in a
>>> week's time.
>>>
>>> I've set an auto-increment primary key column in the DB table, so once
>>> imported at least the data can be pulled out in batches.
>>>
>>> There are 2 paths ahead once I've imported it:
>>> ---
>>>
>>> *1. Serving vector tiles*
>>> I want to serve MVT vector tiles from this DB - and then have a map
>>> display the same. That way one can directly have this stuff render on a map
>>> as they browse it - fetching only one small region at a time and hopefully
>>> not being too slow.
>>>
>>> Finding some references here:
>>> https://blog.jawg.io/how-to-make-mvt-with-postgis/
>>> https://www.crunchydata.com/blog/dynamic-vector-tiles-from-postgis
>>>
>>> https://medium.com/@frederic.rodrigo/web-mapping-comparing-vector-tile-servers-from-postgres-postgis-405055e69084
>>>
>>> I'm new to this MVT business, so if anybody wants to collaborate pls
>>> feel free to jump in.
>>>
>>> --
>>>
>>> *2. Tag with region ids*
>>> Add columns to the DB table and tag each shape by state, district ids
>>> etc using Within operations either in the DB or in python-geopandas.
>>>
>>>
>>> --
>>> Cheers,
>>> Nikhil VJ
>>> https://nikhilvj.co.in
>>>
>>>
>>> On Tue, May 24, 2022 at 10:14 AM Bibhash Na

Re: [datameet] india building footprints

2022-05-24 Thread Deepak Sharda
Hello Nikhil,

I would definitely love to collobrate. The best i would suggest is to make
Mbtiles and host them as data is not going to change a lot so most of the
time static.

Rendering from hosted Mbtiles will not only fast but easy to handle on
small web server.

How to proceed.

First creation of Mbtiles
second Hosting of Mbtiles
Third  Styling at client side.


Thanks



On Tue, 24 May, 2022, 1:03 pm Nikhil VJ,  wrote:

> Hi Bhibhash,
>
> Short answer: No.
> There is no metadata. I took the top 1000 lines and visualized it : the
> shapes were spread all over the country and there wasn't any order in them.
>
> With an intern's help I've started import of them into a portable
> postgresql DB (dockerized with a persistent volume) on my webserver.
> Started yesterday and it's 10 million shapes in; from size comparisons
> it'll probably be around 79 million shapes, so should be imported in a
> week's time.
>
> I've set an auto-increment primary key column in the DB table, so once
> imported at least the data can be pulled out in batches.
>
> There are 2 paths ahead once I've imported it:
> ---
>
> *1. Serving vector tiles*
> I want to serve MVT vector tiles from this DB - and then have a map
> display the same. That way one can directly have this stuff render on a map
> as they browse it - fetching only one small region at a time and hopefully
> not being too slow.
>
> Finding some references here:
> https://blog.jawg.io/how-to-make-mvt-with-postgis/
> https://www.crunchydata.com/blog/dynamic-vector-tiles-from-postgis
>
> https://medium.com/@frederic.rodrigo/web-mapping-comparing-vector-tile-servers-from-postgres-postgis-405055e69084
>
> I'm new to this MVT business, so if anybody wants to collaborate pls feel
> free to jump in.
>
> --
>
> *2. Tag with region ids*
> Add columns to the DB table and tag each shape by state, district ids etc
> using Within operations either in the DB or in python-geopandas.
>
>
> --
> Cheers,
> Nikhil VJ
> https://nikhilvj.co.in
>
>
> On Tue, May 24, 2022 at 10:14 AM Bibhash Nath  wrote:
>
>> Thanks for sharing.
>> Do we have state-wise datasets? It seems quite large to process on my
>> computer.
>>
>> Best,
>> Bibhash
>>
>> On Wed, May 18, 2022 at 4:58 AM Nikhil VJ  wrote:
>>
>>> Thanks Justin for sharing!
>>>
>>> I've downloaded and extracted the India.geojsonl on a webserver.
>>>
>>> ref about .geojsonl : https://www.interline.io/blog/geojsonl-extracts/
>>> -> pretty useful! One can loop through a huge file without having to
>>> load it all into RAM.
>>>
>>> top lines look like:
>>> {"type": "Feature", "properties": {},"geometry": {"type":
>>> "Polygon","coordinates": [[[83.06380515611697, 25.34167404697847],
>>> [83.06380909901775, 25.341635591519122], [83.06386494585949,
>>> 25.341640268589657], [83.06386100295869, 25.341678724047526],
>>> [83.06380515611697, 25.34167404697847]]]}}
>>> {"type": "Feature", "properties": {},"geometry": {"type":
>>> "Polygon","coordinates": [[[87.87555977691633, 22.397660095199],
>>> [87.8754256865811, 22.397658576750985], [87.87542690191553,
>>> 22.397566835386712], [87.87556099225075, 22.39756835383578],
>>> [87.87555977691633, 22.397660095199]]]}}
>>> ...
>>> So we have just basic polygons, one for each building, no properties or
>>> categorization.
>>>
>>> Here are some ideas on what to do with this:
>>>
>>> 1. Postgresql DB:
>>> - Load all of these into a PostGreSQL DB
>>> - Setup an api that will take a lat/lon and give all shapes within 1km
>>> radius
>>> - Next possible api: send a bounding polygon and get all buildings in
>>> that
>>>
>>> 2. Split up by district or lower level admin boundaries:
>>> - Load the admin boundaries into a Postgresql DB
>>> - Loop through each line (ie each building)
>>> - Find out which place it's in by ST_Within query
>>> - Dump it into a separate .geojsonl for that place
>>> - We've now split it into multiple smaller files that are more usable,
>>> can be loaded up by OSM mappers etc.
>>>
>>> --
>>> Cheers,
>>> Nikhil VJ
>>> https://nikhilvj.co.in
>>>
>>>
>>> On Wed, May 18, 2022 at 3:51 AM Justin 
>>> wrote:
>>>
 [image: lg.png]

 https://github.com/microsoft/GlobalMLBuildingFootprints


 --
 Datameet is a community of Data Science enthusiasts in India. Know more
 about us by visiting http://datameet.org
 ---
 You received this message because you are subscribed to the Google
 Groups "datameet" group.
 To unsubscribe from this group and stop receiving emails from it, send
 an email to datameet+unsubscr...@googlegroups.com.
 To view this discussion on the web visit
 https://groups.google.com/d/msgid/datameet/68c0ecc4-5b07-4eb9-a69d-ae6e5ad6832bn%40googlegroups.com
 
 .

>>> --
>>> Datameet is a community of Data Science enthusiasts in India. Know more
>>> about us by visiting 

[datameet] Satellite Tiles - Satellite Imagenery

2022-03-10 Thread Deepak Sharda
Hello guys,

If you could share the information or knoowledge to access High Resolution 
satelllite images.
 
Other then these :
Copernicus (https://scihub.copernicus.eu/ 

), 
Earth Explorer (https://earthexplorer.usgs.gov/ 

) 
NASA imagery (https://search.earthdata.nasa.gov/search 
)
  
  


All three doesnt have a clear data. 

Is there anyway we can access old High resolution data?
Is there open source api to render satellite maps in the webb app or app ?

Please  suggest the best possible way to show satellite images in our app.





-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/a48c3dc6-a027-4814-9c11-616aa699c2c1n%40googlegroups.com.


Re: [datameet] Mouza Maps for Ara, Baram, Mahilog Villaged in Jharkand state

2020-10-30 Thread Deepak Sharda
there is discussion with heading in data meet group

BhuNaksha: source of cadastral maps

you will get your answer.

On Fri, 30 Oct, 2020, 6:59 pm rajesh...@gmail.com, 
wrote:

> Dear All,
>
> Request to help out to provide Mouza maps for Ara, Baram, Mahilog villaged
> in Jharkand State, I am would like to utilize for a pilot work for railways.
>
> Kindly help me to get the data.
>
> Regards
> A Rajesh Kumar
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/dae929a1-f38f-4691-b74f-c23dea9480b2n%40googlegroups.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CA%2B4SsQAgu79u2hjS9ohdVvNvouqDUAiuageXraZZcmVZ39a%3DZg%40mail.gmail.com.


Re: [datameet] Re: National Highway Network in India

2020-10-22 Thread Deepak Sharda
There is another way to get data from in different formats  with the help 
of this tool 

https://export.hotosm.org/en/v3/exports/new/describe

it is easy and all popular formats are available 

for Tamilnadu you can create a bounding box or search in.

On Thursday, October 22, 2020 at 7:25:01 PM UTC+5:30 arka...@gmail.com 
wrote:

> Hi Krishna,
>
> Thanks to Openstreetmap Volunteers and overpass turbo. You can download 
> the highway vector files in geojson from here (
> https://overpass-turbo.eu/s/ZiR) and then convert it to shp using qgis or 
> any other tool. 
>
> On Thu, 22 Oct 2020 at 18:48, Dammalapati Sai Krishna <
> saikrishna...@gmail.com> wrote:
>
>> Hello everyone, 
>>
>> I am working on a research project and I need Tamil Nadu Highway 
>> shapefile. Can any one give me few leads to a data source?
>>
>> Thanks much!
>>
>> Regards, 
>> Sai
>>
>> On Tuesday, May 12, 2020 at 10:57:12 AM UTC+5:30 sunilp...@gmail.com 
>> wrote:
>>
>>> The information under the link 
>>> http://tis.nhai.gov.in/tollplazasataglance?language=en# is not an 
>>> updated one, I understand
>>> Sunil
>>>
>>> On Sun, May 10, 2020 at 12:32 PM sumit mishra  
>>> wrote:
>>>
 Hi,

 I am analyzing PCU/day for different toll plaza in India. For that i 
 need number of lane available on toll plazas. The above link is not 
 working. Also I tried this- https://nhai.ncog.gov.in/login but it is 
 asking for login. Any suggestions on how to access lane specific data. 

 Some toll plaza specific data is available at- 
 http://tis.nhai.gov.in/tollplazasataglance?language=en#

 Thanks and regards
 Sumit Mishra

 On Sunday, February 4, 2018 at 11:16:21 PM UTC-8, Naveen Francis wrote:
>
>
> NCOG has created new updated maps for our National Highways. 
> https://ncog.gov.in/NHAI/admin/gisModulePublicWeb?uname=user
>
> It includes Bharatmala Corridors, NHAI projects, NHDCL projects, In 
> principle approved NHs. 
>
>
> Thanks,
> naveenpf
>
 -- 

>>> Datameet is a community of Data Science enthusiasts in India. Know more 
 about us by visiting http://datameet.org
 --- 
 You received this message because you are subscribed to the Google 
 Groups "datameet" group.

>>> To unsubscribe from this group and stop receiving emails from it, send 
 an email to datameet+u...@googlegroups.com.
 To view this discussion on the web visit 
 https://groups.google.com/d/msgid/datameet/30d43e96-7688-4f20-ae49-deda8a9d0687%40googlegroups.com
  
 
 .

>>> -- 
>> Datameet is a community of Data Science enthusiasts in India. Know more 
>> about us by visiting http://datameet.org
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to datameet+u...@googlegroups.com.
>>
> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/datameet/c85a566c-8cef-410c-9047-8a67c48eb607n%40googlegroups.com
>>  
>> 
>> .
>>
>
>
> -- 
> Regards,
> *ark Arjun*
> arkives.in
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/ea0f6d1b-2055-4aab-93fe-01e4717c327en%40googlegroups.com.


Re: [datameet] I need WPF application with open source world map and it need to display location based up on lat and long values

2020-10-21 Thread Deepak Sharda
This might Help.

Here's a number of projects that might save you some work:

OpenSource:

   -
   
http://www.codeproject.com/Articles/238551/WPF-Map-App-WPF-meets-Google-Geocoding-Static-Maps
   - http://xamlmapcontrol.codeplex.com/
   - http://greatmaps.codeplex.com/
   - http://wpfsharpmapcontrols.codeplex.com


On Thu, 22 Oct, 2020, 12:41 am saikumar dandla, 
wrote:

> urgent please any one can suggest me best possible solution
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/0b655f4d-85e2-4b5a-8a8a-4f4175442808n%40googlegroups.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CA%2B4SsQB8%3Dd-4AUbWe3xkOgnG3denk%2B5uryG8dU4BGbgzc2h78A%40mail.gmail.com.


Re: [datameet] Re: Identifying urban agglomeration boundaries

2020-10-15 Thread Deepak Sharda
thanks it helped a lot. Although it does not cover complete area. I am
attaching Geo Package file here
 GHS_STAT_UCDB2015MT_GLOBE_R2019A.zip


On Thu, Oct 15, 2020 at 8:52 PM Siddhant N  wrote:

> Have you seen GHSL? https://ghsl.jrc.ec.europa.eu/data.php
> They have a robust methodology for UA identification across the globe inc
> India. Their India UA data is not perfect but beats most other public
> datasets.
>
> On Wednesday, 14 October 2020 at 19:47:27 UTC+5:30 Aditya Medury wrote:
>
>> Hi,
>>
>> I am trying make sense of how to translate the definitions of urban
>> agglomerations/million-plus cities in the 2011 census. Census defines urban
>> agglomeration as follows:
>>
>> *An urban agglomeration is a continuous urban spread constituting a town
>> and its adjoining outgrowths (OGs), or two or more physically contiguous
>> towns together with or without outgrowths of such towns. An Urban
>> Agglomeration must consist of at least a statutory town and its total
>> population (i.e. all the constituents put together) should not be less than
>> 20,000 as per the 2001 Census. In varying local conditions, there were
>> similar other combinations which have been treated as urban agglomerations
>> satisfying the basic condition of contiguity. Examples: Greater Mumbai UA,
>> Delhi UA, etc.*
>> *Source: *
>> https://censusindia.gov.in/2011-prov-results/paper2/data_files/India2/1.%20Data%20Highlight.pdf
>>
>> Since they can be a combination of multiple towns/cities, outgrowths,
>> municipal corporations, identifying their sociodemographic and built
>> environment characteristics from other databases becomes a little
>> challenging. For instance, the breakdown of all UAs with more than 1 lakh
>> population is specified here:
>>
>> https://censusindia.gov.in/2011-prov-results/paper2/data_files/India2/Table_4_PR_UAs_1Lakh_and_Above_Appendix.pdf
>>
>> I can think of a few different ways in which I may be able to approximate
>> some boundaries associated with these UAs:
>>
>>- I could use the ADM3 shapefiles of sub-districts (
>>https://earthworks.stanford.edu/catalog/stanford-rj389fh4679) and
>>picking locations based on visual inspections/overlap of city points. I
>>understand that municipal boundaries may or may not always match the
>>administrative divisions (not very clear on this)
>>- I could also base it off of pincode layers (
>>https://github.com/justinelliotmeyers/INDIA_PINCODES) which might be
>>more fine-grained if I need additional flexibility in selecting small
>>regions at the periphery.
>>- I could go the population grid route and do some clustering to find
>>regions that might approximate the UA populations provided in the 2011
>>census for some of the bigger cities. But this would get really crude with
>>no unique boundary solutions.
>>
>> Wondering if people have any thoughts on this.
>>
>> Thanks!
>>
>> Aditya
>>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/31c8b0d0-0bbf-4f5b-ba12-5e934e7b7d84n%40googlegroups.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CA%2B4SsQBqFeu4FsMD_kKS4GCe5rgO-RGX%2Bg%2B6F7ZDwmLbu-tmDg%40mail.gmail.com.


Re: [datameet] Identifying urban agglomeration boundaries

2020-10-14 Thread Deepak Sharda
Hello sir great thinking.

I suggest to do it with LULC data. We have color coded raster data of area
(Red for urbanised or populated area).

we can extract polygon from LULC  data for Boundaries.

regards



On Wed, 14 Oct, 2020, 7:47 pm Aditya Medury,  wrote:

> Hi,
>
> I am trying make sense of how to translate the definitions of urban
> agglomerations/million-plus cities in the 2011 census. Census defines urban
> agglomeration as follows:
>
> *An urban agglomeration is a continuous urban spread constituting a town
> and its adjoining outgrowths (OGs), or two or more physically contiguous
> towns together with or without outgrowths of such towns. An Urban
> Agglomeration must consist of at least a statutory town and its total
> population (i.e. all the constituents put together) should not be less than
> 20,000 as per the 2001 Census. In varying local conditions, there were
> similar other combinations which have been treated as urban agglomerations
> satisfying the basic condition of contiguity. Examples: Greater Mumbai UA,
> Delhi UA, etc.*
> *Source: *
> https://censusindia.gov.in/2011-prov-results/paper2/data_files/India2/1.%20Data%20Highlight.pdf
>
> Since they can be a combination of multiple towns/cities, outgrowths,
> municipal corporations, identifying their sociodemographic and built
> environment characteristics from other databases becomes a little
> challenging. For instance, the breakdown of all UAs with more than 1 lakh
> population is specified here:
>
> https://censusindia.gov.in/2011-prov-results/paper2/data_files/India2/Table_4_PR_UAs_1Lakh_and_Above_Appendix.pdf
>
> I can think of a few different ways in which I may be able to approximate
> some boundaries associated with these UAs:
>
>- I could use the ADM3 shapefiles of sub-districts (
>https://earthworks.stanford.edu/catalog/stanford-rj389fh4679) and
>picking locations based on visual inspections/overlap of city points. I
>understand that municipal boundaries may or may not always match the
>administrative divisions (not very clear on this)
>- I could also base it off of pincode layers (
>https://github.com/justinelliotmeyers/INDIA_PINCODES) which might be
>more fine-grained if I need additional flexibility in selecting small
>regions at the periphery.
>- I could go the population grid route and do some clustering to find
>regions that might approximate the UA populations provided in the 2011
>census for some of the bigger cities. But this would get really crude with
>no unique boundary solutions.
>
> Wondering if people have any thoughts on this.
>
> Thanks!
>
> Aditya
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/da0f619a-9d2a-4161-b3e8-d04ecbd334fbn%40googlegroups.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CA%2B4SsQD76Yz0SdmXw5ZFVEhne-5nGZK6NnLAAzR_z12HMRUZiA%40mail.gmail.com.


Re: [datameet] Smart City Data

2020-06-10 Thread Deepak Sharda
hello tej,


here is the data of 100 smart cities.

On Wed, Jun 10, 2020 at 6:26 PM 'TEJ CHAVDA' via datameet <
datameet@googlegroups.com> wrote:

> Hey everyone,
> Hope everything is well with you. Anyone can help me with getting smart
> city Data like name population or any information regarding smart city.
>
> Thanks
>
> Disclaimer : The information transmitted with this email is intended only
> for the person or entity to which it is addressed and may contain
> confidential and/or privileged material. Any review, re-transmission,
> dissemination or other use of this information by persons or entities other
> than the intended recipient is prohibited. If you received this in error,
> please contact the sender and delete the material from any computer.
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CAOt9pNe9GUXMXakCa3dcaNz85WaOyq14GV1BNvupSutuJUjf-w%40mail.gmail.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CA%2B4SsQB7%3D-kivE%2BYaAqAy0HBK2Dq_B3HB9Task9%3De-FM%2BP%3DFSw%40mail.gmail.com.


smart city.csv
Description: MS-Excel spreadsheet


Re: [datameet] TOLL INFORMATION SYSTEM

2020-05-20 Thread Deepak Sharda
dear souvik ,

so you share what kind of parsing tool or bot you use. we all have many
queries like this for parsing locations from websites. it would be easier
for everyone if you could share guidance on this matter.

thank you

On Thu, May 21, 2020 at 8:07 AM Arun Ganesh  wrote:

> Wonderful Souvik!
>
> Have added the CSV to the gist for future reference
> https://gist.github.com/planemad/fa8eb76f09ec2f95997a2b819381ea4e . Would
> be great if you could share the code to do the parsing, it would be
> interesting to parse out the rates as well.
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CA%2BGKQr2zy%3DJ1qSt-MXc6B6wvn0CAYewoe5PZWiHfyB7qD%2BQZQA%40mail.gmail.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CA%2B4SsQDWvyjFTWLpqSJ4yWkNV8PO-p5%3De4YshSGHQay097COxw%40mail.gmail.com.


Re: [datameet] TOLL INFORMATION SYSTEM

2020-05-20 Thread Deepak Sharda
try doing web scrapping that supports locations

On Wed, May 20, 2020 at 8:04 PM blessing isaiah 
wrote:

> Hi all,
>
> I would need the toll locations and the type of toll (BOT or public funded
> etc) from here, http://tis.nhai.gov.in/tollplazasonmap?language=en
>
> Can someone share it with me please.
> Many thanks.
>
> Best regards,
> Blessing Isaiah
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CABxwALYGs0ONwaQdEF6Cm_3eHUHVGe23fBYct2AOZ44Di0GdmQ%40mail.gmail.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CA%2B4SsQB861Gcj3gW%2BF6hkw-H0E0%3DV9yby5Req7YgHJEpqRC8fQ%40mail.gmail.com.


[datameet] Re: Socioeconomic High-resolution Rural-Urban Geographic Platform for India (SHRUG)

2020-05-06 Thread Deepak Sharda
Is this the same data you are referring to. 


https://www.openicpsr.org/openicpsr/project/109703/version/V1/view?path=/openicpsr/109703/fcr:versions/V1/data/pmgsy=folder



can you get me the link of shapefiles.


thank you 

On Thursday, September 5, 2019 at 7:12:45 AM UTC+5:30, Naveen Francis wrote:
>
>
>
> https://twitter.com/paulnovosad/status/1169364171781287936
>
>
> http://www.devdatalab.org/shrug
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/d889ea37-5aa7-49b2-8d44-030f0bffb1c6%40googlegroups.com.


[datameet] Re: Sentinel 2 urban area shapefile data extraction

2020-05-04 Thread Deepak Sharda
perfect.


can you extract data for whole of India in shape files 

that will be helfpful.



thank you 

On Friday, February 5, 2016 at 2:28:59 AM UTC+5:30, Justin wrote:
>
> source of imagery: 
> http://sentinel-s2-l1c.s3-website.eu-central-1.amazonaws.com/#tiles/43/R/EP/2015/12/30/0/
>
> composites 752 and 654 extracted unsupervised classifications where bands 
> matched based on intersection and manual checking
>
> geometry is a little loose, but this is my first time.  did not clean any 
> of this - this is the raw first version
>
> cheers!!
> Justin
>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/31d53e6e-6c1f-4758-a3c4-6eff227adb68%40googlegroups.com.


[datameet] Re: Facebook Road AI data!!!!!!!!!!

2020-05-04 Thread Deepak Sharda

thanks a lot you are a true gem 

i have not opened it yet but fingers crossed 


On Friday, November 22, 2019 at 9:30:29 AM UTC+5:30, Justin wrote:
>
> free up a lot of space on your machine - all the roads in India missing 
> from OSM
>
> https://mapwith.ai/country_exports/IN_PK_mapwithai_road_data.gpkg.tar.gz
>
> Have fun!
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/a5fb10d7-8f04-4ce0-bba3-da796b534c91%40googlegroups.com.


[datameet] please help to extract data from pmgsy (pradhan matri gramin sadak yojna)

2020-05-04 Thread Deepak Sharda
dear group members

We are privileged to have gems among us who know how to extract data from 
this website 

Kindly help me with data 

http://www.pmgsy-grris.nic.in/gis.aspx

whole of India with habitation code.

I am willing to pay for shape files format.

thank you 

Regards 



-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/5abcde0d-5907-42c7-9e9f-8db6c4e243dd%40googlegroups.com.


Re: [datameet] Re: Facebook Road AI data!!!!!!!!!!

2020-05-04 Thread Deepak Sharda
Now as I know how to extract data for any region. A new challenge is how to 
refine data as it does have lots of line data which are not roads in my 
case in Barmer rajasthan we have sand dunes which has shadow property with 
contrast in google earth. I am thinking to minimize this data with accuracy 
in three steps
1. First to clean data upto  village level 
   
   Get list of all villages of India with Lat Log address (most probably 
middle of village) 
2. create an buffer of 500 Mtr or 1 km or 2 km as per population index 
3. select Facebook ai data in that buffer region only and delete rest of 
lines 
4. merge that data with OSM line data ( only lines which are connected to 
an existing osm lines ) in other words if a line is not connected with any 
other line(road ) with OSM data with the help of query tool it will be 
deleted 

I believe this can be a method to refine data. If you agree or have better 
idea kindly guide with some instruction video or page as number of villages 
in india are more then 15 lak and manually this is next to impossible 

If we can publish that data on this group this will be ahead all the data 
source available even with bhuvan wms rj_roads doesnt have that much data.

Note - I have a shape file data that distinguish between urban and rural 
areas of India but accuracy is upto 85 % (area larger then actual area)


   



On Friday, May 1, 2020 at 7:27:01 AM UTC+5:30, Nikhil VJ wrote:
>
> Hi, I learned from GIS stackexchange 
> 
>  
> that "-spat" may be better than "-clipsrc" as it doesn't bother to cut 
> features that extend beyond our rectangle. Which I'm fine with, and it 
> saves a lot on processing time.
>
> So this command worked better for me:
> ogr2ogr -spat 70.1 18.2 75.5 20.6 
> output.gpkg IN_PK_mapwithai_road_data.gpkg
>
> PFA a screenshot : I loaded OSM road data (highway=*) in white and this 
> data (let's call it FB-AI) in orange over a satellite view. 
>
> My observation: The FB-AI data has excluded existing roads that are 
> already there on OSM it seems, and is marking possible roads that don't 
> existi in OSM yet. And It seems to be doing a pretty good job of detecting 
> unmapped roads.
>
> Caveats: Inevitable consequence of trying to catch em all: False 
> positives. It's marking any scratch it finds and many are just dirt tracks 
> in the fields or even dried canals that may or may not be getting used as 
> general thoroughfare. While local tracks used by tractors to go to fields 
> are fine for mapping as dirt tracks (pls don't mark them as residential 
> roads or unclassified), there is a greater priority to mark roads that can 
> be used by regular vehicles without damaging those vehicles; roads than can 
> be used in times of emergencies, for delivery of essentials and the likes. 
> And you wouldn't want to send an ambulance trying to get to a landlslide 
> affected area into an impasse while thinking they were taking a shortcut as 
> shown on map.
>
> For this reason, IMHO the current approach of not declaring this data as 
> roads straightaway but rather feeding it in as suggestions and letting 
> human mappers decide (see links below), is better. That being said, there 
> can be purposes other than precise mapping, such as using this data as 
> proxy for indicating other things, or aggregating over areas to compare 
> between areas, or using this to map irrigation canals (:D), or using it to 
> decide where to focus the next mapping efforts. This data can be useful and 
> fill in (do mention the caveats in your summary!) for areas where OSM 
> mapping hasn't had proper coverage yet.
>
>
> I'm sharing source links:
> Github page where all countries' data download links are posted:
>
> https://github.com/facebookmicrosites/Open-Mapping-At-Facebook/wiki/Available-Countries
> Ah, even there they're mentioning "Country exports contain only the AI 
> predicted roads that are missing from OpenStreetMap."
>
> The RapID editor that brings this data as pink suggestions into OSM's 
> online editor for mapping:
> https://mapwith.ai/rapid
>
> The main website where there's explanation etc: https://mapwith.ai/
>
> PS: Satellite imagery brought in to QGIS by copying over tile urls from 
> http://leaflet-extras.github.io/leaflet-providers/preview/ under "XYZ 
> Tiles" in left pane where we find the OpenStreetMap layer.
>
>
> Regards
> Nikhil VJ
> https://nikhilvj.co.in
>
>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/b0638440-7c05-4f0a-a41e-6cf3279d9c86%40googlegroups.com.


Re: [datameet] any help with geocoding and reverse geocoding without api or from open source

2020-05-04 Thread Deepak Sharda
thanks a lot.

i have so many data sets u can ask any time in shapefiles

On Mon, 27 Apr, 2020, 10:25 am Sajjad Anwar,  wrote:

> Highly recommend https://opencagedata.com/. Based on OSM and several open
> datasets. Really good API and documentation. Also free for a pretty good
> number of requests.
>
> Sajjad
>
> On Sun, Apr 26, 2020 at 4:05 PM Jobin Jose  wrote:
>
>> Geocoding can be done with the help of Google sheets. Please check these
>> links
>>
>>
>> https://discourse.looker.com/t/get-latitude-longitude-for-any-location-through-google-sheets-and-plot-these-in-looker/5402
>>
>> http://youtube.com/watch?v=vE5gTSw4M7Q
>>
>> http://youtube.com/watch?v=ozjSCoJGgVc
>>
>> On Sat 18 Apr, 2020, 10:30 PM Deepak Sharda, 
>> wrote:
>>
>>> i googled and get this site address which is open source of geocoding
>>> and reverse geocoding but i am not expert in node.js  could you help .
>>>
>>>
>>> is it helpful for data relating to india.
>>>
>>>
>>> there was a file aattached as sample data for india
>>>
>>> https://github.com/pelias/pelias
>>>
>>> --
>>> Datameet is a community of Data Science enthusiasts in India. Know more
>>> about us by visiting http://datameet.org
>>> ---
>>> You received this message because you are subscribed to the Google
>>> Groups "datameet" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to datameet+unsubscr...@googlegroups.com.
>>> To view this discussion on the web visit
>>> https://groups.google.com/d/msgid/datameet/a672e807-c8dd-4dba-8d79-f407aa076cb1%40googlegroups.com
>>> <https://groups.google.com/d/msgid/datameet/a672e807-c8dd-4dba-8d79-f407aa076cb1%40googlegroups.com?utm_medium=email_source=footer>
>>> .
>>>
>> --
>> Datameet is a community of Data Science enthusiasts in India. Know more
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to datameet+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/datameet/CAKmBd7tjac15zuV7raY5m3AwPGCCxee64FT1qMc_PTOKsjXUmg%40mail.gmail.com
>> <https://groups.google.com/d/msgid/datameet/CAKmBd7tjac15zuV7raY5m3AwPGCCxee64FT1qMc_PTOKsjXUmg%40mail.gmail.com?utm_medium=email_source=footer>
>> .
>>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CALQA-LXH4yNvAgTZnLYA2cgbQQfkTmk3UUDnND5DhYuC3e6L%2BQ%40mail.gmail.com
> <https://groups.google.com/d/msgid/datameet/CALQA-LXH4yNvAgTZnLYA2cgbQQfkTmk3UUDnND5DhYuC3e6L%2BQ%40mail.gmail.com?utm_medium=email_source=footer>
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CA%2B4SsQAXibDzWSp%3DV1gk%2Btd5bwTSkrycziyLzvvOkcQuMEXd2Q%40mail.gmail.com.


Re: [datameet] Re: Facebook Road AI data!!!!!!!!!!

2020-04-29 Thread Deepak Sharda
it works fine.



On Wed, 29 Apr, 2020, 6:36 pm Ujaval Gandhi, 
wrote:

> You will have to subset the data to make it usable in QGIS. An easy and
> fast way would be to use the 'Clip' algorithm from Processing Toolbox. It
> can read input data directly from disk (without loading it in QGIS) and
> clip using another layer with AOI polygons. I tried it on my machine and it
> could read the geopackage and clip it to a state in 2 minutes (see
> screenshot)
>
> [image: Logo] 
> Ujaval Gandhi
> Spatial Thoughts
> mobile: +91-8095684687
> email: uja...@spatialthoughts.com
> [image: LinkedIn icon]   [image:
> Twitter icon] 
> Subscribe to our newsletter http://bit.ly/spatialthoughts-newsletter
>
>
> On Wed, Apr 29, 2020 at 10:15 AM Devdatta Tengshe 
> wrote:
>
>> Hi Nikhil,
>>
>> While you can always connect to the GeoPackage via a sqlite connector,
>> and Run Spatial SQL queries, the easiest way to create a subset, is using
>> GDAL's ogr2ogr utility.
>>
>> If you have Qgis Installed, you would have an Os4GeoShell (For linux and
>> Mac, the command can be run in your regular shell).
>> Here, you can use ogr2ogr to transform data quite quickly, and creating a
>> spatial subset is as easy as passing the proper boundingbox, in a command
>> like this:
>>
>>
>> ogr2ogr -clipsrc 70.1 18.2 75.5 20.6 output.gpkg input.gpkg
>>
>> Regards,
>> Devdatta
>>
>>
>> On Wed, 29 Apr 2020 at 09:42, Nikhil VJ  wrote:
>>
>>> I'm reading more about the .gpkg format here:
>>>
>>> http://switchfromshapefile.org/#alternatives
>>>
>>> Question: If I have lat-long bounds for a smaller regions, then how do
>>> extract that much part of data (one feature starting inside and continuing
>>> outwards is ok, no need to chop)... without having to load up the complete
>>> file into memory ?
>>>
>>> I understand this format is SQLite at its core. And that is known for
>>> enabling us to query it without having to load the full data into memory.
>>> I've been using osmconvert for extracting from .pbf, but afaik it
>>> doesn't support .gpkg formats.
>>>
>>> Regards
>>> Nikhil VJ
>>> https://nikhilvj.co.in
>>>
>>>
>>> On Tuesday, April 28, 2020 at 10:51:03 PM UTC+5:30, Justin wrote:

 @Deepak, open it, and walk away for about 30 minutes. It will open. Try
 to have your area of interested centered on your screen, zoom into it. Then
 select and export the section you need, otherwise it is a bit difficult to
 work with.

>>> --
>>> Datameet is a community of Data Science enthusiasts in India. Know more
>>> about us by visiting http://datameet.org
>>> ---
>>> You received this message because you are subscribed to the Google
>>> Groups "datameet" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to datameet+unsubscr...@googlegroups.com.
>>> To view this discussion on the web visit
>>> https://groups.google.com/d/msgid/datameet/014a86b6-ed55-4018-890e-7dcbf412dc38%40googlegroups.com
>>> 
>>> .
>>>
>> --
>> Datameet is a community of Data Science enthusiasts in India. Know more
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to datameet+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/datameet/CAOQOUMskj2DFwMiojD87w0LaUAt%3DDZyWt2MWekQ-6Eq1h6CXBw%40mail.gmail.com
>> 
>> .
>>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CALymcQCZa4kMFb-uc5Wx7xEh2D_j-OgeCAFMDM%3DP5Jk%2BN3FZVw%40mail.gmail.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 

Re: [datameet] Re: Facebook Road AI data!!!!!!!!!!

2020-04-29 Thread Deepak Sharda
thank a lot.

one more question. As osm doesnt have so many rural roads  in its data for
India.

Does this file has all India rural road Data kindly tell is it worth.


u being so kind and helpful


thank you



On Tue, 28 Apr, 2020, 10:51 pm Justin,  wrote:

> @Deepak, open it, and walk away for about 30 minutes. It will open. Try to
> have your area of interested centered on your screen, zoom into it. Then
> select and export the section you need, otherwise it is a bit difficult to
> work with.
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/d6563043-1155-494b-8c85-1bbe20d94cbe%40googlegroups.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CA%2B4SsQBLaOqJAB%2BeOTpLe7czE4uB4PZkY%2BLzkzxOK%2B7ebX8uUQ%40mail.gmail.com.


[datameet] Re: Facebook Road AI data!!!!!!!!!!

2020-04-28 Thread Deepak Sharda

can you please help me how to open this data as QGIS hunged when i tried to 
open this big file 



On Friday, November 22, 2019 at 9:30:29 AM UTC+5:30, Justin wrote:
>
> free up a lot of space on your machine - all the roads in India missing 
> from OSM
>
> https://mapwith.ai/country_exports/IN_PK_mapwithai_road_data.gpkg.tar.gz
>
> Have fun!
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/dc2eefec-03e2-451a-aafd-fbb3379c7044%40googlegroups.com.


Re: [datameet] any help with geocoding and reverse geocoding without api or from open source

2020-04-26 Thread Deepak Sharda
i am trying to pelicia with qgis and try to dig data will update you once i
get some results

On Sun, 19 Apr, 2020, 11:06 am Nikhil VJ,  wrote:

> Hi Deepak,
>
> I was digging up regarding this recently and tried one option that didn't
> work out; sharing my notes:
>
> Starting rule : Cannot rely on 3rd party service; needs to be self-hosted;
> use OSM country extract from https://download.geofabrik.de/ as base data.
>
> Starting point:
>
> OSM wiki page listing several different software for searching places:
>
> https://wiki.openstreetmap.org/wiki/Search_engines
>
>
> Osmnames + Sphinxsearch :
>
> This seemed easier to start off so tried it. Once I got it depoyed, didn't
> get any proper results even for city names. I'm guessing the parameters may
> require fine-tuning. And I couldn't understand why they are involving
> wikipedia. It seemed like the search was relying more on data from
> wikipedia than from OSM.
>
> Didn't explore on it further. (Spare time burned up!)
>
>
> Nominatim related leads, where I want to dig into in next sprint:
>
> https://www.cascadia-analytics.com/2017/10/01/nominatim-docker.html
>
> https://github.com/mediagis/nominatim-docker
>
>
> Pelias seems promising too, but we need a proper elasticsearch deployment
> to run it and that takes up quite some memory.
>
>
> -
>
>
> My personal observations, may be inaccurate:
>
> We should treat geocoding and reverse geocoding as two different
> applications.
>
>
> Reverse geocoding would be much simpler to do, since you just need to put
> in the lat-longs and cough up the closest place names.
>
>
> Geocoding involves complicated textual search, especially given the
> variations in ways place names are stored. There has to be high flexibility
> like making up for spelling differences. So elasticsearch seems like a good
> fit for it. Then, geo-constraining searches is very important here. We need
> ways to progressively narrow down the search areas and cut out false
> positives. Letting the user draw a box on the map to search in, for
> example, can greatly increase effectiveness of results rather than
> searching the whole country / planet data.
>
> --
> Cheers,
> Nikhil VJ
> https://nikhilvj.co.in
>
>
> On Sun, Apr 19, 2020 at 8:26 AM Bhanu K  wrote:
>
>> Hi Deepak,
>>
>> Few options depending on the tool:
>>
>> - if Google Sheets is an option, Geocode by Awesome Table
>> <https://gsuite.google.com/u/0/marketplace/app/geocode_by_awesome_table/904124517349?hl=en=sheets_addon_widget>
>> is a good add-on.
>> - if Microsoft Excel is an option, geocode-excel
>> <https://github.com/gramener/geocode-excel> is an offline version.
>> - Nominatim API
>> <https://nominatim.org/release-docs/develop/api/Overview/> can be used
>> in a language of your choice.
>>
>> thanks,
>> Bhanu
>>
>>
>> On Sat, Apr 18, 2020 at 5:00 PM Deepak Sharda 
>> wrote:
>>
>>> i googled and get this site address which is open source of geocoding
>>> and reverse geocoding but i am not expert in node.js  could you help .
>>>
>>>
>>> is it helpful for data relating to india.
>>>
>>>
>>> there was a file aattached as sample data for india
>>>
>>> https://github.com/pelias/pelias
>>>
>>> --
>>> Datameet is a community of Data Science enthusiasts in India. Know more
>>> about us by visiting http://datameet.org
>>> ---
>>> You received this message because you are subscribed to the Google
>>> Groups "datameet" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to datameet+unsubscr...@googlegroups.com.
>>> To view this discussion on the web visit
>>> https://groups.google.com/d/msgid/datameet/a672e807-c8dd-4dba-8d79-f407aa076cb1%40googlegroups.com
>>> <https://groups.google.com/d/msgid/datameet/a672e807-c8dd-4dba-8d79-f407aa076cb1%40googlegroups.com?utm_medium=email_source=footer>
>>> .
>>>
>>
>>
>> --
>> Bhanu
>>
>> --
>> Datameet is a community of Data Science enthusiasts in India. Know more
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to datameet+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/

Re: [datameet] Re: Local Government Directory, Government of India

2020-04-17 Thread Deepak Sharda
thanks i needed shape files

but thanks a lot for  response

On Fri, Apr 17, 2020 at 11:33 AM Arun Ganesh  wrote:

> Was looking through the directory to get details about some new districts
> and eventually downloaded most of the files. Have uploaded them here:
> https://github.com/planemad/india-local-government-directory
>
> This is probably the most updated official source for listing of
> administrative units. Its not as updated as i would have hoped though, for
> instance the state list is still missing the merger of Dadra and Nagar
> Haveli and Daman and Diu, but its likely better than anything else
> available online.
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CA%2BGKQr0xFaiTF%2BGvLX-tsX1Q8nM9_tE2o0L8tGcGMbQ9NWJWEQ%40mail.gmail.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CA%2B4SsQDN1svq49q9Cn_gTAbVT0Yi3iVPrH3bFFH%2BjyjUqk6h5g%40mail.gmail.com.