Re: [datameet] Any data about migration?

2020-05-04 Thread Sarabjeet Matharu
It might be possible to get some data on migrants going back to home states
through the railways.

For road migration, we could try and get data on the temporary camps that
the state governments had set up.

Another inexact way could be to check state government resources for the
number of migrants fed - I dont know if this is available anywhere though.

On Tue, May 5, 2020 at 9:37 AM Thejesh GN  wrote:

> We are probably seeing one of the biggest mass migration in recent
> history. Is anyone collecting this data? Can we do something as a community?
>
>
>
> Regards,
> Thej
>
> Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
> http://thejeshgn.com
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CAABnYsXjogqQ2G1%2BsaUf8ybToO8PGN4BpC8O5%3DrFK7WwJt7Q9g%40mail.gmail.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAPW0H0Lvjhfwr4GLdN1prGkDc8bn3AjKt-4tNVp6we%2Btn4ZYng%40mail.gmail.com.


[datameet] Re: Sentinel 2 urban area shapefile data extraction

2020-05-04 Thread Deepak Sharda
perfect.


can you extract data for whole of India in shape files 

that will be helfpful.



thank you 

On Friday, February 5, 2016 at 2:28:59 AM UTC+5:30, Justin wrote:
>
> source of imagery: 
> http://sentinel-s2-l1c.s3-website.eu-central-1.amazonaws.com/#tiles/43/R/EP/2015/12/30/0/
>
> composites 752 and 654 extracted unsupervised classifications where bands 
> matched based on intersection and manual checking
>
> geometry is a little loose, but this is my first time.  did not clean any 
> of this - this is the raw first version
>
> cheers!!
> Justin
>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/31d53e6e-6c1f-4758-a3c4-6eff227adb68%40googlegroups.com.


[datameet] Re: Facebook Road AI data!!!!!!!!!!

2020-05-04 Thread Deepak Sharda

thanks a lot you are a true gem 

i have not opened it yet but fingers crossed 


On Friday, November 22, 2019 at 9:30:29 AM UTC+5:30, Justin wrote:
>
> free up a lot of space on your machine - all the roads in India missing 
> from OSM
>
> https://mapwith.ai/country_exports/IN_PK_mapwithai_road_data.gpkg.tar.gz
>
> Have fun!
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/a5fb10d7-8f04-4ce0-bba3-da796b534c91%40googlegroups.com.


[datameet] please help to extract data from pmgsy (pradhan matri gramin sadak yojna)

2020-05-04 Thread Deepak Sharda
dear group members

We are privileged to have gems among us who know how to extract data from 
this website 

Kindly help me with data 

http://www.pmgsy-grris.nic.in/gis.aspx

whole of India with habitation code.

I am willing to pay for shape files format.

thank you 

Regards 



-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/5abcde0d-5907-42c7-9e9f-8db6c4e243dd%40googlegroups.com.


Re: [datameet] Re: Facebook Road AI data!!!!!!!!!!

2020-05-04 Thread Deepak Sharda
Now as I know how to extract data for any region. A new challenge is how to 
refine data as it does have lots of line data which are not roads in my 
case in Barmer rajasthan we have sand dunes which has shadow property with 
contrast in google earth. I am thinking to minimize this data with accuracy 
in three steps
1. First to clean data upto  village level 
   
   Get list of all villages of India with Lat Log address (most probably 
middle of village) 
2. create an buffer of 500 Mtr or 1 km or 2 km as per population index 
3. select Facebook ai data in that buffer region only and delete rest of 
lines 
4. merge that data with OSM line data ( only lines which are connected to 
an existing osm lines ) in other words if a line is not connected with any 
other line(road ) with OSM data with the help of query tool it will be 
deleted 

I believe this can be a method to refine data. If you agree or have better 
idea kindly guide with some instruction video or page as number of villages 
in india are more then 15 lak and manually this is next to impossible 

If we can publish that data on this group this will be ahead all the data 
source available even with bhuvan wms rj_roads doesnt have that much data.

Note - I have a shape file data that distinguish between urban and rural 
areas of India but accuracy is upto 85 % (area larger then actual area)


   



On Friday, May 1, 2020 at 7:27:01 AM UTC+5:30, Nikhil VJ wrote:
>
> Hi, I learned from GIS stackexchange 
> 
>  
> that "-spat" may be better than "-clipsrc" as it doesn't bother to cut 
> features that extend beyond our rectangle. Which I'm fine with, and it 
> saves a lot on processing time.
>
> So this command worked better for me:
> ogr2ogr -spat 70.1 18.2 75.5 20.6 
> output.gpkg IN_PK_mapwithai_road_data.gpkg
>
> PFA a screenshot : I loaded OSM road data (highway=*) in white and this 
> data (let's call it FB-AI) in orange over a satellite view. 
>
> My observation: The FB-AI data has excluded existing roads that are 
> already there on OSM it seems, and is marking possible roads that don't 
> existi in OSM yet. And It seems to be doing a pretty good job of detecting 
> unmapped roads.
>
> Caveats: Inevitable consequence of trying to catch em all: False 
> positives. It's marking any scratch it finds and many are just dirt tracks 
> in the fields or even dried canals that may or may not be getting used as 
> general thoroughfare. While local tracks used by tractors to go to fields 
> are fine for mapping as dirt tracks (pls don't mark them as residential 
> roads or unclassified), there is a greater priority to mark roads that can 
> be used by regular vehicles without damaging those vehicles; roads than can 
> be used in times of emergencies, for delivery of essentials and the likes. 
> And you wouldn't want to send an ambulance trying to get to a landlslide 
> affected area into an impasse while thinking they were taking a shortcut as 
> shown on map.
>
> For this reason, IMHO the current approach of not declaring this data as 
> roads straightaway but rather feeding it in as suggestions and letting 
> human mappers decide (see links below), is better. That being said, there 
> can be purposes other than precise mapping, such as using this data as 
> proxy for indicating other things, or aggregating over areas to compare 
> between areas, or using this to map irrigation canals (:D), or using it to 
> decide where to focus the next mapping efforts. This data can be useful and 
> fill in (do mention the caveats in your summary!) for areas where OSM 
> mapping hasn't had proper coverage yet.
>
>
> I'm sharing source links:
> Github page where all countries' data download links are posted:
>
> https://github.com/facebookmicrosites/Open-Mapping-At-Facebook/wiki/Available-Countries
> Ah, even there they're mentioning "Country exports contain only the AI 
> predicted roads that are missing from OpenStreetMap."
>
> The RapID editor that brings this data as pink suggestions into OSM's 
> online editor for mapping:
> https://mapwith.ai/rapid
>
> The main website where there's explanation etc: https://mapwith.ai/
>
> PS: Satellite imagery brought in to QGIS by copying over tile urls from 
> http://leaflet-extras.github.io/leaflet-providers/preview/ under "XYZ 
> Tiles" in left pane where we find the OpenStreetMap layer.
>
>
> Regards
> Nikhil VJ
> https://nikhilvj.co.in
>
>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/b0638440-7c05-4f0a-a41e-6cf3279d9c86%40googlegroups.com.


Re: [datameet] any help with geocoding and reverse geocoding without api or from open source

2020-05-04 Thread Deepak Sharda
thanks a lot.

i have so many data sets u can ask any time in shapefiles

On Mon, 27 Apr, 2020, 10:25 am Sajjad Anwar,  wrote:

> Highly recommend https://opencagedata.com/. Based on OSM and several open
> datasets. Really good API and documentation. Also free for a pretty good
> number of requests.
>
> Sajjad
>
> On Sun, Apr 26, 2020 at 4:05 PM Jobin Jose  wrote:
>
>> Geocoding can be done with the help of Google sheets. Please check these
>> links
>>
>>
>> https://discourse.looker.com/t/get-latitude-longitude-for-any-location-through-google-sheets-and-plot-these-in-looker/5402
>>
>> http://youtube.com/watch?v=vE5gTSw4M7Q
>>
>> http://youtube.com/watch?v=ozjSCoJGgVc
>>
>> On Sat 18 Apr, 2020, 10:30 PM Deepak Sharda, 
>> wrote:
>>
>>> i googled and get this site address which is open source of geocoding
>>> and reverse geocoding but i am not expert in node.js  could you help .
>>>
>>>
>>> is it helpful for data relating to india.
>>>
>>>
>>> there was a file aattached as sample data for india
>>>
>>> https://github.com/pelias/pelias
>>>
>>> --
>>> Datameet is a community of Data Science enthusiasts in India. Know more
>>> about us by visiting http://datameet.org
>>> ---
>>> You received this message because you are subscribed to the Google
>>> Groups "datameet" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to datameet+unsubscr...@googlegroups.com.
>>> To view this discussion on the web visit
>>> https://groups.google.com/d/msgid/datameet/a672e807-c8dd-4dba-8d79-f407aa076cb1%40googlegroups.com
>>> 
>>> .
>>>
>> --
>> Datameet is a community of Data Science enthusiasts in India. Know more
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to datameet+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/datameet/CAKmBd7tjac15zuV7raY5m3AwPGCCxee64FT1qMc_PTOKsjXUmg%40mail.gmail.com
>> 
>> .
>>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CALQA-LXH4yNvAgTZnLYA2cgbQQfkTmk3UUDnND5DhYuC3e6L%2BQ%40mail.gmail.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CA%2B4SsQAXibDzWSp%3DV1gk%2Btd5bwTSkrycziyLzvvOkcQuMEXd2Q%40mail.gmail.com.