Re: [datameet] Where can I find land cover data for Kerala from 2008 - 2012?

2023-01-11 Thread Shijith Kunhitty
Thanks Devdatta, Sarath and Pradeep for responding. 

Managed to find land cover data for Kerala from Bhuvan's WMS service. 
Unfortunately, they only provide png/jpeg images, so had to write code to 
convert those images into the underlying data. Just sharing a link to the 
python 
code  
in case others want it.

(Also I work in the media and these calculations gives me a rough idea of 
landuse/landcover, so that's good enough for me. But if you're in academia, 
i think the actual data may be available for purchase, please do that 
instead.)

The code should give you LULC data at 1:50,000 scale for any area in India 
for 2005-06, 2011-12 or 2015-16 and save it as an netcdf file. 

In the netcdf file, the LULC class will be under the band 'class_new'. What 
each class code represents can be seen from this bhuvan request 
.
 
And for visualising the data, use the 'red_new', 'green_new' and 'blue_new' 
bands. 

Have pasted a few lines of the code below. 

regards, shijith 

# docstring for function
def download_lulc_data(state, bbox, period, save_path):
'''
This function gets 1:50,000 or 25m resolution land use/land cover 
imagery \n
from bhuvan's wms service, estimates the underlying data, and \n
saves that data as a netcdf file.

Parameters:
state -- location of area of interest. Use 2-letter codes like KL for 
Kerala
bbox -- bounding box for area of interest: [min_lon, min_lat, max_lon, 
max_lat] 
period -- 3 options are '2005-06', '2011-12' and '2015-16'
save_path -- where netcdf will be saved 
'''

# example of usage
state = 'KL'
bbox = (76.5368557, 9.5704093, 76.5883541, 9.628581)
period = '2011-12'
save_path = 'kl_2011_12_lulc.nc'
download_lulc_data(state, bbox, period, save_path)




On Friday, 6 January 2023 at 05:55:58 UTC+5:30 Pradeep wrote:
A yet another freely available land cover dataset, for 2020, at 10m, from 
ESA, is WorldCover: viewable at 
https://viewer.esa-worldcover.org/worldcover/, more information at 
https://esa-worldcover.org/.

On Monday, January 2, 2023 at 10:18:37 AM UTC+5:30 Sarath Guttikunda wrote:
One more set of lulc datasets - 1992 to 2020
https://urbanemissions.info/india-air-quality/india-ncap-landcover-classification/
Portal has files cut for Indian city airsheds and the link to global files 
is at the top

With best wishes,
Sarath

--
*Dr. Sarath Guttikunda*

*http://www.urbanemissions.info *


On Sun, Jan 1, 2023 at 9:36 PM Devdatta Tengshe  wrote:
Hi  Shijith,

Your requirement of a 30 m Land Cover from 2008 to 2012 is a difficult ask. 

This is because there wasn't a good multispectral dataset of that vintage 
which was widely available. It is only with the advent of the Sentinel 
System, and advances in storage, that generating a Global, or even county 
wide LULC dataset became reasonable, at such a high resolution. ( A rule of 
thumb is that your source Multispectral data should be 1/3 spatial 
resolution of your required LULC)

Having said that, there are 2 options that you could look into:
1) ESRI has released a Global LULC of 2019-2020 vintage which is freely 
available here: (https://livingatlas.arcgis.com/landcover/)
2) NRSC/Bhuvan has a LULC from 2005 Data, which was made at a 1:50k 
resolution, which is approximately equivalent to 50m resolution. The bad 
news is that this is not directly downloadable, and you will have to write 
to them, and see if they are willing to share the data with you.

A third option is that if you have enough resources, you could download/buy 
data of your study area, and generate the LULC.




Regards,
Devdatta


On Thu, 29 Dec 2022 at 20:33, Shijith Kunhitty  wrote:
So I'm doing some work on Kerala, and wanted to use a land cover dataset 
that covers any year from 2008 to 2012. 

Does anyone have any idea on where I could find such data? Preferably at 
30m resolution?

I was thinking of using one of those global land cover datasets, but they 
don't work for one reason or the other.

I know there is Glance  from 
Boston University that covers 2001-2019, but they've only released data for 
North America so far.

There are some datasets from academics in China -- FROM-GLC 30 
, Globeland30 
 -- but their websites are 
either difficult to navigate or don't work anymore.

There are other datasets from NASA 

 and ESA 
,
 
but at 500m and 300m their spatial resolution isn't high enough.
If anyone could give me any leads, I'd really appreciate it

Thanks

Re: [datameet] Pincode Boundaries of India

2023-01-11 Thread Gaurav Meena
Thank You for prompt reply and new data

On Wed, 11 Jan 2023 at 19:24, Vaidya  wrote:

> Hi Gaurav,
>
> 562112 seems to point to Harohalli which is in Ramanagara district?
> There is a new pincode map here that has some 562XXX codes that cover the
> suburbs of Bangalore.
> Hope this helps.
>
> https://data.opencity.in/dataset/pincode-maps-of-cities/resource/pincode-map---bengaluru
>
> Thanks,
> Vaidya
>
>
> On Wed, Jan 11, 2023 at 1:30 PM gauravm...@gmail.com <
> gauravmeena0...@gmail.com> wrote:
>
>> I was just using the Bengaluru file for pincode visualization. relaised
>> that new pincodes like 562112 is not available here.
>> how to add these?
>>
>> On Wednesday, 8 March, 2017 at 9:15:58 pm UTC+5:30 Vaishnavi Jayakumar
>> (Inclusive India) wrote:
>>
>>> Thanks Devdatta. If you could point out problematic areas, we could look
>>> at
>>> having it fixed.
>>> On 08-Mar-2017 2:39 pm, "Devdatta Tengshe"  wrote:
>>>
 Hey Vaishnavi,
 That looks interesting.

 I've scraped the boundaries for the 6 cities, and put them here:
 https://github.com/datameet/PincodeBoundary

 At first glance, there are some oddities in the data, so I'll suggest
 that you cross check before using them.


 Regards,
 Devdatta

>>>
 On Wed, Mar 8, 2017 at 12:52 PM, Vaishnavi Jayakumar (Inclusive India)
  wrote:

> Reminder in case anyone has inputs on this a year later - the
> geo-entities standard bit.
>
> ALSO - what is the latest feedback on postal GIS? Any feedback I could
> pass on? In July 2016 it was still work in progress.
>
> http://postoffice.umd.nic.in:8080/nicutility/#
> FYI
>
> *#Pincode*
>
> I had spoken a week back to a friend from the Indian Postal service
> regarding pincode layers, here's what she replied :
>
> "We do not have an official map yet. Currently am working in
> geotagging all our post offices with delivery boundaries. We have 
> geotagged
> 15 post offices. Drawing pincode boundaries with ISRO. Hope to provide
> public access in 4-5 months."
>
> So will check with her again in August.
>
> *#Geocodes #GLC*
>
> On a related matter, I was wondering what the group's knowledge is on
> standardised codes for government properties. To explain - in the last
> couple of months I have been struggling with poorly specified addresses
> provided by Government authorities for purposes as diverse as Chennai rain
> shelter locations to assembly election polling booths. If the rain shelter
> information provided was maddeningly obfuscatory, the polling booth 
> entries
> were uniquely different for the SAME polling station location. Extensive
> manual cleanup by volunteers had to happen before it could even be
> processed by the polling booth access audit app.
>
> My question is this :
>
> Surely as part of data.gov.in an initiative that standardises data
> collection codes across departments and ministries can be developed which
> will save everyone a lot of time and effort? So while the thrust would be
> on ALL government buildings initially - layers like schools, parks,
> post-office, revenue office, ration shop etc should be available on a 
> drill
> down basis.
>
> So if one needs to reference a particular postoffice in rural Tamil
> Nadu - a code comprising standard census state, district downwards code +
> rural / urban indicator + administrative allotment (political, centre vs
> state cs Municipal vs panchayat) + purpose
> 
> indicator + building particulars (toilet availability, parking facility
> etc)
>
> Something open and internationally standard on these lines with scope
> for evolution and addiition is what I'm imagining -
> http://vcgi.vermont.gov/sites/vcgi/files/standards/partii_section_j.pdf
> - does anything like this exist? Is it on the cards? What IS the
> international open standard adopted across governments?
>
> Looking forward to the group's thoughts / knowledge in this respect.
>
> Vaishnavi
>
>
>
>
>
> ---
> *VAISHNAVI JAYAKUMAR*
> http://about.me/vjayakumar
>
> On Mon, Mar 28, 2016 at 11:20 AM, Raphael Susewind <
> li...@raphael-susewind.de> wrote:
>
>> Dear Avinash and all,
>>
>> I will try to make some time this week to scrape the pincodes from
>> electoral rolls for all polling booths in my electoral GIS shapefiles.
>>
>> Since pincode is in latin script, this should not be affected by the
>> much discussed PDF scraping issues with electoral rolls.
>>
>> We could then either go down the voronoi route, or alternatively use
>> the
>> heatmap processing

Re: [datameet] Pincode Boundaries of India

2023-01-11 Thread Vaidya
Hi Gaurav,

562112 seems to point to Harohalli which is in Ramanagara district?
There is a new pincode map here that has some 562XXX codes that cover the
suburbs of Bangalore.
Hope this helps.
https://data.opencity.in/dataset/pincode-maps-of-cities/resource/pincode-map---bengaluru

Thanks,
Vaidya


On Wed, Jan 11, 2023 at 1:30 PM gauravm...@gmail.com <
gauravmeena0...@gmail.com> wrote:

> I was just using the Bengaluru file for pincode visualization. relaised
> that new pincodes like 562112 is not available here.
> how to add these?
>
> On Wednesday, 8 March, 2017 at 9:15:58 pm UTC+5:30 Vaishnavi Jayakumar
> (Inclusive India) wrote:
>
>> Thanks Devdatta. If you could point out problematic areas, we could look
>> at
>> having it fixed.
>> On 08-Mar-2017 2:39 pm, "Devdatta Tengshe"  wrote:
>>
>>> Hey Vaishnavi,
>>> That looks interesting.
>>>
>>> I've scraped the boundaries for the 6 cities, and put them here:
>>> https://github.com/datameet/PincodeBoundary
>>>
>>> At first glance, there are some oddities in the data, so I'll suggest
>>> that you cross check before using them.
>>>
>>>
>>> Regards,
>>> Devdatta
>>>
>>
>>> On Wed, Mar 8, 2017 at 12:52 PM, Vaishnavi Jayakumar (Inclusive India) <
>>> vaishnavi.jayaku...@inclusiveindia.info> wrote:
>>>
 Reminder in case anyone has inputs on this a year later - the
 geo-entities standard bit.

 ALSO - what is the latest feedback on postal GIS? Any feedback I could
 pass on? In July 2016 it was still work in progress.

 http://postoffice.umd.nic.in:8080/nicutility/#
 FYI

 *#Pincode*

 I had spoken a week back to a friend from the Indian Postal service
 regarding pincode layers, here's what she replied :

 "We do not have an official map yet. Currently am working in geotagging
 all our post offices with delivery boundaries. We have geotagged 15
 post offices. Drawing pincode boundaries with ISRO. Hope to provide public
 access in 4-5 months."

 So will check with her again in August.

 *#Geocodes #GLC*

 On a related matter, I was wondering what the group's knowledge is on
 standardised codes for government properties. To explain - in the last
 couple of months I have been struggling with poorly specified addresses
 provided by Government authorities for purposes as diverse as Chennai rain
 shelter locations to assembly election polling booths. If the rain shelter
 information provided was maddeningly obfuscatory, the polling booth entries
 were uniquely different for the SAME polling station location. Extensive
 manual cleanup by volunteers had to happen before it could even be
 processed by the polling booth access audit app.

 My question is this :

 Surely as part of data.gov.in an initiative that standardises data
 collection codes across departments and ministries can be developed which
 will save everyone a lot of time and effort? So while the thrust would be
 on ALL government buildings initially - layers like schools, parks,
 post-office, revenue office, ration shop etc should be available on a drill
 down basis.

 So if one needs to reference a particular postoffice in rural Tamil
 Nadu - a code comprising standard census state, district downwards code +
 rural / urban indicator + administrative allotment (political, centre vs
 state cs Municipal vs panchayat) + purpose
 
 indicator + building particulars (toilet availability, parking facility
 etc)

 Something open and internationally standard on these lines with scope
 for evolution and addiition is what I'm imagining -
 http://vcgi.vermont.gov/sites/vcgi/files/standards/partii_section_j.pdf
 - does anything like this exist? Is it on the cards? What IS the
 international open standard adopted across governments?

 Looking forward to the group's thoughts / knowledge in this respect.

 Vaishnavi





 ---
 *VAISHNAVI JAYAKUMAR*
 http://about.me/vjayakumar

 On Mon, Mar 28, 2016 at 11:20 AM, Raphael Susewind <
 li...@raphael-susewind.de> wrote:

> Dear Avinash and all,
>
> I will try to make some time this week to scrape the pincodes from
> electoral rolls for all polling booths in my electoral GIS shapefiles.
>
> Since pincode is in latin script, this should not be affected by the
> much discussed PDF scraping issues with electoral rolls.
>
> We could then either go down the voronoi route, or alternatively use
> the
> heatmap processing chain that I used to generate AC boundaries - this
> latter would have the advantage of dealing with wrong coordinates in
> the
> booth point dataset (basically, not all electoral booth coord

Re: [datameet] Pincode Boundaries of India

2023-01-11 Thread gauravm...@gmail.com
I was just using the Bengaluru file for pincode visualization. relaised 
that new pincodes like 562112 is not available here.
how to add these?

On Wednesday, 8 March, 2017 at 9:15:58 pm UTC+5:30 Vaishnavi Jayakumar 
(Inclusive India) wrote:

> Thanks Devdatta. If you could point out problematic areas, we could look 
> at 
> having it fixed.
> On 08-Mar-2017 2:39 pm, "Devdatta Tengshe"  wrote:
>
>> Hey Vaishnavi, 
>> That looks interesting.
>>
>> I've scraped the boundaries for the 6 cities, and put them here: 
>> https://github.com/datameet/PincodeBoundary
>>
>> At first glance, there are some oddities in the data, so I'll suggest 
>> that you cross check before using them.
>>
>>
>> Regards,
>> Devdatta
>>
>
>> On Wed, Mar 8, 2017 at 12:52 PM, Vaishnavi Jayakumar (Inclusive India) <
>> vaishnavi.jayaku...@inclusiveindia.info> wrote:
>>
>>> Reminder in case anyone has inputs on this a year later - the 
>>> geo-entities standard bit.
>>>
>>> ALSO - what is the latest feedback on postal GIS? Any feedback I could 
>>> pass on? In July 2016 it was still work in progress.
>>>
>>> http://postoffice.umd.nic.in:8080/nicutility/#
>>> FYI 
>>>
>>> *#Pincode*
>>>
>>> I had spoken a week back to a friend from the Indian Postal service 
>>> regarding pincode layers, here's what she replied : 
>>>
>>> "We do not have an official map yet. Currently am working in geotagging 
>>> all our post offices with delivery boundaries. We have geotagged 15 
>>> post offices. Drawing pincode boundaries with ISRO. Hope to provide public 
>>> access in 4-5 months."
>>>
>>> So will check with her again in August.
>>>
>>> *#Geocodes #GLC*
>>>
>>> On a related matter, I was wondering what the group's knowledge is on 
>>> standardised codes for government properties. To explain - in the last 
>>> couple of months I have been struggling with poorly specified addresses 
>>> provided by Government authorities for purposes as diverse as Chennai rain 
>>> shelter locations to assembly election polling booths. If the rain shelter 
>>> information provided was maddeningly obfuscatory, the polling booth entries 
>>> were uniquely different for the SAME polling station location. Extensive 
>>> manual cleanup by volunteers had to happen before it could even be 
>>> processed by the polling booth access audit app.
>>>
>>> My question is this :
>>>
>>> Surely as part of data.gov.in an initiative that standardises data 
>>> collection codes across departments and ministries can be developed which 
>>> will save everyone a lot of time and effort? So while the thrust would be 
>>> on ALL government buildings initially - layers like schools, parks, 
>>> post-office, revenue office, ration shop etc should be available on a drill 
>>> down basis.
>>>
>>> So if one needs to reference a particular postoffice in rural Tamil Nadu 
>>> - a code comprising standard census state, district downwards code + rural 
>>> / urban indicator + administrative allotment (political, centre vs state cs 
>>> Municipal vs panchayat) + purpose 
>>> 
>>>  
>>> indicator + building particulars (toilet availability, parking facility 
>>> etc) 
>>>
>>> Something open and internationally standard on these lines with scope 
>>> for evolution and addiition is what I'm imagining - 
>>> http://vcgi.vermont.gov/sites/vcgi/files/standards/partii_section_j.pdf 
>>> - does anything like this exist? Is it on the cards? What IS the 
>>> international open standard adopted across governments?
>>>
>>> Looking forward to the group's thoughts / knowledge in this respect.
>>>
>>> Vaishnavi
>>>
>>>  
>>>
>>>
>>>
>>> ---
>>> *VAISHNAVI JAYAKUMAR*
>>> http://about.me/vjayakumar
>>>
>>> On Mon, Mar 28, 2016 at 11:20 AM, Raphael Susewind <
>>> li...@raphael-susewind.de> wrote:
>>>
 Dear Avinash and all,

 I will try to make some time this week to scrape the pincodes from
 electoral rolls for all polling booths in my electoral GIS shapefiles.

 Since pincode is in latin script, this should not be affected by the
 much discussed PDF scraping issues with electoral rolls.

 We could then either go down the voronoi route, or alternatively use the
 heatmap processing chain that I used to generate AC boundaries - this
 latter would have the advantage of dealing with wrong coordinates in the
 booth point dataset (basically, not all electoral booth coordinates are
 correct; consequently, if we only voronoi, we would have a blip of
 pincode B within a see of pincode A quite frequently. The heatmap stuff
 takes care of this).

 Since I am not familiar with postal boundaries: can anyone here confirm
 whether pincode areas are contiguous, and whether each pincode has only
 one area? Or can it be that several non-contiguous areas have the same
 pincodem intersparsed with other pincodes? (In