Re: [datameet] Help in extracting Mumbai's Development Plan 2034 as Shapefile

[Devdatta Tengshe]

This is coming from an ArcGIS Based Service at:
https://agsmaps.mcgm.gov.in/server/rest/services/Development_Plan_2034/MapServer/

It is possible to scrape the data from here, but we need to know what
layers to scrape. Unfortunately, their naming convention is non-existent,
and unless we have some detailed knowledge on what each layer means, it
will be a futile exercise, even if we get the data.

Regards,
Devdatta


On Wed, Oct 23, 2019 at 1:23 AM akshit Shah  wrote:

> Hi,
>
> Thanks Nikhil VJ for underlining the fact that we are still far away from
> free data regime prevailing in western countries. I already approached head
> of Development Plan department at MCGM and their typical reply was that "we
> can not share this data due to security reasons !!, even to share this with
> MMRDA (Mumbai Metropolitan Region Development Authority) we have signed
> non-disclosure bond and stuff.
>
> I don't understand what threat can a publicly available development plan
> could pose to authorities !!!  just because its in a vector format. 26/11
> happened even before the GIS era in India. Rationally, the amount of help
> in urban planning research through such dataset is far more greater than
> any security threat (that you guys may think of). but it seems our
> bureaucrats doesn't understand such things (may be because
> Architecture/Planning is not available as an optional subject).
>
> Coming to the extraction point, there are multiple long routes to
> achieve the objective of getting vector shapes. I have tried one of them by
> geo-referencing the one PDF tile using AutoCAD Map & then exporting it
> layer by layer to QGIS. but I could not achieve accurate scale and
> geo-referencing. Also the task is too tedious considering the scale of
> city, the development plan is divided into more than 150 tiles which will
> take too long to accomplish.
>
> Alternatively, every concerned individual can populate landuse data in OSM
> for a specific region, this way it can be made available in vector. But the
> manual input for metadata is also a time consuming challenge.
>
> Lastly we need some other idea to cut short this task, as authority is not
> going to handover it so easily.
>
> On Mon, Oct 21, 2019 at 11:42 PM Nikhil VJ  wrote:
>
>> Hi,
>>
>> Great to know they're finally moving from PDFs to zoomable maps! One
>> thing I had really hoped for was for people to pin-point exact locations in
>> the DP and talk about that, instead of just making grand reports with
>> overall stats.
>>
>> So again the data you see on this site is coming from a map server that
>> pre-renders the data and sends stuff across as broken down image tiles.
>>
>> Precisely to prevent site visitors from scraping the original vector data.
>>
>> I'm guessing the bureaucracy would have consented to this move (from PDFs
>> to actual map) only under strict conditions that it must not be scrape-able.
>>
>> All the best.. if somebody does find a way to break through though, I can
>> imagine the whole thing will be taken down and that will be regrettable,
>> because this is a really good leg-up for the urban planning sector in India
>> and I'd like to see the same happen in Pune as well. Between PDFs and this
>> I prefer this even if both options aren't open.
>>
>> A longer approach could be to share examples from Europe/US of cities
>> releasing such full data openly and persuade/petition these folks with
>> that. Again, all the best for that. And when one day some municipal
>> corporation in India does do this, we should congratulate and praise them
>> like anything so that others are encouraged too.
>>
>> Yet another approach, and given the target area is Mumbai, this might
>> actually have a chance: get a price from the bureaucrats for releasing this
>> data publicly, and collectively crowdfund it. Just consider the combined
>> purses of all real estate companies and high profile ngo's operating in
>> this region that would want this. If someone from the relevant govt office
>> is seeing this, c'mon guys, give a quote!
>>
>> Regards
>> Nikhil VJ
>>
>> On Mon, Oct 21, 2019, 21:51 Aditi Nair  wrote:
>>
>>> I would also be interested in this accessing this information.
>>>
>>> On Mon, Oct 21, 2019 at 8:13 AM akshit Shah 
>>> wrote:
>>>
 Dear Datameet Memebrs,

 I want your help in extracting Development Plan 2034 of Mumbai from
 their web portal . I want the
 whole Landuse with plot boundaries and its metadata (CTS no., DP Remarl,
 Reservation, etc.) in GSI as a vector shapefile. Can anyone please help me
 in doing so?

 Alternatively, the Development Plan 1991 of Mumbai has been hosted by
 UDRI on their portal . Can we
 extract this as well?

 Thank you in advance.

 --
 Warm Regards,

 *Ar. Akshit Shah*
 | M.Tech Student, RCGSIDM, IIT-KGP |
 | B.Arch, VNIT Nagpur |
 

Re: [datameet] Help in extracting Mumbai's Development Plan 2034 as Shapefile

[akshit Shah]

Hi,

Thanks Nikhil VJ for underlining the fact that we are still far away from
free data regime prevailing in western countries. I already approached head
of Development Plan department at MCGM and their typical reply was that "we
can not share this data due to security reasons !!, even to share this with
MMRDA (Mumbai Metropolitan Region Development Authority) we have signed
non-disclosure bond and stuff.

I don't understand what threat can a publicly available development plan
could pose to authorities !!!  just because its in a vector format. 26/11
happened even before the GIS era in India. Rationally, the amount of help
in urban planning research through such dataset is far more greater than
any security threat (that you guys may think of). but it seems our
bureaucrats doesn't understand such things (may be because
Architecture/Planning is not available as an optional subject).

Coming to the extraction point, there are multiple long routes to
achieve the objective of getting vector shapes. I have tried one of them by
geo-referencing the one PDF tile using AutoCAD Map & then exporting it
layer by layer to QGIS. but I could not achieve accurate scale and
geo-referencing. Also the task is too tedious considering the scale of
city, the development plan is divided into more than 150 tiles which will
take too long to accomplish.

Alternatively, every concerned individual can populate landuse data in OSM
for a specific region, this way it can be made available in vector. But the
manual input for metadata is also a time consuming challenge.

Lastly we need some other idea to cut short this task, as authority is not
going to handover it so easily.

On Mon, Oct 21, 2019 at 11:42 PM Nikhil VJ  wrote:

> Hi,
>
> Great to know they're finally moving from PDFs to zoomable maps! One thing
> I had really hoped for was for people to pin-point exact locations in the
> DP and talk about that, instead of just making grand reports with overall
> stats.
>
> So again the data you see on this site is coming from a map server that
> pre-renders the data and sends stuff across as broken down image tiles.
>
> Precisely to prevent site visitors from scraping the original vector data.
>
> I'm guessing the bureaucracy would have consented to this move (from PDFs
> to actual map) only under strict conditions that it must not be scrape-able.
>
> All the best.. if somebody does find a way to break through though, I can
> imagine the whole thing will be taken down and that will be regrettable,
> because this is a really good leg-up for the urban planning sector in India
> and I'd like to see the same happen in Pune as well. Between PDFs and this
> I prefer this even if both options aren't open.
>
> A longer approach could be to share examples from Europe/US of cities
> releasing such full data openly and persuade/petition these folks with
> that. Again, all the best for that. And when one day some municipal
> corporation in India does do this, we should congratulate and praise them
> like anything so that others are encouraged too.
>
> Yet another approach, and given the target area is Mumbai, this might
> actually have a chance: get a price from the bureaucrats for releasing this
> data publicly, and collectively crowdfund it. Just consider the combined
> purses of all real estate companies and high profile ngo's operating in
> this region that would want this. If someone from the relevant govt office
> is seeing this, c'mon guys, give a quote!
>
> Regards
> Nikhil VJ
>
> On Mon, Oct 21, 2019, 21:51 Aditi Nair  wrote:
>
>> I would also be interested in this accessing this information.
>>
>> On Mon, Oct 21, 2019 at 8:13 AM akshit Shah 
>> wrote:
>>
>>> Dear Datameet Memebrs,
>>>
>>> I want your help in extracting Development Plan 2034 of Mumbai from
>>> their web portal . I want the
>>> whole Landuse with plot boundaries and its metadata (CTS no., DP Remarl,
>>> Reservation, etc.) in GSI as a vector shapefile. Can anyone please help me
>>> in doing so?
>>>
>>> Alternatively, the Development Plan 1991 of Mumbai has been hosted by
>>> UDRI on their portal . Can we
>>> extract this as well?
>>>
>>> Thank you in advance.
>>>
>>> --
>>> Warm Regards,
>>>
>>> *Ar. Akshit Shah*
>>> | M.Tech Student, RCGSIDM, IIT-KGP |
>>> | B.Arch, VNIT Nagpur |
>>> 
>>> *Indian Institute of Technology*
>>> Kharagpur, West Bengal,
>>> 721302, India
>>> +91 3222 255221
>>> IIT KGP  | Linkedin
>>> 
>>>
>>> --
>>> Datameet is a community of Data Science enthusiasts in India. Know more
>>> about us by visiting http://datameet.org
>>> ---
>>> You received this message because you are subscribed to the Google
>>> Groups "datameet" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to datameet+unsubscr...@googlegroups.com.
>>> To view this 

Re: [datameet] Look for district annual wage data (2014-18)

[akshit Shah]

Hi Raahil,

You may consider state level economic survey (published every year) where
you will fine district wise data. eg. Economic Survey of Maharashtra
2018-19 is latest one.

On Tue, Oct 22, 2019 at 10:07 PM Raahil Madhok 
wrote:

> Hi All,
>
> Is anyone aware of a source for district level wage data from 2014-2018?
> District GDP would work too, as I can impute per capita estimates. I know
> the NITI Aayog published sector-wise district GDP but that is until 2010
> only. Wondering if there is something that spans more recent years. Thanks,
>
> Raahil
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/03bd562f-9e19-4a8f-82be-ded771a00a56%40googlegroups.com
> 
> .
>


-- 
Warm Regards,

*Ar. Akshit Shah*
| M.Tech Student, RCGSIDM, IIT-KGP |
| B.Arch, VNIT Nagpur |
| +91 8007762247 |

*Indian Institute of Technology*
Kharagpur, West Bengal,
721302, India
+91 3222 255221
IIT KGP  | Linkedin


-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAJHzfxX1muudwoD7hz8jh-8wTaakHV1fmfm_5kxhUrFxxskYSQ%40mail.gmail.com.

[datameet] Look for district annual wage data (2014-18)

[Raahil Madhok]

Hi All,

Is anyone aware of a source for district level wage data from 2014-2018? 
District GDP would work too, as I can impute per capita estimates. I know 
the NITI Aayog published sector-wise district GDP but that is until 2010 
only. Wondering if there is something that spans more recent years. Thanks,

Raahil

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/03bd562f-9e19-4a8f-82be-ded771a00a56%40googlegroups.com.

[datameet] New shp- J-India

[siddhant]

Do we have the .shp of India with bifurcated J in the open repository?
I checked datameet resources..it seems it has not been added there as yet!
Please share if available with someone- I guess post October 31 maps will
need to represent the changed boundaries.
For privately sharing- siddhan...@apu.edu.in

Many thanks
Siddhant

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CADmtLDdHR9XZqegWmFKH5TcVBnun5F1aO-PSHiaB5EwFwTf8uQ%40mail.gmail.com.