Re: [datameet] Census 2011 Data

[Thejesh GN]

Thanks Dev.

We have it on Archive.org now

https://archive.org/details/CompleteDataOfCensusOfIndia2011

Its large and hence best way to download is to use bittorrent feature of
archive.org

https://archive.org/download/CompleteDataOfCensusOfIndia2011/CompleteDataOfCensusOfIndia2011_archive.torrent

magnet:?xt=urn:btih:721F2628070593F017C2BEC98EDAEE87A122E853

It might take a while for archive.org as it was still under process.

I was able to open the smallest file with pandas using just two lines

import pandas as pd
reader = pd.read_stata('/home/thej/Downloads/pca_census91_st_dist.dta')

I think you can also use AM if you like GUI
http://am.air.org/help/JSTree/MainFrame.asp


If someone can make a note of what data looks like. I will add it to the
description.








Thej
--
Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

On 23 August 2016 at 18:34, Devdatta Tengshe  wrote:

> Someone had collated & shared this data as a Strata .dta file a couple of
> years ago. That dropbox link is dead right now, but I could probably share
> it with whoever needs it.
>
> I can't share the link with the General Public, since it's a Large File,
> and it will easily eat through my Dropbox Bandwidth limit.
>
> Regards,
> Devdatta
>
> On Tue, Aug 23, 2016 at 5:54 PM, Sarath Guttikunda 
> wrote:
>
>> Good evening.
>>
>> The all India files are not complete on data.gov.in, at least the fields
>> I am looking for.
>>
>> Question - http://www.censusindia.gov.in/DigitalLibrary/Tables.aspx is
>> where the tables from census surveys are, but the site is not opening.
>> Keeps saying server busy - for the past two days.
>>
>> Any other way to access the files?
>>
>> With regards,
>> Sarath
>>
>> --
>> *Dr. Sarath Guttikunda*
>> *http://www.urbanemissions.info *
>>
>> On Thu, Jun 11, 2015 at 5:25 PM, Dilip Damle  wrote:
>>
>>> Hello,
>>>
>>> Visiting the group after a long, long time.
>>> Hope everyone is fine
>>>
>>> I just noticed that data.gov.in now has a lot of data on census 2011
>>> Thought of informing people who may not have noticed it.
>>>
>>> Rgds
>>> Dilip Damle
>>>
>>> --
>>> Datameet is a community of Data Science enthusiasts in India. Know more
>>> about us by visiting http://datameet.org
>>> ---
>>> You received this message because you are subscribed to the Google
>>> Groups "datameet" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to datameet+unsubscr...@googlegroups.com.
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>>
>> --
>> Datameet is a community of Data Science enthusiasts in India. Know more
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to datameet+unsubscr...@googlegroups.com.
>> For more options, visit https://groups.google.com/d/optout.
>>
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [datameet] Census 2011 Data

[Devdatta Tengshe]

Someone had collated & shared this data as a Strata .dta file a couple of
years ago. That dropbox link is dead right now, but I could probably share
it with whoever needs it.

I can't share the link with the General Public, since it's a Large File,
and it will easily eat through my Dropbox Bandwidth limit.

Regards,
Devdatta

On Tue, Aug 23, 2016 at 5:54 PM, Sarath Guttikunda 
wrote:

> Good evening.
>
> The all India files are not complete on data.gov.in, at least the fields
> I am looking for.
>
> Question - http://www.censusindia.gov.in/DigitalLibrary/Tables.aspx is
> where the tables from census surveys are, but the site is not opening.
> Keeps saying server busy - for the past two days.
>
> Any other way to access the files?
>
> With regards,
> Sarath
>
> --
> *Dr. Sarath Guttikunda*
> *http://www.urbanemissions.info *
>
> On Thu, Jun 11, 2015 at 5:25 PM, Dilip Damle  wrote:
>
>> Hello,
>>
>> Visiting the group after a long, long time.
>> Hope everyone is fine
>>
>> I just noticed that data.gov.in now has a lot of data on census 2011
>> Thought of informing people who may not have noticed it.
>>
>> Rgds
>> Dilip Damle
>>
>> --
>> Datameet is a community of Data Science enthusiasts in India. Know more
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to datameet+unsubscr...@googlegroups.com.
>> For more options, visit https://groups.google.com/d/optout.
>>
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [datameet] Census 2011 Data

[Sarath Guttikunda]

Good evening.

The all India files are not complete on data.gov.in, at least the fields I
am looking for.

Question - http://www.censusindia.gov.in/DigitalLibrary/Tables.aspx is
where the tables from census surveys are, but the site is not opening.
Keeps saying server busy - for the past two days.

Any other way to access the files?

With regards,
Sarath

--
*Dr. Sarath Guttikunda*
*http://www.urbanemissions.info *

On Thu, Jun 11, 2015 at 5:25 PM, Dilip Damle  wrote:

> Hello,
>
> Visiting the group after a long, long time.
> Hope everyone is fine
>
> I just noticed that data.gov.in now has a lot of data on census 2011
> Thought of informing people who may not have noticed it.
>
> Rgds
> Dilip Damle
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [datameet] Digitising Ward Maps of Bhubaneswar, Odisha. [Work in Progress] Information about Bhubaneswar

[Devdatta Tengshe]

The way to do this, is to first figure out the Backend of the map. If you
use Chrome's Developer tools, and look at the Network Tab, you can Find out
where the data is coming from. I found out that it coming from an ArcGIS
Server REST endpoint at http://bhubaneswarone.in/arcgis/rest/services/.

You will find a number of layers, and say that I want to get the data for
the BMC boundry, which is available at:
http://bhubaneswarone.in/arcgis/rest/services/Boundry/MapServer/

The Actual Boundry is at layer number 2, and then you can query it by using
the following URL

http://bhubaneswarone.in/arcgis/rest/services/Boundry/MapServer/2/query?where=1%3D1=esriGeometryEnvelope==esriSpatialRelIntersects==*=true=falsefalse=falsefalse=false==false===geojson

This gives you data in GeoJSON


Regards,
Devdatta

On Tue, Aug 23, 2016 at 2:58 PM, Pratyush Mohapatra <
pratyushpmohapa...@gmail.com> wrote:

> How did you scrape off the data?
>
> On Tuesday, 23 August 2016 14:42:03 UTC+5:30, Devdatta Tengshe wrote:
>>
>> Hi Pratyush,
>>
>> After you shared the link on the Slack channel, I scraped some of the
>> data, directly from the ArcGIS backend.
>>
>> I've shared it at the following location: https://github.com/d
>> atameet/Municipal_Spatial_Data/tree/master/Bhubaneswar
>>
>> Having the original data, as compared to digitized data is better,
>> because invariably some errors are introduced when you Georeference, and
>> Digitize data, based off that.
>>
>> Regards,
>> Devdatta
>>
>> On Tue, Aug 23, 2016 at 1:33 PM, Pratyush Mohapatra <
>> pratyushp...@gmail.com> wrote:
>>
>>> Link to the geojson file:
>>> https://github.com/Ativerc/GeoData/blob/master/BBSR_Wardmap_v0.1.geojson
>>>
>>> If you have any suggestions, please let me know.
>>>
>>>
>>> Created by following the steps given here:
>>> http://datameet.org/2016/08/12/guide-on-digitizing-static-maps/
>>>
>>> So thanks NikhilVJ for that (why don't you put your contact links on
>>> datameet's website?).
>>>
>>> About Bhubaneswar:
>>>
>>> Bhubaneswar is the capital of Odisha. Its local urban governing body is
>>> called Bhubaneswar Municipal Corporation  (BMC).
>>> https://en.wikipedia.org/wiki/Bhubaneswar_Municipal_Corporation
>>>
>>> www.bmc.gov.in
>>>
>>> I will be posting more information soon.
>>>
>>> --
>>> Datameet is a community of Data Science enthusiasts in India. Know more
>>> about us by visiting http://datameet.org
>>> ---
>>> You received this message because you are subscribed to the Google
>>> Groups "datameet" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to datameet+u...@googlegroups.com.
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>>
>> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [datameet] Digitising Ward Maps of Bhubaneswar, Odisha. [Work in Progress] Information about Bhubaneswar

[Pratyush Mohapatra]

How did you scrape off the data? 

On Tuesday, 23 August 2016 14:42:03 UTC+5:30, Devdatta Tengshe wrote:
>
> Hi Pratyush,
>
> After you shared the link on the Slack channel, I scraped some of the 
> data, directly from the ArcGIS backend.
>
> I've shared it at the following location: 
> https://github.com/datameet/Municipal_Spatial_Data/tree/master/Bhubaneswar
>
> Having the original data, as compared to digitized data is better, because 
> invariably some errors are introduced when you Georeference, and Digitize 
> data, based off that.
>
> Regards,
> Devdatta
>
> On Tue, Aug 23, 2016 at 1:33 PM, Pratyush Mohapatra <
> pratyushp...@gmail.com > wrote:
>
>> Link to the geojson file:
>> https://github.com/Ativerc/GeoData/blob/master/BBSR_Wardmap_v0.1.geojson
>>
>> If you have any suggestions, please let me know.
>>
>>
>> Created by following the steps given here:
>> http://datameet.org/2016/08/12/guide-on-digitizing-static-maps/
>>
>> So thanks NikhilVJ for that (why don't you put your contact links on 
>> datameet's website?).
>>
>> About Bhubaneswar:
>>
>> Bhubaneswar is the capital of Odisha. Its local urban governing body is 
>> called Bhubaneswar Municipal Corporation  (BMC). 
>> https://en.wikipedia.org/wiki/Bhubaneswar_Municipal_Corporation
>>
>> www.bmc.gov.in
>>
>> I will be posting more information soon.
>>
>> --
>> Datameet is a community of Data Science enthusiasts in India. Know more 
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google Groups 
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to datameet+u...@googlegroups.com .
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [datameet] Digitising Ward Maps of Bhubaneswar, Odisha. [Work in Progress] Information about Bhubaneswar

[Devdatta Tengshe]

Hi Pratyush,

After you shared the link on the Slack channel, I scraped some of the data,
directly from the ArcGIS backend.

I've shared it at the following location:
https://github.com/datameet/Municipal_Spatial_Data/tree/master/Bhubaneswar

Having the original data, as compared to digitized data is better, because
invariably some errors are introduced when you Georeference, and Digitize
data, based off that.

Regards,
Devdatta

On Tue, Aug 23, 2016 at 1:33 PM, Pratyush Mohapatra <
pratyushpmohapa...@gmail.com> wrote:

> Link to the geojson file:
> https://github.com/Ativerc/GeoData/blob/master/BBSR_Wardmap_v0.1.geojson
>
> If you have any suggestions, please let me know.
>
>
> Created by following the steps given here:
> http://datameet.org/2016/08/12/guide-on-digitizing-static-maps/
>
> So thanks NikhilVJ for that (why don't you put your contact links on
> datameet's website?).
>
> About Bhubaneswar:
>
> Bhubaneswar is the capital of Odisha. Its local urban governing body is
> called Bhubaneswar Municipal Corporation  (BMC).
> https://en.wikipedia.org/wiki/Bhubaneswar_Municipal_Corporation
>
> www.bmc.gov.in
>
> I will be posting more information soon.
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[datameet] Fwd: [CrisisMappers] WorldPop internal migration data

[sibi kanagaraj]

Found this to be interesting - Especially the WorldPop project .

-- Forwarded message --
From: Andy Tatem 
Date: Mon, Aug 22, 2016 at 4:58 PM
Subject: [CrisisMappers] WorldPop internal migration data
To: CrisisMappers 


As part of WorldPop (www.worldpop.org) we have made available new data on
internal migration mapping across all low and middle income countries here:
http://www.worldpop.org.uk/data/summary/?contselect=Africa;
countselect=Whole+Continent=Internal+Migration+Flows+2010
http://www.worldpop.org.uk/data/summary/?contselect=America;
countselect=Whole+Continent=Internal+Migration+Flows+2010
http://www.worldpop.org.uk/data/summary/?contselect=Asia
ntselect=Whole+Continent=Internal+Migration+Flows+2010

Full details of the data and methods are in this article:
http://www.nature.com/articles/sdata201666

Best wishes,

Andy Tatem

Webpage: www.southampton.ac.uk/geography/about/staff/ajt1m11.page
WorldPop Project: www.worldpop.org 
Flowminder Foundation: www.flowminder.org


-- 
K.Sibi
Blog  | Discuss





-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[datameet] Digitising Ward Maps of Bhubaneswar, Odisha. [Work in Progress] Information about Bhubaneswar

[Pratyush Mohapatra]

Link to the geojson file:
https://github.com/Ativerc/GeoData/blob/master/BBSR_Wardmap_v0.1.geojson

If you have any suggestions, please let me know.


Created by following the steps given here:
http://datameet.org/2016/08/12/guide-on-digitizing-static-maps/

So thanks NikhilVJ for that (why don't you put your contact links on datameet's 
website?).

About Bhubaneswar:

Bhubaneswar is the capital of Odisha. Its local urban governing body is called 
Bhubaneswar Municipal Corporation  (BMC). 
https://en.wikipedia.org/wiki/Bhubaneswar_Municipal_Corporation

www.bmc.gov.in

I will be posting more information soon.

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.