And since I was cursing the census website, I found that they have another website which is more user friendly in terms of finding and downloading data tables:
https://censusindia.gov.in/census.website/data/census-tables I am downloading all Primary Census Abstracts from here and will post them soon in the same link as above Sharad On Monday, January 27, 2025 at 11:31:54 AM UTC+5:30 Sharad Lele (शरच्चंद्र लेले) wrote: Hi Shwetha: I have uploaded the rural and urban 'directories' (amenities directories) for all states here <https://drive.google.com/drive/folders/1zWcKbL9tVXk0nLD-bbl5TIhJ8u3gkoY9?usp=sharing>. Please check and see if this is what you want.And if any state is missing. I don't think I have PCA data for all states already downloaded but will check. Am sure there are others in datameet who are better at scraping the current (totally messed up and user un-friendly Census website). But i thought we can make a start here. Sharad On 27-01-2025 11:03, Swetha S wrote: Hi Shiv and Sharad, Thanks for your responses. - I was hoping someone might have already consolidated the town and village amenities tables from the states into one dataset. - Shiv, the links to the tables on the page you shared do not work from India either. So far the best way to locate the files seems to be to search for "district census handbook" on https://censusindia.gov.in/nada/index.php/catalog/. The title is at odds with the content - the district census handbooks bring up the village and town amenities Excel files for that state. A public repository of all the files would be a much-needed public good. I'm surprised there isn't one already. Best, Swetha On Fri, 24 Jan 2025 at 17:06, 'Shiv Hastawala' via datameet < [email protected]> wrote: Hi Shwetha If I correctly understand what you need, then I believe you should be able to find it somewhere on this link: https://censusindia.gov.in/census.website/data/tables Now, since I am not physically in India, the link doesn't open for me. Funnily enough, it doesn't work with an Indian VPN server either. But I'm pretty sure you will be able to access it if you are in India. However, a caveat is that I last accessed it (using help from a friend in India) around May 2024; so I'm not sure if the link is actually broken right now. If that is the case, then I apologize in advance. Anyway, if it does work for you, a little word of caution: each census year on this link consists of hundreds (or maybe a little over 1000) of data files, and the search tool sucks quite a bit, with only 10 or so results showing up on each page (I think they deliberately make it difficult for some reason). So you may have to do a lot of manual work to find the right files. Unless you know how to automate the process using python or something. *By the way, this just gave me an idea: does anyone want to voluntarily create a dump of all these files on GitHub so that they are easily accessible to anyone who needs them? I would urge some of the senior members of the group to volunteer for this effort. I think it would be extremely useful for all of us.* Thanks and regards. Yours sincerely *Shiv Hastawala* (He/His/Him) Doctoral Graduate Department of Economics Binghamton University (State University of New York) Email ID: shastaw1[at]binghamton[dot]edu Zoom ID: 201 717 2613 www.shivhastawala.com On Fri, Jan 24, 2025 at 11:17 AM S <[email protected]> wrote: Hi everyone, Does anyone have the consolidated Census 2011 villages amenities dataset? SHRUG is fantastic, but does not work for my purpose since I need the unit of observation to be exactly per the Census 2011 and not at the level of the shrug ID (which is the lowest common denominator across the 1991, 2001 and 2011 censuses). Many thanks, Swetha On Friday, 2 February 2024 at 1:59:54 pm UTC+5:30 Shiv Hastawala wrote: My pleasure! Thanks and regards. Yours sincerely *Shiv Hastawala* (He/His/Him) Doctoral Student Department of Economics Binghamton University (State University of New York) Zoom ID: 201 717 2613 www.shivhastawala.com On Fri, 2 Feb 2024 at 3:28 am, Nadine K.J. <[email protected]> wrote: Thanks Shiv!! Yes I had read the documentation/user manual but was unable to locate it (I didn't think it would be written in the FAQ ;) ). If anyone wonders the same: go to "Core Keys" on the download page. Thanks for your help and patience :) Kind regards, Nadine On Thursday 1 February 2024 at 20:13:35 UTC+1 Shiv Hastawala wrote: Actually all place names are available in the file 'shrid_loc_names'. Please go through their documentation to understand how they define a SHRID. It is basically a village, but you will get the nuances from their docs. Thanks and regards. Yours sincerely *Shiv Hastawala* (He/His/Him) Doctoral Student Department of Economics Binghamton University (State University of New York) Zoom ID: 201 717 2613 www.shivhastawala.com On Thu, 1 Feb 2024 at 2:02 pm, Nadine K.J. <[email protected]> wrote: Hi Shiv, Thanks again! In the SHRUG data there are no village names in the Census village files. It appears that the numbers are a collection of the total villages in that State,District combination. I require those for matching, how can I get the names? Kind regards, Nadine On Thursday 1 February 2024 at 12:40:03 UTC+1 Shiv Hastawala wrote: Hi Nadine You can find that in Table A01 of both the 2001 and 2011 Censuses. You can access those tables here: https://censusindia.gov.in/census.website/data/census-tables# You will need to select the census year on the left to get the tables from that year. Thanks and regards. Yours sincerely *Shiv Hastawala* (He/His/Him) Doctoral Student Department of Economics Binghamton University (State University of New York) Zoom ID: 201 717 2613 www.shivhastawala.com On Tue, 30 Jan 2024 at 4:00 pm, Nadine K.J. <[email protected]> wrote: Hi Shiv, Thank you so much! Is it also possible to obtain the rural_population per district? (I recall that Census displays also the breakdown of urban/rural population) Kind regards, Nadine On Tuesday 30 January 2024 at 00:24:55 UTC+1 Shiv Hastawala wrote: Hi Nadine It is available here: https://www.devdatalab.org/shrug_download/ Thanks and regards. Yours sincerely *Shiv Hastawala* (He/His/Him) Doctoral Student Department of Economics Binghamton University (State University of New York) Zoom ID: 201 717 2613 www.shivhastawala.com On Mon, 29 Jan 2024 at 6:22 pm, Nadine K.J. <[email protected]> wrote: Hi everyone, I am looking for the population for each village according to 2001 census and 2011 census. The links here above in this thread are no longer working. I looked at: https://censusindia.gov.in/nada/index.php/catalog/?page=1&sk=village%20directory&tag%5B%5D=Census-2001&sort_by=popularity&sort_order=desc&ps=15 and there you can search for each STATE + DISTRICT separately to obtain a VILLAGE DIRECTORY. However, I wonder if someone has the village population data in one excel sheet of India 2001 and 2011 census. Thank you so much! Nadine On Tuesday 31 January 2017 at 11:29:13 UTC+1 AVANI DARE wrote: Hi, The Census Data Village Directory for 2001 of all States is provided in Census Digital Library. Data which you will download is in Excel Format only. Hope this will help you.Check this link http://www.censusindia.gov.in/DigitalLibrary/MFTableSeries.aspx Warm Regard Avani Dare Special Project Associate Indian Institute of Forest Management, Bhopal -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/acaa6132-235a-4535-8104-945673c2c771n%40googlegroups.com <https://groups.google.com/d/msgid/datameet/acaa6132-235a-4535-8104-945673c2c771n%40googlegroups.com?utm_medium=email&utm_source=footer> . -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/51100090-e1bd-4311-85a3-15603375ca70n%40googlegroups.com <https://groups.google.com/d/msgid/datameet/51100090-e1bd-4311-85a3-15603375ca70n%40googlegroups.com?utm_medium=email&utm_source=footer> . -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/a52b4f68-ca6e-4496-8480-4e5b97d93a05n%40googlegroups.com <https://groups.google.com/d/msgid/datameet/a52b4f68-ca6e-4496-8480-4e5b97d93a05n%40googlegroups.com?utm_medium=email&utm_source=footer> . -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/d0a158d5-8c89-448e-9e82-6d5a3935dd79n%40googlegroups.com <https://groups.google.com/d/msgid/datameet/d0a158d5-8c89-448e-9e82-6d5a3935dd79n%40googlegroups.com?utm_medium=email&utm_source=footer> . -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion visit https://groups.google.com/d/msgid/datameet/1008d60b-c2ce-4ad4-8c2b-e209b86576ben%40googlegroups.com <https://groups.google.com/d/msgid/datameet/1008d60b-c2ce-4ad4-8c2b-e209b86576ben%40googlegroups.com?utm_medium=email&utm_source=footer> . -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion visit https://groups.google.com/d/msgid/datameet/CAGiG-AxZOGq_j1ti5jm0omKH76_jArqCVAfvttorKHCCAXOzrQ%40mail.gmail.com <https://groups.google.com/d/msgid/datameet/CAGiG-AxZOGq_j1ti5jm0omKH76_jArqCVAfvttorKHCCAXOzrQ%40mail.gmail.com?utm_medium=email&utm_source=footer> . -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to a topic in the Google Groups "datameet" group. To unsubscribe from this topic, visit https://groups.google.com/d/topic/datameet/WcgiHq0trBc/unsubscribe. To unsubscribe from this group and all its topics, send an email to [email protected]. To view this discussion visit https://groups.google.com/d/msgid/datameet/CAH9LZCVkD5PgAF4uhFsEh8JLkk1cY%2B%2B0VV8vT8UPH%2BOJo%3DFhGg%40mail.gmail.com <https://groups.google.com/d/msgid/datameet/CAH9LZCVkD5PgAF4uhFsEh8JLkk1cY%2B%2B0VV8vT8UPH%2BOJo%3DFhGg%40mail.gmail.com?utm_medium=email&utm_source=footer> . -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion visit https://groups.google.com/d/msgid/datameet/bd966180-3070-42fe-9ba2-131aaf02491en%40googlegroups.com.
