I have now also uploaded a zip file with all PCA 2011 data. The files are unfortunately district-wise, but hopefully easy to integrate. There is one catch, however: Only 640 files were available on the website, although I think there should be 662. Perhaps PCA was not available for those 22 districts? Can someone throw some light on this? Or locate them separately and send to me to upload here?
On Monday, January 27, 2025 at 12:08:36 PM UTC+5:30 Sharad Lele (शरच्चंद्र लेले) wrote: > Gujarat file is sitting outside the zip file. Also Maharashtra. > > On 27-01-2025 12:02, Swetha S wrote: > > Thanks a lot! This is helpful - especially because I couldn't find the > town/village directories 5 states/UTs on the census site. > > The town amenities directories in your folder look complete. But I think > the village file is missing for Gujarat (state 24) > > On Mon, 27 Jan 2025 at 11:31, Sharad Lele (शरच्चंद्र लेले) < > [email protected]> wrote: > >> Hi Shwetha: >> >> I have uploaded the rural and urban 'directories' (amenities directories) >> for all states here >> <https://drive.google.com/drive/folders/1zWcKbL9tVXk0nLD-bbl5TIhJ8u3gkoY9?usp=sharing>. >> >> Please check and see if this is what you want.And if any state is missing. >> >> I don't think I have PCA data for all states already downloaded but will >> check. Am sure there are others in datameet who are better at scraping the >> current (totally messed up and user un-friendly Census website). But i >> thought we can make a start here. >> >> Sharad >> >> On 27-01-2025 11:03, Swetha S wrote: >> >> Hi Shiv and Sharad, >> >> Thanks for your responses. >> >> - I was hoping someone might have already consolidated the town and >> village amenities tables from the states into one dataset. >> >> - Shiv, the links to the tables on the page you shared do not work from >> India either. So far the best way to locate the files seems to be to search >> for "district census handbook" on >> https://censusindia.gov.in/nada/index.php/catalog/. The title is at odds >> with the content - the district census handbooks bring up the village and >> town amenities Excel files for that state. >> >> A public repository of all the files would be a much-needed public good. >> I'm surprised there isn't one already. >> >> Best, >> >> Swetha >> >> On Fri, 24 Jan 2025 at 17:06, 'Shiv Hastawala' via datameet < >> [email protected]> wrote: >> >>> Hi Shwetha >>> >>> If I correctly understand what you need, then I believe you should be >>> able to find it somewhere on this link: >>> >>> https://censusindia.gov.in/census.website/data/tables >>> >>> Now, since I am not physically in India, the link doesn't open for me. >>> Funnily enough, it doesn't work with an Indian VPN server either. But I'm >>> pretty sure you will be able to access it if you are in India. However, a >>> caveat is that I last accessed it (using help from a friend in India) >>> around May 2024; so I'm not sure if the link is actually broken right now. >>> If that is the case, then I apologize in advance. >>> >>> Anyway, if it does work for you, a little word of caution: each census >>> year on this link consists of hundreds (or maybe a little over 1000) of >>> data files, and the search tool sucks quite a bit, with only 10 or so >>> results showing up on each page (I think they deliberately make it >>> difficult for some reason). So you may have to do a lot of manual work to >>> find the right files. Unless you know how to automate the process using >>> python or something. >>> >>> *By the way, this just gave me an idea: does anyone want to voluntarily >>> create a dump of all these files on GitHub so that they are easily >>> accessible to anyone who needs them? I would urge some of the senior >>> members of the group to volunteer for this effort. I think it would be >>> extremely useful for all of us.* >>> >>> Thanks and regards. >>> >>> >>> Yours sincerely >>> >>> *Shiv Hastawala* >>> >>> (He/His/Him) >>> Doctoral Graduate >>> Department of Economics >>> Binghamton University (State University of New York) >>> >>> Email ID: shastaw1[at]binghamton[dot]edu >>> >>> Zoom ID: 201 717 2613 <(201)%20717-2613> >>> >>> www.shivhastawala.com >>> >>> >>> On Fri, Jan 24, 2025 at 11:17 AM S <[email protected]> wrote: >>> >>>> Hi everyone, >>>> >>>> Does anyone have the consolidated Census 2011 villages amenities >>>> dataset? >>>> >>>> SHRUG is fantastic, but does not work for my purpose since I need the >>>> unit of observation to be exactly per the Census 2011 and not at the level >>>> of the shrug ID (which is the lowest common denominator across the 1991, >>>> 2001 and 2011 censuses). >>>> >>>> Many thanks, >>>> Swetha >>>> >>>> On Friday, 2 February 2024 at 1:59:54 pm UTC+5:30 Shiv Hastawala wrote: >>>> >>>>> My pleasure! >>>>> >>>>> >>>>> >>>>> Thanks and regards. >>>>> >>>>> >>>>> Yours sincerely >>>>> >>>>> *Shiv Hastawala* >>>>> >>>>> (He/His/Him) >>>>> Doctoral Student >>>>> Department of Economics >>>>> Binghamton University (State University of New York) >>>>> >>>>> Zoom ID: 201 717 2613 <%28201%29%20717-2613> >>>>> >>>>> www.shivhastawala.com >>>>> On Fri, 2 Feb 2024 at 3:28 am, Nadine K.J. <[email protected]> >>>>> wrote: >>>>> >>>>>> Thanks Shiv!! >>>>>> >>>>>> Yes I had read the documentation/user manual but was unable to locate >>>>>> it (I didn't think it would be written in the FAQ ;) ). >>>>>> >>>>>> If anyone wonders the same: go to "Core Keys" on the download page. >>>>>> >>>>>> Thanks for your help and patience :) >>>>>> >>>>>> Kind regards, >>>>>> Nadine >>>>>> >>>>>> On Thursday 1 February 2024 at 20:13:35 UTC+1 Shiv Hastawala wrote: >>>>>> >>>>>>> Actually all place names are available in the file >>>>>>> 'shrid_loc_names'. Please go through their documentation to understand >>>>>>> how >>>>>>> they define a SHRID. It is basically a village, but you will get the >>>>>>> nuances from their docs. >>>>>>> >>>>>>> >>>>>>> >>>>>>> Thanks and regards. >>>>>>> >>>>>>> >>>>>>> Yours sincerely >>>>>>> >>>>>>> *Shiv Hastawala* >>>>>>> >>>>>>> (He/His/Him) >>>>>>> Doctoral Student >>>>>>> Department of Economics >>>>>>> Binghamton University (State University of New York) >>>>>>> >>>>>>> Zoom ID: 201 717 2613 <%28201%29%20717-2613> >>>>>>> >>>>>>> www.shivhastawala.com >>>>>>> >>>>>> On Thu, 1 Feb 2024 at 2:02 pm, Nadine K.J. <[email protected]> >>>>>>> wrote: >>>>>>> >>>>>>>> Hi Shiv, >>>>>>>> >>>>>>>> Thanks again! >>>>>>>> >>>>>>>> In the SHRUG data there are no village names in the Census village >>>>>>>> files. It appears that the numbers are a collection of the total >>>>>>>> villages >>>>>>>> in that State,District combination. I require those for matching, how >>>>>>>> can I >>>>>>>> get the names? >>>>>>>> >>>>>>>> Kind regards, >>>>>>>> Nadine >>>>>>>> >>>>>>>> On Thursday 1 February 2024 at 12:40:03 UTC+1 Shiv Hastawala wrote: >>>>>>>> >>>>>>>>> Hi Nadine >>>>>>>>> >>>>>>>>> You can find that in Table A01 of both the 2001 and 2011 Censuses. >>>>>>>>> You can access those tables here: >>>>>>>>> >>>>>>>>> https://censusindia.gov.in/census.website/data/census-tables# >>>>>>>>> >>>>>>>>> You will need to select the census year on the left to get the >>>>>>>>> tables from that year. >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> Thanks and regards. >>>>>>>>> >>>>>>>>> >>>>>>>>> Yours sincerely >>>>>>>>> >>>>>>>>> *Shiv Hastawala* >>>>>>>>> >>>>>>>>> (He/His/Him) >>>>>>>>> Doctoral Student >>>>>>>>> Department of Economics >>>>>>>>> Binghamton University (State University of New York) >>>>>>>>> >>>>>>>>> Zoom ID: 201 717 2613 <%28201%29%20717-2613> >>>>>>>>> >>>>>>>>> www.shivhastawala.com >>>>>>>>> >>>>>>>> On Tue, 30 Jan 2024 at 4:00 pm, Nadine K.J. <[email protected]> >>>>>>>>> wrote: >>>>>>>>> >>>>>>>>>> Hi Shiv, >>>>>>>>>> >>>>>>>>>> Thank you so much! >>>>>>>>>> >>>>>>>>>> Is it also possible to obtain the rural_population per district? >>>>>>>>>> (I recall that Census displays also the breakdown of urban/rural >>>>>>>>>> population) >>>>>>>>>> >>>>>>>>>> Kind regards, >>>>>>>>>> Nadine >>>>>>>>>> >>>>>>>>>> On Tuesday 30 January 2024 at 00:24:55 UTC+1 Shiv Hastawala wrote: >>>>>>>>>> >>>>>>>>>>> Hi Nadine >>>>>>>>>>> >>>>>>>>>>> It is available here: >>>>>>>>>>> >>>>>>>>>>> https://www.devdatalab.org/shrug_download/ >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> Thanks and regards. >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> Yours sincerely >>>>>>>>>>> >>>>>>>>>>> *Shiv Hastawala* >>>>>>>>>>> >>>>>>>>>>> (He/His/Him) >>>>>>>>>>> Doctoral Student >>>>>>>>>>> Department of Economics >>>>>>>>>>> Binghamton University (State University of New York) >>>>>>>>>>> >>>>>>>>>>> Zoom ID: 201 717 2613 <%28201%29%20717-2613> >>>>>>>>>>> >>>>>>>>>>> www.shivhastawala.com >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On Mon, 29 Jan 2024 at 6:22 pm, Nadine K.J. <[email protected]> >>>>>>>>>>> wrote: >>>>>>>>>>> >>>>>>>>>>>> Hi everyone, >>>>>>>>>>>> >>>>>>>>>>>> I am looking for the population for each village according to >>>>>>>>>>>> 2001 census and 2011 census. The links here above in this thread >>>>>>>>>>>> are no >>>>>>>>>>>> longer working. >>>>>>>>>>>> >>>>>>>>>>>> I looked at: >>>>>>>>>>>> https://censusindia.gov.in/nada/index.php/catalog/?page=1&sk=village%20directory&tag%5B%5D=Census-2001&sort_by=popularity&sort_order=desc&ps=15 >>>>>>>>>>>> >>>>>>>>>>>> and there you can search for each STATE + DISTRICT separately >>>>>>>>>>>> to obtain a VILLAGE DIRECTORY. >>>>>>>>>>>> However, I wonder if someone has the village population data in >>>>>>>>>>>> one excel sheet of India 2001 and 2011 census. >>>>>>>>>>>> >>>>>>>>>>>> Thank you so much! >>>>>>>>>>>> >>>>>>>>>>>> Nadine >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> On Tuesday 31 January 2017 at 11:29:13 UTC+1 AVANI DARE wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Hi, >>>>>>>>>>>>> >>>>>>>>>>>>> The Census Data Village Directory for 2001 of all States is >>>>>>>>>>>>> provided in Census Digital Library. Data which you will download >>>>>>>>>>>>> is in >>>>>>>>>>>>> Excel Format only. Hope this will help you.Check this link >>>>>>>>>>>>> http://www.censusindia.gov.in/DigitalLibrary/MFTableSeries.aspx >>>>>>>>>>>>> >>>>>>>>>>>>> Warm Regard >>>>>>>>>>>>> >>>>>>>>>>>>> Avani Dare >>>>>>>>>>>>> Special Project Associate >>>>>>>>>>>>> Indian Institute of Forest Management, Bhopal >>>>>>>>>>>>> >>>>>>>>>>>> -- >>>>>>>>>>>> >>>>>>>>>>> Datameet is a community of Data Science enthusiasts in India. >>>>>>>>>>>> Know more about us by visiting http://datameet.org >>>>>>>>>>>> --- >>>>>>>>>>>> >>>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>>>> Google Groups "datameet" group. >>>>>>>>>>>> To unsubscribe from this group and stop receiving emails from >>>>>>>>>>>> it, send an email to [email protected]. >>>>>>>>>>>> To view this discussion on the web visit >>>>>>>>>>>> https://groups.google.com/d/msgid/datameet/acaa6132-235a-4535-8104-945673c2c771n%40googlegroups.com >>>>>>>>>>>> >>>>>>>>>>>> <https://groups.google.com/d/msgid/datameet/acaa6132-235a-4535-8104-945673c2c771n%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>>>>>>>>> . >>>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>> Datameet is a community of Data Science enthusiasts in India. >>>>>>>>>> Know more about us by visiting http://datameet.org >>>>>>>>>> --- >>>>>>>>>> You received this message because you are subscribed to the >>>>>>>>>> Google Groups "datameet" group. >>>>>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>>>>> send an email to [email protected]. >>>>>>>>>> >>>>>>>>> To view this discussion on the web visit >>>>>>>>>> https://groups.google.com/d/msgid/datameet/51100090-e1bd-4311-85a3-15603375ca70n%40googlegroups.com >>>>>>>>>> >>>>>>>>>> <https://groups.google.com/d/msgid/datameet/51100090-e1bd-4311-85a3-15603375ca70n%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>>>>>>> . >>>>>>>>>> >>>>>>>>> -- >>>>>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>>>>> more about us by visiting http://datameet.org >>>>>>>> --- >>>>>>>> You received this message because you are subscribed to the Google >>>>>>>> Groups "datameet" group. >>>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>>> send an email to [email protected]. >>>>>>>> >>>>>>> To view this discussion on the web visit >>>>>>>> https://groups.google.com/d/msgid/datameet/a52b4f68-ca6e-4496-8480-4e5b97d93a05n%40googlegroups.com >>>>>>>> >>>>>>>> <https://groups.google.com/d/msgid/datameet/a52b4f68-ca6e-4496-8480-4e5b97d93a05n%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>>>>> . >>>>>>>> >>>>>>> -- >>>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>>> more about us by visiting http://datameet.org >>>>>> --- >>>>>> You received this message because you are subscribed to the Google >>>>>> Groups "datameet" group. >>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>> send an email to [email protected]. >>>>>> >>>>> To view this discussion on the web visit >>>>>> https://groups.google.com/d/msgid/datameet/d0a158d5-8c89-448e-9e82-6d5a3935dd79n%40googlegroups.com >>>>>> >>>>>> <https://groups.google.com/d/msgid/datameet/d0a158d5-8c89-448e-9e82-6d5a3935dd79n%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>>> . >>>>>> >>>>> -- >>>> Datameet is a community of Data Science enthusiasts in India. Know more >>>> about us by visiting http://datameet.org >>>> --- >>>> You received this message because you are subscribed to the Google >>>> Groups "datameet" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to [email protected]. >>>> To view this discussion visit >>>> https://groups.google.com/d/msgid/datameet/1008d60b-c2ce-4ad4-8c2b-e209b86576ben%40googlegroups.com >>>> >>>> <https://groups.google.com/d/msgid/datameet/1008d60b-c2ce-4ad4-8c2b-e209b86576ben%40googlegroups.com?utm_medium=email&utm_source=footer> >>>> . >>>> >>> -- >>> Datameet is a community of Data Science enthusiasts in India. Know more >>> about us by visiting http://datameet.org >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "datameet" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected]. >>> To view this discussion visit >>> https://groups.google.com/d/msgid/datameet/CAGiG-AxZOGq_j1ti5jm0omKH76_jArqCVAfvttorKHCCAXOzrQ%40mail.gmail.com >>> >>> <https://groups.google.com/d/msgid/datameet/CAGiG-AxZOGq_j1ti5jm0omKH76_jArqCVAfvttorKHCCAXOzrQ%40mail.gmail.com?utm_medium=email&utm_source=footer> >>> . >>> >> -- >> Datameet is a community of Data Science enthusiasts in India. Know more >> about us by visiting http://datameet.org >> --- >> You received this message because you are subscribed to a topic in the >> Google Groups "datameet" group. >> To unsubscribe from this topic, visit >> https://groups.google.com/d/topic/datameet/WcgiHq0trBc/unsubscribe. >> To unsubscribe from this group and all its topics, send an email to >> [email protected]. >> To view this discussion visit >> https://groups.google.com/d/msgid/datameet/CAH9LZCVkD5PgAF4uhFsEh8JLkk1cY%2B%2B0VV8vT8UPH%2BOJo%3DFhGg%40mail.gmail.com >> >> <https://groups.google.com/d/msgid/datameet/CAH9LZCVkD5PgAF4uhFsEh8JLkk1cY%2B%2B0VV8vT8UPH%2BOJo%3DFhGg%40mail.gmail.com?utm_medium=email&utm_source=footer> >> . >> >> >> > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion visit https://groups.google.com/d/msgid/datameet/69cd0a66-c431-469d-9764-22bf55792013n%40googlegroups.com.
