Re: [datameet] Re: Looking for list of census village names for CG and MP in Devanagari

[Pradeep Vanga]

That makes sense Vivek.

On Monday, February 13, 2023 at 8:15:17 AM UTC+5:30 Vivek Matthew wrote:

> Hi Pradeep,
>
> The 12k that you're seeing on GitHub seems to be a limitation with the 
> number of lines of a single gist that can render on the web interface. The 
> raw CSV file when downloaded should contain the 22k+ lines you're looking 
> for: 
> https://gist.githubusercontent.com/Vonter/dde3c47dfd3ca11e678cea61821aa099/raw/ba6b45cfcd8f1e7f17ef038ac1a08a70410630e0/villages.csv
>
> Regards,
> Vivek
>
> On Monday, 13 February 2023 at 03:08:09 UTC+5:30 Pradeep Vanga wrote:
>
>> Hi Vivek, it looks like the csv file contains only about 12k+ entries.
>>
>> (It looks like I replied to the author and not this thread earlier, I 
>> have also scraped the data and uploaded it here :)  
>> https://www.kaggle.com/datasets/vangap/madhya-pradesh-village-list )
>
>
>>
>> On Monday, February 6, 2023 at 9:49:48 PM UTC+5:30 Vivek Matthew wrote:
>>
> Hi Sharad,
>>>
>>> Nice catch regarding the switch to Hindi. The choice of English/Hindi 
>>> names returned by the server is based on the cookie sent with the request.
>>>
>>> I've scraped the village list and put it as a CSV and JSON here: 
>>> https://gist.github.com/Vonter/dde3c47dfd3ca11e678cea61821aa099
>>>
>>> There are 23170 villages in there, but based on my count it looks like 
>>> there's about a dozen of them without Devanagiri names.
>>>
>>> On Saturday, 4 February 2023 at 11:01:58 UTC+5:30 shara...@gmail.com 
>>> wrote:
>>>
 [image: mndagofkncnplmoa.png]
 But btw, there is an option on the main PRD website to switch to Hindi, 
 and when I do that, then when I go searching for specific Gram Panchayats, 
 I do get this search menu, which suggests that at the backend somewhere 
 the 
 Hindi lists also exist? Any ideas? 
 On Saturday, February 4, 2023 at 10:32:59 AM UTC+5:30 Sharad Lele wrote:

> Dear Nikhil,
>
> Thanks for your help and yes, I assumed (incorrectly) that if the 
> menus are in Hindi then the data will also be in Hindi/Devanagari! 
> Unfortunately, as you pointed, out, the data are still in English/Roman 
> script. 
>
> Which means I have to expand my request: any one who can find a 
> website that has village name lists in Hindi/Devanagari (for MP in 
> particular), please flag. If someone has the data already in Devanagari, 
> great!
>
> Sreeram pointed out that the list on the govt of India's LGDIR website 
> has devanagari names for some states, but in the case of MP, the column 
> for 
> names in Devanagari is very sporadically filled!
>
> Sharad
>
> On 04-Feb-23 10:11, Nikhil VJ wrote:
>
> Hi Sharad, 
>
> The site you linked is quite easy to scrape with basic GET api calls 
> (aka you can open the url in browser also) giving the data in a proper 
> structure that can be directly used by a program.
>
> *But : the data is all in English only.*
>
> Anyways, in case you want to scrape, can get someone to do using:
>
> Districts list:
> https://www.prd.mp.gov.in/Handlers/Districts.ashx?DivisionID=0
>
> Take district ID from there to get local bodies list:
> https://www.prd.mp.gov.in/Handlers/localbodies.ashx?DistrictID=*45*
> _Rural=1
>
> Take "LBID" from there to get GP Zones:
> https://www.prd.mp.gov.in/Handlers/GpZones.ashx?LbId=*24319*
>
>
> Note to freshers in python coding who are looking for real world use 
> cases to learn and apply their skills: This is a good starting project. 
> Make 3 nested for loops and append all the results to a dict (json) 
> array. At end, convert to a pandas dataframe, and output to CSV.
> https://www.prd.mp.gov.in/Handlers/Districts.ashx?DivisionID=0
> --
> Cheers,
> Nikhil VJ
> https://nikhilvj.co.in
>
>
> On Fri, Feb 3, 2023 at 12:10 AM Sharad Lele  
> wrote:
>
>> For instance, if someone can scrape the names from this website: 
>> https://www.prd.mp.gov.in/GramSearch/SearchPanchayat.aspx  
>> (sequentially, so as to get the district, block and GP tags also)
>>
>> On Thursday, February 2, 2023 at 9:47:01 PM UTC+5:30 Sharad Lele 
>> wrote:
>>
>>> I am looking for the census village list for Chhattisgarh and Madhya 
>>> Pradesh (for starters) in Devanagari (Hindi script). Preferably with 
>>> Census 
>>> 2011 codes, so that I can quickly match them to the Census dataset, 
>>> which 
>>> is in English. But even if no codes attached, an accurate list with 
>>> tehsil/block and district tags in digital format (not pdf hopefully) 
>>> will 
>>> be a big help.
>>>
>>> Any suggestions, folks?
>>>
>>> Sharad
>>>
>> -- 
>> Datameet is a community of Data Science enthusiasts in India. Know 
>> more about us by visiting http://datameet.org
>> --- 
>> You received this 

Re: [datameet] Re: Looking for list of census village names for CG and MP in Devanagari

[Vivek Matthew]

Hi Pradeep,

The 12k that you're seeing on GitHub seems to be a limitation with the 
number of lines of a single gist that can render on the web interface. The 
raw CSV file when downloaded should contain the 22k+ lines you're looking 
for: 
https://gist.githubusercontent.com/Vonter/dde3c47dfd3ca11e678cea61821aa099/raw/ba6b45cfcd8f1e7f17ef038ac1a08a70410630e0/villages.csv

Regards,
Vivek

On Monday, 13 February 2023 at 03:08:09 UTC+5:30 Pradeep Vanga wrote:

> Hi Vivek, it looks like the csv file contains only about 12k+ entries.
>
> (It looks like I replied to the author and not this thread earlier, I have 
> also scraped the data and uploaded it here :)  
> https://www.kaggle.com/datasets/vangap/madhya-pradesh-village-list )
>
> On Monday, February 6, 2023 at 9:49:48 PM UTC+5:30 Vivek Matthew wrote:
>
>> Hi Sharad,
>>
>> Nice catch regarding the switch to Hindi. The choice of English/Hindi 
>> names returned by the server is based on the cookie sent with the request.
>>
>> I've scraped the village list and put it as a CSV and JSON here: 
>> https://gist.github.com/Vonter/dde3c47dfd3ca11e678cea61821aa099
>>
>> There are 23170 villages in there, but based on my count it looks like 
>> there's about a dozen of them without Devanagiri names.
>>
>> On Saturday, 4 February 2023 at 11:01:58 UTC+5:30 shara...@gmail.com 
>> wrote:
>>
>>> [image: mndagofkncnplmoa.png]
>>> But btw, there is an option on the main PRD website to switch to Hindi, 
>>> and when I do that, then when I go searching for specific Gram Panchayats, 
>>> I do get this search menu, which suggests that at the backend somewhere the 
>>> Hindi lists also exist? Any ideas? 
>>> On Saturday, February 4, 2023 at 10:32:59 AM UTC+5:30 Sharad Lele wrote:
>>>
 Dear Nikhil,

 Thanks for your help and yes, I assumed (incorrectly) that if the menus 
 are in Hindi then the data will also be in Hindi/Devanagari! 
 Unfortunately, 
 as you pointed, out, the data are still in English/Roman script. 

 Which means I have to expand my request: any one who can find a website 
 that has village name lists in Hindi/Devanagari (for MP in particular), 
 please flag. If someone has the data already in Devanagari, great!

 Sreeram pointed out that the list on the govt of India's LGDIR website 
 has devanagari names for some states, but in the case of MP, the column 
 for 
 names in Devanagari is very sporadically filled!

 Sharad

 On 04-Feb-23 10:11, Nikhil VJ wrote:

 Hi Sharad, 

 The site you linked is quite easy to scrape with basic GET api calls 
 (aka you can open the url in browser also) giving the data in a proper 
 structure that can be directly used by a program.

 *But : the data is all in English only.*

 Anyways, in case you want to scrape, can get someone to do using:

 Districts list:
 https://www.prd.mp.gov.in/Handlers/Districts.ashx?DivisionID=0

 Take district ID from there to get local bodies list:
 https://www.prd.mp.gov.in/Handlers/localbodies.ashx?DistrictID=*45*
 _Rural=1

 Take "LBID" from there to get GP Zones:
 https://www.prd.mp.gov.in/Handlers/GpZones.ashx?LbId=*24319*


 Note to freshers in python coding who are looking for real world use 
 cases to learn and apply their skills: This is a good starting project. 
 Make 3 nested for loops and append all the results to a dict (json) 
 array. At end, convert to a pandas dataframe, and output to CSV.
 https://www.prd.mp.gov.in/Handlers/Districts.ashx?DivisionID=0
 --
 Cheers,
 Nikhil VJ
 https://nikhilvj.co.in


 On Fri, Feb 3, 2023 at 12:10 AM Sharad Lele  wrote:

> For instance, if someone can scrape the names from this website: 
> https://www.prd.mp.gov.in/GramSearch/SearchPanchayat.aspx  
> (sequentially, so as to get the district, block and GP tags also)
>
> On Thursday, February 2, 2023 at 9:47:01 PM UTC+5:30 Sharad Lele wrote:
>
>> I am looking for the census village list for Chhattisgarh and Madhya 
>> Pradesh (for starters) in Devanagari (Hindi script). Preferably with 
>> Census 
>> 2011 codes, so that I can quickly match them to the Census dataset, 
>> which 
>> is in English. But even if no codes attached, an accurate list with 
>> tehsil/block and district tags in digital format (not pdf hopefully) 
>> will 
>> be a big help.
>>
>> Any suggestions, folks?
>>
>> Sharad
>>
> -- 
> Datameet is a community of Data Science enthusiasts in India. Know 
> more about us by visiting http://datameet.org
> --- 
> You received this message because you are subscribed to the Google 
> Groups "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send 
> an email to datameet+u...@googlegroups.com.
> To view this discussion on the web visit 

Re: [datameet] Re: Looking for list of census village names for CG and MP in Devanagari

[Pradeep Vanga]

Hi Vivek, it looks like the csv file contains only about 12k+ entries.

(It looks like I replied to the author and not this thread earlier, I have 
also scraped the data and uploaded it here :)  
https://www.kaggle.com/datasets/vangap/madhya-pradesh-village-list )

On Monday, February 6, 2023 at 9:49:48 PM UTC+5:30 Vivek Matthew wrote:

> Hi Sharad,
>
> Nice catch regarding the switch to Hindi. The choice of English/Hindi 
> names returned by the server is based on the cookie sent with the request.
>
> I've scraped the village list and put it as a CSV and JSON here: 
> https://gist.github.com/Vonter/dde3c47dfd3ca11e678cea61821aa099
>
> There are 23170 villages in there, but based on my count it looks like 
> there's about a dozen of them without Devanagiri names.
>
> On Saturday, 4 February 2023 at 11:01:58 UTC+5:30 shara...@gmail.com 
> wrote:
>
>> [image: mndagofkncnplmoa.png]
>> But btw, there is an option on the main PRD website to switch to Hindi, 
>> and when I do that, then when I go searching for specific Gram Panchayats, 
>> I do get this search menu, which suggests that at the backend somewhere the 
>> Hindi lists also exist? Any ideas? 
>> On Saturday, February 4, 2023 at 10:32:59 AM UTC+5:30 Sharad Lele wrote:
>>
>>> Dear Nikhil,
>>>
>>> Thanks for your help and yes, I assumed (incorrectly) that if the menus 
>>> are in Hindi then the data will also be in Hindi/Devanagari! Unfortunately, 
>>> as you pointed, out, the data are still in English/Roman script. 
>>>
>>> Which means I have to expand my request: any one who can find a website 
>>> that has village name lists in Hindi/Devanagari (for MP in particular), 
>>> please flag. If someone has the data already in Devanagari, great!
>>>
>>> Sreeram pointed out that the list on the govt of India's LGDIR website 
>>> has devanagari names for some states, but in the case of MP, the column for 
>>> names in Devanagari is very sporadically filled!
>>>
>>> Sharad
>>>
>>> On 04-Feb-23 10:11, Nikhil VJ wrote:
>>>
>>> Hi Sharad, 
>>>
>>> The site you linked is quite easy to scrape with basic GET api calls 
>>> (aka you can open the url in browser also) giving the data in a proper 
>>> structure that can be directly used by a program.
>>>
>>> *But : the data is all in English only.*
>>>
>>> Anyways, in case you want to scrape, can get someone to do using:
>>>
>>> Districts list:
>>> https://www.prd.mp.gov.in/Handlers/Districts.ashx?DivisionID=0
>>>
>>> Take district ID from there to get local bodies list:
>>> https://www.prd.mp.gov.in/Handlers/localbodies.ashx?DistrictID=*45*
>>> _Rural=1
>>>
>>> Take "LBID" from there to get GP Zones:
>>> https://www.prd.mp.gov.in/Handlers/GpZones.ashx?LbId=*24319*
>>>
>>>
>>> Note to freshers in python coding who are looking for real world use 
>>> cases to learn and apply their skills: This is a good starting project. 
>>> Make 3 nested for loops and append all the results to a dict (json) 
>>> array. At end, convert to a pandas dataframe, and output to CSV.
>>> https://www.prd.mp.gov.in/Handlers/Districts.ashx?DivisionID=0
>>> --
>>> Cheers,
>>> Nikhil VJ
>>> https://nikhilvj.co.in
>>>
>>>
>>> On Fri, Feb 3, 2023 at 12:10 AM Sharad Lele  wrote:
>>>
 For instance, if someone can scrape the names from this website: 
 https://www.prd.mp.gov.in/GramSearch/SearchPanchayat.aspx  
 (sequentially, so as to get the district, block and GP tags also)

 On Thursday, February 2, 2023 at 9:47:01 PM UTC+5:30 Sharad Lele wrote:

> I am looking for the census village list for Chhattisgarh and Madhya 
> Pradesh (for starters) in Devanagari (Hindi script). Preferably with 
> Census 
> 2011 codes, so that I can quickly match them to the Census dataset, which 
> is in English. But even if no codes attached, an accurate list with 
> tehsil/block and district tags in digital format (not pdf hopefully) will 
> be a big help.
>
> Any suggestions, folks?
>
> Sharad
>
 -- 
 Datameet is a community of Data Science enthusiasts in India. Know more 
 about us by visiting http://datameet.org
 --- 
 You received this message because you are subscribed to the Google 
 Groups "datameet" group.
 To unsubscribe from this group and stop receiving emails from it, send 
 an email to datameet+u...@googlegroups.com.
 To view this discussion on the web visit 
 https://groups.google.com/d/msgid/datameet/4c644c88-1d3b-4e71-81a2-2e48d6c794c3n%40googlegroups.com
  
 
 .

>>> -- 
>>> Datameet is a community of Data Science enthusiasts in India. Know more 
>>> about us by visiting http://datameet.org
>>> --- 
>>>
>>> You received this message because you are subscribed to a topic in the 
>>> Google Groups "datameet" group.
>>> To unsubscribe from this topic, visit 
>>> 

Re: [datameet] Re: Looking for list of census village names for CG and MP in Devanagari

[Pradeep Vanga]

(Looks like I replied to the author earlier, instead of replying in the 
thread)

I have also scraped this data a few days back btw 
https://www.kaggle.com/datasets/vangap/madhya-pradesh-village-list

Vivek, it looks like the CSV file in the gist contains only 12k entries 
while there should be around 22k+ I think?


On Monday, February 6, 2023 at 9:49:48 PM UTC+5:30 Vivek Matthew wrote:

> Hi Sharad,
>
> Nice catch regarding the switch to Hindi. The choice of English/Hindi 
> names returned by the server is based on the cookie sent with the request.
>
> I've scraped the village list and put it as a CSV and JSON here: 
> https://gist.github.com/Vonter/dde3c47dfd3ca11e678cea61821aa099
>
> There are 23170 villages in there, but based on my count it looks like 
> there's about a dozen of them without Devanagiri names.
>
> On Saturday, 4 February 2023 at 11:01:58 UTC+5:30 shara...@gmail.com 
> wrote:
>
>> [image: mndagofkncnplmoa.png]
>> But btw, there is an option on the main PRD website to switch to Hindi, 
>> and when I do that, then when I go searching for specific Gram Panchayats, 
>> I do get this search menu, which suggests that at the backend somewhere the 
>> Hindi lists also exist? Any ideas? 
>> On Saturday, February 4, 2023 at 10:32:59 AM UTC+5:30 Sharad Lele wrote:
>>
>>> Dear Nikhil,
>>>
>>> Thanks for your help and yes, I assumed (incorrectly) that if the menus 
>>> are in Hindi then the data will also be in Hindi/Devanagari! Unfortunately, 
>>> as you pointed, out, the data are still in English/Roman script. 
>>>
>>> Which means I have to expand my request: any one who can find a website 
>>> that has village name lists in Hindi/Devanagari (for MP in particular), 
>>> please flag. If someone has the data already in Devanagari, great!
>>>
>>> Sreeram pointed out that the list on the govt of India's LGDIR website 
>>> has devanagari names for some states, but in the case of MP, the column for 
>>> names in Devanagari is very sporadically filled!
>>>
>>> Sharad
>>>
>>> On 04-Feb-23 10:11, Nikhil VJ wrote:
>>>
>>> Hi Sharad, 
>>>
>>> The site you linked is quite easy to scrape with basic GET api calls 
>>> (aka you can open the url in browser also) giving the data in a proper 
>>> structure that can be directly used by a program.
>>>
>>> *But : the data is all in English only.*
>>>
>>> Anyways, in case you want to scrape, can get someone to do using:
>>>
>>> Districts list:
>>> https://www.prd.mp.gov.in/Handlers/Districts.ashx?DivisionID=0
>>>
>>> Take district ID from there to get local bodies list:
>>> https://www.prd.mp.gov.in/Handlers/localbodies.ashx?DistrictID=*45*
>>> _Rural=1
>>>
>>> Take "LBID" from there to get GP Zones:
>>> https://www.prd.mp.gov.in/Handlers/GpZones.ashx?LbId=*24319*
>>>
>>>
>>> Note to freshers in python coding who are looking for real world use 
>>> cases to learn and apply their skills: This is a good starting project. 
>>> Make 3 nested for loops and append all the results to a dict (json) 
>>> array. At end, convert to a pandas dataframe, and output to CSV.
>>> https://www.prd.mp.gov.in/Handlers/Districts.ashx?DivisionID=0
>>> --
>>> Cheers,
>>> Nikhil VJ
>>> https://nikhilvj.co.in
>>>
>>>
>>> On Fri, Feb 3, 2023 at 12:10 AM Sharad Lele  wrote:
>>>
 For instance, if someone can scrape the names from this website: 
 https://www.prd.mp.gov.in/GramSearch/SearchPanchayat.aspx  
 (sequentially, so as to get the district, block and GP tags also)

 On Thursday, February 2, 2023 at 9:47:01 PM UTC+5:30 Sharad Lele wrote:

> I am looking for the census village list for Chhattisgarh and Madhya 
> Pradesh (for starters) in Devanagari (Hindi script). Preferably with 
> Census 
> 2011 codes, so that I can quickly match them to the Census dataset, which 
> is in English. But even if no codes attached, an accurate list with 
> tehsil/block and district tags in digital format (not pdf hopefully) will 
> be a big help.
>
> Any suggestions, folks?
>
> Sharad
>
 -- 
 Datameet is a community of Data Science enthusiasts in India. Know more 
 about us by visiting http://datameet.org
 --- 
 You received this message because you are subscribed to the Google 
 Groups "datameet" group.
 To unsubscribe from this group and stop receiving emails from it, send 
 an email to datameet+u...@googlegroups.com.
 To view this discussion on the web visit 
 https://groups.google.com/d/msgid/datameet/4c644c88-1d3b-4e71-81a2-2e48d6c794c3n%40googlegroups.com
  
 
 .

>>> -- 
>>> Datameet is a community of Data Science enthusiasts in India. Know more 
>>> about us by visiting http://datameet.org
>>> --- 
>>>
>>> You received this message because you are subscribed to a topic in the 
>>> Google Groups "datameet" group.
>>> To unsubscribe from this topic, 

Re: [datameet] Re: Looking for list of census village names for CG and MP in Devanagari

[Vivek Matthew]

Hi Sharad,

Nice catch regarding the switch to Hindi. The choice of English/Hindi names 
returned by the server is based on the cookie sent with the request.

I've scraped the village list and put it as a CSV and JSON 
here: https://gist.github.com/Vonter/dde3c47dfd3ca11e678cea61821aa099

There are 23170 villages in there, but based on my count it looks like 
there's about a dozen of them without Devanagiri names.

On Saturday, 4 February 2023 at 11:01:58 UTC+5:30 shara...@gmail.com wrote:

> [image: mndagofkncnplmoa.png]
> But btw, there is an option on the main PRD website to switch to Hindi, 
> and when I do that, then when I go searching for specific Gram Panchayats, 
> I do get this search menu, which suggests that at the backend somewhere the 
> Hindi lists also exist? Any ideas? 
> On Saturday, February 4, 2023 at 10:32:59 AM UTC+5:30 Sharad Lele wrote:
>
>> Dear Nikhil,
>>
>> Thanks for your help and yes, I assumed (incorrectly) that if the menus 
>> are in Hindi then the data will also be in Hindi/Devanagari! Unfortunately, 
>> as you pointed, out, the data are still in English/Roman script. 
>>
>> Which means I have to expand my request: any one who can find a website 
>> that has village name lists in Hindi/Devanagari (for MP in particular), 
>> please flag. If someone has the data already in Devanagari, great!
>>
>> Sreeram pointed out that the list on the govt of India's LGDIR website 
>> has devanagari names for some states, but in the case of MP, the column for 
>> names in Devanagari is very sporadically filled!
>>
>> Sharad
>>
>> On 04-Feb-23 10:11, Nikhil VJ wrote:
>>
>> Hi Sharad, 
>>
>> The site you linked is quite easy to scrape with basic GET api calls (aka 
>> you can open the url in browser also) giving the data in a proper structure 
>> that can be directly used by a program.
>>
>> *But : the data is all in English only.*
>>
>> Anyways, in case you want to scrape, can get someone to do using:
>>
>> Districts list:
>> https://www.prd.mp.gov.in/Handlers/Districts.ashx?DivisionID=0
>>
>> Take district ID from there to get local bodies list:
>> https://www.prd.mp.gov.in/Handlers/localbodies.ashx?DistrictID=*45*
>> _Rural=1
>>
>> Take "LBID" from there to get GP Zones:
>> https://www.prd.mp.gov.in/Handlers/GpZones.ashx?LbId=*24319*
>>
>>
>> Note to freshers in python coding who are looking for real world use 
>> cases to learn and apply their skills: This is a good starting project. 
>> Make 3 nested for loops and append all the results to a dict (json) 
>> array. At end, convert to a pandas dataframe, and output to CSV.
>> https://www.prd.mp.gov.in/Handlers/Districts.ashx?DivisionID=0
>> --
>> Cheers,
>> Nikhil VJ
>> https://nikhilvj.co.in
>>
>>
>> On Fri, Feb 3, 2023 at 12:10 AM Sharad Lele  wrote:
>>
>>> For instance, if someone can scrape the names from this website: 
>>> https://www.prd.mp.gov.in/GramSearch/SearchPanchayat.aspx  
>>> (sequentially, so as to get the district, block and GP tags also)
>>>
>>> On Thursday, February 2, 2023 at 9:47:01 PM UTC+5:30 Sharad Lele wrote:
>>>
 I am looking for the census village list for Chhattisgarh and Madhya 
 Pradesh (for starters) in Devanagari (Hindi script). Preferably with 
 Census 
 2011 codes, so that I can quickly match them to the Census dataset, which 
 is in English. But even if no codes attached, an accurate list with 
 tehsil/block and district tags in digital format (not pdf hopefully) will 
 be a big help.

 Any suggestions, folks?

 Sharad

>>> -- 
>>> Datameet is a community of Data Science enthusiasts in India. Know more 
>>> about us by visiting http://datameet.org
>>> --- 
>>> You received this message because you are subscribed to the Google 
>>> Groups "datameet" group.
>>> To unsubscribe from this group and stop receiving emails from it, send 
>>> an email to datameet+u...@googlegroups.com.
>>> To view this discussion on the web visit 
>>> https://groups.google.com/d/msgid/datameet/4c644c88-1d3b-4e71-81a2-2e48d6c794c3n%40googlegroups.com
>>>  
>>> 
>>> .
>>>
>> -- 
>> Datameet is a community of Data Science enthusiasts in India. Know more 
>> about us by visiting http://datameet.org
>> --- 
>>
>> You received this message because you are subscribed to a topic in the 
>> Google Groups "datameet" group.
>> To unsubscribe from this topic, visit 
>> https://groups.google.com/d/topic/datameet/x2kTZlgPeb4/unsubscribe.
>> To unsubscribe from this group and all its topics, send an email to 
>> datameet+u...@googlegroups.com.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/datameet/CAH7jeuMKboJCh71j%2Bncfbg%3DSbjpxjUVW4gWHk59VZ-2SKnN_7w%40mail.gmail.com
>>  
>> 
>> .
>>

Re: [datameet] Re: Looking for list of census village names for CG and MP in Devanagari

[Sharad Lele]

[image: mndagofkncnplmoa.png]
But btw, there is an option on the main PRD website to switch to Hindi, and 
when I do that, then when I go searching for specific Gram Panchayats, I do 
get this search menu, which suggests that at the backend somewhere the 
Hindi lists also exist? Any ideas? 
On Saturday, February 4, 2023 at 10:32:59 AM UTC+5:30 Sharad Lele wrote:

> Dear Nikhil,
>
> Thanks for your help and yes, I assumed (incorrectly) that if the menus 
> are in Hindi then the data will also be in Hindi/Devanagari! Unfortunately, 
> as you pointed, out, the data are still in English/Roman script. 
>
> Which means I have to expand my request: any one who can find a website 
> that has village name lists in Hindi/Devanagari (for MP in particular), 
> please flag. If someone has the data already in Devanagari, great!
>
> Sreeram pointed out that the list on the govt of India's LGDIR website has 
> devanagari names for some states, but in the case of MP, the column for 
> names in Devanagari is very sporadically filled!
>
> Sharad
>
> On 04-Feb-23 10:11, Nikhil VJ wrote:
>
> Hi Sharad, 
>
> The site you linked is quite easy to scrape with basic GET api calls (aka 
> you can open the url in browser also) giving the data in a proper structure 
> that can be directly used by a program.
>
> *But : the data is all in English only.*
>
> Anyways, in case you want to scrape, can get someone to do using:
>
> Districts list:
> https://www.prd.mp.gov.in/Handlers/Districts.ashx?DivisionID=0
>
> Take district ID from there to get local bodies list:
> https://www.prd.mp.gov.in/Handlers/localbodies.ashx?DistrictID=*45*
> _Rural=1
>
> Take "LBID" from there to get GP Zones:
> https://www.prd.mp.gov.in/Handlers/GpZones.ashx?LbId=*24319*
>
>
> Note to freshers in python coding who are looking for real world use cases 
> to learn and apply their skills: This is a good starting project. 
> Make 3 nested for loops and append all the results to a dict (json) array. 
> At end, convert to a pandas dataframe, and output to CSV.
> https://www.prd.mp.gov.in/Handlers/Districts.ashx?DivisionID=0
> --
> Cheers,
> Nikhil VJ
> https://nikhilvj.co.in
>
>
> On Fri, Feb 3, 2023 at 12:10 AM Sharad Lele  wrote:
>
>> For instance, if someone can scrape the names from this website: 
>> https://www.prd.mp.gov.in/GramSearch/SearchPanchayat.aspx  
>> (sequentially, so as to get the district, block and GP tags also)
>>
>> On Thursday, February 2, 2023 at 9:47:01 PM UTC+5:30 Sharad Lele wrote:
>>
>>> I am looking for the census village list for Chhattisgarh and Madhya 
>>> Pradesh (for starters) in Devanagari (Hindi script). Preferably with Census 
>>> 2011 codes, so that I can quickly match them to the Census dataset, which 
>>> is in English. But even if no codes attached, an accurate list with 
>>> tehsil/block and district tags in digital format (not pdf hopefully) will 
>>> be a big help.
>>>
>>> Any suggestions, folks?
>>>
>>> Sharad
>>>
>> -- 
>> Datameet is a community of Data Science enthusiasts in India. Know more 
>> about us by visiting http://datameet.org
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to datameet+u...@googlegroups.com.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/datameet/4c644c88-1d3b-4e71-81a2-2e48d6c794c3n%40googlegroups.com
>>  
>> 
>> .
>>
> -- 
> Datameet is a community of Data Science enthusiasts in India. Know more 
> about us by visiting http://datameet.org
> --- 
>
> You received this message because you are subscribed to a topic in the 
> Google Groups "datameet" group.
> To unsubscribe from this topic, visit 
> https://groups.google.com/d/topic/datameet/x2kTZlgPeb4/unsubscribe.
> To unsubscribe from this group and all its topics, send an email to 
> datameet+u...@googlegroups.com.
> To view this discussion on the web visit 
> https://groups.google.com/d/msgid/datameet/CAH7jeuMKboJCh71j%2Bncfbg%3DSbjpxjUVW4gWHk59VZ-2SKnN_7w%40mail.gmail.com
>  
> 
> .
>
>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/dc5434e4-af5c-4882-81ed-eff09cabb4d1n%40googlegroups.com.

Re: [datameet] Re: Looking for list of census village names for CG and MP in Devanagari

[शरच्चंद्र लेले]

Dear Nikhil,

Thanks for your help and yes, I assumed (incorrectly) that if the menus 
are in Hindi then the data will also be in Hindi/Devanagari! 
Unfortunately, as you pointed, out, the data are still in English/Roman 
script.


Which means I have to expand my request: any one who can find a website 
that has village name lists in Hindi/Devanagari (for MP in particular), 
please flag. If someone has the data already in Devanagari, great!


Sreeram pointed out that the list on the govt of India's LGDIR website 
has devanagari names for some states, but in the case of MP, the column 
for names in Devanagari is very sporadically filled!


Sharad


On 04-Feb-23 10:11, Nikhil VJ wrote:

Hi Sharad,

The site you linked is quite easy to scrape with basic GET api calls 
(aka you can open the url in browser also) giving the data in a proper 
structure that can be directly used by a program.


*But : the data is all in English only.*

Anyways, in case you want to scrape, can get someone to do using:

Districts list:
https://www.prd.mp.gov.in/Handlers/Districts.ashx?DivisionID=0

Take district ID from there to get local bodies list:
https://www.prd.mp.gov.in/Handlers/localbodies.ashx?DistrictID=*45*_Rural=1

Take "LBID" from there to get GP Zones:
https://www.prd.mp.gov.in/Handlers/GpZones.ashx?LbId=*24319*


Note to freshers in python coding who are looking for real world use 
cases to learn and apply their skills: This is a good starting project.
Make 3 nested for loops and append all the results to a dict (json) 
array. At end, convert to a pandas dataframe, and output to CSV.

https://www.prd.mp.gov.in/Handlers/Districts.ashx?DivisionID=0
--
Cheers,
Nikhil VJ
https://nikhilvj.co.in


On Fri, Feb 3, 2023 at 12:10 AM Sharad Lele > wrote:


For instance, if someone can scrape the names from this website:
https://www.prd.mp.gov.in/GramSearch/SearchPanchayat.aspx
(sequentially, so as to get the district, block and GP tags also)

On Thursday, February 2, 2023 at 9:47:01 PM UTC+5:30 Sharad Lele
wrote:

I am looking for the census village list for Chhattisgarh and
Madhya Pradesh (for starters) in Devanagari (Hindi script).
Preferably with Census 2011 codes, so that I can quickly match
them to the Census dataset, which is in English. But even if
no codes attached, an accurate list with tehsil/block and
district tags in digital format (not pdf hopefully) will be a
big help.

Any suggestions, folks?

Sharad

-- 
Datameet is a community of Data Science enthusiasts in India. Know

more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google
Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it,
send an email to datameet+unsubscr...@googlegroups.com
.
To view this discussion on the web visit

https://groups.google.com/d/msgid/datameet/4c644c88-1d3b-4e71-81a2-2e48d6c794c3n%40googlegroups.com

.

--
Datameet is a community of Data Science enthusiasts in India. Know 
more about us by visiting http://datameet.org

---
You received this message because you are subscribed to a topic in the 
Google Groups "datameet" group.
To unsubscribe from this topic, visit 
https://groups.google.com/d/topic/datameet/x2kTZlgPeb4/unsubscribe.
To unsubscribe from this group and all its topics, send an email to 
datameet+unsubscr...@googlegroups.com 
.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAH7jeuMKboJCh71j%2Bncfbg%3DSbjpxjUVW4gWHk59VZ-2SKnN_7w%40mail.gmail.com 
.


--
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups "datameet" group.

To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/00cf56fe-bdc3-ba94-41d1-9c0052f39ffb%40gmail.com.

Re: [datameet] Re: Looking for list of census village names for CG and MP in Devanagari

[Nikhil VJ]

Hi Sharad,

The site you linked is quite easy to scrape with basic GET api calls (aka
you can open the url in browser also) giving the data in a proper structure
that can be directly used by a program.

*But : the data is all in English only.*

Anyways, in case you want to scrape, can get someone to do using:

Districts list:
https://www.prd.mp.gov.in/Handlers/Districts.ashx?DivisionID=0

Take district ID from there to get local bodies list:
https://www.prd.mp.gov.in/Handlers/localbodies.ashx?DistrictID=*45*
_Rural=1

Take "LBID" from there to get GP Zones:
https://www.prd.mp.gov.in/Handlers/GpZones.ashx?LbId=*24319*


Note to freshers in python coding who are looking for real world use cases
to learn and apply their skills: This is a good starting project.
Make 3 nested for loops and append all the results to a dict (json) array.
At end, convert to a pandas dataframe, and output to CSV.
https://www.prd.mp.gov.in/Handlers/Districts.ashx?DivisionID=0
--
Cheers,
Nikhil VJ
https://nikhilvj.co.in


On Fri, Feb 3, 2023 at 12:10 AM Sharad Lele  wrote:

> For instance, if someone can scrape the names from this website:
> https://www.prd.mp.gov.in/GramSearch/SearchPanchayat.aspx  (sequentially,
> so as to get the district, block and GP tags also)
>
> On Thursday, February 2, 2023 at 9:47:01 PM UTC+5:30 Sharad Lele wrote:
>
>> I am looking for the census village list for Chhattisgarh and Madhya
>> Pradesh (for starters) in Devanagari (Hindi script). Preferably with Census
>> 2011 codes, so that I can quickly match them to the Census dataset, which
>> is in English. But even if no codes attached, an accurate list with
>> tehsil/block and district tags in digital format (not pdf hopefully) will
>> be a big help.
>>
>> Any suggestions, folks?
>>
>> Sharad
>>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/4c644c88-1d3b-4e71-81a2-2e48d6c794c3n%40googlegroups.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAH7jeuMKboJCh71j%2Bncfbg%3DSbjpxjUVW4gWHk59VZ-2SKnN_7w%40mail.gmail.com.

[datameet] Re: Looking for list of census village names for CG and MP in Devanagari

[Sharad Lele]

For instance, if someone can scrape the names from this website: 
https://www.prd.mp.gov.in/GramSearch/SearchPanchayat.aspx  (sequentially, 
so as to get the district, block and GP tags also)

On Thursday, February 2, 2023 at 9:47:01 PM UTC+5:30 Sharad Lele wrote:

> I am looking for the census village list for Chhattisgarh and Madhya 
> Pradesh (for starters) in Devanagari (Hindi script). Preferably with Census 
> 2011 codes, so that I can quickly match them to the Census dataset, which 
> is in English. But even if no codes attached, an accurate list with 
> tehsil/block and district tags in digital format (not pdf hopefully) will 
> be a big help.
>
> Any suggestions, folks?
>
> Sharad
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/4c644c88-1d3b-4e71-81a2-2e48d6c794c3n%40googlegroups.com.