Re: [datameet] Developing tool to extract table from images

2021-05-26 Thread Sarath Guttikunda
If you can test on these
daily bulletins to automate tabulation, that will be very helpful.
https://cpcb.nic.in/AQI_Bulletin.php
Sample file attached

With best wishes,
Sarath

--
*Dr. Sarath Guttikunda*

*http://www.urbanemissions.info *


On Wed, May 26, 2021 at 6:58 PM Dilawar Singh 
wrote:

> Dear all,
>
> I am developing a tool to extract a table from an image. It is a big
> undertaking but I hope to release a beta version soon.
>
> The input to the tool is a PNG/JPG/PDF image and output is a CSV/ODT/XLS
> table.
>
> I have some simple tables extracted from PDF. If there are formats which
> govt uses often and people often need/want to digitize them, I'd like to
> have some samples. I am thinking of census data, GIS data etc..
>
> There is no plan to support multi-page tables. I can use some advice on
> the OCR backend (I am using pytesseract from google for now).
>
> best,
> Dilawar
>
> --
> Dilawar Singh, Ph.D.
> LinkedIn  ORCID
>  Github
> 
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CAM72-Zs9PT7CNZONjCUWM3%3D%3DiNDyfhVPg7Yhko1ALJ_Cmp25%2Bw%40mail.gmail.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAAj%2BwWrV_brtZkpkPZFKgTTgcdYKKT%2B_1E7U-CM-bd4qrSfQJw%40mail.gmail.com.


AQI_Bulletin_20210526.pdf
Description: Adobe PDF document


[datameet] Infosec, data security and network security issues with electronic voting

2021-05-26 Thread Zainab Bawa
Hello Datameet members,

This Saturday, former IAS officer, Kannan Gopinathan, will speak about the
ground level issues with EVMs and VVPATs in Indian elections, and data
security issues arising from electronic voting mechanisms interacting with
the electricity grid systems.

Kannan will also comment on the proposal to introduce blockchain in India's
electoral system, and the impact of this proposal on data security, InfoSec
and sovereignty.

*Date:* Saturday, 29 May
*Time:* 4 PM
Participation and live stream -
https://hasgeek.com/kaarana/blockchain-based-voting-systems-and-electoral-democracy/

The Call for Evidence is open. Thus far, in the three master classes, the
following issues have come up:

   1. The role of access and coercion with respect to women's ability to
   participate in elections. How will the introduction of technology in
   elections impact these factors for women's participation in elections?
   2. Marginalized communities such as LGBTQ face challenges with respect
   to inclusion in electoral rolls. How will the proposal to put electoral
   rolls on blockchain change access and democratic processes for LGBTQ
   communities?
   3. Finally, trust and a clear understanding of how the polling process
   and election results process works is the most important factor for
   democratic functioning of elections. When technology is introduced in
   election processes, how much of the changed processes do common people
   understand? How does grievance redressal work with technologically driven
   processes in elections?

If you have worked on any of the above issues in any area of governance and
technology, share your work with the call for evidence at
https://hasgeek.com/kaarana/blockchain-based-voting-systems-and-electoral-democracy/

Regards,

Zainab

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAHLMco3c0k4kwkm1EWgxWB-ukDhKmf1%3DpB2%3Dyonr65S9sw%2Bdww%40mail.gmail.com.


[datameet] Re: Data for Petrol Pumps

2021-05-26 Thread Naveen Francis
Hello Madhur,

Please click on 'Search Overpass Turbo'
https://nsi.guide/index.html?t=brands=amenity=fuel=in

Thanks,
naveenpf
On Thursday, 27 May, 2021 at 3:32:36 am UTC+5:30 gurm...@gmail.com wrote:

> For IOCL Petrol Pumps 
> https://associates.indianoil.co.in/PumpLocator/location.jsp
>
> On Thursday, May 13, 2021 at 3:28:57 PM UTC+5:30 mkukr...@gmail.com wrote:
>
>> I require shapefiles (lat-longs) of the following for my project:
>>
>>- Petrol Pumps
>>- Shopping Malls
>>- Dedicated Parking Lots
>>- Residential Colonies
>>
>>
>> The data is required for India. Can anyone suggest how/ where can I 
>> extract it from.
>>
>> Any help will be really appreciated.
>>
>> Thanks
>>
>> -- 
>> *Madhur Kukreja*
>> *Ph- +91-8719820130 <+91-8719820130>*
>>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/7c15c6da-7ada-4ba8-9cc4-0c9669d53d0en%40googlegroups.com.


Re: [datameet] Extract district wise rainfall prediction data from NWP site

2021-05-26 Thread Dammalapati Sai Krishna
I wrote a Python code that does a similar web crawling -
WebScraping/WebCrawling_MissionAntyodaya.ipynb at master ·
d-saikrishna/WebScraping (github.com)


You could be able to get what you want with minor changes to the code, let
me know if you need any help.

Regards,
Dammalapati Sai Krishna,
www.dsaikrishna.wordpress.com
7981548365


On Thu, May 27, 2021 at 3:32 AM a.ja...@gmail.com 
wrote:

> Hi,
>
> https://nwp.imd.gov.in/blf/blf_temp/
>
> In the link above, we can see the 5 days weather prediction by districts -
> however, there are a lot of clicks that are required to reach any one
> particular district. Please help in identifying a method to collate all
> India Rainfall data in a single table.
>
> Tried to use Octoparse - however, either I am using it incorrectly or else
> it doesn't work in this site. any other source of the same data is also
> welcome.
>
> regards,
> Abhishek
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/00fa6267-9dcd-489a-b579-58be5d62b383n%40googlegroups.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAK0JssaL2O0Gw2j6OoH4Jz1efReTxxXLYAhy3_Ro7nU%3Dg6SZ6g%40mail.gmail.com.


Re: [datameet] Extract district wise rainfall prediction data from NWP site

2021-05-26 Thread Nikhil VJ
Hi Abhishek,

Right-click on page -> Inspect -> opens the browser console -> Go to
Network tab , then browse around the site and check out the comings and
goings between site and server.

I was able to get the data we're seeing in the website coming in my command
prompt (which means: one can capture this) with this simplified cURL
command:
curl 'https://nwp.imd.gov.in/blf/blf_temp/block.php' --compressed
--data-raw 'dis=22AMRAVATI'

How to get these district codes: inspecting one page before..
curl --compressed '
https://nwp.imd.gov.in/blf/blf_temp/dis.php?value=22maharashtra'

How to get the state codes: just scrape from the html of the page you
shared: https://nwp.imd.gov.in/blf/blf_temp/

Before my foray into python, I used to use notepad++ and libreoffice Calc
(their raw text import dialog leaves excel in the dust) to separate out the
data I needed from the html tags etc. I'd use spreadsheet formulas to even
generate command-prompt commands in bulk. Fun times. For limited jobs,
there's things you can do there in a few mins which would take hours of
coding.

Maybe you can set these up in Octoparse (i have no experience with that as
I just roll my own code) or some other tools to get the data you need. All
the best!

--
Cheers,
Nikhil VJ
https://nikhilvj.co.in


On Thu, May 27, 2021 at 3:32 AM a.ja...@gmail.com 
wrote:

> Hi,
>
> https://nwp.imd.gov.in/blf/blf_temp/
>
> In the link above, we can see the 5 days weather prediction by districts -
> however, there are a lot of clicks that are required to reach any one
> particular district. Please help in identifying a method to collate all
> India Rainfall data in a single table.
>
> Tried to use Octoparse - however, either I am using it incorrectly or else
> it doesn't work in this site. any other source of the same data is also
> welcome.
>
> regards,
> Abhishek
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/00fa6267-9dcd-489a-b579-58be5d62b383n%40googlegroups.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAH7jeuM80boH2pdNrOkef3wQcTzFD9Yg0LVJaQL-SNr8pU_GbA%40mail.gmail.com.


Re: [datameet] UDISE districts

2021-05-26 Thread Devdatta Tengshe
Hi Thej,

What do you want to scrape from this site?

I have scraped some of the school locations from this site, but have not
tried scraping the school reports.

I also found that the location of many schools is incorrect. ( Schools
tagged with Punjab appear in MP and so on)

Regards,
Devdatta


On Wed, 26 May 2021 at 15:53, Thejesh GN  wrote:

> Thanks Gautam and Emmerich.
>
> Here[1] is the summary of everything I know until now, including the list
> of current UDISE Districts and Blocks along with codes.
>
> I am planning to scrape https://schoolgis.nic.in/. But it seems to be
> down most of the time. Has anyone here tried scraping it before?
>
> I have not looked at data.gov.in for school list. May be I should check
> that too.
>
> - [1]
> https://thejeshgn.com/2021/05/26/india-udise-educational-districts-and-blocks/
>
> On Saturday, 10 April 2021 at 20:38:03 UTC+5:30 emmeric...@gmail.com
> wrote:
>
>> Hi Thej and Gautam,
>>
>> From what I know, Gautam is exactly right.  For example, in Delhi, the
>> Directorate of Education maintains 13 education districts that do not
>> correspond to the 10 administrative districts for Delhi. They are for
>> management and administrative purposes within the Directorate of Education
>> (see here:
>> http://www.edudel.nic.in/mis/schoolplant/school_information.htm and look
>> at by district).  I'm not sure if they maintain maps of these boundaries.
>>
>> I can't speak for any other states.
>>
>> Adding to Gautam and others approach beyond KA, you can also get lat/long
>> for a lot of schools from here: https://schoolgis.nic.in/. I believe
>> many on here have also pointed to that site. Scraping that data and
>> matching to DISE data gets you ~85% of the schools.  DISE school codes
>> minus the last two digits gets you villages, so you can then get another
>> couple of percent by matching any schools with missing lat/longs that are
>> in the same village as schools with lat/longs.
>>
>> From there you could aggregate up to the administrative district.
>>
>> hth,
>> Emmerich
>>
>> On Sunday, March 28, 2021 at 11:10:50 PM UTC-7 Gautam John wrote:
>>
>>> Hi Thej:
>>>
>>> > I am trying to make sense of UDISE wrt administrative boundaries.
>>>
>>> There isn't any linkage - they are completely independent at least
>>> when I last checked in 2016. What we did was to collect the lat/long
>>> for schools so we could plot them to administrative and electoral
>>> boundaries. And infer educational boundaries from the school points we
>>> had and since we knew ed boundary each school belonged to.
>>>
>>> See: https://dise.klp.org.in/about/
>>>
>>> I wonder if Sajjad might have any of those scripts handy.
>>>
>> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/f658144f-9ea1-4c89-9a6a-06feb0e71b4cn%40googlegroups.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAOQOUMs8rVRWvZg%3D-GoxF9q1%2BNRpN-W8yC-kxCQayGbeQxveUg%40mail.gmail.com.


[datameet] Extract district wise rainfall prediction data from NWP site

2021-05-26 Thread a.ja...@gmail.com
Hi,

https://nwp.imd.gov.in/blf/blf_temp/

In the link above, we can see the 5 days weather prediction by districts - 
however, there are a lot of clicks that are required to reach any one 
particular district. Please help in identifying a method to collate all 
India Rainfall data in a single table.

Tried to use Octoparse - however, either I am using it incorrectly or else 
it doesn't work in this site. any other source of the same data is also 
welcome.

regards,
Abhishek

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/00fa6267-9dcd-489a-b579-58be5d62b383n%40googlegroups.com.


[datameet] Re: Data for Petrol Pumps

2021-05-26 Thread gurm...@gmail.com
For IOCL Petrol 
Pumps https://associates.indianoil.co.in/PumpLocator/location.jsp

On Thursday, May 13, 2021 at 3:28:57 PM UTC+5:30 mkukr...@gmail.com wrote:

> I require shapefiles (lat-longs) of the following for my project:
>
>- Petrol Pumps
>- Shopping Malls
>- Dedicated Parking Lots
>- Residential Colonies
>
>
> The data is required for India. Can anyone suggest how/ where can I 
> extract it from.
>
> Any help will be really appreciated.
>
> Thanks
>
> -- 
> *Madhur Kukreja*
> *Ph- +91-8719820130 <+91-8719820130>*
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/795ad760-2150-425f-94b1-ad72ea648249n%40googlegroups.com.


Re: [datameet] Request for setting up a data scraper for Tamil Nadu COVID bed availability

2021-05-26 Thread gurm...@gmail.com
Hey. Is it possible to preserve the historical data in a separate CSV? 
Useful for looking at the time series.

On Sunday, April 18, 2021 at 1:37:23 PM UTC+5:30 Arun Ganesh wrote:

> Kudos Pratap Vardhan and Devdatta for jumping on this. We have a dashboard 
> ready to use and share: https://stopcoronatn.github.io
>
> Its updated hourly from  https://stopcorona.tn.gov.in/beds.php
>
>
>
>
> On Sun, Apr 18, 2021 at 2:54 AM Devdatta Tengshe  
> wrote:
>
>> Hi Arun,
>>
>> I have taken a crack at this:
>>
>> https://github.com/devdattaT/TN-Beds-Status/tree/main
>>
>> Can you tell me how frequently this server gets updated? I will try to 
>> automate the script accordingly.
>>
>> Regards,
>> Devdatta
>>
>>
>> On Sun, 18 Apr 2021 at 10:57, Arun Ganesh  wrote:
>>
>>> The TN govt maintains a regularly updated list of hospital bed capacity 
>>> throughout the state, but the interface has been terrible for people to 
>>> quickly find the info they need.
>>>
>>> https://stopcorona.tn.gov.in/beds.php
>>>
>>> Is there anyone who can put together a scraper to gather the data and 
>>> dump a csv regularly on github? Just the github csv interface will already 
>>> be hugely helpful for someone to filter through this data and would be in 
>>> very heavy demand right now.
>>>
>>> -- 
>>> Datameet is a community of Data Science enthusiasts in India. Know more 
>>> about us by visiting http://datameet.org
>>> --- 
>>> You received this message because you are subscribed to the Google 
>>> Groups "datameet" group.
>>> To unsubscribe from this group and stop receiving emails from it, send 
>>> an email to datameet+u...@googlegroups.com.
>>> To view this discussion on the web visit 
>>> https://groups.google.com/d/msgid/datameet/CA%2BGKQr1DdU0_Ac%2BwRXJU050f73YQ_LjdZdgTg6Sc78WWcZ7Sqw%40mail.gmail.com
>>>  
>>> 
>>> .
>>>
>> -- 
>> Datameet is a community of Data Science enthusiasts in India. Know more 
>> about us by visiting http://datameet.org
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to datameet+u...@googlegroups.com.
>>
> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/datameet/CAOQOUMuQmA2jeWBcjqFmNKVp5EiU%2BD%3DbQ8gWqA2PzwYVQHBLCQ%40mail.gmail.com
>>  
>> 
>> .
>>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/f2065279-09ce-47e1-8351-cfc9add3103an%40googlegroups.com.


[datameet] Developing tool to extract table from images

2021-05-26 Thread Dilawar Singh
Dear all,

I am developing a tool to extract a table from an image. It is a big
undertaking but I hope to release a beta version soon.

The input to the tool is a PNG/JPG/PDF image and output is a CSV/ODT/XLS
table.

I have some simple tables extracted from PDF. If there are formats which
govt uses often and people often need/want to digitize them, I'd like to
have some samples. I am thinking of census data, GIS data etc..

There is no plan to support multi-page tables. I can use some advice on the
OCR backend (I am using pytesseract from google for now).

best,
Dilawar

--
Dilawar Singh, Ph.D.
LinkedIn  ORCID
 Github 

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAM72-Zs9PT7CNZONjCUWM3%3D%3DiNDyfhVPg7Yhko1ALJ_Cmp25%2Bw%40mail.gmail.com.


Re: [datameet] Download Global Temperature and Precipitation statistics using Google Earth

2021-05-26 Thread Sarath Guttikunda
 IMD site is a maze and with some digging you may be able to find the raw
files. Links keep changing.

With the need for hourly or daily meteorological parameters at higher
spatial resolution, the main option is WRF simulations - time consuming and
computationally heavy duty. This is the best method in the field to run the
system for your domain, your time frame, and downscale it to your spatial
resolution. Even IMD does the same for downscaling.

They have an open course next week
https://www.mmm.ucar.edu/joint-wrf-and-mpas-users-workshop-2021

Another option, also modeled, is the global reanalysis database
from NASA - https://gmao.gsfc.nasa.gov/reanalysis/MERRA-2/
from ESA -
https://www.ecmwf.int/en/research/climate-reanalysis/cams-reanalysis

Archived, long term grib format files
https://rda.ucar.edu/datasets/ds083.2/#!description
Very large files - AWS was supposed to have an archive on S3 buckets, but I
never saw any announcement.

Measurements only, mostly from the airport stations
http://climexp.knmi.nl/start.cgi?someone@somewhere

World Bank has an explorer as well
https://olc.worldbank.org/about-olc/spatial-agent-world-data-your-fingertips
best works on ipad or iphone -- worth a try

With best wishes,
Sarath

--
*Dr. Sarath Guttikunda*

*http://www.urbanemissions.info *


On Wed, May 26, 2021 at 5:29 AM Rahul Wadhwani 
wrote:

> Thanks, Sarath. Its quite useful however the data are monthly averaged. I
> am looking for daily data any source other than IMD?
>
> On Tue, 25 May 2021 at 21:52, Sarath Guttikunda 
> wrote:
>
>>
>> https://www.youtube.com/watch?v=xsUht1hamOk
>> https://crudata.uea.ac.uk/cru/data/hrg/cru_ts_4.04/ge/
>>
>> --
>> *Dr. Sarath Guttikunda*
>>
>> *http://www.urbanemissions.info *
>>
>> --
>> Datameet is a community of Data Science enthusiasts in India. Know more
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to datameet+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/datameet/CAAj%2BwWoK%3DgsxE9jUn0JdrmE9j-j3UBdoZTE6E-c9_YTimSQ3Fw%40mail.gmail.com
>> 
>> .
>>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CANh0EDAxv_DfbKH69G7NBTtCwzdE0F1bKOcXpaT2JVDOw6nNQg%40mail.gmail.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAAj%2BwWoOt_P8pS89z-LFoX8ZP7%3D18rzCipczzG8Wi8-F0GrSuA%40mail.gmail.com.


Re: [datameet] Historic village-level census data

2021-05-26 Thread Rashmi Singh Rana
Thank you all for your help. Will look at the data sources/links given by 
all of you. Thank you again!

On Tuesday, 25 May 2021 at 03:19:33 UTC+5:30 thakurd...@gmail.com wrote:

> The language for the DCHBs has changed though. They were originally in 
> English then the system changed after the Shanta Kumar govt. to Hindi. So 
> look out for that!
>
> On Thu, 20 May 2021, 04:26 K Shakya,  wrote:
>
>> *http://lsi.gov.in:8081/jspui/simple-search?query=Himachal 
>> *
>>
>> *official source  for census handbooks since 1901 for Himachal*
>>
>> On Tue, 18 May 2021 at 07:54, Rashmi Singh Rana  
>> wrote:
>>
>>> Hi,
>>> I am looking for village-level census data for Himachal Pradesh. I have 
>>> village-level data for the 15th & 14th Census (2011 & 2001). I am looking 
>>> for census data for previous years/ older census records, at the village 
>>> level for Himachal. 
>>> Can anyone help me access or direct to where I can access it? The Census 
>>> digital library has the 13th Census data but it is incomplete. 
>>>
>>> Thanks in advance!
>>>
>>> Regards,
>>> Rashmi
>>>
>>> -- 
>>> Datameet is a community of Data Science enthusiasts in India. Know more 
>>> about us by visiting http://datameet.org
>>> --- 
>>> You received this message because you are subscribed to the Google 
>>> Groups "datameet" group.
>>> To unsubscribe from this group and stop receiving emails from it, send 
>>> an email to datameet+u...@googlegroups.com.
>>> To view this discussion on the web visit 
>>> https://groups.google.com/d/msgid/datameet/eac0ce5d-3b4b-4391-84be-84c6337152a4n%40googlegroups.com
>>>  
>>> 
>>> .
>>>
>>
>>
>> -- 
>>
>>
>> ​Regards
>>
>> *Ar. Kisho**r*
>> *e Shakyawar*
>> (Architect, Planner)
>>
>> Contact : +91- 810 394 7709 <+91%2081039%2047709>
>> E-Mail:* kishore@gmail.com  *
>>
>> -- 
>> Datameet is a community of Data Science enthusiasts in India. Know more 
>> about us by visiting http://datameet.org
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to datameet+u...@googlegroups.com.
>>
> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/datameet/CAGyNUtOOcUQGrODrrrTGZhFWiGrE8uL91aVG5TJRFi6rQ8Sn-Q%40mail.gmail.com
>>  
>> 
>> .
>>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/5c18f05f-fc74-4576-b96e-4a6cc77e71a5n%40googlegroups.com.


[datameet] Pincode WIth viilage code

2021-05-26 Thread apurva...@gmail.com
Hi Friends,

Hope you and your family are doing well and Safe.

I am looking for pincode with village code of LG directory 
pincode directory is available on post office website but village name is 
differ from LG directory village name 

Please suggest from where I can get this

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/9c97677d-1c4d-455c-b238-80d72c282c2an%40googlegroups.com.


Re: [datameet] UDISE districts

2021-05-26 Thread Thejesh GN
Thanks Gautam and Emmerich.

Here[1] is the summary of everything I know until now, including the list 
of current UDISE Districts and Blocks along with codes.

I am planning to scrape https://schoolgis.nic.in/. But it seems to be down 
most of the time. Has anyone here tried scraping it before?

I have not looked at data.gov.in for school list. May be I should check 
that too.

- [1] 
https://thejeshgn.com/2021/05/26/india-udise-educational-districts-and-blocks/

On Saturday, 10 April 2021 at 20:38:03 UTC+5:30 emmeric...@gmail.com wrote:

> Hi Thej and Gautam,
>
> From what I know, Gautam is exactly right.  For example, in Delhi, the 
> Directorate of Education maintains 13 education districts that do not 
> correspond to the 10 administrative districts for Delhi. They are for 
> management and administrative purposes within the Directorate of Education 
> (see here: http://www.edudel.nic.in/mis/schoolplant/school_information.htm 
> and look at by district).  I'm not sure if they maintain maps of these 
> boundaries.
>
> I can't speak for any other states.
>
> Adding to Gautam and others approach beyond KA, you can also get lat/long 
> for a lot of schools from here: https://schoolgis.nic.in/. I believe many 
> on here have also pointed to that site. Scraping that data and matching to 
> DISE data gets you ~85% of the schools.  DISE school codes minus the last 
> two digits gets you villages, so you can then get another couple of percent 
> by matching any schools with missing lat/longs that are in the same village 
> as schools with lat/longs.
>
> From there you could aggregate up to the administrative district.
>
> hth,
> Emmerich
>
> On Sunday, March 28, 2021 at 11:10:50 PM UTC-7 Gautam John wrote:
>
>> Hi Thej: 
>>
>> > I am trying to make sense of UDISE wrt administrative boundaries. 
>>
>> There isn't any linkage - they are completely independent at least 
>> when I last checked in 2016. What we did was to collect the lat/long 
>> for schools so we could plot them to administrative and electoral 
>> boundaries. And infer educational boundaries from the school points we 
>> had and since we knew ed boundary each school belonged to. 
>>
>> See: https://dise.klp.org.in/about/ 
>>
>> I wonder if Sajjad might have any of those scripts handy. 
>>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/f658144f-9ea1-4c89-9a6a-06feb0e71b4cn%40googlegroups.com.