Re: [datameet] UDISE districts

2021-05-26 Thread Thejesh GN
Thanks Gautam and Emmerich. Here[1] is the summary of everything I know until now, including the list of current UDISE Districts and Blocks along with codes. I am planning to scrape https://schoolgis.nic.in/. But it seems to be down most of the time. Has anyone here tried scraping it before?

Re: [datameet] Download Global Temperature and Precipitation statistics using Google Earth

2021-05-26 Thread Sarath Guttikunda
IMD site is a maze and with some digging you may be able to find the raw files. Links keep changing. With the need for hourly or daily meteorological parameters at higher spatial resolution, the main option is WRF simulations - time consuming and computationally heavy duty. This is the best

Re: [datameet] Historic village-level census data

2021-05-26 Thread Rashmi Singh Rana
Thank you all for your help. Will look at the data sources/links given by all of you. Thank you again! On Tuesday, 25 May 2021 at 03:19:33 UTC+5:30 thakurd...@gmail.com wrote: > The language for the DCHBs has changed though. They were originally in > English then the system changed after the

[datameet] Pincode WIth viilage code

2021-05-26 Thread apurva...@gmail.com
Hi Friends, Hope you and your family are doing well and Safe. I am looking for pincode with village code of LG directory pincode directory is available on post office website but village name is differ from LG directory village name Please suggest from where I can get this -- Datameet is a

[datameet] Developing tool to extract table from images

2021-05-26 Thread Dilawar Singh
Dear all, I am developing a tool to extract a table from an image. It is a big undertaking but I hope to release a beta version soon. The input to the tool is a PNG/JPG/PDF image and output is a CSV/ODT/XLS table. I have some simple tables extracted from PDF. If there are formats which govt

Re: [datameet] UDISE districts

2021-05-26 Thread Devdatta Tengshe
Hi Thej, What do you want to scrape from this site? I have scraped some of the school locations from this site, but have not tried scraping the school reports. I also found that the location of many schools is incorrect. ( Schools tagged with Punjab appear in MP and so on) Regards, Devdatta

[datameet] Extract district wise rainfall prediction data from NWP site

2021-05-26 Thread a.ja...@gmail.com
Hi, https://nwp.imd.gov.in/blf/blf_temp/ In the link above, we can see the 5 days weather prediction by districts - however, there are a lot of clicks that are required to reach any one particular district. Please help in identifying a method to collate all India Rainfall data in a single

Re: [datameet] Request for setting up a data scraper for Tamil Nadu COVID bed availability

2021-05-26 Thread gurm...@gmail.com
Hey. Is it possible to preserve the historical data in a separate CSV? Useful for looking at the time series. On Sunday, April 18, 2021 at 1:37:23 PM UTC+5:30 Arun Ganesh wrote: > Kudos Pratap Vardhan and Devdatta for jumping on this. We have a dashboard > ready to use and share:

[datameet] Re: Data for Petrol Pumps

2021-05-26 Thread gurm...@gmail.com
For IOCL Petrol Pumps https://associates.indianoil.co.in/PumpLocator/location.jsp On Thursday, May 13, 2021 at 3:28:57 PM UTC+5:30 mkukr...@gmail.com wrote: > I require shapefiles (lat-longs) of the following for my project: > >- Petrol Pumps >- Shopping Malls >- Dedicated Parking

Re: [datameet] Extract district wise rainfall prediction data from NWP site

2021-05-26 Thread Nikhil VJ
Hi Abhishek, Right-click on page -> Inspect -> opens the browser console -> Go to Network tab , then browse around the site and check out the comings and goings between site and server. I was able to get the data we're seeing in the website coming in my command prompt (which means: one can

Re: [datameet] Extract district wise rainfall prediction data from NWP site

2021-05-26 Thread Dammalapati Sai Krishna
I wrote a Python code that does a similar web crawling - WebScraping/WebCrawling_MissionAntyodaya.ipynb at master ยท d-saikrishna/WebScraping (github.com) You could be able to get what you want with minor

[datameet] Re: Data for Petrol Pumps

2021-05-26 Thread Naveen Francis
Hello Madhur, Please click on 'Search Overpass Turbo' https://nsi.guide/index.html?t=brands=amenity=fuel=in Thanks, naveenpf On Thursday, 27 May, 2021 at 3:32:36 am UTC+5:30 gurm...@gmail.com wrote: > For IOCL Petrol Pumps > https://associates.indianoil.co.in/PumpLocator/location.jsp > > On

[datameet] Infosec, data security and network security issues with electronic voting

2021-05-26 Thread Zainab Bawa
Hello Datameet members, This Saturday, former IAS officer, Kannan Gopinathan, will speak about the ground level issues with EVMs and VVPATs in Indian elections, and data security issues arising from electronic voting mechanisms interacting with the electricity grid systems. Kannan will also

Re: [datameet] Developing tool to extract table from images

2021-05-26 Thread Sarath Guttikunda
If you can test on these daily bulletins to automate tabulation, that will be very helpful. https://cpcb.nic.in/AQI_Bulletin.php Sample file attached With best wishes, Sarath -- *Dr. Sarath Guttikunda* *http://www.urbanemissions.info * On Wed, May 26, 2021 at