[datameet] OpenStreetMap Bengaluru Mapping Party

[Vivek Matthew]

Hello everyone,

OpenStreetMap Bengaluru will be hosting a mapping party in Malleshwaram, 
Bengaluru, this Sunday.

For those unfamiliar with what an OpenStreetMap mapping party is, it's an 
event where a group of us get together to explore an area and map it by 
adding data to OpenStreetMap, using a mobile app. Aman who helped organize 
one of the first OpenStreetMap Bengaluru mapping parties, wrote a blog post 
about that event: 
https://www.openstreetmap.org/user/aman_bagrecha/diary/402347

If this sounds interesting to you, the next mapping party is happening this 
Sunday:

* Date: 12th May 2024 (Sunday)
* Time: 09:00AM - 11:30AM (Mapping, followed by dosa at CTR)
* Meeting Point: Sankey Tank, at the gazebo near Sampige Road 
(https://omaps.app/8xx2EQUmjF/Shelter)

For event updates, do join the OpenStreetMap Bengaluru group:

* Telegram: https://t.me/OSM_BLR
* Matrix: https://matrix.to/#/#OSM_BLR:matrix.org

If you'd like to participate and receive event updates, but are not on 
Telegram or Matrix, please do drop me a private mail so that I can send you 
event updates or in case you want any further details.

Regards,
Vivek

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/2e2a5d55-4fe8-4ee5-a905-ce37cfe29077n%40googlegroups.com.

Re: [datameet] Re: Lok Sabha MP affidavit data

[Vivek Matthew]

A related dataset is the parliamentary activity data available from PRS 
India, which has details on attendance, debates, questions, bills by Indian 
parliamentary representatives.

CSV for the 17th Lok Sabha (Current): 
https://flatgithub.com/Vonter/india-representatives-activity?filename=csv/Lok%20Sabha/17th.csv=Name

Scripts and more extensive data (in JSON) fetched from PRS India, across 
multiple Lok Sabhas, can be found on GitHub: 
https://github.com/Vonter/india-representatives-activity

On Tuesday 20 February 2024 at 22:35:02 UTC+5:30 Aman Bhargava wrote:

> Amazing work, many thanks Vivek!!
>
> On Tue, 20 Feb 2024, 21:36 Arun Ganesh,  wrote:
>
>> Goldmine! Thank you Vivek.
>>
>>
>>
>> On Mon, Feb 19, 2024 at 11:43 PM Vivek Matthew  
>> wrote:
>>
>>> State Assembly election candidate affidavit summaries have been added to 
>>> the repository.
>>>
>>> Andhra Pradesh (any particular state can be selected from the dropdown 
>>> on this page): 
>>> https://flatgithub.com/Vonter/india-election-affidavits?filename=csv/State%20Assemblies/Andhra%20Pradesh/Candidates.csv=Candidate
>>>
>>> All States - warning takes time to load the ~1.6 lakh entries (20MB): 
>>> https://flatgithub.com/Vonter/india-election-affidavits?filename=csv%2FState%20Assemblies%2FCandidates.csv
>>>
>>> On Wednesday 14 February 2024 at 03:23:43 UTC+5:30 gurugubelli sai ratna 
>>> chaitanya wrote:
>>>
>>>> brilliant work, vivek.
>>>>
>>>> On Mon, Feb 12, 2024 at 10:30 PM Vivek Matthew  
>>>> wrote:
>>>>
>>>>> I was interested in this data myself, so I got around to putting it in 
>>>>> a CSV that can be browsed: 
>>>>> https://flatgithub.com/Vonter/india-election-affidavits?filename=csv/Lok%20Sabha/Candidates.csv=Candidate
>>>>>
>>>>> Raw data (with separate CSVs by election year/constituency) and 
>>>>> scripts can be found on GitHub: 
>>>>> https://github.com/Vonter/india-election-affidavits
>>>>>
>>>>> On Friday 9 February 2024 at 14:09:56 UTC+5:30 Arun Ganesh wrote:
>>>>>
>>>>>> Does anyone know if the data for the declared assets, criminal cases 
>>>>>> and educational qualification of sitting Lok Sabha MPs are available in 
>>>>>> a 
>>>>>> ready to use format?
>>>>>>
>>>>>> Much of this information has been digitized by public filings by ADR 
>>>>>> and available as a PDF report[1]  but not as raw data.
>>>>>>
>>>>>> There is a very useful API[2] that has this data for pre 2019 MPs at 
>>>>>> but not for the sitting MPs unfortunately.
>>>>>>
>>>>>> I'm curious to see how these stats have changed over the past three 
>>>>>> elections.
>>>>>>
>>>>>> [1] 
>>>>>> https://adrindia.org/content/lok-sabha-elections-2019-analysis-criminal-background-financial-education-gender-and-other
>>>>>> [2] https://github.com/nini1294/myneta_api 
>>>>>>
>>>>> -- 
>>>>>
>>>> Datameet is a community of Data Science enthusiasts in India. Know more 
>>>>> about us by visiting http://datameet.org
>>>>> --- 
>>>>> You received this message because you are subscribed to the Google 
>>>>> Groups "datameet" group.
>>>>> To unsubscribe from this group and stop receiving emails from it, send 
>>>>> an email to datameet+u...@googlegroups.com.
>>>>> To view this discussion on the web visit 
>>>>> https://groups.google.com/d/msgid/datameet/c422fdc6-99d4-4c5d-909f-357db01fb85dn%40googlegroups.com
>>>>>  
>>>>> <https://groups.google.com/d/msgid/datameet/c422fdc6-99d4-4c5d-909f-357db01fb85dn%40googlegroups.com?utm_medium=email_source=footer>
>>>>> .
>>>>>
>>>> -- 
>>> Datameet is a community of Data Science enthusiasts in India. Know more 
>>> about us by visiting http://datameet.org
>>> --- 
>>> You received this message because you are subscribed to the Google 
>>> Groups "datameet" group.
>>> To unsubscribe from this group and stop receiving emails from it, send 
>>> an email to datameet+u...@googlegroups.com.
>>> To view this discussion on the web visit 
>>> https://groups.google.com/d/msgid/datameet/ace205e5-22c1-4fdb-8312-e1e8f

Re: [datameet] Re: Lok Sabha MP affidavit data

[Vivek Matthew]

State Assembly election candidate affidavit summaries have been added to 
the repository.

Andhra Pradesh (any particular state can be selected from the dropdown on 
this page): 
https://flatgithub.com/Vonter/india-election-affidavits?filename=csv/State%20Assemblies/Andhra%20Pradesh/Candidates.csv=Candidate

All States - warning takes time to load the ~1.6 lakh entries (20MB): 
https://flatgithub.com/Vonter/india-election-affidavits?filename=csv%2FState%20Assemblies%2FCandidates.csv

On Wednesday 14 February 2024 at 03:23:43 UTC+5:30 gurugubelli sai ratna 
chaitanya wrote:

> brilliant work, vivek.
>
> On Mon, Feb 12, 2024 at 10:30 PM Vivek Matthew  
> wrote:
>
>> I was interested in this data myself, so I got around to putting it in a 
>> CSV that can be browsed: 
>> https://flatgithub.com/Vonter/india-election-affidavits?filename=csv/Lok%20Sabha/Candidates.csv=Candidate
>>
>> Raw data (with separate CSVs by election year/constituency) and scripts 
>> can be found on GitHub: 
>> https://github.com/Vonter/india-election-affidavits
>>
>> On Friday 9 February 2024 at 14:09:56 UTC+5:30 Arun Ganesh wrote:
>>
>>> Does anyone know if the data for the declared assets, criminal cases and 
>>> educational qualification of sitting Lok Sabha MPs are available in a ready 
>>> to use format?
>>>
>>> Much of this information has been digitized by public filings by ADR and 
>>> available as a PDF report[1]  but not as raw data.
>>>
>>> There is a very useful API[2] that has this data for pre 2019 MPs at but 
>>> not for the sitting MPs unfortunately.
>>>
>>> I'm curious to see how these stats have changed over the past three 
>>> elections.
>>>
>>> [1] 
>>> https://adrindia.org/content/lok-sabha-elections-2019-analysis-criminal-background-financial-education-gender-and-other
>>> [2] https://github.com/nini1294/myneta_api 
>>>
>> -- 
>>
> Datameet is a community of Data Science enthusiasts in India. Know more 
>> about us by visiting http://datameet.org
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to datameet+u...@googlegroups.com.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/datameet/c422fdc6-99d4-4c5d-909f-357db01fb85dn%40googlegroups.com
>>  
>> <https://groups.google.com/d/msgid/datameet/c422fdc6-99d4-4c5d-909f-357db01fb85dn%40googlegroups.com?utm_medium=email_source=footer>
>> .
>>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/ace205e5-22c1-4fdb-8312-e1e8fa27fa22n%40googlegroups.com.

[datameet] Dataset of Karnataka tenders from KPPP

[Vivek Matthew]

5000 latest tenders issued in Karnataka (as of the time of this mail): 
https://flatgithub.com/Vonter/karnataka-tenders?filename=csv/LatestTenders.csv=Tender%20Number=Published%20Date%2Cdesc

Tenders issued in Karnataka since 1st June 2023 (may take time to load the 
~86000 tenders): 
https://flatgithub.com/Vonter/karnataka-tenders?filename=csv/AllTenders.csv=Tender%20Number=Published%20Date%2Cdesc

Scripts for fetching and parsing the data from KPPP are on GitHub: 
https://github.com/Vonter/karnataka-tenders
3m

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/1f296a64-d079-4377-af30-77a94db27578n%40googlegroups.com.

[datameet] Re: Lok Sabha MP affidavit data

[Vivek Matthew]

I was interested in this data myself, so I got around to putting it in a 
CSV that can be 
browsed: 
https://flatgithub.com/Vonter/india-election-affidavits?filename=csv/Lok%20Sabha/Candidates.csv=Candidate

Raw data (with separate CSVs by election year/constituency) and scripts can 
be found on GitHub: https://github.com/Vonter/india-election-affidavits

On Friday 9 February 2024 at 14:09:56 UTC+5:30 Arun Ganesh wrote:

> Does anyone know if the data for the declared assets, criminal cases and 
> educational qualification of sitting Lok Sabha MPs are available in a ready 
> to use format?
>
> Much of this information has been digitized by public filings by ADR and 
> available as a PDF report[1]  but not as raw data.
>
> There is a very useful API[2] that has this data for pre 2019 MPs at but 
> not for the sitting MPs unfortunately.
>
> I'm curious to see how these stats have changed over the past three 
> elections.
>
> [1] 
> https://adrindia.org/content/lok-sabha-elections-2019-analysis-criminal-background-financial-education-gender-and-other
> [2] https://github.com/nini1294/myneta_api 
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/c422fdc6-99d4-4c5d-909f-357db01fb85dn%40googlegroups.com.

[datameet] Unofficial GTFS dataset for BMTC

[Vivek Matthew]

Hey everyone,

I've scraped data from the Namma BMTC app and parsed the raw responses to 
generate an unofficial GTFS dataset. More details (and caveat) are on 
GitHub: https://github.com/Vonter/bmtc-gtfs

Hope this GTFS dataset may be of use to someone. If anyone is interested in 
contributing to/improving the GTFS dataset, do check out the Contributing 
section on the GitHub page.

Regards,
Vivek

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/ada3bf38-4613-4c84-b3e4-c2a575e18f3en%40googlegroups.com.

[datameet] Re: Delhi shape file - census wards or post-2017 MCD delimitation

[Vivek Matthew]

Hi Anisha,

OpenCity has shapefiles for the 2017 and 2022 MCD ward 
delimitation: https://data.opencity.in/dataset/delhi-wards-information

Regards,
Vivek

On Wednesday, 2 August 2023 at 09:11:06 UTC+5:30 Anisha Garg wrote:

> Hello everyone,
>
> I am a PhD student working on Delhi. I am looking for ward level shape 
> file. I came across - 
> https://github.com/datameet/Municipal_Spatial_Data/tree/master/Delhi - 
> but this seems to be made in 2013. I searched more and came across - 
> https://github.com/HindustanTimesLabs/shapefiles/tree/master/city/delhi/ward 
> - but the classification dictionary seems to be missing.
>
> Could anyone please point me towards either
> - census ward level shapefile, or
> - post-2017 delimitation shapefile, or
> - pre-2017 delimitation population by wards?
>
> Thank you so much in advance! :)
> I really appreciate any leads on this. :)
>
> Warm Regards,
> Anisha
>
>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/254d11ac-5d13-4a4b-8e19-543a971f9e7en%40googlegroups.com.

Re: [datameet] Issues with the UDISE API

[Vivek Matthew]

On the API Specifications page, only the first 3 APIs seem to link to any 
sort of documentation: https://api.udiseplus.gov.in/apiSpecification

And on the GitHub repo which Srikanth linked, only 1 API seems to be 
getting used in any way: 
https://github.com/Unified-Learner-Passbook/ulp-bff/search?q=https%3A%2F%2Fapi.udiseplus.gov.in%2F

I think it's quite likely these API don't work and even if they do, only 
very limited functionality is made available.

The better option for scraping data off UDISE might be to use the method 
Thejesh used in the below 2 repositories: 

Reports: 
https://github.com/thejeshgn/udise-report-data-downloader/blob/master/scraper.py

Geodata: https://github.com/datameet/udise_schools/blob/master/scraper.py

The SQLite file was generated with the above script, so if the APIs haven't 
changed since it was written, it should be possible to re-run the script 
and get an up to date version of the UDISE data.

On Tuesday, 9 May 2023 at 15:05:45 UTC+5:30 Srikanth Lakshmanan wrote:

> udise api issue solved  -- 
> https://github.com/Unified-Learner-Passbook/ulp-bff/commit/06fd8f58a620dc4fece2d119453778a9e6b7c79f
>   
> -:) -- I really don't know if its solved for all / only for those with 
> special access
>
> https://api.udiseplus.gov.in/docs/auth - does mention about registered 
> user being able to generate tokens for querying, but can't find out way to 
> register though.
>
>
> On Mon, 8 May 2023 at 19:10, Rahul Muraleedharan  
> wrote:
>
>> Hey everyone,
>> I'm trying to use the following API to extract data based on the UDISE 
>> provided.
>> https://api.udiseplus.gov.in/
>> Problem is, I can't get it to work. Keep getting errors. Also, not sure 
>> how to authenticate the same. There are no links to the registration 
>> portal, if any so I can't generate a userid and password.
>> I know thanks to an earlier effort by datameet, there is a sqlite 
>> database with the information I need. However, the data is pretty old and 
>> is not up to date. Would appreciate all the help I can get. Thank you.
>>
>> -- 
>> Datameet is a community of Data Science enthusiasts in India. Know more 
>> about us by visiting http://datameet.org
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to datameet+u...@googlegroups.com.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/datameet/9ae919f8-c748-4dd0-af5b-0c5d57806171n%40googlegroups.com
>>  
>> 
>> .
>>
>
>
> -- 
> Regards
> Srikanth.L
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/bf79d40f-c32d-40b5-9d84-69e8efcef249n%40googlegroups.com.

[datameet] Re: Delhi Municipal Ward Shapefiles (after 2022 delimitation)

[Vivek Matthew]

Hi Sofie,

OpenCity has the 2022 Delimitation Ward and Zone Maps (sourced from GSDL 
Delhi): https://data.opencity.in/dataset/delhi-wards-information

The data on OpenCity is in KML format, but this can be converted to 
Shapefile using QGIS or an online tool like MyGeodata 
Converter: https://mygeodata.cloud/converter/

Regards,
Vivek

On Tuesday, 9 May 2023 at 00:40:32 UTC+5:30 Sofie Heintz wrote:

> Hi everyone, 
>
> Does anyone know where one can find data in shapefile format of Delhi's 
> wards after the 2022 delimitation? So far, I could only find the PDFs here: 
> https://sec.delhi.gov.in/sec/delimitation-2022-final. 
>
> Any help would be much appreciated.
>
> Thank you in advance and best wishes, 
>
> Sofie
>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/5eaac1c6-f08f-440b-8c7b-64bddcbe518en%40googlegroups.com.

Re: [datameet] Google Earth historical imagery disappeared?

[Vivek Matthew]

Historical imagery seems to still be accessible through the Timelapse 
feature on Google Earth. I'm not sure if the imagery on there is different, 
but it looks like it can possibly be of 
use: 
https://earth.google.com/web/@12.93438804,77.6926285,904.67103645a,7409.14647402d,35y,0h,0t,0r/data=CjISMBIgNTQ0MGExNzMxYzI1MTFlYTk0NDM4YmI2ODk0NDUyOTciDG1haW5Ob1JhbmRvbQ

Another option would be to access the Google Earth Engine Data Catalog. 
Again the imagery may not be the same as the original Google Earth 
historical imagery feature. There is a QGIS plugin to view imagery from the 
Google Earth Engine Data Catalog inside QGIS.

Most of the historical imagery shown on Google Earth was sourced from 
Landsat imagery, so that can be accessed from the site Aman had shared. 
Other possible sources of historical imagery are:

USGS LandsatLook (1982-2023): https://landsatlook.usgs.gov/explore

ESRI's LivingAtlas (2014-2023): https://livingatlas.arcgis.com/wayback

On Tuesday, 2 May 2023 at 16:02:33 UTC+5:30 Aman Bhargava wrote:

> This is a really bad loss if it has been removed permanently, I hope it 
> gets fixed soon. 
>
> In the meantime, I often use Sentinel Hub to browse historic and current 
> data. The interface is easy and being able to access multiple sources in 
> one place is useful. Hopefully you're able to make do till this gets 
> resolved. https://apps.sentinel-hub.com/eo-browser/
>
> On Tue, May 2, 2023 at 3:36 PM Sharad Lele  wrote:
>
>> Hi Mukesh: Since Ashish has also experienced this ,and all the folks in 
>> my team are facing this, and there is a similar problem posted on the GE 
>> support thread, I doubt that my problem will be fixed by reinstalling GE on 
>> just my laptop. I think the problem is systemic. Here is a screenshot of 
>> what the timeslider looks like now:
>>
>> [image: GE time slider on 2 May 2023_no images between 1985 and 2019.jpg]
>>
>> On Tuesday, May 2, 2023 at 10:24:19 AM UTC+5:30 Mukesh Yadav wrote:
>>
>>> Hi Sharad, I have just checked, historical images are available on 
>>> Google Earth. You can try re-installing the application once.
>>>
>>> Regards,
>>>
>>> On Tue, May 2, 2023 at 8:22 AM Sharad Lele  wrote:
>>>
 Folks,
 Over the last few days, it appears as if Google has removed all 
 historical satellite imagery for India for the 2000-2019 period. Just last 
 week, I was using imagery from 2005 and 2003 for our field sites in MP and 
 Chhattisgarh. But as of this weekend, there is NO historical imagery 
 between 1985 and 2019! I have checked several different locations in India.

 Can others confirm this? This is a huge loss for us and the wider 
 public--e.g., historical imagery is crucial in the implementation of the 
 Forest Rights Act. Is there a way we can ask Google to reinstate the 
 imagery?

 Sharad

 -- 

>>> Datameet is a community of Data Science enthusiasts in India. Know more 
 about us by visiting http://datameet.org
 --- 
 You received this message because you are subscribed to the Google 
 Groups "datameet" group.
 To unsubscribe from this group and stop receiving emails from it, send 
 an email to datameet+u...@googlegroups.com.
 To view this discussion on the web visit 
 https://groups.google.com/d/msgid/datameet/3ee3a628-b7ea-4257-8994-2aacac0ecbc7n%40googlegroups.com
  
 
 .

>>>
>>>
>>> -- 
>>> Mukesh Yadav 
>>> Practice
>>> Mobile: +91 - 97112 86815 <+91%2097112%2086815>
>>> --
>>> [image: Indian Institute for Human Settlements]  
>>> iihs.co.in 
>>>
>>> [image: Twitter]  [image: Facebook] 
>>>  [image: LinkedIn] 
>>>  
>>> [image: 
>>> Youtube] 
>>> 
>>>  
>>>
>>> IIHS DELHI :: 803 Surya Kiran, 19 Kasturba Gandhi Marg, New Delhi 110 
>>> 001. India. T: +91 11 4360 2798 <+91%2011%204360%202798> 
>>>
>>> IIHS BENGALURU CITY CAMPUS :: 197/36, 2nd Main Road, Sadashivanagar, 
>>> Bengaluru 560 080. India. T: +91 80 6760  <+91%2080676%200> | 
>>> F: +91 80 2361 6814 <+91%2080%202361%206814> 
>>>
>>> IIHS CHENNAI :: Floor 7A, Chaitanya Exotica, 24/51 Venkatnarayana Road, 
>>> T Nagar, Chennai 600 017. India. T +91 44 6630 5500 
>>> <+91%2044%206630%205500>/6555 6590 
>>>
>>> IIHS MUMBAI :: Flat No.2, Purnima Building, Patel Compound, 20-C, Napean 
>>> Sea Road, Mumbai 400 006. India. T: +91 22 6525 3874 
>>> <+91%2022%206525%203874> 
>>>
>> -- 
>> Datameet is a community of Data Science enthusiasts in India. Know more 
>> about us by visiting http://datameet.org
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "datameet" 

[datameet] Re: Dataset with lat long of all Indian cities?

[Vivek Matthew]

The Smart Cities GMIS has a publicly accessible folder with spatial data 
for the 100 Smart Cities: https://gmis.smartcities.gov.in/

The layer with the locations and other details for these 100 Smart Cities 
can be found in CSV format 
here: https://gist.github.com/Vonter/5d4aaca8c1180241f3acc75f93cbd116

Regards,
Vivek

On Tuesday, 21 March 2023 at 19:04:26 UTC+5:30 Saba Mundlay wrote:

> Hi, you can download lat / Lon of cities from here (single point, not 
> boundaries): 
> https://simplemaps.com/data/in-cities
>
> On Tuesday, March 21, 2023 at 5:19:28 AM UTC+5:30 Aishwarya Soni wrote:
>
>> Hello,
>>
>> Does anyone have a .csv dataset of all Indian cities, including the smart 
>> cities? 
>>
>> Thank you in advance!
>>
>> Warmly,
>> Aishwarya
>>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/c28d7ea5-3ca8-45e8-a18d-b39d01da2040n%40googlegroups.com.

Re: [External Email] [datameet] Data on socio economic effects of lockdowns / pandemic fears

[Vivek Matthew]

Regarding schooling and educational outcomes, the below 2 datasets might 
work as a starting point:

The National Achievement Survey (NAS), by the Ministry of Education, for 
assessing educational outcomes. The previous 2 surveys were done in 2017 
and 2021. There is national/state/district level data for school 
participation, performance and learning outcomes. These reports can be 
found on the NAS site: https://nas.gov.in/report-card

The Annual Status of Education Report (ASER), done annually and targeted at 
rural India. They have extensive documentation of the data collection 
process/methodology. Unfortunately due to the pandemic, 2020 and 2021 had 
to be done as phone-based surveys, unlike other years' which are field 
surveys. All the reports (2022 being the latest) can be found on the ASER 
site: http://www.asercentre.org/Keywords/p/407.html

Some of ASER's raw datasets, seem to be up on GitHub already 
(https://github.com/PrathamOrg/ASER-Dataset), but reaching out to the folks 
at ASER directly would probably be the best way to get the latest raw 
datasets.

Regards,
Vivek
On Saturday, 18 March 2023 at 21:49:22 UTC+5:30 Shiv Hastawala wrote:

> Another one is the COVID19 Related Shocks in Rural India Survey conducted 
> in 3 different rounds.
>
> Here are the links to the datasets:
>
> https://microdata.worldbank.org/index.php/catalog/3769
>
> https://microdata.worldbank.org/index.php/catalog/3773
>
> https://microdata.worldbank.org/index.php/catalog/3830
>
> Thanks and regards.
>
>
> Yours sincerely
>
> *Shiv Hastawala*
>
> (He/His/Him)
> Doctoral Student
> Department of Economics
> Binghamton University (State University of New York)
>
> Zoom ID: 201 717 2613 <(201)%20717-2613>
>
> www.shivhastawala.com
>
>
> On Sat, Mar 18, 2023 at 12:11 PM Shiv Hastawala  
> wrote:
>
>> Hi Nikhil
>>
>> This might be relevant: the Covid 19 Livelihoods Survey by Azim Premji 
>> University
>>
>> https://www.dropbox.com/sh/8z6o8ra1duouokb/AADaAiNkNJtB5AAaHhTJ-6exa?dl=0
>>
>>
>> On Sat, Mar 18, 2023 at 2:56 AM, Nikhil VJ  wrote:
>>
>>> Hi, can anyone connect me to any kind of survey / stats data on the 
>>> socio economic effects of lockdowns / pandemic fears ?
>>>
>>> Monthly Income loss, standard of living downgrades, losses in 
>>> educational achievement for students.
>>>
>>> Has anybody worked on quantifying them? 
>>>
>>> Regards
>>> Nikhil
>>>
>>> -- 
>>> Datameet is a community of Data Science enthusiasts in India. Know more 
>>> about us by visiting http://datameet.org
>>> --- 
>>> You received this message because you are subscribed to the Google 
>>> Groups "datameet" group.
>>> To unsubscribe from this group and stop receiving emails from it, send 
>>> an email to datameet+u...@googlegroups.com.
>>> To view this discussion on the web visit 
>>> https://groups.google.com/d/msgid/datameet/CAH7jeuMQxwbF%2B3A5f4PSuwseqNq7JBmYnq9UwrJN%3DhtGEq7k-Q%40mail.gmail.com
>>>  
>>> 
>>> .
>>>
>> -- 
>>
>> Thanks and regards.
>>
>>
>> Yours sincerely
>>
>> *Shiv Hastawala*
>>
>> (He/His/Him)
>> Doctoral Student
>> Department of Economics
>> Binghamton University (State University of New York)
>>
>> Zoom ID: 201 717 2613 <(201)%20717-2613>
>>
>> www.shivhastawala.com
>>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/df1f99f9-d166-49e2-aeac-a720d250280an%40googlegroups.com.

Re: [datameet] Need hourly rainfall data for kerala

[Vivek Matthew]

IMD also has a website where you can get hourly rainfall data (they even 
provide as granular as 15 minutes supposedly): http://aws.imd.gov.in:8091/

They have national level coverage, but there's lots of stations marked in 
Kerala, so coverage would be quite good. I'm not sure how frequently the 
data actually updates in the backend though.

Regards,
Vivek

On Friday, 24 February 2023 at 14:40:37 UTC+5:30 Hardik Madhu wrote:

> Try NOAA ISD Lite, or Meteostat API. They have global coverage, may 
> include some weather stations from Kerala. 
>
> On Mon, Feb 13, 2023 at 3:08 AM Musaib Ahmad <1020...@smail.iitpkd.ac.in> 
> wrote:
>
>> Hello everyone,
>>
>> Whether anyone can help me in getting the hourly rainfall data for the 
>> Kerala state.
>>
>> Thanks
>> Musaib
>>
>> -- 
>> Datameet is a community of Data Science enthusiasts in India. Know more 
>> about us by visiting http://datameet.org
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to datameet+u...@googlegroups.com.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/datameet/CAJWmgRzahRFwj-QVZJKgS0UmRjpDDdnCBDX%2Bhzc0vW0s1Dd9hQ%40mail.gmail.com
>>  
>> 
>> .
>>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/1c0c6bfb-1d8c-4f64-8b8b-ad24170281e4n%40googlegroups.com.

[datameet] Re: KML file for Delhi police station jurisdictions

[Vivek Matthew]

For anyone who stumbles upon this thread and is looking for newer data, 
check this thread: https://groups.google.com/g/datameet/c/cNqq9bC_RTk

Regards,
Vivek

On Friday, 24 February 2023 at 14:41:32 UTC+5:30 Anisha Garg wrote:

> Hi Harry,
>
> Did you manage to make the latest shape files? If yes, could you please 
> share it with me? I would really appreciate any help on this front.:)
>
> Thank You
>
> Warm Regards,
> Anisha
>
> On Tuesday, 5 January 2016 at 07:11:18 UTC Harry Stevens wrote:
>
>> I'm trying to make crime maps for Delhi. Does anyone have a KML file with 
>> the boundaries of the 176 Delhi police station jurisdictions? Failing that, 
>> does anyone have KML files with the boundaries of the 54 subdivisions, the 
>> 11 districts, or the 6 ranges? I'll take any help I can get. Thanks in 
>> advance.
>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/34e652ed-2483-48da-a5ea-f6d2346fb190n%40googlegroups.com.

[datameet] Re: Shape files for Police Jurisdiction Maps of Delhi

[Vivek Matthew]

Hi Anisha,

The GSDL GIS Server has a layer with police station jurisdictional 
boundaries at various levels: 
https://gsdl.org.in/arcgis/rest/services/Delhi_Police/Delhi_Police/MapServer?f=json

I have scraped them and put them up 
here: https://gist.github.com/Vonter/a1f0f9d50a587ce059ddcfb086fc0fac

On the above link the files are GeoJSONs, you should be able to download it 
as a ZIP file and convert the GeoJSONs to Shapefiles using QGIS or a tool 
like mapshaper: https://mapshaper.org/

I'm not sure how old the data is or what the license is, but it has:

* 7 Ranges
* 16 Districts
* 67 Sub Divisions
* 180 Police Station Boundaries
* 224 Police Station Locations

I'm guessing this is the latest data, since even the Delhi Police page on 
Wikipedia mentions only 15 Districts.

Regards,
Vivek
On Friday, 24 February 2023 at 14:41:27 UTC+5:30 Anisha Garg wrote:

> Hello,
>
> I hope you are doing well! :)
>
> I am a PhD student, working on crime in India.
>
> I am writing on this platform for help regarding police jurisdiction 
> boundaries for Delhi. I saw that the shape files are available for 2014 (
> https://groups.google.com/g/datameet/c/G3EQ5ggZkKc/m/A5IHsj1AvXkJ). 
> However, I wanted to check if anyone has curated the latest set after the 
> change. I would appreciate any help on this front.
>
> Looking forward to any help! :)
>
> Thank You
>
> Warm Regards,
> Anisha
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/8a1a793d-397b-4e10-a2e8-e7707d103ceen%40googlegroups.com.

Re: [datameet] Re: Looking for list of census village names for CG and MP in Devanagari

[Vivek Matthew]

Hi Pradeep,

The 12k that you're seeing on GitHub seems to be a limitation with the 
number of lines of a single gist that can render on the web interface. The 
raw CSV file when downloaded should contain the 22k+ lines you're looking 
for: 
https://gist.githubusercontent.com/Vonter/dde3c47dfd3ca11e678cea61821aa099/raw/ba6b45cfcd8f1e7f17ef038ac1a08a70410630e0/villages.csv

Regards,
Vivek

On Monday, 13 February 2023 at 03:08:09 UTC+5:30 Pradeep Vanga wrote:

> Hi Vivek, it looks like the csv file contains only about 12k+ entries.
>
> (It looks like I replied to the author and not this thread earlier, I have 
> also scraped the data and uploaded it here :)  
> https://www.kaggle.com/datasets/vangap/madhya-pradesh-village-list )
>
> On Monday, February 6, 2023 at 9:49:48 PM UTC+5:30 Vivek Matthew wrote:
>
>> Hi Sharad,
>>
>> Nice catch regarding the switch to Hindi. The choice of English/Hindi 
>> names returned by the server is based on the cookie sent with the request.
>>
>> I've scraped the village list and put it as a CSV and JSON here: 
>> https://gist.github.com/Vonter/dde3c47dfd3ca11e678cea61821aa099
>>
>> There are 23170 villages in there, but based on my count it looks like 
>> there's about a dozen of them without Devanagiri names.
>>
>> On Saturday, 4 February 2023 at 11:01:58 UTC+5:30 shara...@gmail.com 
>> wrote:
>>
>>> [image: mndagofkncnplmoa.png]
>>> But btw, there is an option on the main PRD website to switch to Hindi, 
>>> and when I do that, then when I go searching for specific Gram Panchayats, 
>>> I do get this search menu, which suggests that at the backend somewhere the 
>>> Hindi lists also exist? Any ideas? 
>>> On Saturday, February 4, 2023 at 10:32:59 AM UTC+5:30 Sharad Lele wrote:
>>>
>>>> Dear Nikhil,
>>>>
>>>> Thanks for your help and yes, I assumed (incorrectly) that if the menus 
>>>> are in Hindi then the data will also be in Hindi/Devanagari! 
>>>> Unfortunately, 
>>>> as you pointed, out, the data are still in English/Roman script. 
>>>>
>>>> Which means I have to expand my request: any one who can find a website 
>>>> that has village name lists in Hindi/Devanagari (for MP in particular), 
>>>> please flag. If someone has the data already in Devanagari, great!
>>>>
>>>> Sreeram pointed out that the list on the govt of India's LGDIR website 
>>>> has devanagari names for some states, but in the case of MP, the column 
>>>> for 
>>>> names in Devanagari is very sporadically filled!
>>>>
>>>> Sharad
>>>>
>>>> On 04-Feb-23 10:11, Nikhil VJ wrote:
>>>>
>>>> Hi Sharad, 
>>>>
>>>> The site you linked is quite easy to scrape with basic GET api calls 
>>>> (aka you can open the url in browser also) giving the data in a proper 
>>>> structure that can be directly used by a program.
>>>>
>>>> *But : the data is all in English only.*
>>>>
>>>> Anyways, in case you want to scrape, can get someone to do using:
>>>>
>>>> Districts list:
>>>> https://www.prd.mp.gov.in/Handlers/Districts.ashx?DivisionID=0
>>>>
>>>> Take district ID from there to get local bodies list:
>>>> https://www.prd.mp.gov.in/Handlers/localbodies.ashx?DistrictID=*45*
>>>> _Rural=1
>>>>
>>>> Take "LBID" from there to get GP Zones:
>>>> https://www.prd.mp.gov.in/Handlers/GpZones.ashx?LbId=*24319*
>>>>
>>>>
>>>> Note to freshers in python coding who are looking for real world use 
>>>> cases to learn and apply their skills: This is a good starting project. 
>>>> Make 3 nested for loops and append all the results to a dict (json) 
>>>> array. At end, convert to a pandas dataframe, and output to CSV.
>>>> https://www.prd.mp.gov.in/Handlers/Districts.ashx?DivisionID=0
>>>> --
>>>> Cheers,
>>>> Nikhil VJ
>>>> https://nikhilvj.co.in
>>>>
>>>>
>>>> On Fri, Feb 3, 2023 at 12:10 AM Sharad Lele  wrote:
>>>>
>>>>> For instance, if someone can scrape the names from this website: 
>>>>> https://www.prd.mp.gov.in/GramSearch/SearchPanchayat.aspx  
>>>>> (sequentially, so as to get the district, block and GP tags also)
>>>>>
>>>>> On Thursday, February 2, 2023 at 9:47:01 PM UTC+5:30 Sharad Lele wrote:
>>>>>
>>>>>

Re: [datameet] Re: Looking for list of census village names for CG and MP in Devanagari

[Vivek Matthew]

Hi Sharad,

Nice catch regarding the switch to Hindi. The choice of English/Hindi names 
returned by the server is based on the cookie sent with the request.

I've scraped the village list and put it as a CSV and JSON 
here: https://gist.github.com/Vonter/dde3c47dfd3ca11e678cea61821aa099

There are 23170 villages in there, but based on my count it looks like 
there's about a dozen of them without Devanagiri names.

On Saturday, 4 February 2023 at 11:01:58 UTC+5:30 shara...@gmail.com wrote:

> [image: mndagofkncnplmoa.png]
> But btw, there is an option on the main PRD website to switch to Hindi, 
> and when I do that, then when I go searching for specific Gram Panchayats, 
> I do get this search menu, which suggests that at the backend somewhere the 
> Hindi lists also exist? Any ideas? 
> On Saturday, February 4, 2023 at 10:32:59 AM UTC+5:30 Sharad Lele wrote:
>
>> Dear Nikhil,
>>
>> Thanks for your help and yes, I assumed (incorrectly) that if the menus 
>> are in Hindi then the data will also be in Hindi/Devanagari! Unfortunately, 
>> as you pointed, out, the data are still in English/Roman script. 
>>
>> Which means I have to expand my request: any one who can find a website 
>> that has village name lists in Hindi/Devanagari (for MP in particular), 
>> please flag. If someone has the data already in Devanagari, great!
>>
>> Sreeram pointed out that the list on the govt of India's LGDIR website 
>> has devanagari names for some states, but in the case of MP, the column for 
>> names in Devanagari is very sporadically filled!
>>
>> Sharad
>>
>> On 04-Feb-23 10:11, Nikhil VJ wrote:
>>
>> Hi Sharad, 
>>
>> The site you linked is quite easy to scrape with basic GET api calls (aka 
>> you can open the url in browser also) giving the data in a proper structure 
>> that can be directly used by a program.
>>
>> *But : the data is all in English only.*
>>
>> Anyways, in case you want to scrape, can get someone to do using:
>>
>> Districts list:
>> https://www.prd.mp.gov.in/Handlers/Districts.ashx?DivisionID=0
>>
>> Take district ID from there to get local bodies list:
>> https://www.prd.mp.gov.in/Handlers/localbodies.ashx?DistrictID=*45*
>> _Rural=1
>>
>> Take "LBID" from there to get GP Zones:
>> https://www.prd.mp.gov.in/Handlers/GpZones.ashx?LbId=*24319*
>>
>>
>> Note to freshers in python coding who are looking for real world use 
>> cases to learn and apply their skills: This is a good starting project. 
>> Make 3 nested for loops and append all the results to a dict (json) 
>> array. At end, convert to a pandas dataframe, and output to CSV.
>> https://www.prd.mp.gov.in/Handlers/Districts.ashx?DivisionID=0
>> --
>> Cheers,
>> Nikhil VJ
>> https://nikhilvj.co.in
>>
>>
>> On Fri, Feb 3, 2023 at 12:10 AM Sharad Lele  wrote:
>>
>>> For instance, if someone can scrape the names from this website: 
>>> https://www.prd.mp.gov.in/GramSearch/SearchPanchayat.aspx  
>>> (sequentially, so as to get the district, block and GP tags also)
>>>
>>> On Thursday, February 2, 2023 at 9:47:01 PM UTC+5:30 Sharad Lele wrote:
>>>
 I am looking for the census village list for Chhattisgarh and Madhya 
 Pradesh (for starters) in Devanagari (Hindi script). Preferably with 
 Census 
 2011 codes, so that I can quickly match them to the Census dataset, which 
 is in English. But even if no codes attached, an accurate list with 
 tehsil/block and district tags in digital format (not pdf hopefully) will 
 be a big help.

 Any suggestions, folks?

 Sharad

>>> -- 
>>> Datameet is a community of Data Science enthusiasts in India. Know more 
>>> about us by visiting http://datameet.org
>>> --- 
>>> You received this message because you are subscribed to the Google 
>>> Groups "datameet" group.
>>> To unsubscribe from this group and stop receiving emails from it, send 
>>> an email to datameet+u...@googlegroups.com.
>>> To view this discussion on the web visit 
>>> https://groups.google.com/d/msgid/datameet/4c644c88-1d3b-4e71-81a2-2e48d6c794c3n%40googlegroups.com
>>>  
>>> 
>>> .
>>>
>> -- 
>> Datameet is a community of Data Science enthusiasts in India. Know more 
>> about us by visiting http://datameet.org
>> --- 
>>
>> You received this message because you are subscribed to a topic in the 
>> Google Groups "datameet" group.
>> To unsubscribe from this topic, visit 
>> https://groups.google.com/d/topic/datameet/x2kTZlgPeb4/unsubscribe.
>> To unsubscribe from this group and all its topics, send an email to 
>> datameet+u...@googlegroups.com.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/datameet/CAH7jeuMKboJCh71j%2Bncfbg%3DSbjpxjUVW4gWHk59VZ-2SKnN_7w%40mail.gmail.com
>>  
>> 
>> .
>>

[datameet] Re: GIS SIIDCUL - UTTARAKHAND

[Vivek Matthew]

Hi Saba,

When loading the site, there is a single 6.5 MB JSON file that gets 
downloaded and seems to have all the spatial data on the site. That JSON 
file can then be split into individual files corresponding to each spatial 
feature.

I've gone ahead and done this already, so you should be able to find 
GeoJSONs corresponding to each of the spatial features on the below GitHub 
repository. I've also included the script I used for splitting the JSON 
into the feature-wise GeoJSONs.

https://github.com/Vonter/uttarkhand-spatial-data

The repository should already cover all the data on the site but if I've 
missed any spatial data on the site, I could try and add it.

Regards,
Vivek

On Friday, 27 January 2023 at 13:39:16 UTC+5:30 smun...@gmail.com wrote:

> Hello, 
>
> Does anyone know how to get the data (spatial file) from this site: 
> https://gis-siidcul.com/
>
> Best,
> Saba
>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/0581fe2b-471d-4121-9a3c-1177823fa58fn%40googlegroups.com.

[datameet] Health related spatial data for Karnataka (UPHC/Health Jurisdictions)

[Vivek Matthew]

Hello everyone,

I was searching for a map with all the UPHCs in Bangalore and came across a 
KSRSAC map/site that had a map with 139 UPHCs, 30k+ Polio Immunization 
Centres and 50k+ Health Jurisdiction boundaries (PHC/CHC/Subcentre/Taluk 
Hospital). I went ahead with scraping it and have now put them up on 
GitHub: https://github.com/Vonter/karnataka-health-spatial-data/

There was a layer for Anganwadi locations as well but that had under 200 
features so it's probably missing most of them. I'm curious if anyone has 
come across any good sources for Anganwadi data as well that I could 
possibly add that to this repository.

Thanks,
Vivek

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/ca8b53ad-84d2-40fa-88f4-e94057283634n%40googlegroups.com.

Re: [datameet] Karnataka - Administrative boundaries by KSRSAC.

[Vivek Matthew]

If anyone is still interested in the polling station boundaries, I've 
scraped them and put them up on 
GitHub: https://github.com/Vonter/india-polling-stations

Regards,
Vivek

On Monday, 2 August 2021 at 21:22:04 UTC+5:30 Arun Ganesh wrote:

> Am especially curious about the polling station boundaries in the layer 
> list https://ksrsac.karnataka.gov.in/kgis/layers.aspx . Does anyone know 
> how to download them?
>
> On Sat, Jul 31, 2021 at 2:16 AM Arun Ganesh  wrote:
>
>> Thanks for sharing Sudhira. So good to see this.
>>
>> Tried to make a simple API to get the district/taluk/hobli/constituency 
>> at any point. 
>> 
>>  Feel 
>> free to play by changing the coordinates in the link.
>>
>> On Fri, Jul 30, 2021 at 12:36 PM Nikhil VJ  wrote:
>>
>>> Wow, amazing step forward by Karnataka govt, kudos to the folks who 
>>> pushed to make this happen!
>>>
>>> --
>>> Cheers,
>>> Nikhil VJ
>>> https://nikhilvj.co.in
>>>
>>>
>>> On Fri, Jul 30, 2021 at 10:11 AM H. S. Sudhira  
>>> wrote:
>>>
 Dear all,

 I am sure most of you have learnt that KSRSAC has put out the 
 administrative boundaries of Karnataka in SHP and KML file formats. In 
 case 
 you missed it, do check it out here: 
 K-GIS (karnataka.gov.in) 
  

 Please see related posts here: 

 https://www.linkedin.com/posts/ksrsac-gok_ksrsac-kgis-gis-activity-6825748090587361280-vb2K
 https://twitter.com/ksrsac_gok/status/1419981543557144582

 A key question is on the licensing of this data. Ideally, it should be 
 under the Open Government Data License (as per NDSAP). Hope they mention 
 it 
 explicitly. 

 Regards,
 Sudhira.

 -- 
 Datameet is a community of Data Science enthusiasts in India. Know more 
 about us by visiting http://datameet.org
 --- 
 You received this message because you are subscribed to the Google 
 Groups "datameet" group.
 To unsubscribe from this group and stop receiving emails from it, send 
 an email to datameet+u...@googlegroups.com.
 To view this discussion on the web visit 
 https://groups.google.com/d/msgid/datameet/CALhej%3D%3D_DMNhC9ejkQjMXi0eq2tBYPoQJypkuODJKtb0_7KMYw%40mail.gmail.com
  
 
 .

>>> -- 
>>> Datameet is a community of Data Science enthusiasts in India. Know more 
>>> about us by visiting http://datameet.org
>>> --- 
>>> You received this message because you are subscribed to the Google 
>>> Groups "datameet" group.
>>> To unsubscribe from this group and stop receiving emails from it, send 
>>> an email to datameet+u...@googlegroups.com.
>>> To view this discussion on the web visit 
>>> https://groups.google.com/d/msgid/datameet/CAH7jeuOSARtzWNJQ4UFODjrF-HdgKRHyVK9KKVCDvd7xibZAJQ%40mail.gmail.com
>>>  
>>> 
>>> .
>>>
>>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/8786d69f-ccaf-49ff-8734-9fa63154a0f5n%40googlegroups.com.

Re: [datameet] Any guide on how to scrape from leaflet maps

[Vivek Matthew]

Hi Vaidya,

I had come across this BWSSB site a couple of weeks back and found that 
it's missing a couple of STPs, including large ones like the 60MLD Hebbal 
STP and smaller ones like the one near Halasuru. From what I've seen, 
OpenStreetMap has better coverage of STP locations (and in some cases 
internal details) in the BWSSB region, so if you're still interested in 
BWSSB STP data, you might want to check the data on OpenStreetMap. This 
Overpass query should get you all the STPs in the BMRDA 
region: https://overpass-turbo.eu/s/1qto

Regards,
Vivek

On Monday, 12 December 2022 at 14:48:32 UTC+5:30 vaidyan...@gmail.com wrote:

> Found it, thanks!
>
> On Mon, Dec 12, 2022 at 2:43 PM Devdatta Tengshe  
> wrote:
>
>> Hi Vaidya,
>>
>> There isn't a single way to send data to a map built with leaflet, and 
>> there could be several different ways this could be done.
>>
>> Looking at the page you have mentioned, they have hardcoded the data in 
>> hidden input tags in the HTML itself, it should be straightforward to copy 
>> the data to a text file, and get the locations.
>>
>> Look in the source code for hidden input tags with names such as hid_1, 
>> hid_2 and so on.
>>
>>
>> Regards,
>> Devdatta
>>
>>
>> On Mon, 12 Dec 2022 at 14:36, Vaidya  wrote:
>>
>>> Am trying to get data of STP locations from this site:
>>> http://stpp.bwssb.gov.in/default.aspx
>>>
>>> Has anyone tried scraping from leaflet maps into shape files and written 
>>> a guide?
>>>
>>> Thanks,
>>> Vaidya
>>>
>>> -- 
>>> Datameet is a community of Data Science enthusiasts in India. Know more 
>>> about us by visiting http://datameet.org
>>> --- 
>>> You received this message because you are subscribed to the Google 
>>> Groups "datameet" group.
>>> To unsubscribe from this group and stop receiving emails from it, send 
>>> an email to datameet+u...@googlegroups.com.
>>> To view this discussion on the web visit 
>>> https://groups.google.com/d/msgid/datameet/CAHVy6PEnvZ%2Bt4qhODXmRgrrXrhHR5aAQR9OP3e_6TFauPvB3pg%40mail.gmail.com
>>>  
>>> 
>>> .
>>>
>> -- 
>> Datameet is a community of Data Science enthusiasts in India. Know more 
>> about us by visiting http://datameet.org
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to datameet+u...@googlegroups.com.
>>
> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/datameet/CAOQOUMtegTzKe%3DUaUdw34JTNO%2BnjxD9BVRDODQDo1jqddD_h%3Dg%40mail.gmail.com
>>  
>> 
>> .
>>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/977313b8-2d66-4c65-917b-cc220b786bd1n%40googlegroups.com.

Re: [datameet] Karnataka Polling Station Boundaries scraped from KSRSAC

[Vivek Matthew]

Thanks for the suggestion Sreeram. I have created a GitHub release with the 
Karnataka data in PMTiles and FlatGeobuf 
formats: https://github.com/Vonter/india-polling-stations/releases/tag/karnataka

I don't have much experience with GIS so apologies if these files don't 
work as expected, but I was able to load the FlatGeobuf file into QGIS 
successfully. Not too sure how to test if the PMTiles file is valid, but I 
think it should be correct too.

Regards,
Vivek
On Saturday, 6 August 2022 at 01:17:16 UTC+5:30 Vivek Matthew wrote:

> Hi Nikhil,
>
> I've moved the large files out of Git LFS and stored them as compressed 
> .zip files instead. This was my first time using Git LFS and I didn't 
> realize that it doesn't work in a straightforward way, apparently GitHub 
> even charges for LFS bandwidth usage in excess of 1 GB [1]. So I have also 
> removed the LFS files from the Git history, if anyone has pulled those 
> files, you may need to re-clone the repo again. The README.md has been 
> updated with details regarding the compressed files.
>
> Also thanks for pointing this out! I would not have realized this problem 
> otherwise.
>
> Regards,
> Vivek
>
> [1] - 
> https://docs.github.com/en/repositories/working-with-files/managing-large-files/about-storage-and-bandwidth-usage#tracking-storage-and-bandwidth-use
>
> On Sunday, 31 July 2022 at 09:06:17 UTC+5:30 nikh...@gmail.com wrote:
>
>> Hi Vivek, 
>>
>> Great work!
>> it looks like the big files are all in Github LFS
>>
>> Example: content of Karnataka.shp : 
>> version https://git-lfs.github.com/spec/v1
>> oid 
>> sha256:e32b9cfaa855993cabba3de1f860b248cac98cb53b1a5bf50b8913dda33ad044
>> size 106013972
>>
>> Can you tell how to download that, and add the same in the repo's readme ?
>>
>> --
>> Cheers,
>> Nikhil VJ
>> https://nikhilvj.co.in
>>
>>
>> On Sun, Jul 31, 2022 at 5:44 AM Vivek Matthew  
>> wrote:
>>
>>> Hello folks,
>>>
>>> I had scraped the polling station boundaries for Karnataka from the 
>>> KSRSAC site (https://kgis.ksrsac.in/pollinginfo/). The data is up on 
>>> this GitHub repo: https://github.com/Vonter/india-polling-stations
>>>
>>> There are a total of 60366 polling stations. On the repo there is a 
>>> Karnataka.geojson with the boundaries for all the 60366 polling stations 
>>> but it is a huge 156MB file. So I have also divided it into separate 
>>> GeoJSONs for each of the 224 Assembly Constituencies (~1MB each) and each 
>>> of the 31 districts (~6MB each) in Karnataka.
>>>
>>> I'll soon be adding Parliamentary Constituency level GeoJSONs. 
>>> Converting the GeoJSONs into other formats is also in the pipeline. If 
>>> anyone knows of other states that have similar sites which could be scraped 
>>> to generate polling station boundary GeoJSONs, I would be happy to try and 
>>> do so.
>>>
>>> When I was searching for Karnataka polling station boundary geodata a 
>>> few days back (out of interest in more granular population density geodata) 
>>> I didn't find it anywhere online. So I hope that someone else out there 
>>> searching for it will find this data useful now that it has been scraped 
>>> from KSRSAC.
>>>
>>> Regards,
>>> Vivek
>>>
>>> -- 
>>> Datameet is a community of Data Science enthusiasts in India. Know more 
>>> about us by visiting http://datameet.org
>>> --- 
>>> You received this message because you are subscribed to the Google 
>>> Groups "datameet" group.
>>> To unsubscribe from this group and stop receiving emails from it, send 
>>> an email to datameet+u...@googlegroups.com.
>>> To view this discussion on the web visit 
>>> https://groups.google.com/d/msgid/datameet/CAH8O8LdHebEeQcRWLjXf6t2UK9JHAZ10yR8O_MseD9ji5kygYw%40mail.gmail.com
>>>  
>>> <https://groups.google.com/d/msgid/datameet/CAH8O8LdHebEeQcRWLjXf6t2UK9JHAZ10yR8O_MseD9ji5kygYw%40mail.gmail.com?utm_medium=email_source=footer>
>>> .
>>>
>>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/91ddc04f-6302-4136-a0f8-553750851705n%40googlegroups.com.

Re: [datameet] Karnataka Polling Station Boundaries scraped from KSRSAC

[Vivek Matthew]

Hi Nikhil,

I've moved the large files out of Git LFS and stored them as compressed 
.zip files instead. This was my first time using Git LFS and I didn't 
realize that it doesn't work in a straightforward way, apparently GitHub 
even charges for LFS bandwidth usage in excess of 1 GB [1]. So I have also 
removed the LFS files from the Git history, if anyone has pulled those 
files, you may need to re-clone the repo again. The README.md has been 
updated with details regarding the compressed files.

Also thanks for pointing this out! I would not have realized this problem 
otherwise.

Regards,
Vivek

[1] 
- 
https://docs.github.com/en/repositories/working-with-files/managing-large-files/about-storage-and-bandwidth-usage#tracking-storage-and-bandwidth-use

On Sunday, 31 July 2022 at 09:06:17 UTC+5:30 nikh...@gmail.com wrote:

> Hi Vivek, 
>
> Great work!
> it looks like the big files are all in Github LFS
>
> Example: content of Karnataka.shp : 
> version https://git-lfs.github.com/spec/v1
> oid sha256:e32b9cfaa855993cabba3de1f860b248cac98cb53b1a5bf50b8913dda33ad044
> size 106013972
>
> Can you tell how to download that, and add the same in the repo's readme ?
>
> --
> Cheers,
> Nikhil VJ
> https://nikhilvj.co.in
>
>
> On Sun, Jul 31, 2022 at 5:44 AM Vivek Matthew  wrote:
>
>> Hello folks,
>>
>> I had scraped the polling station boundaries for Karnataka from the 
>> KSRSAC site (https://kgis.ksrsac.in/pollinginfo/). The data is up on 
>> this GitHub repo: https://github.com/Vonter/india-polling-stations
>>
>> There are a total of 60366 polling stations. On the repo there is a 
>> Karnataka.geojson with the boundaries for all the 60366 polling stations 
>> but it is a huge 156MB file. So I have also divided it into separate 
>> GeoJSONs for each of the 224 Assembly Constituencies (~1MB each) and each 
>> of the 31 districts (~6MB each) in Karnataka.
>>
>> I'll soon be adding Parliamentary Constituency level GeoJSONs. Converting 
>> the GeoJSONs into other formats is also in the pipeline. If anyone knows of 
>> other states that have similar sites which could be scraped to generate 
>> polling station boundary GeoJSONs, I would be happy to try and do so.
>>
>> When I was searching for Karnataka polling station boundary geodata a 
>> few days back (out of interest in more granular population density geodata) 
>> I didn't find it anywhere online. So I hope that someone else out there 
>> searching for it will find this data useful now that it has been scraped 
>> from KSRSAC.
>>
>> Regards,
>> Vivek
>>
>> -- 
>> Datameet is a community of Data Science enthusiasts in India. Know more 
>> about us by visiting http://datameet.org
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to datameet+u...@googlegroups.com.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/datameet/CAH8O8LdHebEeQcRWLjXf6t2UK9JHAZ10yR8O_MseD9ji5kygYw%40mail.gmail.com
>>  
>> <https://groups.google.com/d/msgid/datameet/CAH8O8LdHebEeQcRWLjXf6t2UK9JHAZ10yR8O_MseD9ji5kygYw%40mail.gmail.com?utm_medium=email_source=footer>
>> .
>>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/d756db96-f5c5-4c9b-8de1-7969cbab9288n%40googlegroups.com.

Re: [datameet] Karnataka Polling Station Boundaries scraped from KSRSAC

[Vivek Matthew]

Hi Nikhil,

I've moved the large files out of GitHub LFS and into the repository as 
compressed .zip files. This was my first time using Git LFS and I didn't 
realise it wasn't straightforward to download files with Git LFS 
(apparently GitHub even charges for bandwidth used in excess of 1GB [1]). 
The README.md has been updated with these details. I've also removed the 
files from the Git history, if anyone has pulled the files you may need to 
clone the repository from scratch otherwise there may be merge/pull 
conflicts.

Thanks for pointing this out, I would not have noticed this issue otherwise.

Regards,
Vivek

[1] 
- 
https://docs.github.com/en/repositories/working-with-files/managing-large-files/about-storage-and-bandwidth-usage#tracking-storage-and-bandwidth-use

PS: Apologies if you see this mail getting duplicated. I think I tried 
sending a mail on Sunday but got a message saying that approval was pending 
before the mail could be sent. I don't find any indication of an approval 
status so that might have been a bug.

On Sunday, 31 July 2022 at 09:06:17 UTC+5:30 nikh...@gmail.com wrote:

> Hi Vivek, 
>
> Great work!
> it looks like the big files are all in Github LFS
>
> Example: content of Karnataka.shp : 
> version https://git-lfs.github.com/spec/v1
> oid sha256:e32b9cfaa855993cabba3de1f860b248cac98cb53b1a5bf50b8913dda33ad044
> size 106013972
>
> Can you tell how to download that, and add the same in the repo's readme ?
>
> --
> Cheers,
> Nikhil VJ
> https://nikhilvj.co.in
>
>
> On Sun, Jul 31, 2022 at 5:44 AM Vivek Matthew  wrote:
>
>> Hello folks,
>>
>> I had scraped the polling station boundaries for Karnataka from the 
>> KSRSAC site (https://kgis.ksrsac.in/pollinginfo/). The data is up on 
>> this GitHub repo: https://github.com/Vonter/india-polling-stations
>>
>> There are a total of 60366 polling stations. On the repo there is a 
>> Karnataka.geojson with the boundaries for all the 60366 polling stations 
>> but it is a huge 156MB file. So I have also divided it into separate 
>> GeoJSONs for each of the 224 Assembly Constituencies (~1MB each) and each 
>> of the 31 districts (~6MB each) in Karnataka.
>>
>> I'll soon be adding Parliamentary Constituency level GeoJSONs. Converting 
>> the GeoJSONs into other formats is also in the pipeline. If anyone knows of 
>> other states that have similar sites which could be scraped to generate 
>> polling station boundary GeoJSONs, I would be happy to try and do so.
>>
>> When I was searching for Karnataka polling station boundary geodata a 
>> few days back (out of interest in more granular population density geodata) 
>> I didn't find it anywhere online. So I hope that someone else out there 
>> searching for it will find this data useful now that it has been scraped 
>> from KSRSAC.
>>
>> Regards,
>> Vivek
>>
>> -- 
>> Datameet is a community of Data Science enthusiasts in India. Know more 
>> about us by visiting http://datameet.org
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to datameet+u...@googlegroups.com.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/datameet/CAH8O8LdHebEeQcRWLjXf6t2UK9JHAZ10yR8O_MseD9ji5kygYw%40mail.gmail.com
>>  
>> <https://groups.google.com/d/msgid/datameet/CAH8O8LdHebEeQcRWLjXf6t2UK9JHAZ10yR8O_MseD9ji5kygYw%40mail.gmail.com?utm_medium=email_source=footer>
>> .
>>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/1b6e6466-d107-44c7-9c93-92736740d6adn%40googlegroups.com.

[datameet] Karnataka Polling Station Boundaries scraped from KSRSAC

[Vivek Matthew]

Hello folks,

I had scraped the polling station boundaries for Karnataka from the KSRSAC
site (https://kgis.ksrsac.in/pollinginfo/). The data is up on this GitHub
repo: https://github.com/Vonter/india-polling-stations

There are a total of 60366 polling stations. On the repo there is a
Karnataka.geojson with the boundaries for all the 60366 polling stations
but it is a huge 156MB file. So I have also divided it into separate
GeoJSONs for each of the 224 Assembly Constituencies (~1MB each) and each
of the 31 districts (~6MB each) in Karnataka.

I'll soon be adding Parliamentary Constituency level GeoJSONs. Converting
the GeoJSONs into other formats is also in the pipeline. If anyone knows of
other states that have similar sites which could be scraped to generate
polling station boundary GeoJSONs, I would be happy to try and do so.

When I was searching for Karnataka polling station boundary geodata a
few days back (out of interest in more granular population density geodata)
I didn't find it anywhere online. So I hope that someone else out there
searching for it will find this data useful now that it has been scraped
from KSRSAC.

Regards,
Vivek

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAH8O8LdHebEeQcRWLjXf6t2UK9JHAZ10yR8O_MseD9ji5kygYw%40mail.gmail.com.