Re: [datameet] Bangalore road widths
Hi, if there are folks out there who're thinking about mapping this on-ground, then sharing some unsolicited and untested ideas: A real-world requirement for many logistics / transport folks is : which of the roads are too narrow to send my truck / 4-wheeler / tempo / e-rickshaw through? And frankly the people living there may also appreciate if map routers stopped sending wide bodied vehicles through their lanes. So if you aim at that, then you can drop all the wide roads from your task list and focus on just the narrow ones. That dataset can be built by selective querying of OSM data. See: https://wiki.openstreetmap.org/wiki/Key:highway Then, in many cases it might not be the whole stretch of road, but just the narrowest bottleneck on it that matters, as that point will decide what can (or rather shouldn't) pass through. So, mapping of just the narrowest points instead of lengths also cuts down your task load and reduces the scale, complexity and skill requirements for your operations considerably. One can take a simple photo of the point with geo-tagging on instead of having to capture data at every X meters etc. -- Cheers, Nikhil VJ https://nikhilvj.co.in On Fri, Apr 19, 2024 at 4:49 PM Vaidya wrote: > I found this map from KSRSAC. > https://data.opencity.in/dataset/bengaluru-road-width-map > > Many are proposed road widths, especially in outer areas. But the ones in > the centre of the city should be closer to reality. This data is from the > scrapped RMP 2031. > > Thanks, > Vaidya > > > On Tue, Apr 16, 2024, 5:28 AM kwatra...@gmail.com > wrote: > >> Hi all, >> Would you know of any data source which would have road width for >> Bangalore roads? >> OSM doesn't seem to have width tagged. >> >> Thanks, >> Kartik >> >> -- >> Datameet is a community of Data Science enthusiasts in India. Know more >> about us by visiting http://datameet.org >> --- >> You received this message because you are subscribed to the Google Groups >> "datameet" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to datameet+unsubscr...@googlegroups.com. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/datameet/449b12d6-b315-41eb-82ff-169c65b0efaan%40googlegroups.com >> <https://groups.google.com/d/msgid/datameet/449b12d6-b315-41eb-82ff-169c65b0efaan%40googlegroups.com?utm_medium=email_source=footer> >> . >> > -- > Datameet is a community of Data Science enthusiasts in India. Know more > about us by visiting http://datameet.org > --- > You received this message because you are subscribed to the Google Groups > "datameet" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to datameet+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/datameet/CAHVy6PHNGOfTZ65fY2bhRDq5La5x7ahAdUX%2B80nECf4OMdSUcg%40mail.gmail.com > <https://groups.google.com/d/msgid/datameet/CAHVy6PHNGOfTZ65fY2bhRDq5La5x7ahAdUX%2B80nECf4OMdSUcg%40mail.gmail.com?utm_medium=email_source=footer> > . > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAH7jeuMckmnSEG-tKeO4WPn-bn6UjbpNETcUwCnHa67_6CrjSg%40mail.gmail.com.
[datameet] Elections 2024 mapping
Hi, Some sharings, queries and call for information on elections 2024 (a bit late!) *1. Have the Parliamentary Constituencies seen any changes in their delimitations after 2019 elections?* Related links: Shapes: https://github.com/datameet/maps/tree/master/parliamentary-constituencies You can download just the folder using : https://download-directory.github.io/ For comparing with official ECI release: ECI press notes page : https://elections24.eci.gov.in/eci-updates.html There, at the bottom "General Election Schedule" opens a PDF which starts showing maps from pg59 onwards. direct link which might not directly open <https://elections24.eci.gov.in/docs/press-note-no-23.pdf> I've made high-res images of these pages and saved them here: https://server.nikhilvj.co.in/elections24/ Full India map from the ECI's PDF : https://server.nikhilvj.co.in/elections24/p-059-india-all-PCs-map.png J : I know there's changes. If anyone can share the new shapes of J PCs, would be really helpful. *2. Is there an interactive map of the Parliamentary Constiuencies, with election dates and other info?* If *not*, then one crowd-sourcing appeal: a. Open this google spreadsheet and request editing access (I'll approve if you don't sound like a spammer), or just do commenting: https://docs.google.com/spreadsheets/d/1Zj39sgQNqxN_iFRKDZ-itkJIZiELExpjwU_xB_6_C84/edit?usp=sharing b. Using the PDF mentioned above, find in the voting (also called "polling") date for the constituency, and paste it into this sheet. You can start from pg.63 onwards.. Some states are happening all at-a-go so those should be easier to tag. If yes, then pls ignore a & b and just share link to the interactive map, thanks much! *How filling the google spreadsheet can help:* I have shapefile with these columns. I can merge back in the election dates and publish the map. Here's a raw version without the dates: https://server.nikhilvj.co.in/elections24/2019-PCs-simp1.html Disclaimer : it's directly a render of the datameet 2019 PCs data, with a 100meter simplification done to reduce size. there are gaps in the shape data and some areas left out. That doesn't mean those folks can't vote, pls don't take it that way. -- Cheers, Nikhil VJ https://nikhilvj.co.in -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAH7jeuORDjvD7T%3DCnqb3M_8wJOTrPjqKR5BP7Lc%2B78qQ2Lh1hQ%40mail.gmail.com.
Re: [datameet] Elections 2024 mapping
Thanks Arun! Made a map! https://server.nikhilvj.co.in/elections24/election2024-map.html Used the same color scheme as on ECI's own map : https://elections24.eci.gov.in/img/map.png Screenshot: Source code: https://github.com/answerquest/india-elections2024-map Made it using folium lib in python this time. Would anybody know what these attributes mean: DOA example: 16-3-2024(Saturday) DOIN example: 20-3-2024(Wednesday) LDFN example: 27-3-2024(Wednesday) DSN example: 28-3-2024(Thursday) LDWC example: 30-3-2024(Saturday) DOCV example: 4-6-2024(Tuesday) -- Cheers, Nikhil VJ https://nikhilvj.co.in On Fri, Apr 26, 2024 at 5:56 PM Arun Ganesh wrote: > Timely initiative, Nikhil. > Managed to find a vector version of the ECI shapes. Have uploaded as a > simplified shape and points, and includes the phases and polling dates > https://gist.github.com/planemad/1e2b63f6b9806970db749f19980ffd25 > > On Fri, Apr 26, 2024 at 4:42 PM Nikhil VJ wrote: > >> Hi, >> Some sharings, queries and call for information on elections 2024 (a bit >> late!) >> >> >> *1. Have the Parliamentary Constituencies seen any changes in their >> delimitations after 2019 elections?* >> >> Related links: >> Shapes: >> https://github.com/datameet/maps/tree/master/parliamentary-constituencies >> You can download just the folder using : >> https://download-directory.github.io/ >> >> For comparing with official ECI release: >> ECI press notes page : https://elections24.eci.gov.in/eci-updates.html >> There, at the bottom "General Election Schedule" opens a PDF which starts >> showing maps from pg59 onwards. direct link which might not directly open >> <https://elections24.eci.gov.in/docs/press-note-no-23.pdf> >> >> I've made high-res images of these pages and saved them here: >> https://server.nikhilvj.co.in/elections24/ >> Full India map from the ECI's PDF : >> https://server.nikhilvj.co.in/elections24/p-059-india-all-PCs-map.png >> >> J : I know there's changes. If anyone can share the new shapes of J >> PCs, would be really helpful. >> >> >> >> *2. Is there an interactive map of the Parliamentary Constiuencies, with >> election dates and other info?* >> >> If *not*, then one crowd-sourcing appeal: >> a. Open this google spreadsheet and request editing access (I'll approve >> if you don't sound like a spammer), or just do commenting: >> >> https://docs.google.com/spreadsheets/d/1Zj39sgQNqxN_iFRKDZ-itkJIZiELExpjwU_xB_6_C84/edit?usp=sharing >> >> b. Using the PDF mentioned above, find in the voting (also called >> "polling") date for the constituency, and paste it into this sheet. You can >> start from pg.63 onwards.. >> Some states are happening all at-a-go so those should be easier to tag. >> >> If yes, then pls ignore a & b and just share link to the interactive map, >> thanks much! >> >> >> *How filling the google spreadsheet can help:* >> I have shapefile with these columns. I can merge back in the election >> dates and publish the map. >> >> Here's a raw version without the dates: >> https://server.nikhilvj.co.in/elections24/2019-PCs-simp1.html >> >> Disclaimer : it's directly a render of the datameet 2019 PCs data, with a >> 100meter simplification done to reduce size. there are gaps in the shape >> data and some areas left out. That doesn't mean those folks can't vote, pls >> don't take it that way. >> >> >> -- >> Cheers, >> Nikhil VJ >> https://nikhilvj.co.in >> >> -- >> Datameet is a community of Data Science enthusiasts in India. Know more >> about us by visiting http://datameet.org >> --- >> You received this message because you are subscribed to the Google Groups >> "datameet" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to datameet+unsubscr...@googlegroups.com. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/datameet/CAH7jeuORDjvD7T%3DCnqb3M_8wJOTrPjqKR5BP7Lc%2B78qQ2Lh1hQ%40mail.gmail.com >> <https://groups.google.com/d/msgid/datameet/CAH7jeuORDjvD7T%3DCnqb3M_8wJOTrPjqKR5BP7Lc%2B78qQ2Lh1hQ%40mail.gmail.com?utm_medium=email_source=footer> >> . >> > -- > Datameet is a community of Data Science enthusiasts in India. Know more > about us by visiting http://datameet.org > --- > You received this message because you are subscribed to the Google Groups > "datameet" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to datameet+unsubscr...@g
Re: [datameet] 2024 Lok Sabha election results
Hi all, Nice work Vivek! I was scraping to catch by *timestamp* how lead margins, vote counts change over time, from statewise results pages like this <https://results.eci.gov.in/PcResultGenJune2024/statewiseS011.htm> and PC-wise results pages like this <https://results.eci.gov.in/PcResultGenJune2024/ConstituencywiseS0124.htm> . I've collated the data and posted it along with scraping and collating (python) scripts on this github repo: https://github.com/answerquest/india-elections2024-results-timewise *Flaws in this data:* 1. Didn't catch it all from the beginning : leads-margins tally scraping was started from around *1:50 pm,* per-candidate vote numbers scraping was started from around *4.30pm.* 2. There would be some missed time intervals for some constituencies sometimes some pages didn't load, script errored out due to edge cases 3. I bungled up on applying "U" prefixes for union territories so those rows were scraped quite late. But all in all I think it's a pretty good dataset to make time-series viz's, to "audit" tallies over time and detect out-of-norm additions, etc for folks who are interested in settling some ongoing debates using data. *Disclaimer :* I'm only sharing the data as-was at those timestamps, this is secondary scraped data that is prone to flukes like a html tag mis-rendering causing a bad number to come in. If you find something odd, kindly lookup the official sources, file RTIs etc, but leave me out of it pls. *My compliments to Election Commission of India, in case anyone from there is reading:* 1. It was good to have whole integers of absolute vote counts given by ECI. Hope to see this maintained. This was a lot better than the rounded-off fractions of vote-shares we were getting during the US 2020 elections counting which had made it impossible to calculate the actual numbers of votes. 2. Good website work, consistent naming of each constituency / state's pages and consistent page structures. 3. Page-not-opening cases were there but were rare, and the chinks disappeared from around evening onwards when the declarations were happening and I'd expect more site visitors. On my part, I ensured my scripts were hitting 1-at-a-time only, kept adequate time intervals etc so that I don't bombard the server (to coders : this was intentional. Don't suggest "fixing" it by parallel threading etc, that gets you 429'd). 4. Candidates' photos were properly organized and were instantly rendered on all the PC-wise pages I was checking out. Which means each and every candidate was properly tracked in the DB and their files were properly linked and small thumbnails were kept, as opposed to past elections when there would only be scanned pages listing all the candidates's totals. One suggestion: converting these to .webp format will shrink the sizes and your egress loads by around 10x. 5. Even prior to election, voters lists were quite well managed, even the voter roll pdfs were easy to download, and it was quite easy to find our part + serial number provided we'd done our homework (which FYI was the only info we needed in hand apart from photo id on voting day, if you just shared these with the officer when you entered the booth, they'd locate your entry in 5 seconds and you would be done voting in under a minute.) 6. All in all, we've come a long way in digitization and making this data accessible to all, Thank you for all the work done. 7. It would be great if you published some inside stories of the technical infrastructure (server specs etc) used on 4th June for serving the website. -- Cheers, Nikhil VJ https://nikhilvj.co.in On Wed, Jun 5, 2024 at 9:25 AM Vivek Matthew wrote: > Hi all, > > I have scraped the 2024 Lok Sabha election results from the > results.eci.gov.in website. In case anyone is interested, you can find > the CSV with the results attached. > > Once constituency-wise turnout numbers are released for phase 7, I will > include additional columns for turnout and vote share numbers. > > Note that semicolon (;) is used as the column separator. > > Regards, > Vivek > > -- > Datameet is a community of Data Science enthusiasts in India. Know more > about us by visiting http://datameet.org > --- > You received this message because you are subscribed to the Google Groups > "datameet" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to datameet+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/datameet/0c95b2a3-27d3-4146-8ce3-44a49ae72f6fn%40googlegroups.com > <https://groups.google.com/d/msgid/datameet/0c95b2a3-27d3-4146-8ce3-44a49ae72f6fn%40googlegroups.com?utm_medium=email_source=footer> > . > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visitin
