Hi Folks, TL;DR : Exciting data challenges at bottom!
[image: payanam-map.jpg] Following up here after a lot has happened! We've done quite a bit of mapping and are at a point now where the remaining unmapped portions can use some attention from people who know Hyderabad like the back of their hand. So reaching out to such folks: Inviting you to review the routes on our work-site: https://server.nikhilvj.co.in/payanam/ . There's a bunch of pages - please use the top menu to navigate. (and please see the site from a wide screen and not a cell phone! It's a work-site! :P ). I won't get into explaining it all here but will advise the curious to play around like a naughty kid and click everything once or twice before reaching back with queries. If you know where some of these missing stops are supposed to be, or if a route has something entered wrong, then please let me know. Do check out the Map page where you can have a birds-eye view. You can contact me on nikhil.js [at] gmail.com or 9665831250. ----------------- DATA CHALLENGES We have some exciting challenges for the data, programming and GIS whizzes out there (no need to be from Hyd for this): - Visualize our metrics over time : https://server.nikhilvj.co.in/payanam/reports/stats.json : snazziest one gets officially embedded and featured, and don't give me simple stuff : I did that already <https://docs.google.com/spreadsheets/d/e/2PACX-1vRyx0IoaHg_taQ_-dZIdmGsGYjUpXHK05axp4m1xLe1il0eoQ7ruaPEm3Z5gmxeOaOQIoOU3aZ3o73Q/pubchart?oid=530185159&format=interactive> . - Find common patterns: If each trip is represented as a word/string with each unique stop being three letters (26^3 - who knew you could encode so much in 3 letters!), then can you detect the common substrings? Data: https://server.nikhilvj.co.in/payanam/reports/route_patterns.csv Expanding on this a bit: We want to know which routes have A > B > C > D pattern in common, in that order and not jumbled up. And don't bother with permutations-combinations : I ran a script doing that for 11 days straight on a server and didn't get far because there's gazillions of common patterns in 4000+ stops! - Detect all clusters of stops from a large data-bank that are located just X meters from each other. (contact for getting set up with the data) - Given a route of stops and a data-bank of existing stops, find the stops that might also be on that route. (contact for getting set up with the data) - Generate on-road paths of the routes using the stops as waypoints. The resulting data must be copyright-free. (contact for getting set up with the data) --------- PS: For those reading this thread first time : This is a joint project by World Resources Institute and Telangana Open Data Portal - interns may apply for any of the above mentioned tasks, but note that it'll be in this "just take it and do it" challenge format and not spoon-feeding / teaching format (Dude if I already knew, I'd finish this stuff myself!) Regards Nikhil VJ, Pune, India On Sunday, January 6, 2019 at 10:13:14 AM UTC+5:30, Nikhil VJ wrote: > > Hi Friends, > > We had a great mapping session yesterday. Most valuable was the tacit > local information of the participants. > We're changing venue and timings today : > > 6th Jan : continuation of Hyderabad Bus Routes mapping and discussion > about project > 3rd Floor, Abhyaas (opp JNTU gate, behind ICICI bank) > 1pm to 6pm (break around 3pm) > > > Regards > Nikhil VJ > > On Friday, January 4, 2019 at 3:27:32 PM UTC+5:30, Nikhil VJ wrote: >> >> Hi Folks, >> >> Apologies for the late post, but please share this with your friends in >> Hyderabad. We're conducting a Mapathon for mapping Hyderabad's Bus Routes. >> >> 5th, 6th Jan 2019, JNTU College, 10am to 6pm. Participants can also come >> on just one of the days. >> >> >> <https://i.imgur.com/7dvSfIt.jpg> >> >> Direct link to poster: https://i.imgur.com/7dvSfIt.jpg >> >> >> Regards >> Nikhil VJ, Pune, India >> >> >> On Tuesday, December 11, 2018 at 4:39:34 PM UTC+5:30, Nikhil VJ wrote: >>> >>> Hi Srihari, >>> >>> Session was good! Our main purpose was to announce about the project and >>> invite the larger GIS community in Hyderabad to come in and get involved, >>> share ideas or even take up some tasks if they feel inclined. So that >>> invite remains open - pls contact me on me [at] nikhilvj.co.in if >>> anyone wants to get involved and is ready for grunt work (I prefer >>> Hyderabad-based folks because you'll need to know those places, but there >>> are opportunities for folks outside too). >>> >>> I'm very excited about the possibility of detecting common patterns >>> between the routes, suggested by one of the participants whose group works >>> with Random Forest. If we can bring common pattern detection and editing to >>> routes management it'll mean a major time-saving in editing routes. >>> (Example use case: one more stop is added between two existing ones. The >>> change should get rippled across all the routes/trips that ply there.) >>> >>> I've copied links gathered at the session and written some detailed >>> explanations on this swecha forum post (finally seeing a discourse forum >>> that's India-specific), will follow up over there with more stuff so follow >>> it there. The data entry and route mapping apps we've developed can be >>> applied to other places too. I haven't published their code yet, hope to do >>> so soon. >>> >>> >>> https://discuss.swecha.org/t/9-dec-18-session-on-bus-routes-mapping-project-for-hyderabad/218 >>> >>> >>> Regards >>> Nikhil VJ >>> Pune, India >>> >>> -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
