Heads-up for folks in Pune : Mark your calendars for Jan 12th, DMers are organizing a meetup to get together and work on this data. We'll post details here when finalized.
----------- Hi Arun, Good is great, and I tell this to my interns : Never chase perfection, target 80% and take a break; then shoot for 80% in the next round and so on and we'll reach perfection iteratively. ;) That explains why the site didn't seem to be fetching any lat-long data.. it was all in that js. I still can't make out how the map is loading the tracks, though. ------ More on the train (ie, route) info: Two API calls are made my TrainOnMap site to fetch route info: Taking example of train no. 12438: 1. NTES : https://enquiry.indianrail.gov.in/ntes/NTES?action=getTrainData&trainNo=12438 >From this we get the following data: - train (route) code, name - schedule with each stop code, arrival, departure times. But this is main stops only. - but lat-long of station codes not given. - validity dates (at least from which date this schedule is active) - days of the week it runs on (as a 7 digit binary num like 1001010 ) - train type - journey duration - latest journey actual times, delays, timestamp of last update 2. RailGeo: https://enquiry.indianrail.gov.in/ntes/RailGeo?action=getTrainSchedule&trainNo=12438&trainStartDate=6%20Jan%202019 - This gives a flat json array (equivalent to flat table) of 205 rows, - many station codes. Presumably, these are all the stations the train passes, not just the main ones. Hence, intermediate stops can be obtained from here. - but no station names or lat-longs (That "Geo" makes the heart skip a beat but alas, no dice.) - other timing info is all zero'd so N/A. - day-count tells if it's the next day. - the date parameter in the URL can presumably be taken from the response of previous query --------------- Hi Jasvinder, Glad you liked it! We got some students together and mapped around 60 routes, 3000+ stops this past weekend with a next version of that. I'll start work on a version for railway station data. By android I assume you mean mobile-friendly. Been trying for that, but its a bit difficult to re-arrange the various parts and make all the functionality work. I really doubt if the precision needed can be obtained without a mouse. But you're welcome to have a go at it, we can talk it over. Regards Nikhil VJ Pune, India On Monday, January 7, 2019 at 10:05:03 AM UTC+5:30, Jasvinder Singh wrote: > > Dear Nikhil, > > Saw the interface. Its quite simple and easy to use even by newbies. > However is an android version of the same available? > It would be easy to update the databank whenever one is traveling and > comes across an unfamiliar station. > > Regards, > > Jasvinder Singh > > > On Fri, Jan 4, 2019 at 3:51 PM Nikhil VJ <[email protected] <javascript:>> > wrote: > >> Hi, >> >> If there's interest I can set up a mapping interface to crowdsource >> lat-longs. Along the lines of this: https://fuzzymapper.herokuapp.com/ >> But I would take a week to set up so tell. Though it would be best to get >> existing lat-long sets with the official station code and import them in, >> this can help cover the laggards. >> >> >> Also, if collective work on OpenRefine is required then I can help set it >> up on cloud and keep protected edit access. That won't take more time. >> >> >> Regards >> Nikhil VJ, Pune >> >> >> On Friday, January 4, 2019 at 12:43:17 PM UTC+5:30, Jasvinder Singh wrote: >>> >>> Dear Arun, >>> Exactly the type of simple data sheet that newbies can understand. >>> However how location (Coordinates) is linked in this file? >>> >>> On Fri, Jan 4, 2019 at 12:11 PM Arun Ganesh <[email protected]> wrote: >>> >>>> Spreadsheet if anyone wants to explore: >>>> https://docs.google.com/spreadsheets/d/1AFwl_5cB9qD39VWNox1LoeL3tGaGB22f7p4vc7IyMqY/edit#gid=0 >>>> >>>> There are 16,770 station entries of which 11,660 seem to be currently >>>> operational according to the expiry date of 2999. >>>> >>>> Filtering out goods stations, there are 9835 entries. This still seems >>>> to include a few yards and cabins that are not legitimate stations. Also >>>> noticed quite a few spelling and formatting issues in the names. The >>>> station codes look correct. Some amount of manual cleanup is needed on >>>> this >>>> list. >>>> >>>> The official number of stations according to IR is 7349 stations (as >>>> of 2017) >>>> <http://www.indianrailways.gov.in/railwayboard/uploads/directorate/stat_econ/IRSP_2016-17/Facts_Figure/Fact_Figures%20English%202016-17.pdf> >>>> and 1817 halts/block huts (2013) >>>> <http://www.indianrailways.gov.in/railwayboard/uploads/directorate/stat_econ/downloads/Data_Bank.pdf>. >>>> >>>> >>>> >>>> On Fri, Jan 4, 2019 at 11:53 AM Arun Ganesh <[email protected]> wrote: >>>> >>>>> Beauty of the internet, crawler got done by Srihari: >>>>> https://twitter.com/sriharithalla/status/1080801313707896837 >>>>> >>>>> JSON data: >>>>> https://api.apify.com/v1/execs/TsBwnYutP5u9FCKp5/results?format=json&simplified=1 >>>>> >>>>> I'm in the process of doing a little bit of cleanup using openrefine >>>>> and will share on a spreadsheet. >>>>> >>>>> On Fri, Jan 4, 2019 at 10:01 AM Jasvinder Singh <[email protected]> >>>>> wrote: >>>>> >>>>>> Dear All, >>>>>> >>>>>> Not all the members are familiar with intricacies of the data >>>>>> collection for such projects. Since this seems to be a crowd sourcing >>>>>> endeavour, I suggest that the basic data collection protocol be >>>>>> enumerated >>>>>> for newbies so that they can also contribute data which can then be put >>>>>> in >>>>>> proper format by professionals. >>>>>> >>>>>> Regards, >>>>>> >>>>>> Jasvinder Singh >>>>>> >>>>>> On Tue, Dec 25, 2018 at 10:32 AM Nikhil VJ <[email protected]> wrote: >>>>>> >>>>>>> Hi folks, >>>>>>> >>>>>>> There's a project afoot in the OpenStreetMap and Wikidata >>>>>>> communities to get together Indian Railways data. >>>>>>> >>>>>>> One major part of it: Properly mapping all the railway stations of >>>>>>> India, and ensuring they have wikidata entries. >>>>>>> >>>>>>> Here's a wiki page set up for it: >>>>>>> https://www.wikidata.org/wiki/Wikidata:WikiProject_Indian_Railways >>>>>>> >>>>>>> I'm cross-posting from OpenStreetMap India Telegram >>>>>>> <https://t.me/OSMIndia> group: >>>>>>> >>>>>>> (Arun Ganesh): There seems to be around 7000 stations located. There >>>>>>> still ~1.5k missing. A lot more need names, refs and wikidata links. >>>>>>> Overpass: *http://overpass-turbo.eu/s/EC4 >>>>>>> <http://overpass-turbo.eu/s/EC4>* >>>>>>> >>>>>>> >>>>>>> (Srihari Thalla) : Last year I created two MapRoulette Challenges to >>>>>>> tag station codes and add Wiki tags >>>>>>> *https://maproulette.org/mr3/challenge/2403 >>>>>>> <https://maproulette.org/mr3/challenge/2403>* >>>>>>> *https://maproulette.org/mr3/challenge/2404 >>>>>>> <https://maproulette.org/mr3/challenge/2404>* >>>>>>> >>>>>>> -------- >>>>>>> >>>>>>> The overpass query above queries the whole country and may be slow >>>>>>> or timeout. I adapted the query to work only on the map area being >>>>>>> viewed, so you can zoom into smaller regions. And changed a few things, >>>>>>> included a legend in the comments to explain. >>>>>>> >>>>>>> *https://overpass-turbo.eu/s/EL9 <https://overpass-turbo.eu/s/EL9>* >>>>>>> >>>>>>> >>>>>>> Want to get involved? Engage here. >>>>>>> >>>>>>> >>>>>>> >>>>>>> Regards >>>>>>> >>>>>>> Nikhil VJ >>>>>>> >>>>>>> Pune, India >>>>>>> >>>>>>> >>>>>>> PS: Posting on an older thread from '15 that had the perfect subject >>>>>>> line - didn't want to create yet another new thread. Pro tip: Use >>>>>>> Datameet from >>>>>>> google groups <https://groups.google.com/forum/#!forum/datameet> - >>>>>>> its more fun and you can find stuff that was posted long before you >>>>>>> joined. >>>>>>> >>>>>>> -- >>>>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>>>> more about us by visiting http://datameet.org >>>>>>> --- >>>>>>> You received this message because you are subscribed to the Google >>>>>>> Groups "datameet" group. >>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>> send an email to [email protected]. >>>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>>> >>>>>> -- >>>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>>> more about us by visiting http://datameet.org >>>>>> --- >>>>>> You received this message because you are subscribed to the Google >>>>>> Groups "datameet" group. >>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>> send an email to [email protected]. >>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>> >>>>> -- >>>> Datameet is a community of Data Science enthusiasts in India. Know more >>>> about us by visiting http://datameet.org >>>> --- >>>> You received this message because you are subscribed to the Google >>>> Groups "datameet" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to [email protected]. >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>> -- >> Datameet is a community of Data Science enthusiasts in India. Know more >> about us by visiting http://datameet.org >> --- >> You received this message because you are subscribed to the Google Groups >> "datameet" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected] <javascript:>. >> For more options, visit https://groups.google.com/d/optout. >> > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
