Hello, What do I need to do if I want to extract the Name of School and Lat Lon in a particular area?
On Sunday, May 22, 2016 at 6:14:31 PM UTC+5:30, Devdatta Tengshe wrote: > > Nihkil, > > There is a standard ArcGIS rest endpoint which is the backend for this > here: http://rsgis.nic.in/ArcGIS/rest/services/?f=json. > > What data do you want to extract? > > Regards, > Devdatta > > On Sat, May 21, 2016 at 4:04 PM, Venkata Pingali <[email protected] > <javascript:>> wrote: > >> I looked at this site some months back. Notes from my investigation then: >> >> 1. The content/jsons are being served by commercial GIS operated by BSNL >> 2. The content is coming back split across many JSONs (50-60) with >> encoded URLs >> 3. API appeared stateful (URLs kept changing) >> >> This, I concluded, needs a >> (a) phantom-like programmable browser control >> (b) network proxy/sniffer to dump all intercepted content >> (c) wrangling to relate data from across all the jsons >> >> I also believe that there are license issues. >> >> On May 21, 2016 3:51 PM, "Raphael Susewind" <[email protected] >> <javascript:>> wrote: >> >>> Hi Nikhil, >>> >>> most likely the flash application loads something like a JSON (or CSV, >>> if they are bad programmers ;-) ) from a specified API address. Use a >>> network sniffer to intercept the traffic that the flashplayer generates, >>> and see whether you can replicate the API. >>> >>> If you are lucky, you will see HTTP requests to an URL along the lines >>> of http://schoolgis.nic.in/state_x/data.json?school=0000001 to >>> 000014986. In that case, you can then manually scrape the JSON files (if >>> need be by emulating a flashplayer's HTTP headers, though I doubt that >>> they check for this). >>> >>> If you are unlucky, its a more complex API - some stateful frontends for >>> SQL databases can be very nasty to replicate, for instance. One brute >>> force kind of solution in such cases would be to write a custom proxy >>> server (there are python/perl/... modules for this) - i.e. a kind of >>> customized sniffer - and route your browser traffic through this, then >>> automate the browser (again, there are plugins for firefox and chrome >>> that have corresponding python or perl interfaces), and intercept the >>> traffic generated. That's the solution I found to scrape polling station >>> localities from the ECI server (before they put a bold copyright >>> disclaimer on it - now this kind of scraping would probably be illegal - >>> so do check these issues as well). >>> >>> Let us know what you find out about the API, >>> >>> Best of luck, >>> Raphael >>> >>> On 21.05.2016 11:43, Nikhil VJ wrote: >>> >>> > Hi friends, >>> > >>> > is their any way to extract data from such a flash player platform...as >>> > follows... >>> > >>> > schoolgis.nic.in <http://schoolgis.nic.in/> >>> > >>> > --regards, >>> > Nikhil VJ >>> > Pune >>> > >>> > -- >>> > Datameet is a community of Data Science enthusiasts in India. Know more >>> > about us by visiting http://datameet.org >>> > --- >>> > You received this message because you are subscribed to the Google >>> > Groups "datameet" group. >>> > To unsubscribe from this group and stop receiving emails from it, send >>> > an email to [email protected] <javascript:> >>> > <mailto:[email protected] <javascript:>>. >>> > For more options, visit https://groups.google.com/d/optout. >>> >>> -- >>> Dr Raphael Susewind | Associate, Contemporary South Asia Studies, Oxford >>> Snail Mail | Melanchthonstr. 4a, 33615 Bielefeld, Germany >>> Web & Twitter | https://www.raphael-susewind.de | @RaphaelSusewind >>> Impact | https://impactstory.org/raphael-susewind >>> >>> Please consider https://www.gnupg.org for encryption (key id 10AEE42F) >>> >>> -- >>> Datameet is a community of Data Science enthusiasts in India. Know more >>> about us by visiting http://datameet.org >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "datameet" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected] <javascript:>. >>> For more options, visit https://groups.google.com/d/optout. >>> >> -- >> Datameet is a community of Data Science enthusiasts in India. Know more >> about us by visiting http://datameet.org >> --- >> You received this message because you are subscribed to the Google Groups >> "datameet" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected] <javascript:>. >> For more options, visit https://groups.google.com/d/optout. >> > > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
