Devdatta scraped it into a geojson :)

On 17/03/20 1:17 am, Thejesh GN wrote:
> Looks good.
>
> @guneet
> I think it's a good idea to cache the geojson on server and on browser
> (like localstoreage).
>
>
> Also the code for the scraper[1] is published now. Code quality isn't
> great but it works.
> https://github.com/datameet/covid19/blob/master/code/mohfw_data_scraper/scraper.py
>
>
>
> Thej
> --
> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
> http://thejeshgn.com
> GPG ID :  0xBFFC8DD3C06DD6B0
>
>
> On Tue, 17 Mar 2020 at 01:19, Guneet Narula <guneetnar...@sputznik.com
> <mailto:guneetnar...@sputznik.com>> wrote:
>
>     Forgot two points:
>
>     - I have added an active cases column. Seeing this in other
>     country dashboards/analysis that an idea of how many people have
>     not yet recovered or are still infectious is important. Right now
>     this is just calculated by subtracting numbers of discharged and
>     deaths from confirmed.
>
>     - In some cases, I am not able to find the district details. So I
>     have added them to the capital or "epicentre" of the cases in the
>     state.
>
>     - The map is not mobile friendly as of now.
>
>     Cheers,
>     Guneet
>
>     On Monday, 16 March 2020 12:35:19 UTC-7, Guneet Narula wrote:
>
>         Amazing, thanks Thej. I am going to get to it in sometime.
>
>         Just put this district-wise map together
>         https://fieldmaps.in/covid19/ based on news reports. Data
>         comes from a google sheet
>         
> https://docs.google.com/spreadsheets/d/e/2PACX-1vRlSCAn1nS4h9n9Fp25iuOsH54RfMUjj3xX5CZqjGUqYCVXgwgtJojuqVeqekazs2TkSJ95Jwplo7lL/pubhtml#
>
>         Some issues:
>
>         - I am using the district shapefiles from NIC's ArcGIS REST
>         services at
>         https://webgis1.nic.in/publishing/rest/services/bharatmaps
>         it's a bit slow and sometimes just times out completely
>
>         - State shapefiles makes it even slower, so I have ignored it
>         for now
>
>         - Code is a bit messy, and has some documentation here
>         https://github.com/guneetnarula/covid19-in any help would be
>         appreciated
>
>         - Coming to the data, it is not the same as the MoHFW one
>         since it is based on news reports. If any journalists or
>         people tracking the news closely would like to help with this,
>         then please let me know
>
>         More updates soon.
>
>         - Guneet
>
>
>         On 16/03/20 8:51 am, Thejesh GN wrote:
>>         I wrote about it so people can find it easily on Google. 
>>
>>         
>> https://thejeshgn.com/2020/03/16/novel-corona-virus-covid19-archive-api-india-data/
>>
>>
>>
>>
>>         Regards,
>>         Thej
>>
>>         Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
>>         http://thejeshgn.com
>>
>>         On Mon, 16 Mar, 2020, 5:58 PM Thejesh GN, <i...@thejeshgn.com
>>         <mailto:i...@thejeshgn.com>> wrote:
>>
>>             Extracted some more from archive.org <http://archive.org>
>>             and added them to the list. So now we have data from 10th
>>             March.
>>
>>             I also have a JSON dump for download at
>>
>>             https://github.com/datameet/covid19/tree/master/data
>>
>>             You can download and host it on your server if you like.
>>
>>             Also here is aggregation. It took about 5 days to double.
>>             At the same rate we will cross 200 by 20th.
>>
>>             
>> {"rows":[*{"key":["2020-03-10T12:00:00.00+05:30","total_confirmed"],"value":47},*
>>             
>> {"key":["2020-03-11T17:30:00.00+05:30","total_confirmed"],"value":60},
>>             
>> {"key":["2020-03-12T11:00:00.00+05:30","total_confirmed"],"value":73},
>>             
>> {"key":["2020-03-12T18:00:00.00+05:30","total_confirmed"],"value":74},
>>             
>> {"key":["2020-03-13T10:00:00.00+05:30","total_confirmed"],"value":75},
>>             
>> {"key":["2020-03-13T22:15:00.00+05:30","total_confirmed"],"value":79},
>>             
>> {"key":["2020-03-14T09:00:00.00+05:30","total_confirmed"],"value":83},
>>             
>> {"key":["2020-03-14T16:55:00.00+05:30","total_confirmed"],"value":84},
>>             
>> {"key":["2020-03-15T08:55:00.00+05:30","total_confirmed"],"value":93},
>>             
>> *{"key":["2020-03-15T12:00:00.00+05:30","total_confirmed"],"value":107},
>>             
>> *{"key":["2020-03-15T17:00:00.00+05:30","total_confirmed"],"value":107},
>>             
>> {"key":["2020-03-15T23:30:00.00+05:30","total_confirmed"],"value":110},
>>             
>> {"key":["2020-03-16T16:00:00.00+05:30","total_confirmed"],"value":114}
>>             ]}
>>
>>
>>
>>
>>
>>
>>
>>
>>             Thej
>>             --
>>             Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
>>             http://thejeshgn.com
>>             GPG ID :  0xBFFC8DD3C06DD6B0
>>
>>
>>             On Sun, 15 Mar 2020 at 19:39, Sunil Prabhakar
>>             <sunilpara...@gmail.com <mailto:sunilpara...@gmail.com>>
>>             wrote:
>>
>>                 Dear All,
>>                 Pl see.these websites. They might be helpful to you.
>>                 I can send some additional resources too if required.
>>
>>                 https://extranet.who.int/publicemergency👆 Covid 19
>>                 Dashboard
>>
>>                 https://portal.who.int/eios-coronavirus-newsmap/
>>                 👆Covid 19 Newsmap
>>
>>                 
>> https://www.who.int/emergencies/diseases/novel-coronavirus-2019
>>                 👆Covid 19 Website
>>
>>                 Thanks and Regards
>>                 Sunil
>>
>>                 On Sun, 15 Mar 2020, 12:31 pm Thejesh GN,
>>                 <i...@thejeshgn.com <mailto:i...@thejeshgn.com>> wrote:
>>
>>                     The data on http://www.mohfw.gov.in/ is getting
>>                     updated very slowly and there are some changes
>>
>>                     - They have renamed *Cured* to *Discharged*
>>                     - Discharged number is reduced to 10 from
>>                     9. **Don't know why. At 14.03.2020 at 04:55 PM it
>>                     was 10 and 15.03.2020 at 08:55 AM its 9.  UP had
>>                     5 as discharged and now its 3. Don't know what
>>                     happened *"2"*
>>
>>
>>                     On my side
>>                     - I am also to backup raw html -
>>                     https://github.com/datameet/covid19
>>                     - Parsed data is ar
>>                     
>> https://data.thejeshgn.com/covid19/_design/india/_view/incidents?include_docs=true&descending=true
>>
>>
>>
>>                     Thej
>>                     --
>>                     Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
>>                     http://thejeshgn.com
>>                     GPG ID :  0xBFFC8DD3C06DD6B0
>>
>>
>>                     On Sun, 15 Mar 2020 at 00:47, Thejesh GN
>>                     <i...@thejeshgn.com <mailto:i...@thejeshgn.com>> wrote:
>>
>>                         Some interesting data work
>>
>>                         Growth of cases: How long did it take for the
>>                         number of confirmed cases to double?
>>                         
>> https://ourworldindata.org/coronavirus#growth-country-by-country-view
>>
>>
>>
>>                         Thej
>>                         --
>>                         Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
>>                         http://thejeshgn.com
>>                         GPG ID :  0xBFFC8DD3C06DD6B0
>>
>>
>>                         On Sat, 14 Mar 2020 at 10:55, Guneet Narula
>>                         <guneetnar...@sputznik.com
>>                         <mailto:guneetnar...@sputznik.com>> wrote:
>>
>>                             This is great, thanks!
>>
>>                             On Friday, 13 March 2020 05:06:23 UTC-7,
>>                             Thejesh GN wrote:
>>
>>
>>                                 - I have been scraping and diffing
>>                                 the #COVID19 data at
>>                                 https://t.co/qhdbOGGaeh  every 12 hours
>>
>>                                 - Converting them into clean JSON and
>>                                 made a simple API
>>
>>                                 - You can use the below URL if you like
>>
>>                                 
>> https://data.thejeshgn.com/covid19/_design/india/_view/incidents?include_docs=true&limit=5&descending=true
>>
>>
>>
>>
>>                                 Regards,
>>                                 Thej
>>
>>                                 Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್
>>                                 http://thejeshgn.com
>>
>>                             -- 
>>                             Datameet is a community of Data Science
>>                             enthusiasts in India. Know more about us
>>                             by visiting http://datameet.org
>>                             ---
>>                             You received this message because you are
>>                             subscribed to the Google Groups
>>                             "datameet" group.
>>                             To unsubscribe from this group and stop
>>                             receiving emails from it, send an email
>>                             to datameet+unsubscr...@googlegroups.com
>>                             <mailto:datameet+unsubscr...@googlegroups.com>.
>>                             To view this discussion on the web visit
>>                             
>> https://groups.google.com/d/msgid/datameet/5de81071-deeb-461c-b2e6-81668d8b290c%40googlegroups.com
>>                             
>> <https://groups.google.com/d/msgid/datameet/5de81071-deeb-461c-b2e6-81668d8b290c%40googlegroups.com?utm_medium=email&utm_source=footer>.
>>
>>                     -- 
>>                     Datameet is a community of Data Science
>>                     enthusiasts in India. Know more about us by
>>                     visiting http://datameet.org
>>                     ---
>>                     You received this message because you are
>>                     subscribed to the Google Groups "datameet" group.
>>                     To unsubscribe from this group and stop receiving
>>                     emails from it, send an email to
>>                     datameet+unsubscr...@googlegroups.com
>>                     <mailto:datameet+unsubscr...@googlegroups.com>.
>>                     To view this discussion on the web visit
>>                     
>> https://groups.google.com/d/msgid/datameet/CAABnYsV8RXJaZjwYyNnbtb%3DUiAyMBeAj05ucLqef4%3DzxjtHLVA%40mail.gmail.com
>>                     
>> <https://groups.google.com/d/msgid/datameet/CAABnYsV8RXJaZjwYyNnbtb%3DUiAyMBeAj05ucLqef4%3DzxjtHLVA%40mail.gmail.com?utm_medium=email&utm_source=footer>.
>>
>>                 -- 
>>                 Datameet is a community of Data Science enthusiasts
>>                 in India. Know more about us by visiting
>>                 http://datameet.org
>>                 ---
>>                 You received this message because you are subscribed
>>                 to the Google Groups "datameet" group.
>>                 To unsubscribe from this group and stop receiving
>>                 emails from it, send an email to
>>                 datameet+unsubscr...@googlegroups.com
>>                 <mailto:datameet+unsubscr...@googlegroups.com>.
>>                 To view this discussion on the web visit
>>                 
>> https://groups.google.com/d/msgid/datameet/CAFD%2BCBKXmd2AG%3Dg2XNHodqQv0z99V9SF_J1k3fX7BrGEPqECyQ%40mail.gmail.com
>>                 
>> <https://groups.google.com/d/msgid/datameet/CAFD%2BCBKXmd2AG%3Dg2XNHodqQv0z99V9SF_J1k3fX7BrGEPqECyQ%40mail.gmail.com?utm_medium=email&utm_source=footer>.
>>
>>         -- 
>>         Datameet is a community of Data Science enthusiasts in India.
>>         Know more about us by visiting http://datameet.org
>>         ---
>>         You received this message because you are subscribed to a
>>         topic in the Google Groups "datameet" group.
>>         To unsubscribe from this topic, visit
>>         https://groups.google.com/d/topic/datameet/_HnOB5iyEx0/unsubscribe.
>>         To unsubscribe from this group and all its topics, send an
>>         email to datameet+unsubscr...@googlegroups.com
>>         <mailto:datameet+unsubscr...@googlegroups.com>.
>>         To view this discussion on the web visit
>>         
>> https://groups.google.com/d/msgid/datameet/CAABnYsUd8-Ffwd0y_oQQs%2BULKQNDhPwyv9oFDrb2UnPjbQ-Y9Q%40mail.gmail.com
>>         
>> <https://groups.google.com/d/msgid/datameet/CAABnYsUd8-Ffwd0y_oQQs%2BULKQNDhPwyv9oFDrb2UnPjbQ-Y9Q%40mail.gmail.com?utm_medium=email&utm_source=footer>.
>
>         -- 
>         sputznik.com <http://sputznik.com> / 9717664996
>         keybase.io/guneetnarula <http://keybase.io/guneetnarula>
>
>     -- 
>     Datameet is a community of Data Science enthusiasts in India. Know
>     more about us by visiting http://datameet.org
>     ---
>     You received this message because you are subscribed to the Google
>     Groups "datameet" group.
>     To unsubscribe from this group and stop receiving emails from it,
>     send an email to datameet+unsubscr...@googlegroups.com
>     <mailto:datameet+unsubscr...@googlegroups.com>.
>     To view this discussion on the web visit
>     
> https://groups.google.com/d/msgid/datameet/7650ad9d-3136-4ab5-9c32-14a8aa0b5087%40googlegroups.com
>     
> <https://groups.google.com/d/msgid/datameet/7650ad9d-3136-4ab5-9c32-14a8aa0b5087%40googlegroups.com?utm_medium=email&utm_source=footer>.
>
> -- 
> Datameet is a community of Data Science enthusiasts in India. Know
> more about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to a topic in the
> Google Groups "datameet" group.
> To unsubscribe from this topic, visit
> https://groups.google.com/d/topic/datameet/_HnOB5iyEx0/unsubscribe.
> To unsubscribe from this group and all its topics, send an email to
> datameet+unsubscr...@googlegroups.com
> <mailto:datameet+unsubscr...@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CAABnYsU3dMF_211wddYaTYY888bAnUoZkwPPyNtrrSGLq0Ui9Q%40mail.gmail.com
> <https://groups.google.com/d/msgid/datameet/CAABnYsU3dMF_211wddYaTYY888bAnUoZkwPPyNtrrSGLq0Ui9Q%40mail.gmail.com?utm_medium=email&utm_source=footer>.

-- 
sputznik.com / 9717664996
keybase.io/guneetnarula

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/ab599fa9-159f-579b-1bb9-025198e037c1%40sputznik.com.

Reply via email to