Dear Nikhil how can batch download data, https://imdpune.gov.in/lrfindex.php. This page give data wise data. how can download suppose 20 year data of temperature. Any python code to do this to bulk download in csv. Please update any code will very much neede
With Regards P.K.Pandey On Thu, Oct 6, 2022 at 7:28 PM Nikhil VJ <nikhil...@gmail.com> wrote: > Hi Georgelio, Vastav, > > While this link is down: > https://imdpune.gov.in/Clim_Pred_LRF_New/Grided_Data_Download.html > > Upon browsing around the IMD site I found under Climate Monitoring in top > menu, https://imdpune.gov.in/lrfindex.php > Side menu: Gridded Data Archive -> All the data is there and available > just fine. > > > So, taking offline my data dump to save my server's bandwidth. > > > -- > Cheers, > Nikhil VJ > https://nikhilvj.co.in > > > On Thu, Oct 6, 2022 at 6:38 PM Nikhil VJ <nikhil...@gmail.com> wrote: > >> Wow, Dead Internet Theory vibes 🤐 >> >> Ok, I've moved all the gridded data file copies that I had at my end to: >> https://server.nikhilvj.co.in/dump/imd_grid/ >> >> Disclaimer: they were download from <currently down> source >> <https://imdpune.gov.in/Clim_Pred_LRF_New/Grided_Data_Download.html> on >> 13th July 2022, and their sha256 checksums are at: >> >> https://github.com/answerquest/IMD-grid-data-work/blob/main/sha256_checksum_rain.txt >> >> https://github.com/answerquest/IMD-grid-data-work/blob/main/sha256_checksum_tmax.txt >> >> https://github.com/answerquest/IMD-grid-data-work/blob/main/sha256_checksum_tmin.txt >> >> Beyond that digital trail, no guarantee on integrity of the data from my >> side. Use at own risk. >> >> This code snippet should help you turn a file into a flat CSV table: >> >> import imdlib >> rain1 = imdlib.open_data('rain', 2010, 2010, >> 'yearwise').get_xarray().to_dataframe() >> rain2 = rain1[rain1['rain'] > -100].reset_index() >> rain2.to_csv('dump.csv',index=False) >> >> -- >> Cheers, >> Nikhil VJ >> https://nikhilvj.co.in >> >> >> On Thu, Oct 6, 2022 at 10:53 AM Akshay Kumar <akshay.cg...@gmail.com> >> wrote: >> >>> IMD_CSV.7z >>> <https://drive.google.com/file/d/1kYrptA1jYDhrAE5OiNQSQQrcpncQaRo_/view?usp=drive_web> >>> Clipped_rain_INDIA.7z >>> <https://drive.google.com/file/d/1JbZmrSJGMK87Ze6X2MPRWkt_SDw2I5TN/view?usp=drive_web> >>> Hi >>> Please find the attached shapefiles of the IMD Gridded rainfall dataset >>> clipped for India for the years 1990 to 2021. Also, I am attaching the csv >>> files of rainfall datasets, which were further used for creating shapefiles >>> of corresponding years. Please let me know if it solves your purpose. >>> You can clip out Himachal from the Indian shapefile. >>> >>> >>> >>> *Profound RegardsAkshay Kumar* >>> >>> *LinkedIn <https://www.linkedin.com/in/akshay-kumar-a68572118/>* >>> *+91-8198834098* >>> >>> P Please don't print this e-mail unless you really need to. Go Green. >>> *Every 3000 A4 Size papers costs 1 tree.* >>> >>> >>> On Thu, Oct 6, 2022 at 10:39 AM georg...@gmail.com <georgel...@gmail.com> >>> wrote: >>> >>>> Thank you Nikhil, As Vastav said that link is no longer available. Is >>>> there any chance that you have collected the data? I want data for Himachal >>>> from 2000 - 2021 >>>> Thank you >>>> >>>> On Thursday, 6 October 2022 at 03:11:55 UTC+5:30 >>>> f201...@hyderabad.bits-pilani.ac.in wrote: >>>> >>>>> Hi Nikhil >>>>> It seems like the link used to get data no longer works. The >>>>> government has likely made the data inaccessible. Did you download all the >>>>> files by any chance? Would it be possible to upload those in google drive? >>>>> >>>>> Thanks >>>>> Vastav Ratra >>>>> >>>>> On Wednesday, October 5, 2022 at 3:58:10 AM UTC+2 nikh...@gmail.com >>>>> wrote: >>>>> >>>>>> Hi Georgelio, >>>>>> >>>>>> I was able to extract the rainfall data just fine. >>>>>> Bit of programming is needed to get rid of junk data, and we need to >>>>>> work our way thru lot of files for multi-yr. Here is a repo with work >>>>>> done >>>>>> on it. >>>>>> >>>>>> https://github.com/answerquest/IMD-grid-data-work >>>>>> >>>>>> I made a viz of the data for a location nr my home in Pune, and the >>>>>> figures appear to corelate with local history (Panshet flood of 1962 for >>>>>> example shows up vividly). But I'd really like to know what the original >>>>>> raw data was using which the gridded data was obtained. >>>>>> >>>>>> I've loaded it all into a DB; should be able to get out specific data >>>>>> needed, let me know if you need for a particular location(s) and years >>>>>> range. >>>>>> >>>>>> Is there a use case for uploading a mirror dataset to zenodo or >>>>>> kaggle or someplace in simpler CSV form? (Big upload so better if there >>>>>> is >>>>>> a demand for it. Or, better if someone from the institution itself does >>>>>> it). I love the multi-dimensional array format they've used, but the junk >>>>>> values undo the storage savings (a .7z of flattened CSV may be smaller), >>>>>> and it's tougher to access for folks not in the know. >>>>>> >>>>>> - Nikhil >>>>>> https://nikhilvj.co.in >>>>>> >>>>>> On Tue, Oct 4, 2022, 15:37 georg...@gmail.com <georg...@gmail.com> >>>>>> wrote: >>>>>> >>>>>>> Hello all, >>>>>>> Gridded rainfall data for India in IMD is not working. I need >>>>>>> rainfall data for Himachal from 2010 to 2022. >>>>>>> Thanks >>>>>>> >>>>>>> -- >>>>>>> Datameet is a community of Data Science enthusiasts in India. Know >>>>>>> more about us by visiting http://datameet.org >>>>>>> --- >>>>>>> You received this message because you are subscribed to the Google >>>>>>> Groups "datameet" group. >>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>> send an email to datameet+u...@googlegroups.com. >>>>>>> To view this discussion on the web visit >>>>>>> https://groups.google.com/d/msgid/datameet/b6a669b9-6b30-41d6-bc22-cb960814bc6en%40googlegroups.com >>>>>>> <https://groups.google.com/d/msgid/datameet/b6a669b9-6b30-41d6-bc22-cb960814bc6en%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>>>> . >>>>>>> >>>>>> -- >>>> Datameet is a community of Data Science enthusiasts in India. Know more >>>> about us by visiting http://datameet.org >>>> --- >>>> You received this message because you are subscribed to the Google >>>> Groups "datameet" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to datameet+unsubscr...@googlegroups.com. >>>> To view this discussion on the web visit >>>> https://groups.google.com/d/msgid/datameet/628cda0d-26e3-4cf0-8e4e-fa7547a5d3efn%40googlegroups.com >>>> <https://groups.google.com/d/msgid/datameet/628cda0d-26e3-4cf0-8e4e-fa7547a5d3efn%40googlegroups.com?utm_medium=email&utm_source=footer> >>>> . >>>> >>> -- >>> Datameet is a community of Data Science enthusiasts in India. Know more >>> about us by visiting http://datameet.org >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "datameet" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to datameet+unsubscr...@googlegroups.com. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/datameet/CAH9bdtHQuk_uOM%2B0%3Da%2B8pDTPgP4HeNdbU2PaNB%2B2bT8CzAPiiw%40mail.gmail.com >>> <https://groups.google.com/d/msgid/datameet/CAH9bdtHQuk_uOM%2B0%3Da%2B8pDTPgP4HeNdbU2PaNB%2B2bT8CzAPiiw%40mail.gmail.com?utm_medium=email&utm_source=footer> >>> . >>> >> -- > Datameet is a community of Data Science enthusiasts in India. Know more > about us by visiting http://datameet.org > --- > You received this message because you are subscribed to the Google Groups > "datameet" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to datameet+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/datameet/CAH7jeuMv5Kx5zE7YMpNXVbxezrOkc7MqFCoKnB-hJxFy-e5eqA%40mail.gmail.com > <https://groups.google.com/d/msgid/datameet/CAH7jeuMv5Kx5zE7YMpNXVbxezrOkc7MqFCoKnB-hJxFy-e5eqA%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > -- WITH REGARDS DR. PANKAJ KUMAR PANDEY -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAPppCu5Eis3_%2BXudyGCu%3Dx5VrPSePV%2B01pWoyweuT5vaH3cfLg%40mail.gmail.com.
