[datameet] Re: Rainfall Data (Unpivoted) [Need Visualization] {Script for unpivoting done}

2018-03-09 Thread Sandeep Kumar
I think that is pretty easy in pandas also i have analysed daily rainfall 
for jaipur for nearly five years 
here 
https://github.com/sandeepgadhwal/Rainfall-and-Stormwater-Analysis/blob/master/Rainfall_Analysis.ipynb

On Friday, 9 March 2018 16:09:13 UTC+5:30, Kshithij Iyer wrote:
>
> DataMeet Pune Rainfall Data (Unpivoted) 
>  
>
> This is a script which I developed for DataMeet Pune which takes an .xls 
> file which has rainfall data of India and generates state-wise .csv files 
> in an unpivoted format which can be useful for further analysis
>
>
> .
>
> What
>  
> does the script do? 
>
> Look at the unpivoting example.xlsx 
> 
>  
> file and this link 
> 
>  
> you'll get a hang of what the script does. :)
>
>  
> About 
> the data? 
>
> *Source of Data:* 
> http://www.indiawaterportal.org/articles/district-wise-monthly-rainfall-data-list-raingauge-stations-india-meteorological-department
>
> *Issues with the Raw data:* Chandigarh data is given under Chhattisgarh 
> sheet. A sepreated sheet had to be manually created so that the script can 
> run smoothy on the .xls file.
>
>
>
> List
>  
> of R packages needed by the code: 
>
>1. xlsx 
>2. tidyr 
>
>
> Manual
>  
> inputs needed to the script. 
>
>1. You'll have to choose the .xlsx file which has to be processed. 
>However the code does have manual logic as well which can be uncommented 
>and you can create .CSV files of specific sheets instead of the all the 
>sheets in the .xls file.
>2. The .csv file would be store in the ./Processed-Data folder and 
>You'll have to manually add "Sr.No", to the start of the .csv file.
>
>
> What
>  
> can be done with this data? 
>
>1. A choropleth map of the country with a timeline, the colours 
>changing to show amount of rainfall.
>2. A predective model for drought detection can be created.
>
>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[datameet] Re: Updated Taluk Shapefile!!

2018-03-09 Thread Justin

>
> Dilip,
>>
> Do you know where I can find a detailed boundary map for Tiswadi 
Subdistrict? 

Thanks!
Justin

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[datameet] Re: Updated Taluk Shapefile!!

2018-03-09 Thread Dilip Damle
HI, 

I just had a look at the files you sent. There are some differences. 

You could send me a list of doubts (may be a pm) and I will have a look on 
weekend.

On Wednesday, March 7, 2018 at 7:16:15 PM UTC+5:30, Justin wrote:
>
> think im close to cleaning up majority of villages > subdistricts. I 
> think Naroa split to 05611 and 05612 (05611 is Tiswadi and 05612 is 
> Bicholim). still a few weird things I have to troubleshoot and account for. 
> I just want to see how much of a process this will be, but for as much time 
> as I put into just Goa, I know larger states will take quite some time... 
> Cheers!
> Justin
>
>
> 
>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [datameet] Re: Updated Taluk Shapefile!!

2018-03-09 Thread J M
Dilip,
I'm finding quite a few differences; im the middle of editing all of them
now. Panaji is a bit tricky ;)

Once I finish, I will share. Not really finding any detailed maps or data
for Goa; maybe I should have started with an easier state!

Justin

On Fri, Mar 9, 2018 at 1:06 PM, Dilip Damle  wrote:

> HI,
>
> I just had a look at the files you sent. There are some differences.
>
> You could send me a list of doubts (may be a pm) and I will have a look on
> weekend.
>
>
> On Wednesday, March 7, 2018 at 7:16:15 PM UTC+5:30, Justin wrote:
>>
>> think im close to cleaning up majority of villages > subdistricts. I
>> think Naroa split to 05611 and 05612 (05611 is Tiswadi and 05612 is
>> Bicholim). still a few weird things I have to troubleshoot and account for.
>> I just want to see how much of a process this will be, but for as much time
>> as I put into just Goa, I know larger states will take quite some time...
>> Cheers!
>> Justin
>>
>>
>> 
>>
>> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to a topic in the
> Google Groups "datameet" group.
> To unsubscribe from this topic, visit https://groups.google.com/d/
> topic/datameet/QTBcPKZg9cs/unsubscribe.
> To unsubscribe from this group and all its topics, send an email to
> datameet+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[datameet] [Hackathon Announcement] McKinsey 24-Hour Hackathon For Coders & Data Scientists

2018-03-09 Thread Deepika Singhal
Hi,

Calling all coders and data scientists to join McKinsey 24-hour hackathon. 

March 10th is your opportunity to hack your way into the future—all in a 
limited span of 24 hours.  Show your skills by applying machine learning to a 
recommendation system.
 
Prizes: An all-expenses-paid trip to an international analytics conference
 
Starts on: 10 March 2018, 00:00 (GMT)

Register Here: 
https://datahack.analyticsvidhya.com/contest/mckinsey-analytics-online-hackathon-recommendation/

By participating you will have the opportunity to experience and overcome some 
of the challenges that leading global organizations face.

About McKinsey Analytics 
McKinsey Analytics equips clients with strategies and tools to gain meaningful 
insights from data and turn those into competitive advantages. We work together 
with global companies to make lasting improvements to their performance. We use 
data science, strategy, operations, implementation and change management 
solutions to help build analytics-driven organizations. Our teams of data 
scientists and data engineers work with clients to identify opportunities, 
assess available data, define solutions, ingest data, develop relevant 
algorithms and visualize outputs.

Come be a part of this hackathon. 


Regards
Deepika
-- 
This message contains confidential information and is intended only for the 
individual named. If you are not the name addressee you should not 
disseminate, distribute or copy this e-mail. You cannot use or forward any 
attachments in the email. Please notify the sender immediately by e-mail if 
you have received this e-mail by mistake and delete this e-mail from your 
system. Analytics Vidhya Educon Private Limited, DLF Phase 2, Gurgaon, 
India, www.analyticsvidhya.com

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[datameet] Re: Updated Taluk Shapefile!!

2018-03-09 Thread Dilip Damle
I would not know what would be authentic 
How about this wikipedia map

https://upload.wikimedia.org/wikipedia/en/1/10/Tiswadi_taluka_in_North_Goa_district.png


On Saturday, March 10, 2018 at 12:26:25 AM UTC+5:30, Justin wrote:
>
> Dilip,
>>>
>> Do you know where I can find a detailed boundary map for Tiswadi 
> Subdistrict? 
>
> Thanks!
> Justin
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[datameet] Rainfall Data (Unpivoted) [Need Visualization] {Script for unpivoting done}

2018-03-09 Thread Kshithij Iyer
DataMeet Pune Rainfall Data (Unpivoted) 
 

This is a script which I developed for DataMeet Pune which takes an .xls 
file which has rainfall data of India and generates state-wise .csv files 
in an unpivoted format which can be useful for further analysis


.
What
 
does the script do? 

Look at the unpivoting example.xlsx 

 
file and this link 
 
you'll get a hang of what the script does. :)

 
About 
the data? 

*Source of Data:* 
http://www.indiawaterportal.org/articles/district-wise-monthly-rainfall-data-list-raingauge-stations-india-meteorological-department

*Issues with the Raw data:* Chandigarh data is given under Chhattisgarh 
sheet. A sepreated sheet had to be manually created so that the script can 
run smoothy on the .xls file.


List
 
of R packages needed by the code: 
   
   1. xlsx 
   2. tidyr 

Manual
 
inputs needed to the script. 
   
   1. You'll have to choose the .xlsx file which has to be processed. 
   However the code does have manual logic as well which can be uncommented 
   and you can create .CSV files of specific sheets instead of the all the 
   sheets in the .xls file.
   2. The .csv file would be store in the ./Processed-Data folder and 
   You'll have to manually add "Sr.No", to the start of the .csv file.

What
 
can be done with this data? 
   
   1. A choropleth map of the country with a timeline, the colours changing 
   to show amount of rainfall.
   2. A predective model for drought detection can be created.


-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.