[datameet] flights data
Hello. Any website you'd consider reliable for data on domestic flights? I'm not sure if flightstats and flightradar are accurate for India. I'm looking particularly for data on flight delays, but at the individual flight level and not aggregated for airports or airlines. Thanks! Rukmini -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] population data of taluk/sub districts for the states of Maharashtra, Gujarat, Dadar & Nagar Haveli
Hey, I'm looking for population data of taluk/sub districts for the states of Maharashtra, Gujarat, Dadar & Nagar Haveli. I tried looking up in census of india website but could not find the population data for taluks/sub districts. So, if you have any pointers on this, please let me know. Thank You. -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Looking for maharashtra village shapefile data
Hi all, I am ketki phd research scholar, i am looking for mahrashtra village shapefile data. Can somebody please guide me from where i can get this data. Thanks and regards ketki -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] [OT] CashlessConsumer
Hi all, //... Cashless is less about money, more about data ...// There are bunch of things related to data around cashless. There is also need for seeking more opendata for truly fair cashless systems, while seeking privacy / data protection laws. If you are interested to volunteer for CashlessConsumer , do reply me offlist. Thanks. More at http://blog.srik.me/2016/12/10/cashlessconsumer-why/ -- Regards Srikanth.L -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] 'Lives of Data' Workshop, Sarai-CSDS, January 5-7, 2017
The Sarai Programme, CSDS is organising the Lives of Data Workshop on 5th to 7th January, 2017. The workshop examines the historical and emergent conditions of data-driven knowledge production and circulation in India and South Asia. In the context of the Data Revolution, the workshop links emerging research on the history of statistics, new/old technological forms of inscription, digital infrastructures, and governance after Big Data in India and South Asia. The workshop brings together interdisciplinary researchers and practitioners with backgrounds in history of science, anthropology, media and technology studies, software engineering, data science, economics, and policy-making. It is a space to parse lateral connections and mine new ideas to explore the many lives of data, interrogating stable forms and tracking unexpected pathways. The schedule is available on our website - http://sarai.net/lives-of- data-workshop-january-5-7-2017/ Limited seats are available to attend the workshop. To register, please fill up the form available on the above link. We encourage you to use #LivesOfData to Post or Tweet about the workshop. Happy new year! Regards, Sandeep Mertia Research Associate Sarai-CSDS, Delhi -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Any way to get the booth level votes data?
Is there a way to get the bootj level votes data from ECI per candidate? I see this only aggregated at the constituency level. If we have this data we can apply some statistical analysis to detect any electoral fraud. (For example the techniques applied in this paper: http://www.pnas.org/content/109/41/16469.full) -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Is it possible to download census data for India before 1991
HI, The older census data was published in paper form as DCHB (district census hand book). I have seen them in librarries. Is this data available for download anywhere? May be scanned copies. Regards Dilip Damle -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] India GIS Data Update/ Questions
Hello Datameet! Haven't spoken to you all in a while. Several months ago I shared a complete 2011 villages dataset. Has anyone used it, added any metadata/ updates? Has any open gis data come to light in India? Telanagana's new districts? Any new admin 1,2,3,4 boundaries? Any new neighborhood gis data? Anyone have a trustworthy 2001>2011 census code table? Thanks, talk soon! -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] New Data portal on oil and gas resources
"The government will next week launch India's maiden National Data Repository (NDR) that will assimilate, preserve and upkeep country's vast sedimentary data for future use in oil and gas exploration and production." Read more at: http://www.millenniumpost.in/business/business-248664 -- Nisha Thompson DataMeet.org ni...@datameet.org skype: nishaqt mobile: 962-061-2245 -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Costing Strategies - Data & Data stories
Hi All! I am looking for organisations to study and find how costing strategies work for various kind of data sets and the stories/analysis we can find out of them. Can someone please point out if someone has seen something similar anywhere. Thanks & Regards, Shankesh 800 889 4848 -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Telegana Open Data Policy and portal
http://www.livemint.com/Companies/iZKdgU1KkQh4azdSKCZ31O/Telanganas-open-data-policy-to-help-startups-address-pub.html http://www.it.telangana.gov.in/telangana-open-data-policy-2016/ http://www.data.telangana.gov.in/ -- Nisha Thompson DataMeet.org ni...@datameet.org skype: nishaqt mobile: 962-061-2245 -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Data Deleted: PM Jan Dhan Yojana data archive
The PMJDY data on bank accounts has been removed from the website https://www.pmjdy.gov.in/archive. I archived it here. https://github.com/iotakodali/pmjdy These are currently pdfs, I may convert it into csv's later. If someone can fork it and convert it, please share back here Regards, Srinivas Kodali www.lostprogrammer.com -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Talk on Open Data Standards in Hyderabad
Hi All, We intend to regularly organize events on data in Hyderabad, part of this we are having a session on Open Data Standards at Gramener Hyderabad Office tomorrow Sep 14th from 5 p.m - 6 p.m RSVP here if you want to attend the talk. https://docs.google.com/forms/d/e/1FAIpQLSdWOpN3L1jPvftcJDne0- uabyGKOS14KVMoL0H0SY7NyGPyQg/viewform Regards, Srinivas Kodali www.lostprogrammer.com -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Ward-wise income data for Bangalore
Hi, sorry if I'm spamming the board too much, but would anyone know where I'd be able to get ward-wise income data in Bangalore? This data could per per capita, per household, or other. I'm looking for the kind of information collected in a study like this: http://www.ncaer.org/data_details.php?dID=16, specifically in Bangalore, on a ward-wise basis. Thanks! -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Is AgeGroup wise census data available anywhere at Village elevel
Hello, The primary census abstract at Village level has only two Age groups 0-6 and Above 6 Some Years back (before internet was common) we had got data with more Age groups directly from Census department. Is anyone aware of a place where such AGE GROUPING data is available Preferably at Village level if not at a may be district level. Regards Dilip Damle -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] White Paper on Data Protection framework for India - Public Comments invited White Paper on Data Protection framework for India - Public Comments invited
Please read and do send your comments http://meity.gov.in/white-paper-data-protection-framework-india-public-comments-invited Thej -- Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್ http://thejeshgn.com GPG ID : 0xBFFC8DD3C06DD6B0 -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] want to work with an experienced data scientist
Hello,I want to work with an experienced data scientist to get mentored voluntarily.does anyone know any data scientist in India that I can contact and arrange a meeting or call or mail.If yes please give info.Thank you -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [datameet] Re: [Urgent] Pre Budget meeting on the 11th
Hello All, Meeting went on quite well. Here is our final submission[1]. We also sent a one page summary to the ministry[2]. [1] http://datameet.org/wp-content/uploads/2017/12/recommendations_finance_ minister_prebudgetMeeting-201819_DataMeet.pdf [2] http://datameet.org/wp-content/uploads/2017/12/Notes_ PreBudgetMeetingIT201819_DataMeet.pdf Regards, Thej -- Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್ http://thejeshgn.com GPG ID : 0xBFFC8DD3C06DD6B0 On 10 December 2017 at 11:33, srinivas kodali <iota.kod...@gmail.com> wrote: > More points which can be presented during the pre-budget meeting. > > 1. The Economic Survey of 2016-17 briefly recognizes the importance of > data standards in e-governance. “National Centre for e-Governance > Standards and Technology” (NeST) has been tasked with the responsibility of > technical support to notify new e-governance standards. We request these > standards be promoted by default in IT procurement and building of > e-governance projects under Digital India program. We recommend capacity > building inside various government departments be increased with training > on the emerging e-governance and data standards. Storage of data using > e-governance standards brings interoperability and increases efficiency in > IT management. > > 2. As part of the IT procurement the data storage and ownership of data is > not always with the Government departments responsible for it, but data > rights maybe stored and owned by private players who may not archive this > data post the end of tenure of the IT project. Often the reason for this is > lack of storage space or server capacity within government departments. We > recommend IT grants be given to every government department to archive and > maintain data for long-term use. > > 3. Ministry of Commerce has constituted a Task Force on Artificial > Intelligence for Economic Transformation this year. We would like to bring > attention to the need for various open data sets in different sectors for > innovation in the space of Artificial Intelligence. The availability of > open data has helped fuel innovation in various parts of the world, Google > Maps was a direct result of NASA opening LANDSAT satellite imagery in > public domain. > > 4. There is a vast amount of non-personal Government data in the public > domain which is continuously collected to perform various scientific and > administrative tasks within the Government. Lot of private startups and > companies are unable to realize the full potential use for these data-sets > due to lack of licenses for data sharing, copyright limitations of > government owned data. We request relaxation of copyright on government > owned data by issuing data licenses for certain specific use cases in > public interest. > > 5. Various state governments are increasingly adopting the National Data > Sharing and Accessibility Policy (NDSAP) within their respective states to > promote government transparency and also Innovation. Sikkim, Telangana, > Tamilnadu and Orissa have adopted data policies part of their governance. > Telangana is promoting innovation in data further, to help bring data > skills and create jobs part of various data policies. We find the lack of > interest by various state governments to adopt NDSAP or any data policy is > due to lack of funds to promote the space and weak capacity in government > departments. To help NDSAP or data specific policy be adopted by all major > states, the ministry can provide incentives in the form of project specific > grants under Digital India for each state to build a State Data Portal on > the lines of data.gov.in > > 6. Cyber Security and Privacy are more important now than ever with India > transitioning into a Digital Economy and the Supreme Court's decision on > Fundamental Right to Privacy. With a Data Protection Bill expected to be > enacted in the next financial year, we recommend the government to increase > capacity in the space of data protection in various government departments > and follow the National Data Sharing Policy in classifying data-sets into > various categories of open data, sensitive personal data to manage data > publication effectively. > > Regards, > Srinivas Kodali > www.lostprogrammer.com > > On Sat, Dec 9, 2017 at 9:00 AM, srinivas kodali <iota.kod...@gmail.com> > wrote: > >> One of the important developments is to highlight the need of Open Data >> for Artificial Intelligence and stressing on relaxation of >> copyright/issuing licenses to Government owned data at-least as a start >> part of improving economic activity. >> >> Regards, >> Srinivas Kodali >> www.lostprogrammer.com >> >> On Fri, Dec 8, 2017 at 8:02 PM, Nisha Thompson <ni...@datameet
Re: [datameet] How does OSM store its data
Hi Nikhil, The Database design has been documented here: https://wiki.openstreetmap.org/wiki/Database This is, at its essence, a modified EAV Model( https://en.wikipedia.org/wiki/Entity–attribute–value_model). A good place to start researching for these kinds of database design, is to look at various documents on EAV, its shortcomings & Strengths. You should also evaluate if a NoSQL/Object Store database might be a better fit for your purpose, than designing an EAV Data model to be stored in a relational Database. Regards, Devdatta On Mon, Feb 5, 2018 at 11:12 AM, Nikhil VJ <nikhil...@gmail.com> wrote: > Hi, > > I want to learn how OpenStreetmap stores and manages its data, plus how > Overpass Turbo extracts it. > > I find the key-value pair system fascinating (variable fields, organic > building up of data) and want to replicate that elsewhere. Just the data > storing part.. don't want to generate map tiles etc. > > Any pointers? Any place I should ask? > > For those interested, here's a link to the project I have in mind: > Crowdsourcing-Map-based-data > <https://github.com/datameet-pune/datameet-pune.github.io/wiki/Crowdsourcing-Map-based-data> > > -- > Cheers, > Nikhil VJ > Pune, India > > -- > Datameet is a community of Data Science enthusiasts in India. Know more > about us by visiting http://datameet.org > --- > You received this message because you are subscribed to the Google Groups > "datameet" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to datameet+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Population Density per pincode
Hi All, Has anyone worked on computing population density per pincode ? Does post department maintain this data in any form ? We were planning to compute this from census data and our approach was Density per Pincode = ( Pop of district containing the pincode ) / ( Number of pincodes in that district ) *Source* : Census data and List of All Pincodes What is your opinion on this approach ? Regards, Pradeep -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Re: Population Density per pincode
Hello, >From first principles Population density means Population Divided Geographical Area. To compute area we need boundaries or the areas directly. I feel the Area or the boundary of a Pincode number is not available. May not be reliable. Population is also not available Pincodewise. But you have Population and area of villages Precisely in census Data. There are about 6.5 lakh Villages and Data for them is available. Latest Pincode directory has about 1.5 Lakh entries containing about 19000 Pincodes from Data.gov.in If you really want to work at Pincode Level then you will need to figure out how to link these to Data sets. I am not mentioning any specific source because it is confusing. - If you are going by District Data then you are not going at Pincode level. My guess ... - To the Best of my knowledge Census of India Villagewise areas are available only for 2001 census. Same data for 2011 is not released yet. On Wednesday, August 15, 2018 at 1:15:34 PM UTC+5:30, Pradeep wrote: > > Hi All, > > Has anyone worked on computing population density per pincode ? Does post > department maintain this data in any form ? > > We were planning to compute this from census data and our approach was > > Density per Pincode = ( Pop of district containing the pincode ) / ( > Number of pincodes in that district ) > > *Source* : Census data and List of All Pincodes > > What is your opinion on this approach ? > > Regards, > Pradeep > > > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Making 27.23TB of research data available!
"We've designed a distributed system for sharing enormous datasets - for researchers, by researchers. The result is a scalable, secure, and fault-tolerant repository for data, with blazing fast download speeds." http://academictorrents.com/ Is an interesting project. Can be used to distribute open data Thej -- Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್ http://thejeshgn.com GPG ID : 0xBFFC8DD3C06DD6B0 -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [datameet] Needed rivers of Kerala
Hi, I just rendered this data just to see I am just curious if there are any usecases or scenarios that we can use to help people in Kerala using this data by applying gis techniques. Happy to hear from anyone just to understand. -surya On Sat, Aug 18, 2018 at 2:19 PM Devdatta Tengshe wrote: > Here is the data in GeoJSON format > (Data was scraped from the India-WRIS server) > > > https://github.com/devdattaT/KeralaData > > Regards, > Devdatta > > On Sat, Aug 18, 2018 at 2:14 PM, Devdatta Tengshe > wrote: > >> Here is the data in GeoJSON format >> (Data was scraped from the India-WRIS server) >> >> Regards, >> Devdatta >> >> On Fri, Aug 17, 2018 at 2:02 AM, Karunakaran Akhil Dev < >> karunakhil...@gmail.com> wrote: >> >>> Updated rivers of kerala .shp and dams >>> >>> -- >>> Datameet is a community of Data Science enthusiasts in India. Know more >>> about us by visiting http://datameet.org >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "datameet" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to datameet+unsubscr...@googlegroups.com. >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> > -- > Datameet is a community of Data Science enthusiasts in India. Know more > about us by visiting http://datameet.org > --- > You received this message because you are subscribed to the Google Groups > "datameet" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to datameet+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > -- http://www.linkedin.com/pub/umasurya-sykam/6/736/10b/ -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Re: Historical Met Data from 1901 to 2002
Hello Dilip, I have scraped this data in case you need it in the form of a CSV. Let me know. Cheers, Balsher On Sunday, August 19, 2018 at 9:37:56 PM UTC-7, Naraina aka Dilip Damle wrote: > > Hello, > > Found this place where you can download historical Met Data for India > Districtwise from 1901 to 2002. > > > http://www.indiawaterportal.org/met_data/ > > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Re: Data Deleted: PM Jan Dhan Yojana data archive
I've pulled the data to csv files in https://github.com/pratapvardhan/pmjdy Data is pulled up from the pmjdy archive <https://www.pmjdy.gov.in/archive> - Consolated CSV file <https://github.com/pratapvardhan/pmjdy/blob/master/data/data.csv> - Weekly CSV files <https://github.com/pratapvardhan/pmjdy/tree/master/data/csv> - Since September 24, 2014 <https://github.com/pratapvardhan/pmjdy/blob/master/data/csv/2014-09-24.csv> - Till last week Regards, Pratap On Friday, September 8, 2017 at 8:11:40 AM UTC+5:30, srinivas kodali wrote: > > The PMJDY data on bank accounts has been removed from the website > https://www.pmjdy.gov.in/archive. I archived it here. > > https://github.com/iotakodali/pmjdy > > These are currently pdfs, I may convert it into csv's later. If someone > can fork it and convert it, please share back here > > Regards, > Srinivas Kodali > www.lostprogrammer.com > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Re: Sharing : Census 1991 _Village/Town Level PCA Data
Hi sumit, I did download the data and have it with me. I rechecked your link again It is the same file I have. But in the data you shared the 1991 data is not at Village / Town level. The data I have shared now is at the village/town level. On Friday, August 31, 2018 at 9:05:11 AM UTC+5:30, Sumit wrote: > > Hi Dilip and Karthik, > > I had shared the data on the forum a few years ago (Thejesh had created a > repo too; I can't find it now.). Resharing this - > https://sites.google.com/site/mishrasumitr/data?authuser=0 > Hope this helps. > > Sumit > > On Tuesday, 28 August 2018 19:44:10 UTC+5:30, Naraina aka Dilip Damle > wrote: >> >> HI, >> >> The PCA 2001 and 2011 are available in STATA format and there is a link >> somewhere on this group. >> I have got it from there. >> >> I am not sure but it may be in the Group repository. Please check. >> Better if someone else who knows about the repository answers. >> >> On Tuesday, August 28, 2018 at 7:37:27 PM UTC+5:30, Karthik Shashidhar >> wrote: >>> >>> Thanks, Dilip, for making this available. >>> >>> I'm downloading this, and will let you know in case I find any issues. >>> >>> Is the PCA for the 2001 Census available in a similar format? >>> >>> Thanks much >>> Karthik >>> >>> On Monday, 27 August 2018 19:58:39 UTC+1, Naraina aka Dilip Damle wrote: >>>> >>>> Hello, >>>> >>>> I think The Census 1991 PCA ... Primary Census Abstract data was not >>>> available in a collated form anywhere. >>>> >>>> hence started working on this and have created combined files in csv >>>> format using Data downloaded from Census website. >>>> >>>> Hers is the copy of the readme file that accompanies the data. >>>> >>>> == >>>> Reademe file for Census_1991_PCA Village/Town level data >>>> >>>> >>>> Source : Census of India Website : Digital Library >>>> >>>> Compiled by : Naraina Damle AKA Dilip Damle email : cadv...@gmail.com >>>> >>>> Files Included : 4 >>>> >>>> All_India.csv >>>> All_states.csv >>>> PCA_URBAN.csv >>>> PCA_Rural.csv >>>> >>>> Process done >>>> The individual files were downloaded and cleaned for missing Codes/ >>>> Names etc. and combined. >>>> The Total population was checked and verified at all the levels >>>> >>>> >>>> Changes done to data : >>>> >>>> 1. The state codes in individual files did not match the All India and >>>> state level file. Changed them according to all india. >>>> 2. Some states do not have Block and Nyaya Panchayat code. Added >>>> blank/0 value filed there. >>>> 3. All codes except Location code changed to numeric format from padded >>>> text format. >>>> 4. Added ISO state codes for easier identification. >>>> 5. Created Unique record_ID using ISO State codes and Locationcode >>>> 6. No change done to any Data beyond and including the place name >>>> >>>> Possible errors : >>>> >>>> There could still be some missing Names of Districts/Tehsils etc. >>>> >>>> >>>> Further improvments will be done later. >>>> >>>> >>>> Released this Version on 28August2018 >>>> >>>> May edit this file later with more specific cleaning done. >>>> >>>> >>>> >>>> Hers is the googeldrive link to the data : >>>> https://drive.google.com/drive/folders/1CNh5oaX3efZbW4yo8GXqbufjy57cMR09?usp=sharing >>>> >>>> I request interested people to have a look at it and we will rectify >>>> any shortcomings and then load it in the repository. >>>> >>>> If you need the MS Access file which I used to work with this data then >>>> send me a private mail. >>>> >>> -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Open Water Data - Precipitation
Hi all, we (Datameet Pune & CIS) have released the first version of our web app for rainfall data, allowing you to download daily rainfall data for an area of your interest for the time period from 1981 to 2017 http://www.indiawaterportal.org/articles/open-water-data-integrated-water-science the dataset used to show precipitation data is CHIRPS v 2.0, the same dataset used by the IIT Gandhinagar team in their recent publication. http://www.thehindu.com/sci-tech/science/iit-team-develops-system-to-monitor-drought-in-south-asia/article19803285.ece P.S.: Do note however that their dataset has been further corrected for errors and biases to compare it with IMD data, which we haven't done yet. Planning to do so in the coming months. Few requests 1) If there's anyone out here who has scraped IMD weather station data in the past few years we would very much like to see that, it would help in further validating the CHIRPS data. Please do get in touch. 2) If anyone out here works in water resources/hydrology/RS or is interested in the same we would like to chat to see how we can take this work further. 3) We need people to test out the app and give feedback or point out issues. Fill out a short feedback form here <https://docs.google.com/forms/d/e/1FAIpQLSeRiwn-fBp1P-UAV9HKLGnrEjJWW6gw8E-OMTfR9qxdJrHdKw/viewform> Best Craig -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] [Hackathon Announcement] McKinsey 24-Hour Hackathon For Coders & Data Scientists
Hi, Calling all coders and data scientists to join McKinsey 24-hour hackathon. March 10th is your opportunity to hack your way into the future—all in a limited span of 24 hours. Show your skills by applying machine learning to a recommendation system. Prizes: An all-expenses-paid trip to an international analytics conference Starts on: 10 March 2018, 00:00 (GMT) Register Here: https://datahack.analyticsvidhya.com/contest/mckinsey-analytics-online-hackathon-recommendation/ By participating you will have the opportunity to experience and overcome some of the challenges that leading global organizations face. About McKinsey Analytics McKinsey Analytics equips clients with strategies and tools to gain meaningful insights from data and turn those into competitive advantages. We work together with global companies to make lasting improvements to their performance. We use data science, strategy, operations, implementation and change management solutions to help build analytics-driven organizations. Our teams of data scientists and data engineers work with clients to identify opportunities, assess available data, define solutions, ingest data, develop relevant algorithms and visualize outputs. Come be a part of this hackathon. Regards Deepika -- This message contains confidential information and is intended only for the individual named. If you are not the name addressee you should not disseminate, distribute or copy this e-mail. You cannot use or forward any attachments in the email. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. Analytics Vidhya Educon Private Limited, DLF Phase 2, Gurgaon, India, www.analyticsvidhya.com -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Re: Seeking use cases with data | Solving India's problem through data science
https://www.kaggle.com/kiva/data-science-for-good-kiva-crowdfunding https://www.kaggle.com/doyouevendata/kiva-poverty-targeting/notebook On Wednesday, April 18, 2018 at 2:45:38 PM UTC-5, Nishant Gupta wrote: > Hi All > > I've been a regular reader of the posts on this group. I've found this group > to be very informative for GIS related initiatives. > > For past few weeks, I have been deliberating/researching around > India-specific challenges that can be solved using data science and advanced > analytics. > However, for most of these challenges, I don't find relevant or big enough > data that can be used for solving it. > > data.gov.in have many but very small, summarised datasets. These are not good > enough to create data-based solutions/products. > > I'm just getting started in this deliberation, but I feel that many on this > forum have much more experience/knowledge on this front. Hence, I'm reaching > out to gather some ideas. > > In your view, what are some of the most impactful challenges that India needs > to overcome AND we have free, relevant, and granular enough data available to > try and tackle those? Streaming/ real-time data would be even better! > > The second part of the question filters out a lot of use cases... but that's > my understanding, and may very well be under-developed. > > Any thoughts around this are welcome. > > Thanks > Nishant Gupta -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Re: Town Amenities data (Houselisting)
Hello, Census website was down. Now it is working. On Monday, March 12, 2018 at 7:10:59 AM UTC+5:30, Rashmi Kulranjan wrote: > > Hi, > I'm looking for town amenities data/ houselisting data for Karnataka and > Tamil Nadu for the year 1991 and 2001. Could someone please help me with > it? It is not accessible on census website currently. -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Crime against women data by NCRB
Hi all, I am a student at National Institute of Design. I wanted to reach out to you to ask for some help on a project I am working on. I am creating an interactive website for India's crime data as part of my thesis project. I have been using the data provided by NCRB as part of their report for 2016. (That's the last public report I could find) First & foremost I was wondering if I can find more recent crime data (2017 or 2018) would really appreciate it if someone can guide me to the right place to get this as NCRB doesn't have any data beyond 2016. Also while working on the data from the 2016 report, I found a lot of discrepancies specifically in terms of the calculations (mismatch of totals mainly) I was wondering if someone has feedback on how to clean/understand discrepancy in the data? Also tI was surprised to find a major caveat I found in the NCRB report which follows the practice of basing data collection upon the “principal offence” rule. In short, if a rape also involves the murder of a victim then the crime is recorded as a murder and not a rape. This means that some of the most brutal and high profile rape cases in recent memory would not be a part of a dataset. How to deal with this caveat? I would really appreciate any help/suggestions/feedbacks. Also would like to get in touch with others who are looking at this dataset and trying to do something with it. Please feel free to ping me here or email me separately. Cheers, Paridhi -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [datameet] Policy alert - NDAP National Data & Analytics Platform
Hello, When there already is a data.gov.in initiative, why has NITI Aayog decided to embark on the NDAP project? How exactly will NDAP be different? Data.gov.in is a very good initiative but when it comes to datasets, there are a lot of ministries that put the data there (data.gov.in) and it is done by choice. But they also put a lot more information on their (minstry’s) own websites. Some of them have put the data there (data.gov.in) but there is no compulsion to put data there. Some of the datasets have been put there for two or three years and discontinued now. We are picking data directly from the ministry’s website — that will be our primary source — and convert them and standardise the format. Also, there are a lot of data on state government websites that are not captured at all, and we will be having data from there also. https://factordaily.com/niti-aayogs-avik-sarkar-aims-for-democratized-data-led-discussion-and-analytics-in-india/ On Friday, 12 October 2018 12:33:26 UTC+5:30, satyaakam wrote: > > On Fri, Oct 12, 2018 at 12:23 PM Srinivas Karuturi > wrote: > >> Satya, >> >> The RFP is available at this link NDAP >> <http://niti.gov.in/writereaddata/files/tenders/AMENDED-RFP-ndap.pdf> >> > thanks i will go through it > > >> The RFP says you can attend the meeting for clarifications and there is >> no need to register for it. I will drop an email to see if we need a >> special invite. >> > > it would be good for those of you who are interested can collate some > questions after reading the document and we would be happy to raise them in > the meeting from our side as DataMeet > > thanks, > -Satya > Satyaakam.net <http://satyaakam.net/> | afrost.org | fossevents.in > <http://www.fossevents.in/> > ** For all official purposes use my name as Satyakam Goswami ** > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Data on Constituency-level Census Measures for Hyderabad
Hi all, I am looking for a way to map Census 2011 data to the different assembly constituencies in Hyderabad district. However, the wards in the census data do not match those in the delimitation notification. Any suggestions on how I could resolve this would be very helpful. Thank you so much! Shruti -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/5b5bb38b-e880-4cb0-9ba7-c974e4746530%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Data regarding subsidies in India
Hello All, I am a postgraduate student of Economics and have been working on a project involving subsidies in India. Do any of you know where I can find the data for year wise expenditure on subsidies by the central as well as state governments? Getting the data for the different components of the subsidies would be an added bonus. -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/35dff077-fc94-4ac2-b69f-f713ac62be12%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Re: Open Data Portal for smart cities
Speaking of data.gov.in, any idea of the rationale behind asking you for the "purpose" of getting the data before downloading it? Doesn't it make the data less open if you need to go through a statement-of-purpose loop? -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/aa2ad410-3bf6-4895-9d52-852abdc9a4c9%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Traffic counts - Data set for Indian city
Hi, Does anyone know where can I find traffic count data set of any Indian city? I am particularly looking for peak hour traffic data for research. Regards, Shravan -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CADn1HW9UR5aoV8zkNDiO2goMMRFn0JXA%3DXHzv%2BQiE0cVdkRiJQ%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Found NASA rainfall data TRMM
Hello, Just came across this website which has world rainfall data since about 1998. http://www.geog.ucsb.edu/~bodo/TRMM/ There are more and more detailed datasets available google "TRMM Data." -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/4fb67952-8fd4-4c77-9c13-46690398f46e%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Re: [Datameet] Groundwater Level Data
Hi Fazil, Looks like WRIS site is on a revamp mode and data download is all obscured by less useful graphics. Here is a link for the old site, hope you can download data district-wise from here: http://59.179.19.250/GWL/GWL.html?UType=R2VuZXJhbA==?UName= Considering that this data might have short access time, it would be great if volunteers can download data for all States(till 2018) and make it available for all future users! Any takers? :) Hope there is no any limitation on sharing this data, I have downloaded data for Karnataka, AndhraPradesh, Telangana, TamilNadu and Kerala. I can share it from a github site regards sashi On Friday, August 9, 2019 at 7:24:05 PM UTC+5:30, Fazil Khan wrote: > > Hi, > > I wanted to download groundwater level data for the Delhi-NCR region > station-wise for the last 10 years. I am trying this WRIS source ( > http://tamcnhp.com/wris/#/groundWater) but I am not able to download > cumulative numbers for the entire period. It only gives me numbers for a > single year, that too for the whole district and not the specific stations. > > Can anyone help? > > regards, > Fazil > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/8223071f-9258-4d7c-85c7-4df711642844%40googlegroups.com.
[datameet] Data Ethics: Contesting Truth and Rearranging Power – Data Science Blog by Domino
https://blog.dominodatalab.com/data-ethics-contesting-truth-and-rearranging-power/ ? Regards, Thej Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್ http://thejeshgn.com -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAABnYsVn-8e45rycpxr_uUCLCUsadeRz3WP2tQz%3Dr0zsE%2BPGLw%40mail.gmail.com.
Re: [datameet] Data on Railway Passenger Traffic
the passenger data(including segmental revenues and passenger KM) can be got from Railways statistics yearbook from MOSPI site On Tue, Jul 16, 2019 at 1:15 AM Rithika Kumar wrote: > Dear all, > > I had a question regarding the availability of/ access to Railway > passenger traffic data. Is this data publicly available? i am looking for > the data on origin to destination trips made by passengers on Indian > railways. It was used in the Economic Survey, 2017 (Chapter 12: > https://www.indiabudget.gov.in/budget2017-2018/es2016-17/echap12.pdf). > > Any leads on this will be greatly appreciated. > > Best, > Rithika > > -- > Datameet is a community of Data Science enthusiasts in India. Know more > about us by visiting http://datameet.org > --- > You received this message because you are subscribed to the Google Groups > "datameet" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to datameet+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/datameet/2a1fc108-9f8b-4e14-9e94-cbb2ce307308%40googlegroups.com > . > For more options, visit https://groups.google.com/d/optout. > -- Regards Venkat +91 8754464737 'It is a capital mistake to theorize before one has data. ~ S̶h̶e̶r̶l̶o̶c̶k̶ ̶H̶o̶l̶m̶e̶s̶ *Arthur Conan Doyle!* -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CABZR6GpKnPDCwQWsCytPRcpaWES0tDjmF16YyNWDykdr6OS6kQ%40mail.gmail.com.
[datameet] NSSO 75th Round data
Hi, This is a request for an open-access link to NSSO 75th Round data "Social Consumption: Health". The latest health expenditure data made public by the NSSO in its microdata catalogue seems to be the 71st Round. Any help is appreciated. Thanks and regards, Piyush Kumar -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAFtOtdtz6vxLWXg%2BkaXDQmqSL6ih9JP3J5giZH6yXJre6Cd3Dw%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Satellite imagery data for road
Hi, I am trying to work on analyzing traffic condition on roads. I think, satellite imagery can be a good option. Do you know about any data-set/ link for satellite imagery that can provide historic or real time image/video data for roads, possibly in India or anywhere in world? Thanks and Regards Sumit Mishra -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/633ea0d6-62d1-4cd3-951f-4f5cdbef61b4%40googlegroups.com.
Re: [datameet] Where can I find district-wise - population, income, housing and charging stations data for whole of India?
Dear Friend Please have look at the fourth round of National Family Health Survey Data (NFHS-4) On Mon, Oct 21, 2019 at 6:12 AM Ee Ann Ng wrote: > Hello, > > I am looking to get some data on the district level, and I see that there > are 620 districts in India. > > I've tried looking for income data at data.gov.in, however they only have > the district-wise data for the states of Tamil Nadu and Madhya Pradesh > <https://data.gov.in/statedepartment/madhya-pradesh>. > > The other data such as housing and charging stations data is not easily > found. > > Can anyone suggest where I can find those? > > Please and thank you :-) > > -- > Datameet is a community of Data Science enthusiasts in India. Know more > about us by visiting http://datameet.org > --- > You received this message because you are subscribed to the Google Groups > "datameet" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to datameet+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/datameet/e2e3293e-74ee-4680-9072-03f8e8686463%40googlegroups.com > <https://groups.google.com/d/msgid/datameet/e2e3293e-74ee-4680-9072-03f8e8686463%40googlegroups.com?utm_medium=email_source=footer> > . > -- *With Warm Regards* GULSHAN KUMAR Ph.D. Senior Research Fellow International Institute for Population Sciences (IIPS) Station Road Govandi, Mumbai 400088 E.mail- kumargulshan...@gmail.com gulshankumar@i ips.net -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAAWitNhYd-RS10OzaUx2zKz3nwxYki4R9foWWb_XwPi4AMvfyw%40mail.gmail.com.
Re: [datameet] Historical customs data
The customs department shutdown the imported and exported goods information along with goods values and goods revenues. It seems they are continuously publishing the revenue details only for the current day at https://www.icegate.gov.in/jsp/DailyReport.jsp The best way to get this data is to file an RTI asking for the required data to be supplied through a DVD. If you need further assistance, please write to me of the group. Regards, Srinivas Kodali On Wed, Sep 4, 2019 at 10:43 PM Kiran Jonnalagadda wrote: > On Wed, 4 Sep, 2019, 22:40 Surb B, wrote: > >> The Customs and Central Excise department publishes a daily report of >> customs revenue at various ports --> >> https://www.icegate.gov.in/jsp/DailyReport.jsp >> >> However, I can't find the Archives for the same data beyond the most >> recent date. Is there a compiled dataset / website somewhere that I am >> missing? >> > > As I recall, Zauba and EximInfo publish customs data and have > historical data, including individual import data until that was > discontinued in 2016. > > Kiran > >> -- > Datameet is a community of Data Science enthusiasts in India. Know more > about us by visiting http://datameet.org > --- > You received this message because you are subscribed to the Google Groups > "datameet" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to datameet+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/datameet/CAFhXvyEYMY%2BL5M-wksRk3d9fxUMy2B1g8-7O%2BzLE80h_pv8ogA%40mail.gmail.com > <https://groups.google.com/d/msgid/datameet/CAFhXvyEYMY%2BL5M-wksRk3d9fxUMy2B1g8-7O%2BzLE80h_pv8ogA%40mail.gmail.com?utm_medium=email_source=footer> > . > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAGnvSPHKutWH8b63N029Y4RtYLet2WcsfNdndJeX4a1vy3F%3DLg%40mail.gmail.com.
[datameet] Daily Air Quality Data of Vadodara City
Hello , I need daily Air Quality Data of Vadodara City from Jan'20 onwards. Please provide any useful websites or data if possible. -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/3b3be7b4-f9e4-40f8-ba28-c53cad961e5e%40googlegroups.com.
Re: [datameet] #COVID19 mohfw data
On Wed, Mar 25, 2020 at 1:56 PM Anand Chitipothu wrote: > I wrote some code to scrap the Coivd19 data displayed on The Hindu website > and put it behind an API. This is live data being updated by their team and > I've taken their permission to publish it. > > http://covid19-india.anandology.com/thehindu/cases > > Source Code: > https://github.com/anandology/covid19 > > Data Source: > > https://www.thehindu.com/sci-tech/health/covid-19-interactive-map-confirmed-cases-in-india/article31041690.ece > > I've scrapping this data periodically. Will publish a hourly feed shortly. > I've updated the code to include mohfw data along with an API to query for historical data, using the data published by Thejesh. Daily cases in India: http://covid19-india.anandology.com/cases/daily Daily cases in Maharashtra: http://covid19-india.anandology.com/cases/daily/mh The API is open and documented at: https://github.com/anandology/covid19 Anand -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAC7wXFxc8ZQ8Om0mqGmoW4maPznBA0SQ52mhcvNJFdFASvH5tg%40mail.gmail.com.
[datameet] please help to extract data from pmgsy (pradhan matri gramin sadak yojna)
dear group members We are privileged to have gems among us who know how to extract data from this website Kindly help me with data http://www.pmgsy-grris.nic.in/gis.aspx whole of India with habitation code. I am willing to pay for shape files format. thank you Regards -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/5abcde0d-5907-42c7-9e9f-8db6c4e243dd%40googlegroups.com.
[datameet] TN Election Form 20
Hi Friends, I would like to analysis TN Election Result data so I need 2016 and 2018 Form 20 data CSV format any have this data kindly support to me Arul Prakasam T -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/95017783-c535-4eed-9831-36ed2ebbc339n%40googlegroups.com.
[datameet] COVID-19 Data related stories from across the world
Covid-19 Data in the US Is an ‘Information Catastrophe’ https://www.wired.com/story/covid-19-data-in-the-us-is-an-information-catastrophe/ Thej -- Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್ http://thejeshgn.com GPG ID : 0xBFFC8DD3C06DD6B0 -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAABnYsUMpm%3DLu_bNAXGOtpkGv9t20ed7H7%3D9w_ApMBbDXBDuUw%40mail.gmail.com.
[datameet] Request for data on Storm water zones and new GHMC Hyderabad Zones shapefiles and AWS hourly weather data of GHMC regarding..
Dear All, I am a PhD Research Scholar from JNTU Hyderabad. It would be really helpful, if anyone can help me with the Storm water zones and new GHMC Hyderabad Zones shapefiles of latest. And also AWS hourly weather data of GHMC - HYDERABAD area from 1989 to 2020. Thanks a lot in advance! -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAL-XWmBRcWe_ZUtmNPM0LaTOUOUKqrOtBDK5nFshDHNHDz5OKA%40mail.gmail.com.
[datameet] Looking for data on public school teachers
Hi, I am looking for data on public school teachers at elementary school. I know DISE has some information aggregagted at school level. I am wondering if there exist different data sources that have information on individual teachers. Any information would be appreciated. Thank you very much! Best, Ken -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/166c8313-220e-400d-8928-714a741015f3n%40googlegroups.com.
[datameet] Needed data SVG\KML\Shapefiles for India with states,Districts,Assembly & Parliamentary constituencies
I'm Planning to do a website for a survey specifically for India and Needed data SVG\KML\Shapefiles for India with states,Districts,Assembly & Parliamentary constituencies. Can you please let me know , How can I get the data for free ? -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/a62970f5-d14e-4a30-b7ad-ec9e762f6ac6%40googlegroups.com.
[datameet] Domestic Violence
Hi, Has anyone compiled National Crime Records Bureau data? I am looking for domestic violence data. Also, if anyone is aware of another survey or data source where I may not face issue of under-reporting, I would appreciate it. Thank you Regards, Purnima -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/3d10cb24-4bbe-444e-9f87-785e9821c509o%40googlegroups.com.
[datameet] Soil texture shapefile data of Jabalpur and Katni districts of Madhya Pradesh
Hi all, If anyone have the Soil texture shapefile data of Jabalpur and Katni districts of Madhya Pradesh, please do share me via direct message. It would be of great help for my research and the data provider will be acknowledged in every possible way. Thanking you Regards *Nirmal* -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/eb372524--4fd3-aa8e-6e138e7c65bdo%40googlegroups.com.
Re: [datameet] CPCB AQI All Parameters Data
Hello all, I've just uploaded the updated data for all pollution parameters data from the 221 available stations under cpcbccr here <https://www.kaggle.com/sakethramanujam/metro-cities-pollution-in-lockdown>. Previously the datasets were uploaded for, until 15th of June, which is now updated to 30th of June. Thanks, Saketh. -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAHzVmys1N96%2B9PMBbFMRSu-Ffw3Fedo8GKL%3Dts7hJQUdhgca%3DQ%40mail.gmail.com.
[datameet] Environmental Clearance Data
Hi everyone, There have been a series of clearances granted by MoEFCC and other environmental protection agencies to projects. Does anyone have spatial data of these projects or any one project also ? Or a database of these projects which have been sanctioned say in the last 5 years? Please do share the spatial and/or non spatial data if any. Thank you, Yogada -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CANKd%2BfpMK-4%3DKyh9tmYvTMx9D4LkENh4E4rHXXRkOS7_DPT9Nw%40mail.gmail.com.
[datameet] Need Meterological Data
Dear All, For a study I need meteorological data of Aaralam (Kannur, Kerala) and Athirappilly-Vazhachal (Thrissur, Kerala) forest areas in Kerala for a period between 2011-2017. Can anyone help to find this data? Regards Sunil -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAFD%2BCBJZPw5WJveoovc9gwkjzorg%2B36m_YN%3DWFJBuSmva2t%2BnA%40mail.gmail.com.
[datameet] Looking for open data on Public Toilet locations in Delhi, Bangalore
Hello Everyone, I was looking for location data of SBM, Public toilets for metro cities. To my surprise, couldn't find it anywhere till now. I have checked OSM data, but not any luck with that. Can anyone please point me out to a source, if any in mind. It would be of great help. Thanks, Aakash -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/bd84c7bd-c612-4b2b-b06b-b3c6e1827b90n%40googlegroups.com.
[datameet] Climate related data
Hi All, I am looking for climate related districtwise data of Evapotranspiration, Sunshine, Humidity, temperature (max-min), wind speed & direction, precipitaton etc. of Rajasthan State since 2000 onwards (52 weeks). Plz provide source or data. Thanks in advance for your cooperation. - mahesh gaur -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/9de240e6-a17c-4719-9d9a-1262233f9128n%40googlegroups.com.
[datameet] datameet data in github- is it for commercial use?
Is the data available at: https://github.com/datameet/maps - for commercial use? The license file says software under MIT license and there is no mention of if the data can be used for commercial use or not. But in the Permissions column it shows "green" tick against "commercial". Looking forward to confirmation on commercial use. -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/a9629071-ed87-4536-b2e7-1ba7beebe14bn%40googlegroups.com.
[datameet] Scraping Karnataka Reservoir Water Flow Data
Data and Code: https://github.com/thejeshgn/reservoir More details: https://thejeshgn.com/2021/01/17/scraping-karnataka-reservoir-water-flow-data/ Thej -- Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್ http://thejeshgn.com GPG ID : 0xBFFC8DD3C06DD6B0 -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAABnYsW6iC-M%2BZk25rnto27BhwnNHsAe1CamRd7pEC9_ioAraA%40mail.gmail.com.
[datameet] Vector data of Vertical obstacles like electric towers, telecom towers, radio towers etc..
Hi, Can anyone tell me if I can download vector data of vertical obstacles like electric towers, telecom towers, radio towers, etc... for any country. Also, are these data available in the Open street map, and if so, is there any way to extract them separately. Thank You -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/ee9cb8b2-de89-4e6e-9025-4c6517f36ec6n%40googlegroups.com.
[datameet] Looking for Emission data
Hello all, I am looking for emission data sources in India. I wish to know if there are any sources other than the air quality data from CPCB. Thanks. - Best Regards, *Middela M. Siddartha,* *(Most people hate poetry. Truth is poetry.)* -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAHk%2BY%3D3tJD7gSBrLhOCeko9qzEMxwywANqHM4BXua8Fz67Rjyw%40mail.gmail.com.
Re: [datameet] Historic village-level census data
For years 1991 and 2001, available in https://sedac.ciesin.columbia.edu/data/set/india-india-village-level-geospatial-socio-econ-1991-2001 On Tuesday, May 18, 2021 at 7:59:02 AM UTC+5:30 Dr. Sanjeev K Sinha wrote: > Previous census year data (upto 1981) are in hard copy/ or published as > scanned ebook format. > > On Tue, 18 May 2021, 07:54 Rashmi Singh Rana, wrote: > >> Hi, >> I am looking for village-level census data for Himachal Pradesh. I have >> village-level data for the 15th & 14th Census (2011 & 2001). I am looking >> for census data for previous years/ older census records, at the village >> level for Himachal. >> Can anyone help me access or direct to where I can access it? The Census >> digital library has the 13th Census data but it is incomplete. >> >> Thanks in advance! >> >> Regards, >> Rashmi >> >> -- >> Datameet is a community of Data Science enthusiasts in India. Know more >> about us by visiting http://datameet.org >> --- >> You received this message because you are subscribed to the Google Groups >> "datameet" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to datameet+u...@googlegroups.com. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/datameet/eac0ce5d-3b4b-4391-84be-84c6337152a4n%40googlegroups.com >> >> <https://groups.google.com/d/msgid/datameet/eac0ce5d-3b4b-4391-84be-84c6337152a4n%40googlegroups.com?utm_medium=email_source=footer> >> . >> > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/08ad2479-9b39-40b1-867f-bb50f51e17aan%40googlegroups.com.
[datameet] Re: [Datameet] Looking for district wise covid testing data
No state is making that information available as of now. On Thursday, May 27, 2021 at 12:33:42 PM UTC+5:30 amitje...@gmail.com wrote: > Fellow Data Enthusiasts, > > I am looking for data on daily covid testing (RT-PCR, Antigen & Antibody) > for all the districts of India. Can anyone point me to the available > sources? > > Thanks, > Amit > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/e2b2321c-8766-4325-ad1a-40b54f10e011n%40googlegroups.com.
[datameet] [Datameet] Looking for district wise covid testing data
Fellow Data Enthusiasts, I am looking for data on daily covid testing (RT-PCR, Antigen & Antibody) for all the districts of India. Can anyone point me to the available sources? Thanks, Amit -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CALL74DcR3WdgV%2BSJmc2WuN1Jyi0WViwuG0TLEn_UHoz3YhahmQ%40mail.gmail.com.
Re: [datameet] Data extraction from BHUVAN website
Thank you so much Sir for helping me out. On Fri, 2 Jul 2021, 9:46 am Puneeth Chaganti, wrote: > Hi, > > On 25/06/21 12:49 pm, rituparn...@gmail.com wrote: > > Is it possible to extract the Lat long data of the Kolkata city Parks > > from this BHUVAN webpage? > > > > https://bhuvan-app1.nrsc.gov.in/parks/rc_bhuvan.php# > > Yes, it is possible to extract the data. I tried to scrape the data > using curl and some simple bash + jq. > > https://gist.github.com/punchagan/4d4c326f8c70850e1ac2914d7610f0c3 > > I started with crawling the data by ward, but I found some things about > how that data was organized, a little confusing. > > So, I ended up fetching the data for each park, instead. I clubbed the > separate json files into a single file. The wards based crawl had some > additional information that may be useful, like the total population of > the ward. > > - P > > -- > Datameet is a community of Data Science enthusiasts in India. Know more > about us by visiting http://datameet.org > --- > You received this message because you are subscribed to the Google Groups > "datameet" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to datameet+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/datameet/8f206ef4-27a8-1bb1-9168-a0813e4d8983%40muse-amuse.in > . > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CA%2B72tbKixgRCSfmSn1CZN_xJTVRhPMXc6rkOGu_gwaHuXSxEWQ%40mail.gmail.com.
[datameet] Looking for local bodies and panchayat election data
Hey all, I am looking for candidate data for local bodies and panchayat elections in Uttar Pradesh and Bihar (potentially other states). Does anyone know where I can obtain this data? Any pointers would be really appreciated! Thanks, Aryan :) -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/0bd77edf-618e-47f8-8ad3-38a4c86386b0n%40googlegroups.com.
[datameet] Air Qualiy data-reg.
Dear Fellow Members, I'm seeking hourly/daily air quality data for Mumbai stations. Please suggest any sources or share the data if you have. - Thanks and Regards... Arun Kumar KC [image: Mailtrack] <https://mailtrack.io?utm_source=gmail_medium=signature_campaign=signaturevirality8;> Sender notified by Mailtrack <https://mailtrack.io?utm_source=gmail_medium=signature_campaign=signaturevirality8;> 09/13/21, 11:42:00 AM -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CANLdBx93RimKgn4jvSGAZ9Ny7QgzyX1UBD1FdsOufyme2YAjaw%40mail.gmail.com.
[datameet] Wind Power data
Hi, I am looking for data on locations of wind mills in the Kutch district, Gujarat, India. Any leads would be highly appreciated. The data is to be used for analysis in my master's dissertation project. Best, Divyajyoti Ganguly NCBS -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/826876d2-8d6f-4b81-9f3d-7bca09335d80n%40googlegroups.com.
[datameet] SHRUG Census 1991 Data: District and State
Hello Everyone, I recently downloaded Census Data 1991 from devdata (https://www.devdatalab.org/shrug_download/). The dataset has state id and district id but does not include district and state name. I looked up for codebook but could not find one. Wondering if anyone has used the data previously and/or has any idea. Regards, Prashant -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/59a55ea7-9204-4343-98eb-c905df6d9289n%40googlegroups.com.
[datameet] Boundary data in regional languages
Hey All, Have any of you had the need to show the boundary data (state, district, block, village etc) in regional language? If so how did you go about it? Did you need to translate it and store it in database or is there an android hack or some other way to show translated data on a phone application? Thanks & Regards, Shivangi -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/82B316FE-5783-4259-AAF0-028F9C934A13%40gmail.com.
Re: [datameet] Rainfall data
Thank you Nikhil, As Vastav said that link is no longer available. Is there any chance that you have collected the data? I want data for Himachal from 2000 - 2021 Thank you On Thursday, 6 October 2022 at 03:11:55 UTC+5:30 f201...@hyderabad.bits-pilani.ac.in wrote: > Hi Nikhil > It seems like the link used to get data no longer works. The government > has likely made the data inaccessible. Did you download all the files by > any chance? Would it be possible to upload those in google drive? > > Thanks > Vastav Ratra > > On Wednesday, October 5, 2022 at 3:58:10 AM UTC+2 nikh...@gmail.com wrote: > >> Hi Georgelio, >> >> I was able to extract the rainfall data just fine. >> Bit of programming is needed to get rid of junk data, and we need to work >> our way thru lot of files for multi-yr. Here is a repo with work done on >> it. >> >> https://github.com/answerquest/IMD-grid-data-work >> >> I made a viz of the data for a location nr my home in Pune, and the >> figures appear to corelate with local history (Panshet flood of 1962 for >> example shows up vividly). But I'd really like to know what the original >> raw data was using which the gridded data was obtained. >> >> I've loaded it all into a DB; should be able to get out specific data >> needed, let me know if you need for a particular location(s) and years >> range. >> >> Is there a use case for uploading a mirror dataset to zenodo or kaggle or >> someplace in simpler CSV form? (Big upload so better if there is a demand >> for it. Or, better if someone from the institution itself does it). I love >> the multi-dimensional array format they've used, but the junk values undo >> the storage savings (a .7z of flattened CSV may be smaller), and it's >> tougher to access for folks not in the know. >> >> - Nikhil >> https://nikhilvj.co.in >> >> On Tue, Oct 4, 2022, 15:37 georg...@gmail.com wrote: >> >>> Hello all, >>> Gridded rainfall data for India in IMD is not working. I need rainfall >>> data for Himachal from 2010 to 2022. >>> Thanks >>> >>> -- >>> Datameet is a community of Data Science enthusiasts in India. Know more >>> about us by visiting http://datameet.org >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "datameet" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to datameet+u...@googlegroups.com. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/datameet/b6a669b9-6b30-41d6-bc22-cb960814bc6en%40googlegroups.com >>> >>> <https://groups.google.com/d/msgid/datameet/b6a669b9-6b30-41d6-bc22-cb960814bc6en%40googlegroups.com?utm_medium=email_source=footer> >>> . >>> >> -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/628cda0d-26e3-4cf0-8e4e-fa7547a5d3efn%40googlegroups.com.
[datameet] Data on Literacy rate, Population and drinking water availability for Karnataka
Hello, Where can I get district-wise data about Literacy rate, Population, and drinking water availability for Karnataka state? I need data for at least 10 years i.e. from 2011 to 2020 Kindly help. Thank you in advance Neha Singhal Research Scholar ICAR-IARI, New Delhi -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/bf15404c-d6e5-470c-a953-b22a949c53edn%40googlegroups.com.
[datameet] Query regarding sorting data in pandas DataFrame
Hello all, I am struggling in getting my data set in a usable format. I have posted my query on stackoverflow link- <https://stackoverflow.com/questions/74692855/pandas-dataframe-query-in-sorting-data >. Please consider solving it. Ajay PhD Economics IGIDR -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/42440db8-fc56-4264-9fca-b5ae28d24dd4n%40googlegroups.com.
[datameet] Request for surface water quality data for INDIA
Dear all, Where can I get water-quality data, specifically chlorophyll data, for INDIAN SURFACE WATER BODIES? Thanks and Regards N. Satish SRF, at BITS, Pilani, Hyderabad Campus -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CA%2BgiNiB3o3to1j_hip3OtLepvCjzmCELzJ--bC3N1U0dGqmV2Q%40mail.gmail.com.
[datameet] requesting data for gps coordinates of landfills in India
Hello everyone, I wanted to ask if anyone has some data on gps coordinates of landfills in cities/towns in India. The data is needed for training a model to recognise dumpyards. Would be grateful for any help at all. Thank you, Regards Advaita -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAOz7d5qVWAY0zW4qOvkeHq%2Byun%3D0ypdRDzHVF37v4r5rLVxB2g%40mail.gmail.com.
[datameet] Hindi films revenue data sources?
Hi, I am working on a story that needs authentic earnings data for films released in 90s. Can anyone please suggest an authentic source? I also wanted to know if bollywood magazines can be considered as data source. Regards, A -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAC9Ac93qHPfVXRvKJbwmtzQX4pQTKCtrcRJ8ACw7qSthdPymCA%40mail.gmail.com.
[datameet] In need of labelled data for generative text
I am in need of accurate and labelled data for generative text, I wanna try to make a chatgpt clone using different learnings, so need a labelled data -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/69b35a53-9641-4bc8-a3a9-6d48f2009f8an%40googlegroups.com.
[datameet] E-roll data West Bengal
Hi, Hope you are doing well. Does anyone has E-roll data of West Bengal, India? Preferably in Excel format. The data available in the following link is in PDF format and in Bengali regional language: https://ceowestbengal.nic.in/PollingStationList?DCID=8=82 Thanks in Advance Best Regards Kaibalyapti Mishra -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/7a499b7a-b4c4-4b6f-a768-57679c9096ffn%40googlegroups.com.
[datameet] Booth/Polling Station Level Data Needed (location not necessary)
Hi Everyone Is there any clean booth/polling station level data on electors and vote counts available, in addition to the elections available from Raphael Susewind's https://github.com/raphael-susewind/india-religion-politics? I don't need location data. State, election year, and constituency would help but are not necessary. Best Taha -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/bbdaa95a-c147-4249-8dad-fefff88a4f52n%40googlegroups.com.
[datameet] Raw station level data of IMD
Hi everyone!! I am looking for raw station level data which IMD uses for creation of grid level data. I have looked at their website but did not find any help there. Does anyone have any idea regarding where I could find that or whom should I contact for help? Thanks!! -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/8ec8e880-1f56-49b4-a739-004ad22ec69dn%40googlegroups.com.
[datameet] ISRO satellite data with 5-10m resolution
Hi all, I need land-use satellite data with 5m resolution. Recently, space policy has been updated and ISRO is supposed to provide this data for free. Can anyone please guide me here. Thanks, Arvinder -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/36384c8d-6c07-49c5-af30-573650e70844n%40googlegroups.com.
[datameet] Collation of GIS and Data Portals in India
Hi all, I have been collating links for various GIS and Data portals in Indian context. These will include national, state and city level GIS and data portals. Github Repository: https://github.com/DraconainDevil/India-GIS-Portals Please feel free to contribute any new sources that you might come across. Thanks, Akshay D -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/c5d6eaf3-21e3-4327-9731-b3ab93fe5cbfn%40googlegroups.com.
[datameet] State/Central Govt Directory and Civil List
Hi, Has anyone compiled the govt directory data. For eg, bureaucratic post level data would include list of people who has occupied that post and the duration of their term. For instance, I have compiled the data for Rajasthan from here: https://dop.rajasthan.gov.in/forms/newhistoryform.aspx Was wondering if anyone else is also involved in similar task for other states or at the center level. best, -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/e5a71cc1-f18d-4e7c-957a-960a92fb5f6an%40googlegroups.com.
Re: [datameet] GTFS Feed data of various Public Transportation Departments in India
You can find the static GTFS data here for various cities: https://dataspace.mobi/group/gtfs Many smart cities have opened up realtime mobility data on IUDX as well: https://catalogue.cos.iudx.org.in IUDX does not follow GTFS data standard but you can write a script to convert the data to GTFS. I hope it helps. On Thu, 16 Nov 2023 at 2:42 AM, Harsh Sharma wrote: > Can Anyone tell me where to get GTFS feed data of various public > transportation department (Buses Transportation) in India. Like the Delhi's > DTC and Cluster buses GTFS datasets are publicly available, Is there any > other Transportation Department who made their data public If so, then can > you please send me any link for those datasets. > Both GTFS Static and Real-time will work. > > Thanks in Advance > > -- > Datameet is a community of Data Science enthusiasts in India. Know more > about us by visiting http://datameet.org > --- > You received this message because you are subscribed to the Google Groups > "datameet" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to datameet+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/datameet/91b44fc0-c678-42a8-b807-815c4157ae8en%40googlegroups.com > <https://groups.google.com/d/msgid/datameet/91b44fc0-c678-42a8-b807-815c4157ae8en%40googlegroups.com?utm_medium=email_source=footer> > . > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/CAL2m2mDJ8eoDrQLG9Sp2vWVAZ3rFdUuETfSjkg9gzX9-v217fQ%40mail.gmail.com.
[datameet] Poultry farms data - India - Backyard and commerical
Dear all, I am looking for data related to Poultry farms data - India - Backyard and commerical. Can anyone guide me with regard to it? With Regards, Abraham Daniel Raj RA, National Agro Foundation -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/f819ea76-0246-485c-931a-73b2705d7eb1n%40googlegroups.com.
[datameet] Re: Invitation to Open Data Visualization Workshop in Bangalore, 18th November 2-4pm
Just a reminder. Workshop is taking place next Monday (2-4pm) at Center of Internet and Society, more infos under: http://blog.klp.org.in/2013/10/workshop-on-visualising-open-data-to.html We will be happy to meet you there and exchange about open data in Bangalore/India. There is no participation fee. Alex Corbi Margo Thierry Am Sonntag, 3. November 2013 16:01:58 UTC+5:30 schrieb Alejandro Corbi: Dear fellows, *Open Steps* keeps touring India and is pleased to invite you to *its workshop in Bangalore on the 18th November (2-4pm)*. Open Steps http://www.open-steps.org/ is an initiative from two young berliners Alex (spanish, software developer) and Margo (french, european politics) who decided to leave their daily lives and travel around the world for one year. On this journey, they are meeting people and organisations working actively in open knowledge related projects, documenting them on their website. Also, open data is the area where their both backgrounds converge and that's why they run a workshop entitled “Visualising Open Data to bring out global issues”http://www.open-steps.org/workshop/ on the way and research about the current situation of open data in the countries they are visiting. This event is organised with the support of Karnakata Learning Partnershiphttp://www.klp.org.in/and takes place at* The Centre for Internet and Society, No. 194, 2nd 'C' Cross, Domlur 2nd Stage Bangalore 560 071. *Map and more Infos about the venue under: http://cis-india.org/about/contact . For more information, visit www.open-steps.org/workshop. We hope to see you among the audience on the18th November and are looking forward to discussing with you about open cultures open data in India! Best regards, Margo Thierry Alex Corbi - WORKSHOP DETAILS: Visualizing open data to bring out global issues Thanks to the large amounts of open data being released for free on the Internet, we can take a quick glimpse at current issues characterizing our world. Although, this complex data is sometimes difficult to be understood in its initial form. By going from theory to practice, we will show where data can be quickly gathered from, and by using open source technologies, put it in a visual context to make relevant issues easy to understand. In addition, attendees will be encouraged to discuss topics involving each of us. The goal of this workshop is also to increase awareness of the importance and benefits of making information available for everybody and how sharing knowledge is one of the steps towards making our planet better. Table of contents: 1. Introduction to Open Knowledge and Open Data 1.1 What are open knowledge and open data? Why do they matter? 1.2 Examples of administrations and organisations releasing information to the public domain. 1.3 Transparency in politics as a way to achieve real democracy. 2. There is so much data out there, and its free! 2.1 Online sources where you can get open data. 2.2 World Bank as major data hub. 3. Why visualization matters 3.1 Understanding complex problems by looking at simple graphs. 3.2 Examples of data visualizations we have developed describing worldwide issues in the fields of Politics, Environment, Education and Social development. 4. Practical session 4.1 How to build a data visualization in 5 minutes using free online tools. 4.2. Technical questions related to the tools used. 5. Open debate 5.1 Which data would I like to visualize? Attendees have the opportunity to propose topics and relevant data they would consider interesting to explore. Everyone will be also encouraged to publish their own data visualizations on our platform. Target groups: - individuals or collectives. - interested in open source technologies and the philosophy behind open knowledge. - searching for data sources for research. - working with visualizations. - developing a conscious approach to global topics. - having general interest in the topic. -- For more details about this list http://datameet.org/discussions/ --- You received this message because you are subscribed to the Google Groups datameet group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
Re: [datameet] Re: Invitation to Open Data Visualization Workshop in Bangalore, 18th November 2-4pm
Just a reminder that this is today at 2PM. Hope to see some of you there. On Fri, Nov 15, 2013 at 11:38 AM, Alejandro Corbi a.co...@gmail.com wrote: Just a reminder. Workshop is taking place next Monday (2-4pm) at Center of Internet and Society, more infos under: http://blog.klp.org.in/2013/10/workshop-on-visualising-open-data-to.html We will be happy to meet you there and exchange about open data in Bangalore/India. There is no participation fee. Alex Corbi Margo Thierry Am Sonntag, 3. November 2013 16:01:58 UTC+5:30 schrieb Alejandro Corbi: Dear fellows, Open Steps keeps touring India and is pleased to invite you to its workshop in Bangalore on the 18th November (2-4pm). Open Steps is an initiative from two young berliners Alex (spanish, software developer) and Margo (french, european politics) who decided to leave their daily lives and travel around the world for one year. On this journey, they are meeting people and organisations working actively in open knowledge related projects, documenting them on their website. Also, open data is the area where their both backgrounds converge and that's why they run a workshop entitled “Visualising Open Data to bring out global issues” on the way and research about the current situation of open data in the countries they are visiting. This event is organised with the support of Karnakata Learning Partnership and takes place at The Centre for Internet and Society, No. 194, 2nd 'C' Cross, Domlur 2nd Stage Bangalore 560 071. Map and more Infos about the venue under: http://cis-india.org/about/contact . For more information, visit www.open-steps.org/workshop. We hope to see you among the audience on the18th November and are looking forward to discussing with you about open cultures open data in India! Best regards, Margo Thierry Alex Corbi - WORKSHOP DETAILS: Visualizing open data to bring out global issues Thanks to the large amounts of open data being released for free on the Internet, we can take a quick glimpse at current issues characterizing our world. Although, this complex data is sometimes difficult to be understood in its initial form. By going from theory to practice, we will show where data can be quickly gathered from, and by using open source technologies, put it in a visual context to make relevant issues easy to understand. In addition, attendees will be encouraged to discuss topics involving each of us. The goal of this workshop is also to increase awareness of the importance and benefits of making information available for everybody and how sharing knowledge is one of the steps towards making our planet better. Table of contents: 1. Introduction to Open Knowledge and Open Data 1.1 What are open knowledge and open data? Why do they matter? 1.2 Examples of administrations and organisations releasing information to the public domain. 1.3 Transparency in politics as a way to achieve real democracy. 2. There is so much data out there, and its free! 2.1 Online sources where you can get open data. 2.2 World Bank as major data hub. 3. Why visualization matters 3.1 Understanding complex problems by looking at simple graphs. 3.2 Examples of data visualizations we have developed describing worldwide issues in the fields of Politics, Environment, Education and Social development. 4. Practical session 4.1 How to build a data visualization in 5 minutes using free online tools. 4.2. Technical questions related to the tools used. 5. Open debate 5.1 Which data would I like to visualize? Attendees have the opportunity to propose topics and relevant data they would consider interesting to explore. Everyone will be also encouraged to publish their own data visualizations on our platform. Target groups: - individuals or collectives. - interested in open source technologies and the philosophy behind open knowledge. - searching for data sources for research. - working with visualizations. - developing a conscious approach to global topics. - having general interest in the topic. -- For more details about this list http://datameet.org/discussions/ --- You received this message because you are subscribed to the Google Groups datameet group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out. -- For more details about this list http://datameet.org/discussions/ --- You received this message because you are subscribed to the Google Groups datameet group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
Re: [datameet] Re: Open Data and Data Standards in Indian Transportation
Hi Srinivas, You are absolutely right in identifying the root cause of the problem of availability and quality of public transport information India - The DATA. Lack of proper definition, standardisation and implementation has laid to condition where though services are running somehow but any scope of improving the same adopting technology and systems is getting hindered. I have been discussing on the same issue at different Transport forums. Here is my article on TheCityFix which highlights the same points who put in : http://thecityfix.com/blog/across-divide-information-communication-technologies-ict-data-connect-users-transport-systems-suvajt-sengupta/ My job, expertise and interest revolves around this subject and I will be quite eager to participate in this exercise. If we can come up with the open-data standard, we can surely push them into Central Govt STU technical specifications. It is the need of the hour. I can clearly say, STUs are losing millions of investment money for ITS implementation due to lack of this data and communication standard. I propose to have a first level coordination meeting on this subject. Nisha, Thanks for creating the datameet wiki on this subject. I want upload some more documents and references on this subject. Can you let me know how to do that ? Regards, Suvajit Sengupta On Wednesday, August 13, 2014 9:21:29 AM UTC+5:30, Nisha Thompson wrote: Hey All, I think this is a really great idea. And I agree with Dilip we can break it up and assign tasks. I have started a wiki: http://datameet.org/wiki/start_transportationdocumentdraft Where we can put the final outline and assignments. Let's use this thread to flush out the outline. Nisha On Tue, Aug 12, 2014 at 9:23 PM, srinivas kodali iota@gmail.com javascript: wrote: Well i haven`t laid out the complete sections of the document yet. But it will be majorly on the following topics 1. Standards and Structured data storage of transport data 2. Different practices in transport applications/data analysis 3. Copy rights and licenses of data 4. Open data and Open Source implementations in transport It will be majorly a technical document with minor details on open-data policies and advantages. Individuals who want to contribute need to be fairly aware of the following technologies: These are just to give you an idea what you will be working on. You don`t need to know everything 1. Database design 2. Exposure to OSM, Geojson and Maps/Tranport related specs 3. Exposure to handling Big data (The data can be around 10-40 GB easily) 4. Standards in Transport data (GTFS, GTFS Realtime,SIRI) 5. Expertise in Socket Programming, Protocol Buffers, real-time data protocols. We will be evaluating and implementing couple of applications/protocols before we recommend it. It will be fairly a technical document. The document will be shared in the group after completion for two reviews. Everybody can contribute in terms of suggestions and criticizing the suggestions. Regards, Srinivas On Tue, Aug 12, 2014 at 6:59 PM, Dilip Damle cadv...@gmail.com javascript: wrote: Srinivas, I think it will better if you can list out the tasks that other contributors are expected to do. Based on that and the individual capability and time may be some of us may enlist ourselves for a particular task. rgds Dilip Damle (New Delhi) On Tuesday, August 12, 2014 4:40:46 PM UTC+5:30, srinivas kodali wrote: Hi all, I am looking to publish a technical document on data standards for transport agencies in India. This document will be published through datameet and we are also looking at getting these implemented across transport agencies. The attached technical document from BMTC will give you an Idea what you will be making, but a bit more precise and usage of open data, open source technologies in transport. The timeline we are looking at is 4-6 weeks. Anybody interested in transportation is welcome to contribute. Please state your intentions for contribution within this week. We need this, so that we can have unified transport data across the country, regardless of states and governments. Regards, Srinivas -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups datameet group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+u...@googlegroups.com javascript:. For more options, visit https://groups.google.com/d/optout. -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups datameet group. To unsubscribe from this group and stop receiving emails from it, send
[datameet] Re: How can we add more data to OpenStreetMaps easily?
Hi Try *OsmAnd *app (link <https://play.google.com/store/apps/details?id=net.osmand>). You can also use the latest nightly from here <http://download.osmand.net/latest-night-build/OsmAnd-nightly.apk>. This is offline GPS navigation app. Feature-rich and user-friendly. It has a built-in OSM editor plugin. 1. Activate the plugin, using the Start> Plugins> OSm Editing 2. Go to its Settings, and enter your OSM username and password. 3. In the Settings menu, activate the *offline editing* option. This allows to create new POIs offline, and upload them when you have the WiFi connection. 4. Now switch back to the OsmAnd's main screen. Long-press on any point on the map. A card pops up from bottom of the screen. Tap on the *overflow* button (three vertical dots, at far right). From the context menu that pops up, select *Create POI* option. Enter the data and save. 5. If you have selected the *offline editing* option (step-2), then the POIs will be added to OSM only when you upload them. For this, tap on any POI, and select the *Upload* option. Hope that helps. Regards, Nagesh On Thursday, March 16, 2017 at 7:11:58 PM UTC+5:30, Shrinivasan T wrote: > > > Hi all, > > I am shrini from Chennai. Joined datameet group today. > > > When exploring on creating maps in Tamil using OpenSteetMaps [ > https://goinggnu.wordpress.com/2017/03/04/let-us-create-maps-in-tamil/ ] > found that the current data available on OSM is not equivalent with Google > Maps. > > We can not copy data from Google Maps and import to OSM as it is a big > copyright violation. Yes. We dont have control over the data for the area > where we live. > > We can do the following. > > 1. Look for the data sources who may have the data about the streets, > villages, cities. I think think the government departments like Postal, > Revenue,Rural development, Public Works may have these data. How can we ask > them to share the data in public? Will a RTI help on this? > > I am seeing some data collected by reading our archiees. > Is it possible to share the available data in a single blogpost or page? > > > > 2. Add the data manually. > > By this way, we can add any data manually, edit, improve the existing > data. But editing on the browser is not possible for many. > > It will be nice if we have a mobile app to add data to OSM. When I had a > smartphone, few years ago, searched for a OSM mobile app. Cant find any > app, which helped to edit OSM. > > I dont use smartphone nowadays. > > If you have a smartphoe, can you search for the apps, which can help to > edit the OSM easily? > > The app should be very simple. The user should should open the app. It > should capture the latitude, longitude from its GPS or mobile tower. Then > it should ask for the name of the building, building number, type of the > place, street name, area name,city name, if required a photo, etc. Once the > user entered these data, it should be synced on OSM. Contribution should > very simple as filling few forms only. > > If we have such app, we can create communities/volunteers to add data to > OSM with their smartphones. Just open app, fill data. They are done. > > If there is no such easy editing app for OSM, it is high time to create > such one. If you are a mobile developer, please create such app and help to > build the Openstreetmaps as content rich. > > Wondering how the Google, Apple, Bing maps collected data. What kind of > mobile app they used, what ate the data they collected. If you have worked > for these maps, please share more details about them. It will help a lot. > > There may be other easier, better ways to add data to OSM. Please share > the details or connect with the communities. > > Let us build content rich Open Street Maps. > > > > > > > -- > Regards, > T.Shrinivasan > > > My Life with GNU/Linux : http://goinggnu.wordpress.com > Free E-Magazine on Free Open Source Software in Tamil : http://kaniyam.com > > Get Free Tamil Ebooks for Android, iOS, Kindle, Computer : > http://FreeTamilEbooks.com > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [datameet] Extracting NSSO data
Greetings! If you purchased data from NSSO it comes with a program (nesstar) that extracts the data for you. Use this program and it will extract to whichever format you would like including STATA. Hope this helps. Chandrasekhar On Wed, Aug 8, 2018 at 10:59 PM, Tarun Kateja wrote: > Hi Sachin, > > I also want to extract 68th round Household and Consumer expenditure data. > I am little confused and have never worked with Stata. Can you explain what > is multiplier and how to use it? and can you share your code to extract > data from .txt file? > > This will be a great help! > > Thanks > > On Monday, September 5, 2016 at 1:03:02 PM UTC+5:30, sachin wrote: >> >> Hi, >> I have used 68th round data for agri consumption and poverty estimation >> using STATA. >> I am assuming that the raw data you are referring to is also available in >> .txt format. As I know, the NSSO data has a highly structured format - >> Schedule.Level>Block>Item No. The variables are not declared in the raw >> data. These variables are to be understood from the "layout" file for that >> specific round (released along with the NSSO round data) and this is >> available along with raw data. >> >> The data is a long string characters. These are read in a specific >> manner. The layout file will specify how many characters must be read >> together to form each variable. So it could look like - >> v11 1-3 v12 4-8 v13 9-10 v14 11-13 v15 14-14 v16 15-15 v17 16-18 v18 >> 19-20 v19 21-22 v110 23-24 v111 25-25 v112 26-26 and so on. >> >> Now, this is the data that is then called from your software, to be read >> from a raw data file (.txt) and then a table of required variables is >> obtained for analysis. In a sense, the raw data is always excerpted for >> analysis. And for this one begins with the layout file to check the >> variables of interest and how they are encoded in the data. >> >> I am not sure this helps. With STATA it works a bit easy. With R, I do >> not know how to assemble the same dataframe, although the analysis using >> the variables will be a breeze. >> >> Best >> Sachin >> >> >> >> On Sunday, 4 September 2016 15:27:55 UTC+5:30, Devdatta Tengshe wrote: >>> >>> Can you share the link where this data is available? That way we can >>> have a look at it. >>> >>> Regards, >>> Devdatta Tengshe >>> Ph: 735-358-0782 >>> >>> On 04-Sep-2016 3:01 pm, "Jagriti Arora" wrote: >>> >>>> Hi, >>>> Can anyone tell me how I can make sense of the raw data NSSO provides >>>> on its website? >>>> I tried converting the XML to dataframe in R, to no avail. I, now, have >>>> an excel sheet with references and variables that have not been previously >>>> declared. >>>> Can anyone help? I'm looking for data from 38th and 66th round. >>>> >>>> Thanks and regards! >>>> >>>> -- >>>> Datameet is a community of Data Science enthusiasts in India. Know more >>>> about us by visiting http://datameet.org >>>> --- >>>> You received this message because you are subscribed to the Google >>>> Groups "datameet" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to datameet+u...@googlegroups.com. >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>> -- > Datameet is a community of Data Science enthusiasts in India. Know more > about us by visiting http://datameet.org > --- > You received this message because you are subscribed to the Google Groups > "datameet" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to datameet+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [datameet] Data release as part of Open Data Camp
Hey folks, Proceeding on the lines of what Karthik suggested - it would be a really neat idea if we can come up with a voluntary pledge to release data into the public domain, on occasion of the Open Data Camp 2013. I'm sure that a majority of us here at Datameet have some amount of data with us that has a public quality to it - where its utility and public benefit grows leaps and bounds if it's released to the larger public. I'm fully aware that most data sets people possess come with riders - a government agency might have given it to you for personal/institutional use and not for sharing it with the wider public. Or you may not be finished with the data you've collected - and you don't wish to release it until you've extracted a good amount of value. And all this is perfectly fine. In the former case and in several other situations, I'll admit that I've been far more comfortable sharing data with individuals I trust than truly releasing it into the public domain - and this is where I disagree with Karthik - I don't think most of us data hoarders in India, we're just far more comfortable sharing it in private. However, it will be great if all of us can take a look at what data we have and see how much we can put out into the open without too much trouble. Data has a strong network quality to it - the more data sets you have, the more value one can extract by looking at their relationships. Now, we can do this in three ways: 1) We announce what we're willing to share here on this email thread. (I can go first!) 2) We share our intentions with our gracious organisers Thej/Nisha and we go with the public release at the Data Camp for greater effect. 3) Some of you might even want to share the data anonymously, and we might need an intermediary (like what Thej does with the wonderful http://openbangalore.org/) Let me know what you all think. Regards, Pavan -- Pavan Srinath http://flavors.me/psrinath On Mon, Feb 25, 2013 at 11:58 AM, Gautam John gkj...@gmail.com wrote: On Mon, Feb 25, 2013 at 11:54 AM, Karthik Shashidhar karthik.shashid...@gmail.com wrote: Perhaps we can make it mandatory for each and every speaker at the sessions to make public some data that they possess and which is not in the open domain already? That's a great idea, Karthik. -- For more details about this list http://datameet.org/discussions/ --- You received this message because you are subscribed to the Google Groups datameet group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out. -- For more details about this list http://datameet.org/discussions/ --- You received this message because you are subscribed to the Google Groups datameet group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
Re: [datameet] Digest for datameet@googlegroups.com - 1 Message in 1 Topic
Dear DataMeeters - would be great to get your ideas for a *women's rights hackathon *that Breakthrough and Hacks/Hackers New Delhi are hosting on Dec 7-8. We want people to make data viz, vids and interactive charts about topics like early marriage, domestic violence, etc. We have the following: audio data (via Gram Vaani), crowd-sourced urban safety data (Whypoll), possibly some data on Twitter conversations, and then government and other data. Would be great to get ideas on: 1) additional sources of data sets and 2) types of projects you might want to make with it. Also, would love to have people from DataMeet come by and participate and lend their data expertise to the groups! Send any thoughts you have. Thanks guys! Anika (of Hacks/Hackers New Delhi) On Thu, Nov 28, 2013 at 6:08 AM, datameet@googlegroups.com wrote: Today's Topic Summary Group: http://groups.google.com/group/datameet/topics - [datameet.delhi] notes from datameet-up, held on 22 nov#1429c24ab8efe55c_group_thread_0[1 Update] [datameet.delhi] notes from datameet-up, held on 22 novhttp://groups.google.com/group/datameet/t/9665f67528687603 sumandro suman...@gmail.com Nov 26 10:12PM -0800 Dear all, Sorry for the slight delay in sharing my notes from the DataMeet-Up last Friday. Please find the notes here: http://datameet.org/2013/11/27/notes-datameet-up-delhi-22-nov/. Feel free to add to and correct the details in the note by commenting on the post. I have created a dedicated repository at DataMeet GitHub org page for the election data mapping work. Access it here: https://github.com/datameet/india-election-data. Go take a look at the format for documenting found (relevant) datasets here: https://github.com/datameet/india-election-data/blob/master/data-doc-format.md. Use the same format to document the datasets, and then push the actual data file into the repository as well. Please remember to name the data file and the documentation file in a similar way. Mark required data cleaning/reorganisation/clarification tasks by opening an issue (where the name of the data file is mentioned). Alternatively, access the Google spreadsheet here https://docs.google.com/spreadsheet/ccc?key=0Arxi0bhhq-OxdE1tT2pNemZOWlRremRTZUp5ZUVfX2cusp=sharing and add the details of the documented dataset. Feel free to share suggestions and ask for clarifications. Bests, sumandro ajantriks.net -- For more details about this list http://datameet.org/discussions/ --- You received this message because you are subscribed to the Google Groups datameet group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out. -- anikagupta.wordpress.com +91 9650 888 993 // indiadigitalmedia.wordpress.com new delhi, india -- For more details about this list http://datameet.org/discussions/ --- You received this message because you are subscribed to the Google Groups datameet group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
Re: [datameet] Collection of geospatial data by the State
Dear Praachi, I think coordinated RTIs could help us part of the way. As another lawyer, I'm willing to help out with the drafting, if you or others take the lead in terms of strategizing in terms of the departments and data sets to target. Regards, Pranesh Praachi Misra misra.praa...@gmail.com [2014-04-02 22:45:52 -0700]: Hello, In view of the coming elections there has been a lot of talk about electoral boundaries, district maps etc. In the course of looking for geocoded pin code data earlier, I had come across the *Delhi **Geo-Spatial Data Infrastructure Act, 2011 (*linkhttp://www.delhi.gov.in/wps/wcm/connect/d8f3f20048251b1b813bb7ea9e7528b1/act.pdf?MOD=AJPERESlmod=424882252 *). * The scope of the Act is very broad and envisages the use of geospatial data for delivery of public services across the board . So theoretically, crime, transport, landuse, waste related data should be available with them. The *GeoSpatial Delhi Limited *(link http://delhi.gov.in/wps/wcm/connect/doit_geo/geo/Home)has been created under it, and from the information available on the website charges departments for the use of its data. Its mandate also includes providing data for public use. The presentation http://www.cips.org.in/public-sector-systems-government-innovations/documents/delhi-state-spatial-data-infrastrucutre.pdfoutlines the data collected by the body (see slide 17 onwards). Some articles on the same in Mint are herehttp://www.livemint.com/Industry/stPBT2GcF4lkP055RCFb0O/Creating-a-digital-replica-of-Delhi-one-step-at-a-time.htmland herehttp://www.livemint.com/Industry/SOinttbjYrKzwOcqfNaByM/Coming-up-a-satellite-technology-to-clear-urban-mess-in-Del.html . Similar data collection initiatives have also been taken by Orissahttp://gis.ori.nic.in/, Uttar Pradesh http://emanchitra.up.nic.in/emanchitra/, Keralahttp://ksdi.kerala.gov.in/KSDI/welcome.do, etc . There is also NATMO http://natmo.gov.in/index.htm, Remote Sensing System http://gis.nic.in/, and thishttps://gisserver.nic.in/gvsig/default.aspx . The National Data Sharing Policy (linkhttps://nsdiindia.gov.in/nsdi/nsdiportal/meetings/gazette.pdf) also requires making data open. Therefore, it appears to me that a lot of data is spread across different government agencies and locked up. Some resourcefulness is required to free the same, now that the Datameet group is really raging forward, some of us can take some time to drop be these agencies and see if they are open to making some of this data available. I am not sure if these topics have been discussed earlier, or if something is already in the works. Your thoughts are welcome. Praachi -- Pranesh Prakash Policy Director, Centre for Internet and Society T: +91 80 40926283 | W: http://cis-india.org --- Access to Knowledge Fellow, Information Society Project, Yale Law School M: +1 520 314 7147 | W: http://yaleisp.org PGP ID: 0x1D5C5F07 | Twitter: https://twitter.com/pranesh_prakash signature.asc Description: OpenPGP digital signature
Re: [datameet] Re: India 2001 census data village-wise
Dear Chitra, Could you please upload the data if you get time. thanks Mukesh On Sun, Nov 27, 2016 at 9:09 PM, Chitra Jogani <chitra...@gmail.com> wrote: > Hi Mukesh, > > I do have this data, I could make it available to you within a day or so > if not a problem. > > Thanks, > Chitra > > > On Sunday, 27 November 2016 13:04:20 UTC-6, mukesh ray wrote: >> >> Hi Sharad, >> I wanted data for UP, Uttarakhand, Jharkhand, Bihar, MP >> and Chhattisgarh. It would be very helpful, if you have them and can share >> them with me >> >> >> Thanks >> Mukesh >> >> On Thursday, November 24, 2016 at 12:59:16 AM UTC-5, Sharad Lele wrote: >>> >>> Depends upon which state you want them for. Many of us purchased the >>> 2001 datasets at some point, and I would certainly be happy to share what I >>> have because I believe the data should be in the public domain just like >>> 2011 data are >>> >>> Sharad >>> >>> On 24-11-2016 04:27, mukesh ray wrote: >>> >>> Hello everyone, >>> I was wondering if anyone has access to the >>> village amenities data for 2001. The data for 2011 is available online, but >>> the data for 2001 does not seem to be available online anywhere. I saw this >>> thread of discussion online and I hope someone could help me with the >>> datasets. >>> >>> Thanks >>> Mukesh >>> >>> On Saturday, March 1, 2014 at 12:23:17 AM UTC-5, Fenella C wrote: >>>> >>>> Hello everyone, >>>> >>>> I am wondering if any of you have the village-wise 2001 Indian census >>>> data in a spreadsheet (or similar) format? I am basically looking for >>>> information at the village level from the 2001 census (e.g., population of >>>> the village, number of households in the village, etc.) >>>> >>>> The data is available online at the census website here >>>> http://www.censusindia.gov.in/Census_Data_2001/Village_ >>>> Directory/View_data/Village_Profile.aspx but it is not available in a >>>> spreadsheet. I have already tried web scraping the data, but it is >>>> painfully slow, so I'm wondering if I can find it elsewhere. >>>> >>>> Many thanks, >>>> Fenella >>>> >>> -- >>> Datameet is a community of Data Science enthusiasts in India. Know more >>> about us by visiting http://datameet.org >>> --- >>> You received this message because you are subscribed to a topic in the >>> Google Groups "datameet" group. >>> To unsubscribe from this topic, visit https://groups.google.com/d/to >>> pic/datameet/WcgiHq0trBc/unsubscribe. >>> To unsubscribe from this group and all its topics, send an email to >>> datameet+u...@googlegroups.com. >>> For more options, visit https://groups.google.com/d/optout. >>> >>> >>> -- > Datameet is a community of Data Science enthusiasts in India. Know more > about us by visiting http://datameet.org > --- > You received this message because you are subscribed to a topic in the > Google Groups "datameet" group. > To unsubscribe from this topic, visit https://groups.google.com/d/ > topic/datameet/WcgiHq0trBc/unsubscribe. > To unsubscribe from this group and all its topics, send an email to > datameet+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > -- Mukesh Ray -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Re: Sharing : Census 1991 _Village/Town Level PCA Data
Hi sumit, and for the information of others I rechecked the link again I was talking about the same data . The difference in the data that I have shared now is that THIS DATA for 1991 is at Village / Town level. On Friday, August 31, 2018 at 9:05:11 AM UTC+5:30, Sumit wrote: > > Hi Dilip and Karthik, > > I had shared the data on the forum a few years ago (Thejesh had created a > repo too; I can't find it now.). Resharing this - > https://sites.google.com/site/mishrasumitr/data?authuser=0 > Hope this helps. > > Sumit > > On Tuesday, 28 August 2018 19:44:10 UTC+5:30, Naraina aka Dilip Damle > wrote: >> >> HI, >> >> The PCA 2001 and 2011 are available in STATA format and there is a link >> somewhere on this group. >> I have got it from there. >> >> I am not sure but it may be in the Group repository. Please check. >> Better if someone else who knows about the repository answers. >> >> On Tuesday, August 28, 2018 at 7:37:27 PM UTC+5:30, Karthik Shashidhar >> wrote: >>> >>> Thanks, Dilip, for making this available. >>> >>> I'm downloading this, and will let you know in case I find any issues. >>> >>> Is the PCA for the 2001 Census available in a similar format? >>> >>> Thanks much >>> Karthik >>> >>> On Monday, 27 August 2018 19:58:39 UTC+1, Naraina aka Dilip Damle wrote: >>>> >>>> Hello, >>>> >>>> I think The Census 1991 PCA ... Primary Census Abstract data was not >>>> available in a collated form anywhere. >>>> >>>> hence started working on this and have created combined files in csv >>>> format using Data downloaded from Census website. >>>> >>>> Hers is the copy of the readme file that accompanies the data. >>>> >>>> == >>>> Reademe file for Census_1991_PCA Village/Town level data >>>> >>>> >>>> Source : Census of India Website : Digital Library >>>> >>>> Compiled by : Naraina Damle AKA Dilip Damle email : cadv...@gmail.com >>>> >>>> Files Included : 4 >>>> >>>> All_India.csv >>>> All_states.csv >>>> PCA_URBAN.csv >>>> PCA_Rural.csv >>>> >>>> Process done >>>> The individual files were downloaded and cleaned for missing Codes/ >>>> Names etc. and combined. >>>> The Total population was checked and verified at all the levels >>>> >>>> >>>> Changes done to data : >>>> >>>> 1. The state codes in individual files did not match the All India and >>>> state level file. Changed them according to all india. >>>> 2. Some states do not have Block and Nyaya Panchayat code. Added >>>> blank/0 value filed there. >>>> 3. All codes except Location code changed to numeric format from padded >>>> text format. >>>> 4. Added ISO state codes for easier identification. >>>> 5. Created Unique record_ID using ISO State codes and Locationcode >>>> 6. No change done to any Data beyond and including the place name >>>> >>>> Possible errors : >>>> >>>> There could still be some missing Names of Districts/Tehsils etc. >>>> >>>> >>>> Further improvments will be done later. >>>> >>>> >>>> Released this Version on 28August2018 >>>> >>>> May edit this file later with more specific cleaning done. >>>> >>>> >>>> >>>> Hers is the googeldrive link to the data : >>>> https://drive.google.com/drive/folders/1CNh5oaX3efZbW4yo8GXqbufjy57cMR09?usp=sharing >>>> >>>> I request interested people to have a look at it and we will rectify >>>> any shortcomings and then load it in the repository. >>>> >>>> If you need the MS Access file which I used to work with this data then >>>> send me a private mail. >>>> >>> -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[datameet] Re: Rainfall Data (Unpivoted) [Need Visualization] {Script for unpivoting done}
I think that is pretty easy in pandas also i have analysed daily rainfall for jaipur for nearly five years here https://github.com/sandeepgadhwal/Rainfall-and-Stormwater-Analysis/blob/master/Rainfall_Analysis.ipynb On Friday, 9 March 2018 16:09:13 UTC+5:30, Kshithij Iyer wrote: > > DataMeet Pune Rainfall Data (Unpivoted) > <https://github.com/kshithijiyer/DataMeet-Pune-Rainfall> > > This is a script which I developed for DataMeet Pune which takes an .xls > file which has rainfall data of India and generates state-wise .csv files > in an unpivoted format which can be useful for further analysis > > > . > > <https://github.com/kshithijiyer/DataMeet-Pune-Rainfall#what-does-the-script-do>What > > does the script do? > > Look at the unpivoting example.xlsx > <https://github.com/kshithijiyer/DataMeet-Pune-Rainfall/raw/master/data/unpivoting%20example.xlsx> > > file and this link > <https://github.com/datameet-pune/datameet-pune.github.io/wiki/Table-Un-Pivot> > > you'll get a hang of what the script does. :) > > <https://github.com/kshithijiyer/DataMeet-Pune-Rainfall#about-the-data> > <https://github.com/kshithijiyer/DataMeet-Pune-Rainfall#about-the-data>About > the data? > > *Source of Data:* > http://www.indiawaterportal.org/articles/district-wise-monthly-rainfall-data-list-raingauge-stations-india-meteorological-department > > *Issues with the Raw data:* Chandigarh data is given under Chhattisgarh > sheet. A sepreated sheet had to be manually created so that the script can > run smoothy on the .xls file. > > > > <https://github.com/kshithijiyer/DataMeet-Pune-Rainfall#list-of-r-packages-needed-by-the-code>List > > of R packages needed by the code: > >1. xlsx <https://cran.r-project.org/web/packages/xlsx/index.html> >2. tidyr <https://cran.r-project.org/web/packages/tidyr/index.html> > > > <https://github.com/kshithijiyer/DataMeet-Pune-Rainfall#manual-inputs-needed-to-the-script>Manual > > inputs needed to the script. > >1. You'll have to choose the .xlsx file which has to be processed. >However the code does have manual logic as well which can be uncommented >and you can create .CSV files of specific sheets instead of the all the >sheets in the .xls file. >2. The .csv file would be store in the ./Processed-Data folder and >You'll have to manually add "Sr.No", to the start of the .csv file. > > > <https://github.com/kshithijiyer/DataMeet-Pune-Rainfall#what-can-be-done-with-this-data>What > > can be done with this data? > >1. A choropleth map of the country with a timeline, the colours >changing to show amount of rainfall. >2. A predective model for drought detection can be created. > > > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [datameet] Policy alert - NDAP National Data & Analytics Platform
Naveen, I had attended the pre-bid meeting and this has been something that NITI Aayog has been trying to do for a long time and the RFP has gone through multiple extensions and cancellations. The problem is no one is looking at it as a data gathering exercise with policies and procedures. What Niti Aayog wants to do is a little tricky from a data collection perspective. I have been trying to get to the right people for expanding the Data Policy to give guidelines to ministries and help put them data oon data.gov <http://data.gov/>.in and NITI Aayog can then use the data to conduct different analyses and even bring in AI and ML. If the policy and guidelines can be established it will be a lot easier for data.gov <http://data.gov/>.in or NITI Aayog to build analysis and develop use cases. Do we know who this was awarded to? As this is a managed service they are trying to build. Regards, Srinivas > On Feb 14, 2019, at 10:29 AM, Naveen Francis wrote: > > Hello, > > > > When there already is a data.gov.in <http://data.gov.in/> initiative, why has > NITI Aayog decided to embark on the NDAP project? How exactly will NDAP be > different? > > Data.gov.in is a very good initiative but when it comes to datasets, there > are a lot of ministries that put the data there (data.gov.in) and it is done > by choice. But they also put a lot more information on their (minstry’s) own > websites. Some of them have put the data there (data.gov.in) but there is no > compulsion to put data there. Some of the datasets have been put there for > two or three years and discontinued now. We are picking data directly from > the ministry’s website — that will be our primary source — and convert them > and standardise the format. Also, there are a lot of data on state government > websites that are not captured at all, and we will be having data from there > also. > > https://factordaily.com/niti-aayogs-avik-sarkar-aims-for-democratized-data-led-discussion-and-analytics-in-india/ > > > > > > > On Friday, 12 October 2018 12:33:26 UTC+5:30, satyaakam wrote: > On Fri, Oct 12, 2018 at 12:23 PM Srinivas Karuturi > > wrote: > Satya, > > The RFP is available at this link NDAP > <http://niti.gov.in/writereaddata/files/tenders/AMENDED-RFP-ndap.pdf> > thanks i will go through it > > The RFP says you can attend the meeting for clarifications and there is no > need to register for it. I will drop an email to see if we need a special > invite. > > it would be good for those of you who are interested can collate some > questions after reading the document and we would be happy to raise them in > the meeting from our side as DataMeet > > thanks, > -Satya > Satyaakam.net <http://satyaakam.net/> | afrost.org <http://afrost.org/> | > fossevents.in <http://www.fossevents.in/> > ** For all official purposes use my name as Satyakam Goswami ** > > -- > Datameet is a community of Data Science enthusiasts in India. Know more about > us by visiting http://datameet.org <http://datameet.org/> > --- > You received this message because you are subscribed to the Google Groups > "datameet" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to datameet+unsubscr...@googlegroups.com > <mailto:datameet+unsubscr...@googlegroups.com>. > For more options, visit https://groups.google.com/d/optout > <https://groups.google.com/d/optout>. -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [datameet] Open Transit Data - Delhi
Amazing! Thanks Nikhil. Just downloaded the raw data, will explore it On Friday, 21 June 2019 15:21:05 UTC+5:30, Nikhil VJ wrote: > > Hi Folks, > > I caught up with this project over the last week, revamped my coding and > methods and now have a workflow in place where: > > 1. The GTFS realtime VehiclePositions data of buses released by Open > Transit Data Delhi is being archived once every minute > 2. A clearing-house system processes the data files at regular intervals > and appends it to a CSV > 3. Duplications and bad data are being detected and avoided > 4. Summary data with per-file stats is being logged to accompany the raw > data collecting > 5. Subsets of the summary data are being made for visualisation > 6. Two time-series data visualisations are now up showing the metrics of > the realtime data, and the latency. > 7. The full data collecting since 28 April is compressed into a .7z > archive every morning and posted online for downloading. > > You'll find everything here: > https://server.nikhilvj.co.in/delhirt/ > > Also, just to repeat a link shared earlier, visualisation of current > vehicle locations on a map: http://server.nikhilvj.co.in:8080/ > > The .7z has full raw data - inviting you to dig into it. > > > Cheers > Nikhil VJ, Pune, India > > > On Sunday, April 28, 2019 at 11:30:45 PM UTC+5:30, Nikhil VJ wrote: >> >> Hi Folks, >> >> Early this month the real-time GTFS feed of Delhi transit had gotten >> inflated with duplicating/redundant entries and buggy - They announced a >> downtime <https://otd.delhi.gov.in/announcements/> to make fixes. >> >> Maybe it's the elections code-of-conduct or some other to-do work for >> which announcement has not been made, but I checked again today, and the >> Delhi realtime GTFS is now awesome! Clean and crisp feed, no repetitions, >> very good latency, lat-longs seem accurate, clear route and trip ids given. >> >> I've deployed the live feed on a map visualization called OneBusAway >> visualizer >> <https://github.com/OneBusAway/onebusaway-gtfs-realtime-visualizer/>: >> http://server.nikhilvj.co.in:8080/ >> >> I also downloaded their static GTFS data zip, and it's visualized here >> using Transitfeed's ScheduleViewer >> <https://github.com/google/transitfeed>: >> http://server.nikhilvj.co.in:5060/ >> >> >> I'm not getting too much into analysing these datasets right now, but am >> re-starting long-term archival of the realtime feed which I had >> discontinued last month owing to the aforementioned issues. >> >> >> Note: The viz programs behind these tend to crash after prolonged uptime >> (hey I just use 'em.. this is some pretty complicated programming so I'm >> glad they work and are open-source!), so I've set them to restart every >> hour, and they take a couple of mins to rev up. If you find the link not >> working, please check back in 5-10 mins and if it's still down then let me >> know. You can email me on nikhil.js [at] gmail.com . >> >> >> Regards >> Nikhil VJ >> Pune, India >> >> See full thread on google groups >> <https://groups.google.com/d/topic/datameet/exEoW8aGHu0/discussion> >> > -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to datameet+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/datameet/d6e3ae19-ce0f-4125-9062-2c98dfa61ef9%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
