Hi Rigved, Thanks for sharing the link, they have a good explanation that can be used in the user interface. I intend to use precisely that function in python as i mentioned before.
Disambiguation: My apologies if the words of the subject line are ambiguous. I did not mean it as a stackexchange type of thing where the solution is provided in the form of example code snippets and the solution-seeker is expected to have the necessary programming skills to adapt and apply it to their specific use case. When i wrote the subject line i had in mind what my friends from an ngo asked me, "can you code a solution for this problem?". So i want to collect tasks for: coding (verb) ... (pause for effect)... solutions (noun) to common problems faced in the social sector. Did not mean "coding" as as an adjective. Sorry for the confusion caused. - Nikhil VJ Pune, India On Thursday, November 1, 2018, rigved shenai <[email protected]> wrote: > This can be done pretty quickly with python > http://www.datasciencemadesimple.com/reshape-wide-long- > pandas-python-melt-function/ > worked wonders for me. > > On Thursday, November 1, 2018 at 1:50:25 AM UTC+5:30, Sanjana Krishnan > wrote: >> >> Hello Nikhil, >> >> Interesting initiative! We all have these go-to code snippets somewhere, >> it'll be useful to aggregate and share them, and making these apps(?) is >> amazing cause non-coders can use them too. >> >> One repetitive task I face is converting data to tidy format, from wide >> to long. I can do it very well on R now (thankfully), but its a not >> straightforward to convert it from wide to long using excel, I've used >> openrefine before learning R. >> >> Attaching data about universal health coverage with 3 identifying fields >> (country, indicator name, year) and one value. >> Census data also comes in wide format often (age, gender and >> literacy status by state- attached) >> >> It's possible to specify the data fields to pivot and unpivot data? >> >> Best, >> Sanjana >> >> On Monday, September 17, 2018 at 8:56:33 PM UTC+5:30, Nikhil VJ wrote: >>> >>> Hi friends, >>> >>> For TL;DR : Reply if you want a quick technical solution for a task of >>> yours. >>> >>> Over the past few years interacting with various folks through datameet >>> and other networks, I've kept coming across common needs for small, not >>> big, programming solutions to help NGOs, researchers, journalists, planners >>> etc in their work. I myself use many such tools regularly and have several >>> bookmarked as my go-to whenever I need something specific done fast. Some >>> examples: Venny <http://bioinfogp.cnb.csic.es/tools/venny/>, count >>> duplicates <http://www.somacon.com/p568.php>, remove duplicates >>> <http://textmechanic.com/text-tools/basic-text-tools/remove-duplicate-lines/> >>> . >>> >>> When I couldn't find something already made, I dabbled in making some of >>> these myself and have a small list of them here: >>> http://answerquest.github.io >>> One example : To retrieve some basic metadata of multiple youtube video >>> links that I wanted to share in my blog articles, I made : youtube >>> video info extractor >>> <https://answerquest.github.io/youtube-info-extractor.html>. >>> >>> These needs are not big or glitzy enough to qualify as full-fledged >>> projects. But just because they're small, doesn't mean they're not >>> necessary or impactful. *Au contraire,* there's probably more people >>> around the world using tools like Venny >>> <http://bioinfogp.cnb.csic.es/tools/venny/> than there are using R or >>> Python to achieve the same simple goal of figuring out what's common and >>> not between three or four lists of data. Its initiator made it to help with >>> some work in biology. Well, it's been used in way more fields than biology >>> by now and it's by far the fastest and simplest way to get one specific job >>> done. It may not change the world but it's cured a lot of headaches. >>> >>> I got together with PythonPune <https://meetup.com/PythonPune/> group >>> and organised a *small hackathon event* >>> <https://docs.google.com/presentation/d/e/2PACX-1vRler7N3-FNNJXznMPmwsM7V6uUTESTIDi65TUY96NT8xCSjGmETJcXnC90SwGNfo-V3HUlwG7VGCjy/pub?start=false&loop=false&delayms=3000&slide=id.p> >>> on this theme a few months ago. Great turnout, great experience, lots of >>> potential. On interacting with students who were interested in and wanted >>> to take up tasks like these, one major show-stopper that emerged was : >>> their project guides do not deem such things "major" enough to qualify as a >>> project. Profs typically prioritise something that could lead to them >>> publishing an academic paper (another example of how the academia's >>> obsession with paper publishing prevents real-world problem-solving! ). I >>> can understand now why so many of these amazing solutions get made only in >>> somebody's free time and don't benefit the creator much. >>> >>> *I want to assemble a collection of such requirements*, that we can >>> club together as a consolidated project that qualifies for serious >>> commitment. >>> >>> Output: A slew of small to medium tech solutions that can be of use to >>> people working in the open data world, all nicely featured on a one-stop >>> website like the municipal shapefiles site >>> <https://github.com/datameet/Municipal_Spatial_Data> DMers have made. >>> And the output could also just be a recipe of the quickest way to get a >>> particular job done using available tools, but it will help to put minds >>> together and hammer the best path out. And, of course, localized to your >>> context. >>> >>> *So, reaching out to know YOUR requirement.* >>> Have you ever faced a tough or repetitive task at work for which you >>> wished there would be a simple technical solution? >>> Have you thought "If only I could just ______________" ? >>> Please share about it. Accompanying details, sample data will be helpful. >>> >>> And if you're interested in being one of the coders that creates these >>> solutions and scores a live proof-of-work on your CV, let me know. >>> >>> >>> Disclaimer : Expect solutions slowly working out over time, not miracles. >>> -- >>> Cheers, >>> Nikhil VJ >>> +91-966-583-1250 >>> Pune, India >>> Website <http://nikhilvj.co.in> >>> DataMeet Pune chapter <https://datameet-pune.github.io/> >>> Self-designed learner at Swaraj University < >>> http://www.swarajuniversity.org> >>> Payment / Contribute <https://nikhilvj.benow.in/pay> >>> >> -- > Datameet is a community of Data Science enthusiasts in India. Know more > about us by visiting http://datameet.org > --- > You received this message because you are subscribed to the Google Groups > "datameet" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > For more options, visit https://groups.google.com/d/optout. > -- -- Cheers, Nikhil VJ +91-966-583-1250 Pune, India http://nikhilvj.co.in -- Datameet is a community of Data Science enthusiasts in India. Know more about us by visiting http://datameet.org --- You received this message because you are subscribed to the Google Groups "datameet" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
