On the subject of climate data, there is this project crowdsourcing
old weather information from the captain's logs in WWI battleships.
http://www.oldweather.org/
Anyone given it a try?
I am of the view that there has to be a platform continuum between
writing code to do a proper scraper and parse, and simply rekeying the
data. What this means is if you happen to have a small data-set that
you think would take a three hours to write a parser for and which is
updated once a month, it may be more reasonable to cut-and-paste the
data (or type it in), and then code up some some simple monitoring
mechanism that sends out an email when the next page is uploaded.
It also might be good practice to always have some hand-copied data
from the scraped pages which you automatically test-drive your scraper
against.
Julian.
On Fri, Oct 29, 2010 at 9:57 AM, [email protected]
<[email protected]> wrote:
> On 26 October 2010 21:53, dchetwynd <[email protected]> wrote:
>>
>> I would definitely be up for a Python coding dojo. I've done coding
>> dojos before at other programming groups like XP Manchester at MADLAB,
>> and it's a great way to improve your coding skill. The climate data
>> example sounds like a good one to use.
>
>
> I'd also be very keen to work on climate data. It's a great opportunity to
> stretch our skills on a real world project, and one which I imagine lends
> itself to getting up and running pretty quickly when we meet.
> I'm also very keen on the kind offer of beer and pizza. It's a well known
> fact that beer is more refreshing and pizza tastier when they're free ;)
>>
>> At the other dojos I've been to
>> there were several laptops available, we did pair programming and we
>> switched partners at regular intervals.
>
> I can see this working quite well. There will naturally be people of
> varying experience there on the day, be it with Python / ScraperWiki /
> climate stuff, and I'd hope the opportunity to pair up with someone more
> experienced will encourage those wishing to improve their skills to attend.
> Sounds like fun too!
>
>>
>>
>>
>> --
>> To post: [email protected]
>> To unsubscribe: [email protected]
>> Feeds: http://groups.google.com/group/python-north-west/feeds
>> More options: http://groups.google.com/group/python-north-west
>
> --
> To post: [email protected]
> To unsubscribe: [email protected]
> Feeds: http://groups.google.com/group/python-north-west/feeds
> More options: http://groups.google.com/group/python-north-west
>
--
To post: [email protected]
To unsubscribe: [email protected]
Feeds: http://groups.google.com/group/python-north-west/feeds
More options: http://groups.google.com/group/python-north-west
