Yes scraping for large amounts of data from a smallish server is not really polite. May overload the server. Besides quite inefficient. You could make a request to owner of site instead. Assuming you can present good enough reason you might get lucky
2015-11-13 8:39 GMT+02:00 Josef Moudrik <j.moud...@gmail.com>: > Hello, > > I have a simple script for downloading info (gamelist, list of oponents, > games) one by one here: > > http://repo.or.cz/gostyle.git/blob/HEAD:/kgs/kgs.py > > If you want to download more players, you need to search through opponents > of players you know. But do not spam the kgs server too much please :-) > > Regards, > Josef > > > On Thu, Nov 12, 2015 at 2:35 PM Arthur Cater <arthur.ca...@ucd.ie> wrote: > >> Hello, >> I would be interested for research purposes in getting lots of game sgfs >> of >> lower-ranked players, to contrast with the high dan and pro games that >> get put into collections. Even kyu games. I was thinking of getting them >> from kgs archives. >> >> I wonder if anyone already has a script that could (or could be easily >> adapted to) do this? And would they share? >> >> Thanks, >> >> Arthur >> >> _______________________________________________ >> Computer-go mailing list >> Computer-go@computer-go.org >> http://computer-go.org/mailman/listinfo/computer-go > > > _______________________________________________ > Computer-go mailing list > Computer-go@computer-go.org > http://computer-go.org/mailman/listinfo/computer-go >
_______________________________________________ Computer-go mailing list Computer-go@computer-go.org http://computer-go.org/mailman/listinfo/computer-go
