Re: [R-pkg-devel] new package? - Sports data from transfermarkt.com using rvest

[Kehl Dániel]

Dear Peter and Thierry,

thank you for your answers. I indeed contacted transfermarkt.com and write this 
just to finish up this conversation.

Here is part of their answer:

"thank you for getting in touch with us. Basically our data is copyrighted 
under German law by Transfermarkt, so there is no license whatsoever. 
Therefore, we�re also no friends of data scraping and tend to block bots more 
and more.
Rather we support the scientific community by providing data sets for single 
purposes in a structured process."

Seems like this is a polite way of saying: do not create an R package with this 
purpose. My first package is going to be something else. :(

Thanks and have a great day,
Daniel


[http://wweb.ktk.pte.hu/info/email-alairas/Oktat%C3%B3k/Dr.%20KEHL%20D%C3%A1niel/magyar/image001.png]



Dr. KEHL D�niel
adjunktus

[http://wweb.ktk.pte.hu/info/email-alairas/Oktat%C3%B3k/Dr.%20KEHL%20D%C3%A1niel/magyar/image002.png]
P�CSI TUDOM�NYEGYETEM K�ZGAZDAS�GTUDOM�NYI KAR
K�zgazdas�gtan �s �konometria Int�zet
H-7622 P�cs, R�k�czi �t 80. | www.ktk.pte.hu
+36 72 501 599/ 23144 | ke...@ktk.pte.hu

Felad�: Peter Meissner [retep.meiss...@gmail.com]
K�ldve: 2018. janu�r 24. 18:59
C�mzett: Thierry Onkelinx
M�solatot kap: Kehl D�niel; r-package-devel@r-project.org
T�rgy: Re: [R-pkg-devel] new package? - Sports data from transfermarkt.com 
using rvest

Hey,

I am not a laywer but their terms are quite explicitly prohibiting 
redistribution of their data without written consent.

Now you might build a package that does not collect, store and redistributes 
the data but only allows to access the data provided there 'live' via some 
convenience functions. But I don't really know if that argument actually is 
valid in any legal sense.

To be on the safe side, you probably should contact them.

Best, Peter


Am 24.01.2018 12:13 nachm. schrieb "Thierry Onkelinx" 
>:
Dear Daniel,

First of all you need to make sure that the licence of
transfermarkt.com allows the usage that you have 
intended. If that is
not clear from their website, then you should contact them rather than
us.

CRAN has several packages to assists in downloading data from online
sources. But the source has to allow that kind of usage.

Best regards,

ir. Thierry Onkelinx
Statisticus / Statistician

Vlaamse Overheid / Government of Flanders
INSTITUUT VOOR NATUUR- EN BOSONDERZOEK / RESEARCH INSTITUTE FOR NATURE
AND FOREST
Team Biometrie & Kwaliteitszorg / Team Biometrics & Quality Assurance
thierry.onkel...@inbo.be
Havenlaan 88 bus 73, 1000 Brussel
www.inbo.be

///
To call in the statistician after the experiment is done may be no
more than asking him to perform a post-mortem examination: he may be
able to say what the experiment died of. ~ Sir Ronald Aylmer Fisher
The plural of anecdote is not data. ~ Roger Brinner
The combination of some data and an aching desire for an answer does
not ensure that a reasonable answer can be extracted from a given body
of data. ~ John Tukey
///




2018-01-23 16:27 GMT+01:00 Kehl D�niel 
>:
> Dear List members,
>
> maybe this is not the right place to ask, if that is the case, please forward 
> me to the right place.
> I developed some functions to download and transform football/soccer related 
> data from transfermarkt.com.
> There are plans to create my first package based on these functions and of 
> course develop them and add more later. As far as I know there is no API to 
> that page, so I am using the rvest package.
> My question is: is this an OK thing to do? Should I contact 
> transfermarkt.com? My german is not perfect (just 
> like my english), this is what I've found on thier webpage. Does that mean 
> one can not create a package related to that page? Or can't crawl at all? Or 
> just not allowed to sell the data? If it is allowed, can one post the package 
> on CRAN at the end?
>
> Please if any of you have experience in that or just show me where to ask, do 
> not hesitate!
>
> LEGAL NOTICE
> � Transfermarkt GmbH & Co. KG 2000-2018
>
> All rights reserved.
>
> Der Inhalt dieser Website ist urheberrechtlich gesch�tzt. Nachdruck, Aufnahme 
> in Online-Dienste, Internet und Vervielf�ltigung auf Datentr�ger wie CD-ROM, 
> DVD-ROM usw. d�rfen, auch auszugsweise, nur nach vorheriger schriftlicher 
> Zustimmung durch Transfermarkt erfolgen. Eine kommerzielle Weitervermarktung 
> des Inhalts ist untersagt.
>
> Transfermarkt haftet nicht f�r unverlangt eingesandte Inhalte, Manuskripte 
> und Fotos. F�r Inhalte externer 

[R-pkg-devel] new package? - Sports data from transfermarkt.com using rvest

[Kehl Dániel]

Dear List members,

maybe this is not the right place to ask, if that is the case, please forward 
me to the right place.
I developed some functions to download and transform football/soccer related 
data from transfermarkt.com.
There are plans to create my first package based on these functions and of 
course develop them and add more later. As far as I know there is no API to 
that page, so I am using the rvest package.
My question is: is this an OK thing to do? Should I contact transfermarkt.com? 
My german is not perfect (just like my english), this is what I've found on 
thier webpage. Does that mean one can not create a package related to that 
page? Or can't crawl at all? Or just not allowed to sell the data? If it is 
allowed, can one post the package on CRAN at the end?

Please if any of you have experience in that or just show me where to ask, do 
not hesitate!

LEGAL NOTICE
© Transfermarkt GmbH & Co. KG 2000-2018

All rights reserved.

Der Inhalt dieser Website ist urheberrechtlich geschützt. Nachdruck, Aufnahme 
in Online-Dienste, Internet und Vervielfältigung auf Datenträger wie CD-ROM, 
DVD-ROM usw. dürfen, auch auszugsweise, nur nach vorheriger schriftlicher 
Zustimmung durch Transfermarkt erfolgen. Eine kommerzielle Weitervermarktung 
des Inhalts ist untersagt.

Transfermarkt haftet nicht für unverlangt eingesandte Inhalte, Manuskripte und 
Fotos. Für Inhalte externer Links und fremde Inhalte übernimmt Transfermarkt 
keine Verantwortung.

Thank you for all your insights and/or comments,

best regards
Daniel





















Dr. KEHL Dániel

adjunktus





PÉCSI TUDOMÁNYEGYETEM KÖZGAZDASÁGTUDOMÁNYI KAR

Közgazdaságtan és Ökonometria Intézet

H-7622 Pécs, Rákóczi út 80. | www.ktk.pte.hu 

+36 72 501 599/ 23144 | ke...@ktk.pte.hu










__
R-package-devel@r-project.org mailing list
https://stat.ethz.ch/mailman/listinfo/r-package-devel