Manuel added a comment.
Thank you @Michael for investigating the spiders. This made me realize that "community run bots" are, of course, classified as spiders here. > The page views by spiders do not really seem meaningful in that case. @Lucas_Werkmeister_WMDE: My assessment was wrong. We will definitely need to keep measuring spider activity. Let's please ensure that we clarify on the board what goes into the spider category: basically everything that is not using a classic browser (including community run bots, our own infrastructure, and of course classic web crawlers). This might help other PMs looking at the dashboard making the same mistake. We could also think of naming the two categories more intuitively, e.g. "browser" and "non-browser". > The ones with user agent seem harmless, but the vast majority does not have a user agent. Not sure what is going on there. I checked: The huge number of hits without defined user agent have all originated from only one machine and stopped yesterday. So I guess it was just an ill behaved script. TASK DETAIL https://phabricator.wikimedia.org/T319380 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Michael, Manuel Cc: Lydia_Pintscher, Aklapper, Manuel, Michael, ItamarWMDE, guergana.tzatchkova, karapayneWMDE, Lucas_Werkmeister_WMDE, Astuthiodit_1, Invadibot, maantietaja, SCIdude, Akuckartz, pdehaye, Nandana, Lahi, Gq86, Andrawaag, GoranSMilovanovic, QZanden, YULdigitalpreservation, LawExplorer, Salgo60, _jensen, rosalieper, Scott_WUaS, MisterSynergy, abian, Wikidata-bugs, aude, Mbch331
_______________________________________________ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
