[
https://jira.duraspace.org/browse/DS-919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Masár updated DS-919:
--------------------------
Status: Volunteer Needed (was: Received)
> SOLR Statistics: Better detection & avoidance of abusive traffic (including a
> bot trap)
> ----------------------------------------------------------------------------------------
>
> Key: DS-919
> URL: https://jira.duraspace.org/browse/DS-919
> Project: DSpace
> Issue Type: New Feature
> Components: Solr
> Reporter: Bram Luyten (@mire)
>
> The current implementation of bot traffic filtering relies on IP lists. Even
> though using hostnames (as suggested here:
> https://jira.duraspace.org/browse/DS-790 ) could improve the situation, there
> are still forms of abusive traffic we might want to detect and exclude from
> stats.
> The most obvious example here would be repeated hits or downloads coming from
> the same unique source. Another example could be traffic from spiders that
> aren't included in the lists. A way to do this would be to create a bot trap:
> a link hidden behind one pixel, that a human user would never click, but that
> bots might follow. The agents getting to the resource at this link, could be
> listed and dynamically removed from the hit/download counts.
> Some related links:
> http://www.affiliatebeginnersguide.com/sitelogs/bots_hunt.html
> http://www.elxsy.com/2009/06/how-to-identify-and-ban-bots-spiders-crawlers/
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
------------------------------------------------------------------------------
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. SALE $99.99 this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122412
_______________________________________________
Dspace-devel mailing list
Dspace-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-devel
