| mpopov added a comment. |
- How many IPs use parallel connections to the WDQS servers? Out of the IPs that do the above, how many have the same/different user agents (hinting at one tool or proxy serving multiple clients)?
- Of 14K unique IPs observed between Nov 1st and 28th, 1.9K (13.6%) had made more than 1 request (to SPARQL endpoint) at any given second.
- Of those, 1360 (71.1%) only had 1 UA; 553 (28.9%) had 2 or more UAs; with 2 IP addresses observed to have 30-33 UAs.
- Of 14K unique IPs observed between Nov 1st and 28th, 1.9K (13.6%) had made more than 1 request (to SPARQL endpoint) at any given second.
- How many parallel connections are typically used, how frequent is to use more than 3, what is the max, etc.?
- 726 IPs (5.17%) were seen making 3 or more requests per second.
- Of those, 458 (63.1%) only had 1 UA; 268 (36.9%) had 2 or more UAs.
- 537 IPs (3.82%) were seen making more than 3 requests per second.
- Of those, 331 (61.64%) only had 1 UA; the rest had 2 or more UAs.
- 726 IPs (5.17%) were seen making 3 or more requests per second.
- In general, how many user agents per IP we have - do we have some IPs that have a lot of different agents (indicating a proxy), how much and how traffic from those IPs looks like - e.g. how many parallel requests, how often theres more than one, more than three?
- A particular Digital Ocean IP was especially active, using the axios promise based HTTP client
- 300+ requests made per second 7 different times
- 200-300 requests made per second 306 different times
- 100-300 requests made per second 735 different times
- 100-200 requests made per second by 2 Universidad Politecnica de Madrid IPs 2,200 different times
- Some were made using a browser on a computer (according to the UA)
- Some were made using Requests library for Python
- A particular Digital Ocean IP was especially active, using the axios promise based HTTP client
@Smalyshev: Let me know if you have any additional questions and/or if I missed anything. Hope this helps!
TASK DETAIL
EMAIL PREFERENCES
To: mpopov
Cc: debt, Deskana, chelsyx, mpopov, Gehel, Aklapper, Smalyshev, EBjune, mschwarzer, Avner, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Manybubbles, Mbch331
Cc: debt, Deskana, chelsyx, mpopov, Gehel, Aklapper, Smalyshev, EBjune, mschwarzer, Avner, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Manybubbles, Mbch331
_______________________________________________ Wikidata-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
