[Wikidata-bugs] [Maniphest] [Commented On] T204415: Query stats dashboard not updating

[chelsyx]

chelsyx added a comment.

Hi @Smalyshev , the dashboard is updating. But since August 10th, the SPARQL usage number is very small (even 0 for certain days) and the LDF usage number is 0. Did we change the URI of the endpoint?

Query:

sql
SELECT
  year, month, day,
  IF(uri_path = '/sparql', '/bigdata/namespace/wdq/sparql', uri_path) AS path,
  UPPER(http_status IN('200','304')) as http_success,
  CASE
    WHEN (
      agent_type = 'user' AND (
        user_agent RLIKE 'https?://'
        OR INSTR(user_agent, 'www.') > 0
        OR INSTR(user_agent, 'github') > 0
        OR LOWER(user_agent) RLIKE '([a-z0-9._%-]+@[a-z0-9.-]+\.(com|us|net|org|edu|gov|io|ly|co|uk))'
        OR (
          user_agent_map['browser_family'] = 'Other'
          AND user_agent_map['device_family'] = 'Other'
          AND user_agent_map['os_family'] = 'Other'
          )
        )
    ) OR agent_type = 'spider' THEN 'TRUE'
    ELSE 'FALSE' END AS is_automata,
  COUNT(*) AS events
FROM webrequest
WHERE
  webrequest_source = 'misc'
  AND year = 2018 AND month = 8 AND day > 9
  AND uri_host = 'query.wikidata.org'
  AND uri_path IN('/', '/bigdata/namespace/wdq/sparql', '/bigdata/ldf', '/sparql')
GROUP BY
  year, month, day,
  IF(uri_path = '/sparql', '/bigdata/namespace/wdq/sparql', uri_path),
  UPPER(http_status IN('200','304')),
  CASE
    WHEN (
      agent_type = 'user' AND (
        user_agent RLIKE 'https?://'
        OR INSTR(user_agent, 'www.') > 0
        OR INSTR(user_agent, 'github') > 0
        OR LOWER(user_agent) RLIKE '([a-z0-9._%-]+@[a-z0-9.-]+\.(com|us|net|org|edu|gov|io|ly|co|uk))'
        OR (
          user_agent_map['browser_family'] = 'Other'
          AND user_agent_map['device_family'] = 'Other'
          AND user_agent_map['os_family'] = 'Other'
          )
        )
    ) OR agent_type = 'spider' THEN 'TRUE'
    ELSE 'FALSE' END
ORDER BY year, month, day
LIMIT 10000

TASK DETAIL

https://phabricator.wikimedia.org/T204415

EMAIL PREFERENCES

https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: chelsyx
Cc: mpopov, chelsyx, Aklapper, Addshore, Smalyshev, Lydia_Pintscher, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331

_______________________________________________
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs