Smalyshev created this task.
Smalyshev added a subscriber: Smalyshev.
Smalyshev added a project: Wikidata-Query-Service.
Herald added a subscriber: Aklapper.
Herald added projects: Wikidata, Discovery.

TASK DESCRIPTION
  Right now, when Updater gets HTTP code 503 from Wikidata, it just gives up 
immediately:
  
  ```
  02:27:42.967 [update 9] WARN  org.wikidata.query.rdf.tool.Update - Contained 
error syncing.  Giving up on Q356495
  org.wikidata.query.rdf.tool.exception.ContainedException: Unexpected status 
code fetching RDF for 
https://www.wikidata.org/wiki/Special:EntityData/Q356495.ttl?nocache=1436063257948&flavor=dump:
  503
  ```
  
  and the update is lost. If would be better if it would retry it with some 
delay or put the failed entity in the end of the queue.
  
  In the future, may also make sense to make some list of failed retrievals and 
try to re-fetch them periodically, to minimize chance of losing an update.

TASK DETAIL
  https://phabricator.wikimedia.org/T104783

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Smalyshev
Cc: Aklapper, Smalyshev, jkroll, Wikidata-bugs, Jdouglas, aude, Manybubbles, 
JanZerebecki, Malyacko, P.Copp



_______________________________________________
Wikidata-bugs mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Reply via email to