[Wikidata-bugs] [Maniphest] T186161: What to do if the WDQS does not synchronise with Wikibase?

2022-07-03 Thread Webshark79
Webshark79 added a comment.


  Thought this might be the best thread to ask on.
  
  Getting this error while running the wikidata runUpdater.sh
  
  java.lang.IllegalArgumentException: Buffering capacity 2097152 exceeded
  
  I don't see where I can set this config to a higher number.
  
  full debug log:
  
  12:46:53.179 [update 4] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf 
from 
https://www.wikidata.org/wiki/Special:EntityData/Q103933897.ttl?flavor=dump&nocache=1656679613179
  12:46:53.186 [update 7] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 95 ms
  12:46:53.187 [update 7] DEBUG org.wikidata.query.rdf.tool.Updater - 
Processing data for Q111804028@1651920458@20220601124651|1703581390
  12:46:53.187 [update 7] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf 
from 
https://www.wikidata.org/wiki/Special:EntityData/Q111804028.ttl?flavor=dump&nocache=1656679613187
  12:46:53.214 [update 5] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 101 ms
  12:46:53.214 [update 5] DEBUG org.wikidata.query.rdf.tool.Updater - 
Processing data for Q94562706@1651920485@20220601124654|1703581419
  12:46:53.214 [update 5] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf 
from 
https://www.wikidata.org/wiki/Special:EntityData/Q94562706.ttl?flavor=dump&nocache=1656679613214
  12:46:53.228 [update 1] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 327 ms
  12:46:53.228 [update 0] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 106 ms
  12:46:53.228 [update 1] DEBUG org.wikidata.query.rdf.tool.Updater - 
Processing data for Q5896227@1651920427@20220601124649|1703581359
  12:46:53.228 [update 1] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf 
from 
https://www.wikidata.org/wiki/Special:EntityData/Q5896227.ttl?flavor=dump&nocache=1656679613228
  12:46:53.228 [update 0] DEBUG org.wikidata.query.rdf.tool.Updater - 
Processing data for Q50093816@1651920497@20220601124655|1703581428
  12:46:53.228 [update 0] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf 
from 
https://www.wikidata.org/wiki/Special:EntityData/Q50093816.ttl?flavor=dump&nocache=1656679613228
  12:46:53.230 [update 6] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 110 ms
  12:46:53.231 [update 6] DEBUG org.wikidata.query.rdf.tool.Updater - 
Processing data for Q103933898@1651920437@20220601124650|1703581371
  12:46:53.231 [update 6] DEBUG o.w.q.r.t.w.WikibaseRepository - Fetching rdf 
from 
https://www.wikidata.org/wiki/Special:EntityData/Q103933898.ttl?flavor=dump&nocache=1656679613231
  12:46:53.269 [update 3] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 216 ms
  12:46:53.271 [update 9] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 142 ms
  12:46:53.279 [update 2] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 202 ms
  12:46:53.281 [update 8] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 108 ms
  12:46:53.298 [update 7] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 111 ms
  12:46:53.300 [update 4] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 121 ms
  12:46:53.322 [update 1] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 94 ms
  12:46:53.332 [update 6] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 101 ms
  12:46:53.355 [update 0] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 127 ms
  12:46:53.395 [update 5] DEBUG o.w.q.r.t.w.WikibaseRepository - Done in 180 ms
  12:46:53.424 [main] DEBUG o.w.query.rdf.tool.rdf.RdfRepository - Processing 
80 IDs and 15199 statements
  12:46:53.467 [main] DEBUG o.w.q.rdf.tool.rdf.client.RdfClient - Completed in 
42 ms
  12:46:53.606 [main] DEBUG o.w.query.rdf.tool.rdf.RdfRepository - Sending 
query 4331986 bytes
  12:47:03.497 [main] INFO o.w.query.rdf.tool.HttpClientUtils - HTTP request 
failed: java.util.concurrent.ExecutionException: 
java.lang.IllegalArgumentException: Buffering capacity 2097152 exceeded, 
attempt 1, will retry
  12:47:08.990 [main] INFO o.w.query.rdf.tool.HttpClientUtils - HTTP request 
failed: java.util.concurrent.ExecutionException: 
java.lang.IllegalArgumentException: Buffering capacity 2097152 exceeded, 
attempt 2, will retry
  12:47:16.425 [main] INFO o.w.query.rdf.tool.HttpClientUtils - HTTP request 
failed: java.util.concurrent.ExecutionException: 
java.lang.IllegalArgumentException: Buffering capacity 2097152 exceeded, 
attempt 3, will retry

TASK DETAIL
  https://phabricator.wikimedia.org/T186161

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Webshark79
Cc: Webshark79, Argahsuknesib, RShigapov, danshick-wmde, Samantha_Alipio_WMDE, 
darthmon_wmde, WMDE-leszek, Superraptor123, Tinyttt, Louperivois, Jsamwrites, 
Considering.Different.Routes, DarTar, Addshore, Andrawaag, Aklapper, 
Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, 
Jelabra, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, 
rosalieper, Scott_WUaS, Asahiko, despens, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidat

[Wikidata-bugs] [Maniphest] T311276: Buffer size exceded in Wikidata runUpdate.sh service

2022-06-23 Thread Webshark79
Webshark79 updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T311276

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Webshark79
Cc: #wikibase_3rd_party_installations, Aklapper, Webshark79, Astuthiodit_1, 
karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, darthmon_wmde, 
Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, 
rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org


[Wikidata-bugs] [Maniphest] T311276: Buffer size exceded in Wikidata runUpdate.sh service

2022-06-23 Thread Webshark79
Webshark79 created this task.
Webshark79 added projects: Wikidata, Wikibase (3rd party installations).
Restricted Application added a subscriber: Aklapper.

TASK DESCRIPTION
  Error received :
  
  o.w.query.rdf.tool.HttpClientUtils - HTTP request failed: 
java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: 
Buffering capacity 2097152 exceeded
  
  Don't. see an option to increase the buffersize.
  
  Running an update with this command:
  
  /wdqs/runUpdate.sh -- -v -s 20220401170100
  
  Unable to proceed after this point

TASK DETAIL
  https://phabricator.wikimedia.org/T311276

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Webshark79
Cc: #wikibase_3rd_party_installations, Aklapper, Webshark79, Astuthiodit_1, 
karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, darthmon_wmde, 
Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, 
rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org