[Wikidata-bugs] [Maniphest] T286334: `wdqs-frontend` and `wdqs` containers are constantly restarting in wikibase-release-pipeline

2021-07-26 Thread Addshore 
Addshore added a comment.


wdqs-updater_1 | 
org.wikidata.query.rdf.tool.exception.ContainedException: Non-200 response from 
triple store:  HttpContentResponse[HTTP/1.1 500 Server Error - 8074 bytes] body=
  
  The key thing here is to try and see what the non 200 response from the 
triple store.
  
  Do you see anything in the wdqs logs?
  
docker-compose -f docker-compose.yml -f docker-compose.extra.yml logs wdqs
  
  The 500 error is probably coming from the fact that the wdqs service has 
fallen over, the question is why has it fallen over?

TASK DETAIL
  https://phabricator.wikimedia.org/T286334

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Addshore, toan, danshick-wmde, Aklapper, RShigapov, Invadibot, maantietaja, 
Akuckartz, Iflorez, darthmon_wmde, alaa_wmde, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T286334: `wdqs-frontend` and `wdqs` containers are constantly restarting in wikibase-release-pipeline

2021-07-23 Thread RShigapov 
RShigapov added a comment.


  Hi @toan,
  
  I did as you proposed: `down -volumes` and then `up` again. No changes. Still 
restarting.
  
  At the same time my logs are quite clean, it's strange. Even no message from 
wdqs-updater:
  
wikibase_1  |   Fetching Elasticsearch version...6.5.4...ok
wikibase_1  |   Scanning available plugins...
wikibase_1  |   experimental-highlighter, extra, ingest-geoip, 
ingest-user-agent
wikibase_1  |   Picking analyzer...english
wikibase_1  |   Inferring index identifier...my_wiki_archive_first
wikibase_1  |   Creating index...ok
wikibase_1  |   Validating number of shards...ok
wikibase_1  |   Validating replica range...ok
wikibase_1  |   Validating shard allocation settings...done
wikibase_1  |   Validating max shards per node...ok
wikibase_1  |   Validating analyzers...ok
wikibase_1  |   Validating mappings...
wikibase_1  |   Validating mapping...different...corrected
wikibase_1  |   Validating aliases...
wikibase_1  |   Validating my_wiki_archive alias...alias is 
free...corrected
wikibase_1  |   Updating tracking indexes...done
wikibase_1  | + php 
/var/www/html/extensions/CirrusSearch/maintenance/ForceSearchIndex.php 
--skipParse
wikibase_1  | [ my_wiki] Indexed 1 pages ending at 1 at 
12/second
wikibase_1  | Indexed a total of 1 pages at 12/second
wikibase_1  | + php 
/var/www/html/extensions/CirrusSearch/maintenance/ForceSearchIndex.php 
--skipLinks --indexOnSkip
wikibase_1  | [ my_wiki] Indexed 1 pages ending at 1 at 
21/second
wikibase_1  | Indexed a total of 1 pages at 21/second
wikibase_1  | ++ bash /extra-install/QuickStatements.sh
wikibase_1  | + php 
/var/www/html/extensions/OAuth/maintenance/createOAuthConsumer.php --approve 
--callbackUrl 'http://quickstatements.svc # quickstatements.svc is the internal 
docker hostname, change this value to the public hostname:8840/api.php' 
--callbackIsPrefix true --user admin --name QuickStatements --description 
QuickStatements --version 1.0.1 --grants createeditmovepage --grants editpage 
--grants highvolume --jsonOnSuccess
wikibase_1  | + [[ -f /quickstatements/data/qs-oauth.json ]]
wikibase_1  | ++ grep -o '[^"]*$'
wikibase_1  | ++ grep -o '"key":"[^"]*' /quickstatements/data/qs-oauth.json
wikibase_1  | + OAUTH_CONSUMER_KEY=bla-bla-bla
wikibase_1  | ++ grep -o '"secret":"[^"]*' 
/quickstatements/data/qs-oauth.json
wikibase_1  | ++ grep -o '[^"]*$'
wikibase_1  | + OAUTH_CONSUMER_SECRET=bla-bla-bla
wikibase_1  | + export OAUTH_CONSUMER_KEY
wikibase_1  | + export OAUTH_CONSUMER_SECRET
wikibase_1  | + envsubst
wikibase_1  | + docker-php-entrypoint apache2-foreground
wikibase_1  | AH00558: apache2: Could not reliably determine the server's 
fully qualified domain name, using bla-bla-bla. Set the 'ServerName' directive 
globally to suppress this message
wikibase_1  | AH00558: apache2: Could not reliably determine the server's 
fully qualified domain name, using bla-bla-bla. Set the 'ServerName' directive 
globally to suppress this message
wikibase_1  | [Fri Jul 23 09:49:42.937942 2021] [mpm_prefork:notice] [pid 
89] AH00163: Apache/2.4.38 (Debian) PHP/7.3.28 configured -- resuming normal 
operations
wikibase_1  | [Fri Jul 23 09:49:42.937984 2021] [core:notice] [pid 89] 
AH00094: Command line: 'apache2 -D FOREGROUND'

TASK DETAIL
  https://phabricator.wikimedia.org/T286334

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RShigapov
Cc: toan, danshick-wmde, Aklapper, RShigapov, Invadibot, maantietaja, 
Akuckartz, Iflorez, darthmon_wmde, alaa_wmde, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Lydia_Pintscher, Addshore, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T286334: `wdqs-frontend` and `wdqs` containers are constantly restarting in wikibase-release-pipeline

2021-07-16 Thread toan 
toan added a comment.


  Hello @RShigapov,
  
  Do you have any logs from this that you could provide for debugging this?
  
  Removing the `-d` flag from the docker-compose up command would attach to the 
log output immediately, otherwise running `docker-compose logs -f` would attach 
afterwards.
  
  I noticed this behaviour once while running this locally giving this output 
and the wdqs-updater restarting.
  
  However, just starting over and
  
  `docker-compose -f docker-compose.yml -f docker-compose.extra.yml down 
--volumes`
  `docker-compose -f docker-compose.yml -f docker-compose.extra.yml up`
  
  It would start normally and I don't get this problem again. I think adding 
T283833: Add CI for testing the wikibase-release-strategy example 
docker-compose   might help us 
understanding this better.
  
wdqs-updater_1 | 10:16:46.501 [main] ERROR 
org.wikidata.query.rdf.tool.Update - Error during initialization.
wdqs-updater_1 | 
org.wikidata.query.rdf.tool.exception.ContainedException: Non-200 response from 
triple store:  HttpContentResponse[HTTP/1.1 500 Server Error - 8074 bytes] body=
wdqs-updater_1 | SPARQL-QUERY: queryStr=PREFIX schema: 

wdqs-updater_1 | SELECT * WHERE {  
schema:dateModified ?date }
wdqs-updater_1 | java.util.concurrent.ExecutionException: 
java.lang.RuntimeException: off=0, len=702::namespace=wdq, 
timestamp=readOnly(1626430606490), readTime=readOnly(1620304255632)
wdqs-updater_1 |at 
java.util.concurrent.FutureTask.report(FutureTask.java:122)
wdqs-updater_1 |at 
java.util.concurrent.FutureTask.get(FutureTask.java:206)
wdqs-updater_1 |at 
com.bigdata.rdf.sail.webapp.BigdataServlet.submitApiTask(BigdataServlet.java:292)
wdqs-updater_1 |at 
com.bigdata.rdf.sail.webapp.QueryServlet.doSparqlQuery(QueryServlet.java:678)
wdqs-updater_1 |at 
com.bigdata.rdf.sail.webapp.QueryServlet.doPost(QueryServlet.java:275)
wdqs-updater_1 |at 
com.bigdata.rdf.sail.webapp.RESTServlet.doPost(RESTServlet.java:269)
wdqs-updater_1 |at 
com.bigdata.rdf.sail.webapp.MultiTenancyServlet.doPost(MultiTenancyServlet.java:195)
wdqs-updater_1 |at 
javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
wdqs-updater_1 |at 
javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
wdqs-updater_1 |at 
org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865)
wdqs-updater_1 |at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655)
wdqs-updater_1 |at 
org.wikidata.query.rdf.blazegraph.throttling.ThrottlingFilter.doFilter(ThrottlingFilter.java:320)
wdqs-updater_1 |at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
wdqs-updater_1 |at 
org.wikidata.query.rdf.blazegraph.throttling.SystemOverloadFilter.doFilter(SystemOverloadFilter.java:82)
wdqs-updater_1 |at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
wdqs-updater_1 |at 
ch.qos.logback.classic.helpers.MDCInsertingServletFilter.doFilter(MDCInsertingServletFilter.java:49)
wdqs-updater_1 |at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
wdqs-updater_1 |at 
org.wikidata.query.rdf.blazegraph.filters.QueryEventSenderFilter.doFilter(QueryEventSenderFilter.java:86)
wdqs-updater_1 |at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
wdqs-updater_1 |at 
org.wikidata.query.rdf.blazegraph.filters.ClientIPFilter.doFilter(ClientIPFilter.java:43)
wdqs-updater_1 |at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)
wdqs-updater_1 |at 
org.wikidata.query.rdf.blazegraph.filters.RealAgentFilter.doFilter(RealAgentFilter.java:33)
wdqs-updater_1 |at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634)
wdqs-updater_1 |at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
wdqs-updater_1 |at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146)
wdqs-updater_1 |at 
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)
wdqs-updater_1 |at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
wdqs-updater_1 |at 
org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257)
wdqs-updater_1 |at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
wdqs-updater_1 |

[Wikidata-bugs] [Maniphest] T286334: `wdqs-frontend` and `wdqs` containers are constantly restarting in wikibase-release-pipeline

2021-07-14 Thread Addshore 
Addshore moved this task from Prioritized Product (prioritised from top to 
bottom) to Wikidata-Campsite-Iteration-∞ on the Wikidata-Campsite board.
Addshore edited projects, added Wikidata-Campsite 
(Wikidata-Campsite-Iteration-∞); removed Wikidata-Campsite.

TASK DETAIL
  https://phabricator.wikimedia.org/T286334

WORKBOARD
  https://phabricator.wikimedia.org/project/board/3402/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Aklapper, RShigapov, Invadibot, maantietaja, Akuckartz, Iflorez, 
darthmon_wmde, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Lydia_Pintscher, Addshore, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T286334: `wdqs-frontend` and `wdqs` containers are constantly restarting in wikibase-release-pipeline

2021-07-14 Thread Addshore 
Addshore set the point value for this task to "8".

TASK DETAIL
  https://phabricator.wikimedia.org/T286334

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Aklapper, RShigapov, Invadibot, maantietaja, Akuckartz, darthmon_wmde, 
Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, 
rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Addshore, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T286334: `wdqs-frontend` and `wdqs` containers are constantly restarting in wikibase-release-pipeline

2021-07-14 Thread Samantha_Alipio_WMDE 
Samantha_Alipio_WMDE added a project: Wikidata-Campsite.

TASK DETAIL
  https://phabricator.wikimedia.org/T286334

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Samantha_Alipio_WMDE
Cc: Aklapper, RShigapov, Invadibot, maantietaja, Akuckartz, darthmon_wmde, 
Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, 
rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Addshore, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T286334: `wdqs-frontend` and `wdqs` containers are constantly restarting in wikibase-release-pipeline

2021-07-08 Thread Maintenance_bot 
Maintenance_bot added a project: Wikidata.

TASK DETAIL
  https://phabricator.wikimedia.org/T286334

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Maintenance_bot
Cc: Aklapper, RShigapov, Invadibot, maantietaja, Akuckartz, darthmon_wmde, 
Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, 
rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Addshore, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org