Smalyshev added a comment.
Is this still an issue?TASK DETAILhttps://phabricator.wikimedia.org/T164773EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Hjfocs, Gehel, Smalyshev, Aklapper, Yurik, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE,
Yurik added a comment.
@Smalyshev, I force-killed it, and it dumped this (I couldn't copy all of it - just some parts):
at com.bigdata.rdf.sail.webapp.RESTServlet.doGet(RESTServlet.java:240)
at com.bigdata.rdf.sail.webapp.MultiTenancyServlet.doGet(MultiTenancyServlet.java:271)
at
Smalyshev added a comment.
Not sure whether it has some relation, hard to diagnose from this. Did you see the GC logs? What the status page for Blazegraph showed?TASK DETAILhttps://phabricator.wikimedia.org/T164773EMAIL
Yurik added a comment.
@Smalyshev & @Gehel I'm not sure if this is the same error or different. Today, the service froze in a peculiar way: all queries would time out (both from clients and update ones), and Blazegraph wouldn't quit with Ctrl+C. HTOP shows a single blazegraph process using
Yurik added a comment.
I just finished full re-import with -Xmx=16GB , and it worked fine. I am not sure what has caused the original issue. For future reference, here are the import stats (importing both Wikidata and OSM data from the same dir - 33GB total, 683 files of about the same size.
Yurik added a comment.
I'm re-running the import with the default settings (mmx=16gb), almost 700 gz files (127GB). This time, all of the OSM data uses integer storage instead of the original strings ("osmnode:123" treats 123 as a prefix + an int). Will know the results in 2 days.TASK
Smalyshev added a comment.
MemoryManagerClosedException by itself is not a big issue as far as I can see, it may be query timeout or something like that. That shouldn't happen on data loading though (that one should not time out).TASK DETAILhttps://phabricator.wikimedia.org/T164773EMAIL
Smalyshev added a comment.
Didn't see it happen on my side, is it reproducible?TASK DETAILhttps://phabricator.wikimedia.org/T164773EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Aklapper, Yurik, GoranSMilovanovic, QZanden, EBjune,
