[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[MPhamWMF]

MPhamWMF removed a project: Discovery-Search (Current work).

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: MPhamWMF
Cc: Kristbaum, Jelabra, bking, pmokeefe, YOUR1, AWesterinen, CtrlZvi, 
Bugreporter, SirkoS, Eposthumus, Lectrician1, driib, Bovlb, Dr.uesenfieber, 
JohannesKalmbach, accounting_data_logger, Fnielsen, nguyenm9, AndySeaborne, 
BenAtOlive, YULdigitalpreservation, Iamamz3, namedgraph, Versant.2612, 
AndreasKuczera, DD063520, Michael, toan, Kjauslin, Hannah_Bast, RShigapov, 
Izno, KingsleyIdehen, Daniel_Mietchen, karapayneWMDE, MarioGom, 
Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, Sj, 
Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, Astuthiodit_1, BeautifulBold, Suran38, Invadibot, MPhamWMF, 
maantietaja, Peteosx1x, NavinRizwi, CBogen, ItamarWMDE, Nandana, Namenlos314, 
Lahi, Gq86, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Dinoguy1000, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[cicalese]

cicalese removed a project: MediaWiki-Stakeholders-Group.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: cicalese
Cc: Jelabra, bking, pmokeefe, YOUR1, AWesterinen, CtrlZvi, Bugreporter, SirkoS, 
Eposthumus, Lectrician1, driib, Bovlb, Dr.uesenfieber, JohannesKalmbach, 
accounting_data_logger, Fnielsen, nguyenm9, AndySeaborne, BenAtOlive, 
YULdigitalpreservation, Iamamz3, namedgraph, Versant.2612, AndreasKuczera, 
DD063520, Michael, toan, Kjauslin, Hannah_Bast, RShigapov, Izno, 
KingsleyIdehen, Daniel_Mietchen, karapayneWMDE, MarioGom, Mohammed_Sadat_WMDE, 
Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, Sj, Afandian, Justin0x2004, 
Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, Lydia_Pintscher, Tagishsimon, 
Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, WMDE-leszek, Salgo60, So9q, 
Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, 
Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Astuthiodit_1, 
BeautifulBold, Suran38, Invadibot, MPhamWMF, maantietaja, Peteosx1x, 
NavinRizwi, CBogen, ItamarWMDE, Nandana, Namenlos314, Lahi, Gq86, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Dinoguy1000, Manybubbles, Mbch331, Jtm-lis, Isaacandy, Demian, Olson.jared.m, 
Bryandamon, Steko, Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, 
Bawolff, Darenwelsh, brion, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Gehel]

Gehel closed subtask T299460: Evaluate the Apache Jena Framework as 
Resolved.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: YOUR1, AWesterinen, CtrlZvi, Bugreporter, SirkoS, Eposthumus, Lectrician1, 
driib, Bovlb, Dr.uesenfieber, JohannesKalmbach, accounting_data_logger, 
Fnielsen, nguyenm9, AndySeaborne, BenAtOlive, YULdigitalpreservation, Iamamz3, 
namedgraph, Versant.2612, AndreasKuczera, DD063520, Michael, toan, Kjauslin, 
Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, karapayneWMDE, 
MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, 
Sj, Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, Astuthiodit_1, BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, 
maantietaja, Peteosx1x, NavinRizwi, CBogen, ItamarWMDE, Isaacandy, Demian, 
Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Bawolff, Darenwelsh, 
Dinoguy1000, Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Gehel]

Gehel closed subtask T297473: Evaluate RDF4j API as Resolved.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: YOUR1, AWesterinen, CtrlZvi, Bugreporter, SirkoS, Eposthumus, Lectrician1, 
driib, Bovlb, Dr.uesenfieber, JohannesKalmbach, accounting_data_logger, 
Fnielsen, nguyenm9, AndySeaborne, BenAtOlive, YULdigitalpreservation, Iamamz3, 
namedgraph, Versant.2612, AndreasKuczera, DD063520, Michael, toan, Kjauslin, 
Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, karapayneWMDE, 
MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, 
Sj, Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, Astuthiodit_1, BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, 
maantietaja, Peteosx1x, NavinRizwi, CBogen, ItamarWMDE, Isaacandy, Demian, 
Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Bawolff, Darenwelsh, 
Dinoguy1000, Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Gehel]

Gehel closed subtask T206561: Evaluate Virtuoso as alternative to Blazegraph as 
Resolved.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: YOUR1, AWesterinen, CtrlZvi, Bugreporter, SirkoS, Eposthumus, Lectrician1, 
driib, Bovlb, Dr.uesenfieber, JohannesKalmbach, accounting_data_logger, 
Fnielsen, nguyenm9, AndySeaborne, BenAtOlive, YULdigitalpreservation, Iamamz3, 
namedgraph, Versant.2612, AndreasKuczera, DD063520, Michael, toan, Kjauslin, 
Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, karapayneWMDE, 
MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, 
Sj, Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, Astuthiodit_1, BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, 
maantietaja, Peteosx1x, NavinRizwi, CBogen, ItamarWMDE, Isaacandy, Demian, 
Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Bawolff, Darenwelsh, 
Dinoguy1000, Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[MPhamWMF]

MPhamWMF closed subtask T306724: [EPIC] Create testing strategy for Blazegraph 
alternatives as Resolved.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: MPhamWMF
Cc: YOUR1, AWesterinen, CtrlZvi, Bugreporter, SirkoS, Eposthumus, Lectrician1, 
driib, Bovlb, Dr.uesenfieber, JohannesKalmbach, accounting_data_logger, 
Fnielsen, nguyenm9, AndySeaborne, BenAtOlive, YULdigitalpreservation, Iamamz3, 
namedgraph, Versant.2612, AndreasKuczera, DD063520, Michael, toan, Kjauslin, 
Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, karapayneWMDE, 
MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, 
Sj, Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, Astuthiodit_1, BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, 
maantietaja, Peteosx1x, NavinRizwi, CBogen, ItamarWMDE, Isaacandy, Demian, 
Olson.jared.m, Nandana, Namenlos314, Matlin, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Bawolff, Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[TallTed]

TallTed added a comment.


  In T206560#7775800 , 
@Bugreporter wrote:
  
  > Query performance is an important point to consider - I found a query that 
will run one million time slower in one database engine than in another one
  
  Claims without evidence, such as that quoted above, are generally not helpful 
for evaluations such as this.
  
  It //would// be helpful to all if you would post the query you describe, as 
well as the details of your testing — such as which engine(s) you tested 
(including name and version), on which OS (including version), on what hardware 
(including processor, bitness, and RAM), whether the engine & data were in a 
"hot/warm" state or just past cold start, etc.
  
  Testing your query against current public endpoints and posting details of 
those results would also be helpful.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: TallTed
Cc: AWesterinen, CtrlZvi, Bugreporter, SirkoS, Eposthumus, Lectrician1, driib, 
Bovlb, Dr.uesenfieber, JohannesKalmbach, accounting_data_logger, Fnielsen, 
nguyenm9, AndySeaborne, BenAtOlive, YULdigitalpreservation, Iamamz3, 
namedgraph, Versant.2612, AndreasKuczera, DD063520, Michael, toan, Kjauslin, 
Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, karapayneWMDE, 
MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, 
Sj, Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, Astuthiodit_1, BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, 
maantietaja, Peteosx1x, NavinRizwi, CBogen, ItamarWMDE, Isaacandy, Demian, 
Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[MPhamWMF]

MPhamWMF added a subtask: T306724: [EPIC] Create testing strategy for 
Blazegraph alternatives.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: MPhamWMF
Cc: AWesterinen, CtrlZvi, Bugreporter, SirkoS, Eposthumus, Lectrician1, driib, 
Bovlb, Dr.uesenfieber, JohannesKalmbach, accounting_data_logger, Fnielsen, 
nguyenm9, AndySeaborne, BenAtOlive, YULdigitalpreservation, Iamamz3, 
namedgraph, Versant.2612, AndreasKuczera, DD063520, Michael, toan, Kjauslin, 
Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, karapayneWMDE, 
MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, 
Sj, Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, Astuthiodit_1, BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, 
maantietaja, Peteosx1x, NavinRizwi, CBogen, ItamarWMDE, Isaacandy, Demian, 
Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[MPhamWMF]

MPhamWMF closed subtask T289760: Evaluate Oxigraph as alternative to Blazegraph 
as Declined.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: MPhamWMF
Cc: AWesterinen, CtrlZvi, Bugreporter, SirkoS, Eposthumus, Lectrician1, driib, 
Bovlb, Dr.uesenfieber, JohannesKalmbach, accounting_data_logger, Fnielsen, 
nguyenm9, AndySeaborne, BenAtOlive, YULdigitalpreservation, Iamamz3, 
namedgraph, Versant.2612, AndreasKuczera, DD063520, Michael, toan, Kjauslin, 
Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, karapayneWMDE, 
MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, 
Sj, Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, Astuthiodit_1, BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, 
maantietaja, Peteosx1x, NavinRizwi, CBogen, ItamarWMDE, Isaacandy, Demian, 
Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[MPhamWMF]

MPhamWMF closed subtask T289621: Evaluate Halyard as alternative to Blazegraph 
as Declined.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: MPhamWMF
Cc: AWesterinen, CtrlZvi, Bugreporter, SirkoS, Eposthumus, Lectrician1, driib, 
Bovlb, Dr.uesenfieber, JohannesKalmbach, accounting_data_logger, Fnielsen, 
nguyenm9, AndySeaborne, BenAtOlive, YULdigitalpreservation, Iamamz3, 
namedgraph, Versant.2612, AndreasKuczera, DD063520, Michael, toan, Kjauslin, 
Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, karapayneWMDE, 
MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, 
Sj, Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, Astuthiodit_1, BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, 
maantietaja, Peteosx1x, NavinRizwi, CBogen, ItamarWMDE, Isaacandy, Demian, 
Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[MPhamWMF]

MPhamWMF closed subtask T289561: Evaluate Apache Rya as alternative to 
Blazegraph as Declined.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: MPhamWMF
Cc: AWesterinen, CtrlZvi, Bugreporter, SirkoS, Eposthumus, Lectrician1, driib, 
Bovlb, Dr.uesenfieber, JohannesKalmbach, accounting_data_logger, Fnielsen, 
nguyenm9, AndySeaborne, BenAtOlive, YULdigitalpreservation, Iamamz3, 
namedgraph, Versant.2612, AndreasKuczera, DD063520, Michael, toan, Kjauslin, 
Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, karapayneWMDE, 
MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, 
Sj, Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, Astuthiodit_1, BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, 
maantietaja, Peteosx1x, NavinRizwi, CBogen, ItamarWMDE, Isaacandy, Demian, 
Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[AWesterinen]

AWesterinen closed subtask T275398: Create an updated survey of graph backends 
for WDQS as Resolved.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: AWesterinen
Cc: CtrlZvi, Bugreporter, SirkoS, Eposthumus, Lectrician1, driib, Bovlb, 
Dr.uesenfieber, JohannesKalmbach, accounting_data_logger, Fnielsen, nguyenm9, 
AndySeaborne, BenAtOlive, YULdigitalpreservation, Iamamz3, namedgraph, 
Versant.2612, AndreasKuczera, DD063520, Michael, toan, Kjauslin, Hannah_Bast, 
RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, karapayneWMDE, MarioGom, 
Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, Sj, 
Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, Astuthiodit_1, BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, 
maantietaja, Peteosx1x, NavinRizwi, CBogen, ItamarWMDE, Isaacandy, Demian, 
Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Bugreporter]

Bugreporter added a comment.


  Query performance is an important point to consider - I found a query that 
will run one million time slower in one database engine than in another one

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Bugreporter
Cc: Bugreporter, SirkoS, Eposthumus, Lectrician1, driib, Bovlb, Dr.uesenfieber, 
JohannesKalmbach, accounting_data_logger, Fnielsen, nguyenm9, AndySeaborne, 
BenAtOlive, YULdigitalpreservation, Iamamz3, namedgraph, Versant.2612, 
AndreasKuczera, DD063520, Michael, toan, Kjauslin, Hannah_Bast, RShigapov, 
Izno, KingsleyIdehen, Daniel_Mietchen, karapayneWMDE, MarioGom, 
Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, Sj, 
Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, Astuthiodit_1, BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, 
maantietaja, Peteosx1x, NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, 
Nandana, Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Steko, Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[So9q]

So9q added a subtask: T301227: Create test RDF dataset for evaluating 
alternatives to Blazegraph.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: So9q
Cc: Lectrician1, driib, Bovlb, Dr.uesenfieber, JohannesKalmbach, 
accounting_data_logger, Fnielsen, nguyenm9, AndySeaborne, BenAtOlive, 
YULdigitalpreservation, Iamamz3, namedgraph, Versant.2612, AndreasKuczera, 
DD063520, Michael, toan, Kjauslin, Hannah_Bast, RShigapov, Izno, 
KingsleyIdehen, Daniel_Mietchen, karapayneWMDE, MarioGom, Mohammed_Sadat_WMDE, 
Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, Sj, Afandian, Justin0x2004, 
Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, Lydia_Pintscher, Tagishsimon, 
Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, WMDE-leszek, Salgo60, So9q, 
Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, 
Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, BeautifulBold, Suran38, 
Invadibot, MPhamWMF, Jtm-lis, maantietaja, Peteosx1x, NavinRizwi, CBogen, 
Isaacandy, Demian, Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[MPhamWMF]

MPhamWMF moved this task from Epics to Current work on the 
Wikidata-Query-Service board.
MPhamWMF added a project: Discovery-Search (Current work).

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

WORKBOARD
  https://phabricator.wikimedia.org/project/board/891/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: MPhamWMF
Cc: driib, Bovlb, Dr.uesenfieber, JohannesKalmbach, accounting_data_logger, 
Fnielsen, nguyenm9, AndySeaborne, BenAtOlive, YULdigitalpreservation, Iamamz3, 
namedgraph, Versant.2612, AndreasKuczera, DD063520, Michael, toan, Kjauslin, 
Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, karapayneWMDE, 
MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, 
Sj, Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, maantietaja, 
Peteosx1x, NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, Nandana, 
Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, EBjune, 
merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, 
Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[So9q]

So9q closed subtask T290082: Evaluate Apache HBase and RDF4J as alternative to 
Blazegraph as Declined.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: So9q
Cc: Bovlb, Dr.uesenfieber, JohannesKalmbach, accounting_data_logger, Fnielsen, 
nguyenm9, AndySeaborne, BenAtOlive, YULdigitalpreservation, Iamamz3, 
namedgraph, Versant.2612, AndreasKuczera, DD063520, Michael, toan, Kjauslin, 
Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, karapayneWMDE, 
MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, 
Sj, Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, maantietaja, 
Peteosx1x, NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, Nandana, 
Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, EBjune, 
merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, 
Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[AndySeaborne]

AndySeaborne added a comment.


  Are there any timescale/triple scale goals currently being stated?
  
  With a baseline minimum 
 of 
1B triples/3 months, and assuming a 5-10 year goal for any choice, that gets to 
36B-56B triples minimum and it could easily exceed that.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: AndySeaborne
Cc: Bovlb, Dr.uesenfieber, JohannesKalmbach, accounting_data_logger, Fnielsen, 
nguyenm9, AndySeaborne, BenAtOlive, YULdigitalpreservation, Iamamz3, 
namedgraph, Versant.2612, AndreasKuczera, DD063520, Michael, toan, Kjauslin, 
Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, karapayneWMDE, 
MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, 
Sj, Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, maantietaja, 
Peteosx1x, NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, Nandana, 
Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, EBjune, 
merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, 
Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Justin0x2004]

Justin0x2004 added a comment.


  also, any thoughts on https://cambridgesemantics.com/anzograph/ ?
  
  "Horizontally Scalable Graph Database Built for Online Analytics and Data 
Harmonization"
  
  it looks like anzograph could handle 

 1 trillion triples back in 2016.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Justin0x2004
Cc: Bovlb, Dr.uesenfieber, JohannesKalmbach, accounting_data_logger, Fnielsen, 
nguyenm9, AndySeaborne, BenAtOlive, YULdigitalpreservation, Iamamz3, 
namedgraph, Versant.2612, AndreasKuczera, DD063520, Michael, toan, Kjauslin, 
Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, Majavah, 
karapayneWMDE, MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, 
Thadguidry, Tpt, TallTed, Sj, Afandian, Justin0x2004, Jerven, TheKtk, 
Ivanhercaz, Jneubert, DanBri, Lydia_Pintscher, Tagishsimon, 
Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, WMDE-leszek, Salgo60, So9q, 
Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, 
Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, BeautifulBold, Suran38, 
Invadibot, MPhamWMF, Jtm-lis, maantietaja, Peteosx1x, NavinRizwi, CBogen, 
Isaacandy, Demian, Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[nguyenm9]

nguyenm9 added a comment.


  any thoughts on https://github.com/IBM/expressive-reasoning-graph-store ?

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: nguyenm9
Cc: Bovlb, Dr.uesenfieber, JohannesKalmbach, accounting_data_logger, Fnielsen, 
nguyenm9, AndySeaborne, BenAtOlive, YULdigitalpreservation, Iamamz3, 
namedgraph, Versant.2612, AndreasKuczera, DD063520, Michael, toan, Kjauslin, 
Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, Majavah, 
karapayneWMDE, MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, 
Thadguidry, Tpt, TallTed, Sj, Afandian, Justin0x2004, Jerven, TheKtk, 
Ivanhercaz, Jneubert, DanBri, Lydia_Pintscher, Tagishsimon, 
Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, WMDE-leszek, Salgo60, So9q, 
Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, 
Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, BeautifulBold, Suran38, 
Invadibot, MPhamWMF, Jtm-lis, maantietaja, Peteosx1x, NavinRizwi, CBogen, 
Isaacandy, Demian, Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[AndySeaborne]

AndySeaborne added a comment.


  We can be objective about feature support.
  
  The working group tests for SPARQL 1.1 (updated for RDF 1.1) are maintained 
by the community: https://w3c.github.io/rdf-tests/.
  
  They have reasonable coverage of features.
  
  In addition, engines can an do support more of XPath and XQuery Functions and 
Operators 3.1 than the minimal required the the SPARQL REC.
  
  https://www.w3.org/TR/xpath-functions-3/

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: AndySeaborne
Cc: accounting_data_logger, Fnielsen, nguyenm9, AndySeaborne, BenAtOlive, 
YULdigitalpreservation, Iamamz3, namedgraph, Versant.2612, AndreasKuczera, 
DD063520, Michael, toan, Kjauslin, Hannah_Bast, RShigapov, Izno, 
KingsleyIdehen, Daniel_Mietchen, Majavah, karapayneWMDE, MarioGom, 
Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, Sj, 
Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, maantietaja, 
Peteosx1x, NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, Nandana, 
Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, EBjune, 
merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, 
Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Hannah_Bast]

Hannah_Bast added a comment.


  In T206560#7562538 , 
@Fnielsen wrote:
  
  > I am taking the liberty to polute the thread with a reference to 
"MillenniumDB: A Persistent, Open-Source, Graph Database" 
https://arxiv.org/pdf/2111.01540.pdf from November 2021. Millennium may have 
some serious limitations in terms of requirements that can be setup, but 
interestingly they write "However, MillenniumDB was designed with the complete 
version of Wikidata – including qualifiers, references, etc. – in mind." and 
their benchmarks seems strong. They compare against Blazegraph, Jena, Virtuoso 
and Neo4J.
  
  Thanks for the pointer! Here are my first impressions from reading the paper:
  
  1. The engine is based on similar ideas as QLever. However, QLever is around 
for 5 years already, which the authors fail to acknowledge. I am sure they 
didn't do it on purpose though. I wrote to them.
  
  2. Like QLever, their engine currently is read-only and does not support 
SPARQL Update operations. Given the design of their engine, this is not 
something that will be easy to add.
  
  3. Their engine is currently very far away from SPARQL 1.1 support. In the 
current version, even basic features like GROUP BY and mathematical expressions 
are missing. I am not sure whether they actually strive for SPARQL 1.1 support, 
since the motivation expressed in the paper goes more in the direction of a 
more general data model that is independent of a particular query language. 
Anyway, adding full SPARQL 1.1 support would be a lot of work, as we know from 
experience.
  
  4. I find the evaluation misleading. Right at the beginning of their 
evaluation section, in Section 5.1, they claim that their engine is 30 times 
faster than Virtuoso for very simple queries (consisting of a single triple). 
We know Virtuoso very well and have compared it with QLever extensively. 
Virtuoso is a very mature and efficient engine and hard to beat, even on more 
complex queries. On simple queries, there are natural barriers to what can be 
achieved, and Virtuoso often (though not always) does the optimal thing. I 
think the authors either did not configure Virtuoso optimally or they stumbled 
on an artefact without being aware of it. Namely, Virtuoso is rather slow when 
it has to produce a very large output. That is not a weakness of their query 
processing engine, but of the way they translate their internal IDs to output 
IRIs and literals.
  
  @KingsleyIdehen maybe you can provide some feedback concerning @4, in 
particular, the last two sentences.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Hannah_Bast
Cc: accounting_data_logger, Fnielsen, nguyenm9, AndySeaborne, BenAtOlive, 
YULdigitalpreservation, Iamamz3, namedgraph, Versant.2612, AndreasKuczera, 
DD063520, Michael, toan, Kjauslin, Hannah_Bast, RShigapov, Izno, 
KingsleyIdehen, Daniel_Mietchen, Majavah, karapayneWMDE, MarioGom, 
Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, Sj, 
Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, maantietaja, 
Peteosx1x, NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, Nandana, 
Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, EBjune, 
merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, 
Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Fnielsen]

Fnielsen added a comment.


  I am taking the liberty to polute the thread with a reference to 
"MillenniumDB: A Persistent, Open-Source, Graph Database" 
https://arxiv.org/pdf/2111.01540.pdf from November 2021. Millennium may have 
some serious limitations in terms of requirements that can be setup, but 
interestingly they write "However, MillenniumDB was designed with the complete 
version of Wikidata – including qualifiers, references, etc. – in mind." and 
their benchmarks seems strong. They compare against Blazegraph, Jena, Virtuoso 
and Neo4J.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Fnielsen
Cc: Fnielsen, nguyenm9, AndySeaborne, BenAtOlive, YULdigitalpreservation, 
Iamamz3, namedgraph, Versant.2612, AndreasKuczera, DD063520, Michael, toan, 
Kjauslin, Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, 
Majavah, karapayneWMDE, MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, 
Thadguidry, Tpt, TallTed, Sj, Afandian, Justin0x2004, Jerven, TheKtk, 
Ivanhercaz, Jneubert, DanBri, Lydia_Pintscher, Tagishsimon, 
Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, WMDE-leszek, Salgo60, So9q, 
Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, 
Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, BeautifulBold, Suran38, 
Invadibot, MPhamWMF, Jtm-lis, maantietaja, Peteosx1x, NavinRizwi, CBogen, 
Isaacandy, Demian, Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Lydia_Pintscher]

Lydia_Pintscher added a comment.


  In T206560#7517212 , 
@BenAtOlive wrote:
  
  > Hey all, apologies if this has already been covered elsewhere, but I'm 
curious why Apache Jena Fuseki is not on the list of Blazegraph alternatives?  
It seems to meet the   We've used Jena from time to time and really like it (it 
has a lot of features out of the box), but if there's been a previous analysis 
and it was not worth considering for WDQS's needs I'd love to learn from that.
  
  I think only because so far no-one has brought it up. Please add a ticket for 
it with additional information.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lydia_Pintscher
Cc: AndySeaborne, BenAtOlive, YULdigitalpreservation, Iamamz3, namedgraph, 
Versant.2612, AndreasKuczera, DD063520, Michael, toan, Kjauslin, Hannah_Bast, 
RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, Majavah, karapayneWMDE, 
MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, 
Sj, Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, maantietaja, 
Peteosx1x, NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, Nandana, 
Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, EBjune, 
merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, 
Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[BenAtOlive]

BenAtOlive added a comment.


  Hey all, apologies if this has already been covered elsewhere, but I'm 
curious why Apache Jena Fuseki is not on the list of Blazegraph alternatives?  
It seems to meet the   We've used Jena from time to time and really like it (it 
has a lot of features out of the box), but if there's been a previous analysis 
and it was not worth considering for WDQS's needs I'd love to learn from that.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: BenAtOlive
Cc: BenAtOlive, YULdigitalpreservation, Iamamz3, namedgraph, Versant.2612, 
AndreasKuczera, DD063520, Michael, toan, Kjauslin, Hannah_Bast, RShigapov, 
Izno, KingsleyIdehen, Daniel_Mietchen, Majavah, karapayneWMDE, MarioGom, 
Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, Sj, 
Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, BeautifulBold, Suran38, Invadibot, MPhamWMF, Jtm-lis, maantietaja, 
Peteosx1x, NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, Nandana, 
Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, EBjune, 
merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, 
Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Iamamz3]

Iamamz3 added a comment.


  There is this ticket Create list of criteria for graph backend candidates for 
WDQS  to help reason about the 
future choice.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Iamamz3
Cc: Iamamz3, namedgraph, Versant.2612, AndreasKuczera, DD063520, Michael, toan, 
Kjauslin, Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, 
Majavah, karapayneWMDE, MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, 
Thadguidry, Tpt, TallTed, Sj, Afandian, Justin0x2004, Jerven, TheKtk, 
Ivanhercaz, Jneubert, DanBri, Lydia_Pintscher, Tagishsimon, 
Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, WMDE-leszek, Salgo60, So9q, 
Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, 
Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Suran38, Invadibot, 
MPhamWMF, Jtm-lis, maantietaja, Peteosx1x, NavinRizwi, CBogen, Isaacandy, 
Demian, Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[namedgraph]

namedgraph added a comment.


  @DanBri I would agree if this issue was not specifically about "alternatives 
to BlazeGraph" (RDF triplestore), with explicit requirements. Finding such 
alternative will already be difficult if not impossible, mostly due to the 
open-source requirement.
  
  If you want non-RDF solutions be evaluated as well, then I think a separate 
issue should be created. But I doubt it has a chance of being completed within 
any reasonable timeframe.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: namedgraph
Cc: namedgraph, Versant.2612, AndreasKuczera, DD063520, Michael, toan, 
Kjauslin, Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, 
Majavah, karapayneWMDE, MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, 
Thadguidry, Tpt, TallTed, Sj, Afandian, Justin0x2004, Jerven, TheKtk, 
Ivanhercaz, Jneubert, DanBri, Lydia_Pintscher, Tagishsimon, 
Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, WMDE-leszek, Salgo60, So9q, 
Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, 
Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Suran38, Invadibot, 
MPhamWMF, Jtm-lis, maantietaja, Peteosx1x, NavinRizwi, CBogen, Isaacandy, 
Demian, Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[AndreasKuczera]

AndreasKuczera added a comment.


  I would agree @DanBri.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: AndreasKuczera
Cc: namedgraph, Versant.2612, AndreasKuczera, DD063520, Michael, toan, 
Kjauslin, Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, 
Majavah, karapayneWMDE, MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, 
Thadguidry, Tpt, TallTed, Sj, Afandian, Justin0x2004, Jerven, TheKtk, 
Ivanhercaz, Jneubert, DanBri, Lydia_Pintscher, Tagishsimon, 
Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, WMDE-leszek, Salgo60, So9q, 
Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, 
Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Suran38, Invadibot, 
MPhamWMF, Jtm-lis, maantietaja, Peteosx1x, NavinRizwi, CBogen, Isaacandy, 
Demian, Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[DanBri]

DanBri added a comment.


  “Pollution” is a strong word that comes off as needlessly hostile. It seems
  prudent and rational to get a broad sense of the landscape(and where it is
  moving). The Wikidata data model is not trivially 1:1 with RDF/SPARQL and
  there may be scope for hybrid solutions.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: DanBri
Cc: namedgraph, Versant.2612, AndreasKuczera, DD063520, Michael, toan, 
Kjauslin, Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, 
Majavah, karapayneWMDE, MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, 
Thadguidry, Tpt, TallTed, Sj, Afandian, Justin0x2004, Jerven, TheKtk, 
Ivanhercaz, Jneubert, DanBri, Lydia_Pintscher, Tagishsimon, 
Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, WMDE-leszek, Salgo60, So9q, 
Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, 
Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Suran38, Invadibot, 
MPhamWMF, Jtm-lis, maantietaja, Peteosx1x, NavinRizwi, CBogen, Isaacandy, 
Demian, Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[namedgraph]

namedgraph added a comment.


  @So9q @AndreasKuczera @Versant.2612 why are you polluting the thread by 
suggesting projects/products that clearly do not meet the requirements? This 
includes JanusGraph, Ontop, Neo4J etc.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: namedgraph
Cc: namedgraph, Versant.2612, AndreasKuczera, DD063520, Michael, toan, 
Kjauslin, Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, 
Majavah, karapayneWMDE, MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, 
Thadguidry, Tpt, TallTed, Sj, Afandian, Justin0x2004, Jerven, TheKtk, 
Ivanhercaz, Jneubert, DanBri, Lydia_Pintscher, Tagishsimon, 
Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, WMDE-leszek, Salgo60, So9q, 
Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, 
Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Suran38, Invadibot, 
MPhamWMF, Jtm-lis, maantietaja, Peteosx1x, NavinRizwi, CBogen, Isaacandy, 
Demian, Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Versant.2612]

Versant.2612 added a comment.


  Consider property graph back ends such as Neo4J and TigerGraph
  
  Kovács, T., Simon, G., & Mezei, G. (2019). Benchmarking Graph Database 
Backends—What Works Well with Wikidata?. Acta Cybernetica, 24(1), 43-60. 
https://doi.org/10.14232/actacyb.24.1.2019.5

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Versant.2612
Cc: Versant.2612, AndreasKuczera, DD063520, Michael, toan, Kjauslin, 
Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, Majavah, 
karapayneWMDE, MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, 
Thadguidry, Tpt, TallTed, Sj, Afandian, Justin0x2004, Jerven, TheKtk, 
Ivanhercaz, Jneubert, DanBri, Lydia_Pintscher, Tagishsimon, 
Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, WMDE-leszek, Salgo60, So9q, 
Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, 
Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Suran38, Invadibot, 
MPhamWMF, Jtm-lis, maantietaja, Peteosx1x, NavinRizwi, CBogen, Isaacandy, 
Demian, Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Versant.2612]

Versant.2612 added a comment.


  Consider relational databases with particular schema as graph backends
  
  Daniel Hernández, Aidan Hogan, Cristian Riveros, Carlos Rojas, Enzo Zerega. 
"Querying Wikidata: Comparing SPARQL, Relational and Graph Databases". In the 
Proceedings of the 15th International Semantic Web Conference (ISWC), Kobe, 
Japan, October 17–21, 2016
  
  - http://aidanhogan.com/docs/wikidata-sparql-relational-graph.pdf

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Versant.2612
Cc: Versant.2612, AndreasKuczera, DD063520, Michael, toan, Kjauslin, 
Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, Majavah, 
karapayneWMDE, MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, 
Thadguidry, Tpt, TallTed, Sj, Afandian, Justin0x2004, Jerven, TheKtk, 
Ivanhercaz, Jneubert, DanBri, Lydia_Pintscher, Tagishsimon, 
Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, WMDE-leszek, Salgo60, So9q, 
Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, 
Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Suran38, Invadibot, 
MPhamWMF, Jtm-lis, maantietaja, Peteosx1x, NavinRizwi, CBogen, Isaacandy, 
Demian, Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Versant.2612]

Versant.2612 added a comment.


  Create a query set (extracted from the WDQS log) and a Wikidata subset of 
data to benchmark against graph databases (such as TPC).
  Ask graph database vendors to test their products and publish the results to 
the community.
  
  See 
  http://tpc.org/
  https://github.com/socialsensor/graphdb-benchmarks

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Versant.2612
Cc: Versant.2612, AndreasKuczera, DD063520, Michael, toan, Kjauslin, 
Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, Majavah, 
karapayneWMDE, MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, 
Thadguidry, Tpt, TallTed, Sj, Afandian, Justin0x2004, Jerven, TheKtk, 
Ivanhercaz, Jneubert, DanBri, Lydia_Pintscher, Tagishsimon, 
Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, WMDE-leszek, Salgo60, So9q, 
Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, 
Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Suran38, Invadibot, 
MPhamWMF, Jtm-lis, maantietaja, Peteosx1x, NavinRizwi, CBogen, Isaacandy, 
Demian, Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Hannah_Bast]

Hannah_Bast added a comment.


  In T206560#7430950 , 
@AndreasKuczera wrote:
  
  > I imported the wikidata-DB into neo4j and it works quite well.
  
  Can you be more specific? When we tested Wikidata on Neo4j several years ago, 
it worked in principle, but the performance was unacceptable. In particular, 
Neo4j does not efficiently support all kinds of JOIN operations that occur in 
typical SPARQL queries. Could you time a few SPARQL queries on your Neo4j 
instance and report the results here? That would be very helpful. For starters, 
you can simply pick some example queries from https://query.wikidata.org

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Hannah_Bast
Cc: AndreasKuczera, DD063520, Michael, toan, Kjauslin, Hannah_Bast, RShigapov, 
Izno, KingsleyIdehen, Daniel_Mietchen, Majavah, karapayneWMDE, MarioGom, 
Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, Sj, 
Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, Suran38, Invadibot, MPhamWMF, Jtm-lis, maantietaja, Peteosx1x, 
NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, Nandana, Namenlos314, 
Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, 
PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, 
aude, Tobias1984, Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, 
MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[AndreasKuczera]

AndreasKuczera added a comment.


  I imported the wikidata-DB into neo4j and it works quite well.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: AndreasKuczera
Cc: AndreasKuczera, DD063520, Michael, toan, Kjauslin, Hannah_Bast, RShigapov, 
Izno, KingsleyIdehen, Daniel_Mietchen, Majavah, karapayneWMDE, MarioGom, 
Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, Sj, 
Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, Suran38, Invadibot, MPhamWMF, Jtm-lis, maantietaja, Peteosx1x, 
NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, Nandana, Namenlos314, 
Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, 
PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, 
aude, Tobias1984, Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, 
MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Hannah_Bast]

Hannah_Bast added a comment.


  For whoever is interested, I wrote more about the QLever SPARQL engine 
 on this thread: 
https://phabricator.wikimedia.org/T290839 .

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Hannah_Bast
Cc: Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, Majavah, 
karapayneWMDE, MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, 
Thadguidry, Tpt, TallTed, Sj, Afandian, Justin0x2004, Jerven, TheKtk, 
Ivanhercaz, Jneubert, DanBri, Lydia_Pintscher, Tagishsimon, 
Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, WMDE-leszek, Salgo60, So9q, 
Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, 
Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Suran38, Invadibot, 
MPhamWMF, Jtm-lis, maantietaja, NavinRizwi, CBogen, Isaacandy, Demian, 
Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, 
QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[So9q]

So9q added a subtask: T290839: Evaluate a double backend strategy for WDQS.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: So9q
Cc: Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, Majavah, 
karapayneWMDE, MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, 
Thadguidry, Tpt, TallTed, Sj, Afandian, Justin0x2004, Jerven, TheKtk, 
Ivanhercaz, Jneubert, DanBri, Lydia_Pintscher, Tagishsimon, 
Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, WMDE-leszek, Salgo60, So9q, 
Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, 
Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Invadibot, MPhamWMF, 
Jtm-lis, maantietaja, NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, 
Nandana, Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Steko, Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[KingsleyIdehen]

KingsleyIdehen added a comment.


  A few things:
  
  1. This behavior is configurable i.e., we just have a restrictive timeout 
associated with the current public instance
  2. We could also include HTML-level messaging to complement the HTTP-level 
messaging
  
  This feature is the result of a fundamental challenge associated with the 
following, when you publish a query for ad-hoc query access to the Web:
  
  1. Unpredictable Query Complexity
  2. Unpredictable Query Solution Size
  3. Unpredictable Number of User Agents triggering and combination of the 
above.
  
  Conventional DBMS products can't handle this problem, hence the creation of 
this feature at the time Virtuoso was created circa 1998.
  
  Alternatively, as many do, you can simply throw lots of machines at the 
problem via horizontal partitioning using shards which sets you on the path to 
massive data centers (the norm worldwide these days).
  
  > SELECT (COUNT(*) AS ?count) WHERE { ?s ?p ?o }
  
  Is a typical expensive query that falls into the list I presented above. It's 
no different to
  
  > SELECT * FROM {Some-Table}
  
  in a typical SQL-compliant RDBMS which is why you don't see those published 
to Web -- although Virtuoso instances handle this too using the same "Anytime 
Query" functionality with a configurable timeout.
  
  Getting a result vs an actual latest and greatest result are different 
things. There is no way on earth that
  
  > SELECT (COUNT(*) AS ?count) WHERE { ?s ?p ?o }
  
  is happening in realtime on the Blazegraph instance . We could return a value 
from our statistics table too, but that isn't the global interpretation of a 
solution for that query.  For instance, we could put all the relevant stats in 
a voID graph which scheduled updates to it if need be.
  
  With Virtuoso, everything can be configured to suit the interaction behavior 
desired. It just so happens that ad-hoc querying, for global 24/7 access; 
irrespective of solution size, complexity, origins; is a fundamental challenge 
that isn't generally understood since its pegged to the emergence of the Web :)

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: KingsleyIdehen
Cc: Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, Majavah, 
karapayneWMDE, MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, 
Thadguidry, Tpt, TallTed, Sj, Afandian, Justin0x2004, Jerven, TheKtk, 
Ivanhercaz, Jneubert, DanBri, Lydia_Pintscher, Tagishsimon, 
Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, WMDE-leszek, Salgo60, So9q, 
Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, 
Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Invadibot, MPhamWMF, 
Jtm-lis, maantietaja, NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, 
Nandana, Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Steko, Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Hannah_Bast]

Hannah_Bast added a comment.


  Thanks, Kingsley, that explains it!
  
  I think it's a useful feature, but it's quite confusing that this important 
bit of information (whether the query result is correct or just an 
approximation) is contained only in the result header, but neither on the HTML 
result page, nor when one downloads the result as, say, TSV. Wouldn't it be 
easy to add this bit of information at least to the HTML result page? For 
example, the the form of a message on top of the table.
  
  It also leads to seemingly non-deterministic behavior. When I tried various 
queries the other day, I sometimes got an empty result (which led me to believe 
that I mistyped something, but I didn't), and sometimes not. A message would 
have helped.
  
  What also confused me was that the query  SELECT (COUNT(*) AS ?count) WHERE { 
?s ?p ?o }  always gives an empty result. That is a very common and useful 
query to check the size of the knowledge graph. And it's actually very easy to 
answer. On https://query.wikidata.org , which is otherwise not known for 
super-fast query times, one gets the result in an instant.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Hannah_Bast
Cc: Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, Majavah, 
karapayneWMDE, MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, 
Thadguidry, Tpt, TallTed, Sj, Afandian, Justin0x2004, Jerven, TheKtk, 
Ivanhercaz, Jneubert, DanBri, Lydia_Pintscher, Tagishsimon, 
Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, WMDE-leszek, Salgo60, So9q, 
Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, 
Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Invadibot, MPhamWMF, 
Jtm-lis, maantietaja, NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, 
Nandana, Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Steko, Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[GreenReaper]

GreenReaper added a comment.


  In some cases that feature could be useful, though I suspect many would be 
surprised to get results from an ordered query that might not be correct with 
respect to the entire data set.
  
  I tried the mentioned query, setting a timeout of 0 which disables this 
feature, and I got a 504 gateway timeout after ten minutes, when using the JSON 
format. This also happened if I set LIMIT 10.
  
  I then reset the timeout to a short one and the results similar to those 
reported by Hannah. After doing this, querying with a longer timeout returned a 
quick result, within a few seconds, but it looked to be based on the previous 
result set (or at least, did not return anyone with more than 15 professions), 
even if I increased the limit, which seems odd. I'd expect it to keep searching 
until the timeout.
  
  In fairness, I do not know if this is a query for which it would be 
reasonable to expect a complete result. Wikidata Query Service times out 
repeatedly on the same query after one minute.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: GreenReaper
Cc: Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, Majavah, 
karapayneWMDE, MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, 
Thadguidry, Tpt, TallTed, Sj, Afandian, Justin0x2004, Jerven, TheKtk, 
Ivanhercaz, Jneubert, DanBri, Lydia_Pintscher, Tagishsimon, 
Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, WMDE-leszek, Salgo60, So9q, 
Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, 
Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Invadibot, MPhamWMF, 
Jtm-lis, maantietaja, NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, 
Nandana, Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Steko, Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[KingsleyIdehen]

KingsleyIdehen added a comment.


  That's a consequence of the "Anytime Query" feature in Virtuoso that provides 
partial solutions in situations where a query cannot be completed within a 
specific timeframe. This timeframe takes the form of a configurable timeout, 
and is an critical feature for enabling global ad-hoc query access, 24/7, 365 
days a year re the likes of DBpedia and Wikidata.
  
  When a partial query is returned, information is delivered via the HTTP 
response as per:
  
  curl -I 
"https://wikidata.demo.openlinksw.com/sparql?default-graph-uri=http%3A%2F%2Fwww.wikidata.org%2F=PREFIX+parl%3A+%3Chttps%3A%2F%2Fid.parliament.uk%2Fschema%2F%3E%0D%0APREFIX+rdfs%3A+%3Chttp%3A%2F%2Fwww.w3.org%2F2000%2F01%2Frdf-schema%23%3E%0D%0APREFIX+wd%3A+%3Chttp%3A%2F%2Fwww.wikidata.org%2Fentity%2F%3E%0D%0APREFIX+wdt%3A+%3Chttp%3A%2F%2Fwww.wikidata.org%2Fprop%2Fdirect%2F%3E%0D%0APREFIX+wikibase%3A+%3Chttp%3A%2F%2Fwikiba.se%2Fontology%23%3E%0D%0APREFIX+bd%3A+%3Chttp%3A%2F%2Fwww.bigdata.com%2Frdf%23%3E%0D%0APREFIX+dct%3A+%3Chttp%3A%2F%2Fpurl.org%2Fdc%2Fterms%2F%3E%0D%0APREFIX+dbpedia%3A+%3Chttp%3A%2F%2Fdbpedia.org%2F%3E+%0D%0APREFIX+foaf%3A+%3Chttp%3A%2F%2Fxmlns.com%2Ffoaf%2F0.1%2F%3E%0D%0APREFIX+wds%3A+%3Chttp%3A%2F%2Fwww.wikidata.org%2Fentity%2Fstatement%2F%3E%0D%0APREFIX+wdv%3A+%3Chttp%3A%2F%2Fwww.wikidata.org%2Fvalue%2F%3E%0D%0APREFIX+wdt%3A+%3Chttp%3A%2F%2Fwww.wikidata.org%2Fprop%2Fdirect%2F%3E%0D%0APREFIX+p%3A+%3Chttp%3A%2F%2Fwww.wikidata.org%2Fprop%2F%3E%0D%0APREFIX+ps%3A+%3Chttp%3A%2F%2Fwww.wikidata.org%2Fprop%2Fstatement%2F%3E%0D%0APREFIX+pq%3A+%3Chttp%3A%2F%2Fwww.wikidata.org%2Fprop%2Fqualifier%2F%3E%0D%0A%0D%0ASELECT+%3Fperson_id+%3Fperson+%28COUNT%28%3Fprofession_id%29+AS+%3Fcount%29+%28GROUP_CONCAT%28%3Fprofession%3B+separator%3D%22%2C+%22%29+AS+%3Fprofessions%29+WHERE+%7B%0D%0A++%3Fperson_id+wdt%3AP31+wd%3AQ5+.%0D%0A++%3Fperson_id+wdt%3AP106+%3Fprofession_id+.%0D%0A++%3Fprofession_id+rdfs%3Alabel+%3Fprofession+.%0D%0A++%3Fperson_id+rdfs%3Alabel+%3Fperson+.%0D%0A++FILTER+%28LANG%28%3Fperson%29+%3D+%22en%22%29+.%0D%0A++FILTER+%28LANG%28%3Fprofession%29+%3D+%22en%22%29%0D%0A%7D%0D%0AGROUP+BY+%3Fperson_id+%3Fperson%0D%0AORDER+BY+DESC%28%3Fcount%29=text%2Fx-html%2Btr=3000_void=on_unconnected=on;
  
  Which returns:
  
  HTTP/1.1 200 OK
  Date: Thu, 09 Sep 2021 17:53:51 GMT
  Content-Type: text/html; charset=UTF-8
  Content-Length: 479290
  Connection: keep-alive
  Vary: Accept-Encoding
  Server: Virtuoso/08.03.3320 (Linux) x86_64-generic-linux-glibc25  VDB
  Accept-Ranges: bytes
  X-SPARQL-default-graph: http://www.wikidata.org/
  X-SQL-State: S1TAT
  X-SQL-Message: RC...: Returning incomplete results, query interrupted by 
result timeout.  Activity:  1.075M rnd  530.1K seq  16.78K same seg   109.7K 
same pg  14.13K same par  0 disk  0 spec disk  0B /  0
  X-Exec-Milliseconds: 2031
  X-Exec-DB-Activity: 1.075M rnd  530.1K seq  16.78K same seg   109.7K same pg  
14.13K same par  0 disk  0 spec disk  0B /  0 messages  0 
fork
  Content-disposition: filename=sparql_2021-09-09_17-53-51Z.html
  Expires: Thu, 09 Sep 2021 18:53:51 GMT
  Cache-Control: max-age=3600
  Strict-Transport-Security: max-age=15768000
  
  **Related**
  
  [1] DBpedia Fair Use Note 
  [2] Virtuoso Anytime Query Tips & Tricks Note 


TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: KingsleyIdehen
Cc: Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, Majavah, 
karapayneWMDE, MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, 
Thadguidry, Tpt, TallTed, Sj, Afandian, Justin0x2004, Jerven, TheKtk, 
Ivanhercaz, Jneubert, DanBri, Lydia_Pintscher, Tagishsimon, 
Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, WMDE-leszek, Salgo60, So9q, 
Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, 
Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Invadibot, MPhamWMF, 
Jtm-lis, maantietaja, NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, 
Nandana, Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Steko, Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Hannah_Bast]

Hannah_Bast added a comment.


  > [1] Our Live Wikidata SPARQL Query Endpoint 

  
  Thanks, Kingsley. We tried your Wikidata SPARQL endpoint, in particular some 
queries with an ORDER BY in the end, which require the computation of a fairly 
large intermediate result. These queries are hard because even if you want just 
the top-ranked items in the end, you have to compute all of them first in order 
to find out which of them are the top-ranked ones.
  
  Your Wikidata SPARQL endpoint computed results for those queries surprisingly 
quickly, but the result do not seem to be correct.
  
  Here is an example query (all people and their professions, ordered by the 
number of professions). The top result returned by your SPARQL endpoint is 
"Janet Jackson" with 15 professions. But there are a number of people with more 
professions. For example, Johann Wolfgang von Goethe 
(http://www.wikidata.org/entity/Q5879) with 30 professions. One can also find 
him with your endpoint by adding FILTER (?person_id = 
http://www.wikidata.org/entity/Q5879) to the query below. So something strange 
is going on. Can you explain?
  
SELECT ?person_id ?person (COUNT(?profession_id) AS ?count) 
(GROUP_CONCAT(?profession; separator=", ") AS ?professions) WHERE {
  ?person_id wdt:P31 wd:Q5 .
  ?person_id wdt:P106 ?profession_id .
  ?profession_id rdfs:label ?profession .
  ?person_id rdfs:label ?person .
  FILTER (LANG(?person) = "en") .
  FILTER (LANG(?profession) = "en")
}
GROUP BY ?person_id ?person
ORDER BY DESC(?count)

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Hannah_Bast
Cc: Hannah_Bast, RShigapov, Izno, KingsleyIdehen, Daniel_Mietchen, Majavah, 
karapayneWMDE, MarioGom, Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, 
Thadguidry, Tpt, TallTed, Sj, Afandian, Justin0x2004, Jerven, TheKtk, 
Ivanhercaz, Jneubert, DanBri, Lydia_Pintscher, Tagishsimon, 
Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, WMDE-leszek, Salgo60, So9q, 
Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, 
Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Invadibot, MPhamWMF, 
Jtm-lis, maantietaja, NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, 
Nandana, Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Steko, Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Gehel]

Gehel removed a subtask: T290244: Evaluate whether RDF Thrift is a suitable 
dump format.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Izno, KingsleyIdehen, Daniel_Mietchen, Majavah, karapayneWMDE, MarioGom, 
Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, Sj, 
Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, Invadibot, MPhamWMF, Jtm-lis, maantietaja, NavinRizwi, CBogen, 
Isaacandy, Demian, Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Gehel]

Gehel added a subtask: T290244: Evaluate whether RDF Thrift is a suitable dump 
format.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Izno, KingsleyIdehen, Daniel_Mietchen, Majavah, karapayneWMDE, MarioGom, 
Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, Sj, 
Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, Invadibot, MPhamWMF, Jtm-lis, maantietaja, NavinRizwi, CBogen, 
Isaacandy, Demian, Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Gehel]

Gehel added a subtask: T290240: Evaluate whether RDF Delta is a good idea to 
have in the backend.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Izno, KingsleyIdehen, Daniel_Mietchen, Majavah, karapayneWMDE, MarioGom, 
Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, Sj, 
Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, Invadibot, MPhamWMF, Jtm-lis, maantietaja, NavinRizwi, CBogen, 
Isaacandy, Demian, Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[So9q]

So9q added a comment.


  I recommend the Search Team to attend the ApacheCon to gather insights from 
others using Big Data succesfully:
  https://www.apachecon.com/acah2021/tracks/bigdata.html
  e.g.:
  
  - Containing an Elephant: How we moved Hadoop/HBase into Kubernetes and 
Public Cloud

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: So9q
Cc: KingsleyIdehen, Daniel_Mietchen, Majavah, karapayneWMDE, MarioGom, 
Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, Sj, 
Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, Invadibot, MPhamWMF, Jtm-lis, maantietaja, NavinRizwi, CBogen, 
Isaacandy, Demian, Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[So9q]

So9q added a subtask: T290082: Evaluate Apache HBase as alternative to 
Blazegraph.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: So9q
Cc: KingsleyIdehen, Daniel_Mietchen, Majavah, karapayneWMDE, MarioGom, 
Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, Sj, 
Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, Invadibot, MPhamWMF, Jtm-lis, maantietaja, NavinRizwi, CBogen, 
Isaacandy, Demian, Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[So9q]

So9q added a comment.


  In T206560#7235915 , @So9q 
wrote:
  
  > See my proposal (JanusGraph with a distribued backend like Cassandra) and 
discussion here 
https://www.wikidata.org/wiki/Wikidata:Project_chat#Blazegraph_is_unmaintained_and_does_not_scale_-_is_JanusGraph_a_viable_replacement_for_WDQS?
  
  Since writing this, I have thought more about SPARQL vs Gremlin. The 
advantages of the former seem to be
  
  1. we already are accustomed to it and have it hard-coded in a lot of tools
  2. it is an open standard
  
  A move to a Tinkerpop based infrastructure (thus aligning with the big 
players in the big data graph database industry) is possible while keeping 
SPARQL also! See https://github.com/tinkerpop/gremlin/wiki/SPARQL-vs.-Gremlin 
where Gremlin over Sail is mentioned.
  
  It will incur a lot of extra costs to change away from SPARQL this late in 
the endeavour.
  
  I really hope we can find or build a suitable stable and scalable backend 
that can handle the load of the next 10 years.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: So9q
Cc: KingsleyIdehen, Daniel_Mietchen, Majavah, karapayneWMDE, MarioGom, 
Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, Sj, 
Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, Invadibot, MPhamWMF, Jtm-lis, maantietaja, NavinRizwi, CBogen, 
Isaacandy, Demian, Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[KingsleyIdehen]

KingsleyIdehen added a comment.


  For the record.
  
  At the time of our first rendezvous re Wikidata hosting, handling 20 billion+ 
triples would have typically required our Cluster Edition (a Commercial Only 
offering). That was the deal-breaker back at the time of initial Blazegraph 
selection for Wikidata i.e., it offered an Open Source based Cluster Edition.
  
  Anyway, in recent times, our Open Source Edition has evolved to handle some 
80 Billion+ triples (exemplified by the live Uniprot instance 
) where performance and scale is primary a 
function of available memory. Fundamentally, the current 13 Billion Triples 
size of Wikidata and future growth all lie well within the range of Virtuoso's 
Open Source Edition.
  
  Also note, based on our experience hosting live DBpedia and Wikidata 
instances, we do have configuration best practices in place for uptime and 
scalability without the need for our Cluster Edition (which is really for 
dealing with massive setups in the 100 Billion Triples or higher range).
  
  I hope this helps.
  
  **Related**
  
  [1] Our Live Wikidata SPARQL Query Endpoint 

  [2] Google Spreadsheet about various Virtuoso Configurations associated with 
some well-known public endpoints 

  [3] This query doesn't complete with the current Blazegraph-based Wikidata 
endpoint 
  [4] Same query completing when applied to the Virtuoso-based endpoint 

  [5] About loading Wikidata's datasets into a Virtuoso instance 

  [6] Various demos shared via Twitter over the years regarding Wikidata 

 
  [7] Uniprot SPARQL Endpoint Presentation 

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: KingsleyIdehen
Cc: KingsleyIdehen, Daniel_Mietchen, Majavah, karapayneWMDE, MarioGom, 
Mohammed_Sadat_WMDE, Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, Sj, 
Afandian, Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, Invadibot, MPhamWMF, Jtm-lis, maantietaja, NavinRizwi, CBogen, 
Isaacandy, Demian, Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Darenwelsh, Dinoguy1000, Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[So9q]

So9q added a subtask: T289760: Evaluate Oxigraph as alternative to Blazegraph.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: So9q
Cc: Daniel_Mietchen, Majavah, karapayneWMDE, MarioGom, Mohammed_Sadat_WMDE, 
Hjfocs, danshick-wmde, Thadguidry, Tpt, TallTed, Sj, Afandian, Justin0x2004, 
Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, Lydia_Pintscher, Tagishsimon, 
Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, WMDE-leszek, Salgo60, So9q, 
Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, 
Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Invadibot, MPhamWMF, 
Jtm-lis, maantietaja, NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, 
Nandana, Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Steko, Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[So9q]

So9q added a subtask: T289561: Evaluate Rya as alternative to Blazegraph.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: So9q
Cc: Majavah, karapayneWMDE, MarioGom, Mohammed_Sadat_WMDE, Hjfocs, 
danshick-wmde, Thadguidry, Tpt, TallTed, Sj, Afandian, Justin0x2004, Jerven, 
TheKtk, Ivanhercaz, Jneubert, DanBri, Lydia_Pintscher, Tagishsimon, 
Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, WMDE-leszek, Salgo60, So9q, 
Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, 
Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Invadibot, MPhamWMF, 
Jtm-lis, maantietaja, NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, 
Nandana, Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Steko, Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Thadguidry]

Thadguidry added subscribers: Tpt, Thadguidry.
Thadguidry added a comment.


  +1 for Oxigraph.  @TPT has been putting in a ton of good effort, research, 
features, and stability.  Sponsoring him now in GitHub as well for his effort.
  As it's being developed in Rust, it automatically takes advantage of data 
streaming in places that utilizes intrinsic functions (forwarded through LLVM 
compiler IR) in CPU's.  Java 17 is just now getting into a better position with 
it's new Vector API .  On top of that, the 
RIO Parser is one of the fastest RDF parsers I've seen run on my system, which 
he also graciously maintains in Rust.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Thadguidry
Cc: Thadguidry, Tpt, TallTed, Sj, Afandian, Justin0x2004, Jerven, TheKtk, 
Ivanhercaz, Jneubert, DanBri, Lydia_Pintscher, Tagishsimon, 
Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, WMDE-leszek, Salgo60, So9q, 
Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, 
Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Invadibot, MPhamWMF, 
Jtm-lis, maantietaja, NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, 
Nandana, Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
Steko, Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Justin0x2004]

Justin0x2004 added a comment.


  In T206560#7248377 , 
@DanBri wrote:
  
  > @Lydia_Pintscher mentioned a conversation with the  Data Commons team at 
Google, they have this opensource codebase that's somewhat in this area: 
https://github.com/datacommonsorg/mixer
  
  It looks like Data Commons is not RDF native. And its "SPARQL endpoint" is an 
approximation of a SPARQL endpoint. That is, it is missing lots of things that 
make SPARQL endpoints useful to work with.
  
  e.g. Here is a query that works:
  
curl -X POST 'https://api.datacommons.org/query' \
-d '{"sparql": "SELECT ?state ?name \
WHERE { \
  ?state typeOf State . \
  ?state name ?name \
}"}'
  
  - but it can't handle `select *`
  - notice how the predicates don't use a prefix
  - it doesn't respect a header like 'Accept: text/csv'
  
  In fairness they do say:
  
Graph Query/SPARQL: Given a subgraph where some of the nodes are variables, 
retrieve possible matches. This corresponds to a subset of the graph query 
language SPARQL.
  
  https://docs.datacommons.org/api/
  
  And in the code I see:
  `// Translate takes a datalog query and translates to GoogleSQL query based 
on schema mapping.`
  
https://github.com/datacommonsorg/mixer/blob/b7518499a19360cc4ee33898feb8e26f81cc060b/internal/translator/translate.go#L853
  
  But if you look how the Translate function gets called I think they mean 
"takes a SPARQL query."

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Justin0x2004
Cc: Justin0x2004, Jerven, TheKtk, Ivanhercaz, Jneubert, DanBri, 
Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, GreenReaper, 
WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, 
Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, 
Smalyshev, Invadibot, MPhamWMF, Jtm-lis, maantietaja, NavinRizwi, CBogen, 
Isaacandy, Demian, Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Darenwelsh, Dinoguy1000, Manybubbles, Foxtrott, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[DanBri]

DanBri added subscribers: Lydia_Pintscher, DanBri.
DanBri added a comment.


  @Lydia_Pintscher mentioned a conversation with the  Data Commons team at 
Google, they have this opensource codebase that's somewhat in this area: 
https://github.com/datacommonsorg/mixer

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: DanBri
Cc: DanBri, Lydia_Pintscher, Tagishsimon, Samantha_Alipio_WMDE, Ostrzyciel, 
GreenReaper, WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, 
Akuckartz, Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, 
Aklapper, Smalyshev, Invadibot, MPhamWMF, Jtm-lis, maantietaja, NavinRizwi, 
CBogen, Isaacandy, Demian, Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, 
Bryandamon, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, 
suriyaa, Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Darenwelsh, Dinoguy1000, Manybubbles, Foxtrott, brion, Mbch331, 
MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[So9q]

So9q added a comment.


  See discussion here 
https://www.wikidata.org/wiki/Wikidata:Project_chat#Blazegraph_is_unmaintained_and_does_not_scale_-_is_JanusGraph_a_viable_replacement_for_WDQS?

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: So9q
Cc: Ostrzyciel, GreenReaper, WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, 
TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, Gehel, 
Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Invadibot, MPhamWMF, Jtm-lis, 
maantietaja, NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, Nandana, 
Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, EBjune, 
merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, 
Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, Foxtrott, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Ostrzyciel]

Ostrzyciel added a comment.


  In T206560#7068941 , @So9q 
wrote:
  
  > Today I presented a new found alternative to Blazegraph and the bridge in 
the telegram wikidata chat.
  > See https://github.com/ontop/ontop
  > Can it do the job?
  > No need for sparql update and moving data around it seems.
  >
  > Could someone take a closer look?
  
  Well, the first issue is that it doesn't support many features of WDQS that I 
would consider "kinda important" like property paths, federation and parts of 
GeoSPARQL: https://ontop-vkg.org/guide/compliance.html
  
  The second (and probably much more serious) issue is performance: RDF stores 
are optimized for SPARQL queries, SQL DBs are not. I haven't tested it, but I 
would bet with confidence that Ontop can't come close to Blazegraph's level of 
performance. Their own paper  
lists several perf comparison studies, but all of them involve only similar 
(virtual knowledge graph) solutions and no real RDF stores. Raises an eyebrow, 
if you ask me. :)

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ostrzyciel
Cc: Ostrzyciel, GreenReaper, WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, 
TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, Gehel, 
Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Invadibot, MPhamWMF, Jtm-lis, 
maantietaja, NavinRizwi, CBogen, Isaacandy, Demian, Olson.jared.m, Nandana, 
Namenlos314, Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, EBjune, 
merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, 
Samwilson, PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, Dinoguy1000, 
Manybubbles, Foxtrott, brion, Mbch331, MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[So9q]

So9q added a comment.


  Today I presented a new found alternative to Blazegraph and the bridge in the 
telegram wikidata chat.
  See https://github.com/ontop/ontop
  Can it do the job?
  No need for sparql update and moving data around it seems.
  
  Could someone take a closer look?

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: So9q
Cc: GreenReaper, WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, 
Akuckartz, Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, 
Aklapper, Smalyshev, Invadibot, MPhamWMF, Jtm-lis, maantietaja, NavinRizwi, 
CBogen, Isaacandy, Demian, Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, 
Bryandamon, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, 
suriyaa, Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Darenwelsh, Dinoguy1000, Manybubbles, Foxtrott, brion, Mbch331, 
MarkAHershberger
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[GreenReaper]

GreenReaper added a comment.


  In T206560#6864268 , 
@Krabina wrote:
  
  > I don't understand the "I don't like Java" argument. Blazegraph - which is 
in discussion here - is also written in Java als are most (all?) other 
triplestores or graph databases.
  
  Here's one in Rust , which claims to 
have a level of Wikibase compatibility 
 (i.e. SPARQL 
endpoint and loader) and better simple query performance 
 - but it may 
not compete on complex queries yet 
.
  
  > Oxigraph implements the following specifications:
  >
  > - SPARQL 1.1 Query, SPARQL 1.1 Update, and SPARQL 1.1 Federated Query. 
(+SPARQL Graph Store 1.1, but without POST 
)
  > - Turtle, TriG, N-Triples, N-Quads, and RDF XML RDF serialization formats 
for both data ingestion and retrieval using the Rio library.
  > - SPARQL Query Results XML Format, SPARQL 1.1 Query Results JSON Format and 
SPARQL 1.1 Query Results CSV and TSV Formats.
  
  Still a work in progress; but that progress looks exciting. Its current 
persistent key-Value backends 
 are RocksDB 
 or Sled . Has a HTTP 
server, Python and JS bindings (the latter via WASM). Apache 2.0/MIT.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: GreenReaper
Cc: GreenReaper, WMDE-leszek, Salgo60, So9q, Krabina, Jecummings4, TomT0m, 
Akuckartz, Susannaanas, Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, 
Aklapper, Smalyshev, Invadibot, MPhamWMF, Jtm-lis, maantietaja, NavinRizwi, 
CBogen, Isaacandy, Demian, Olson.jared.m, Nandana, Namenlos314, Lahi, Gq86, 
Bryandamon, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, 
suriyaa, Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Darenwelsh, Dinoguy1000, Manybubbles, Foxtrott, brion, Mbch331, 
MarkAHershberger
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Krabina]

Krabina added a comment.


  I don't understand the "I don't like Java" argument. Blazegraph - which is in 
discussion here - is also written in Java als are most (all?) other 
triplestores or graph databases.
  
  Do you suggest to write a new storage backend from scratch?

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Krabina
Cc: Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, 
Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, 
MPhamWMF, Jtm-lis, NavinRizwi, CBogen, Isaacandy, Demian, Nandana, Namenlos314, 
Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, 
PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, 
aude, Tobias1984, Darenwelsh, Dinoguy1000, Manybubbles, Foxtrott, brion, 
Mbch331, Rxy, MarkAHershberger
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Salgo60]

Salgo60 added a comment.


  neo4j: I spoke with the CIO Emil last year in Stockholm and pinged Lydia 
about it see {T234431#5936337 
} ... Emil said it was just 
send him an email if we would like to move this forward 
  F34123693: image.png 

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Salgo60
Cc: Salgo60, So9q, Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, 
Addshore, Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, 
MPhamWMF, Jtm-lis, NavinRizwi, CBogen, Isaacandy, Demian, Nandana, Namenlos314, 
Lahi, Gq86, Bryandamon, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, 
PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, 
aude, Tobias1984, Darenwelsh, Dinoguy1000, Manybubbles, Foxtrott, brion, 
Mbch331, Rxy, MarkAHershberger
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[So9q]

So9q added a comment.


  In T206560#6849671 , 
@Krabina wrote:
  
  > Interesting. From my (limited) experience, neo4j 
 seems to get a lot of attention.
  >
  > BTW: there was a discussion about triple store experiences at the SMWCon 
last year inlcuding blazegraph, virtuoso and jena: https://youtu.be/AB_dwxG_vEs
  
  https://github.com/neo4j/neo4j is written in Java. I personally don't like 
Java software. My experience is that they seldom scale well and you always got 
the VM overhead. Also I think the language might be dying it's not a good 
choice for anything new these days IMO.
  
  Rust on the other hand seems very attractive from a horizontal scaling 
viewpoint and I really like that the compiler is so strict that runtime errors 
are often turns up at compile time instead. That's a huge plus over e.g. C++ 
which seldom complaines at compile time and you have errors pop up during 
runtime instead.
  
  See this simple comparison 

 for an idea how efficient Rust is compared to Java for backend services.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: So9q
Cc: So9q, Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, 
Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, MPhamWMF, 
Jtm-lis, NavinRizwi, CBogen, Isaacandy, Demian, Nandana, Namenlos314, Lahi, 
Gq86, Bryandamon, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, 
_jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, 
PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, 
aude, Tobias1984, Darenwelsh, Dinoguy1000, Manybubbles, Foxtrott, brion, 
Mbch331, Rxy, MarkAHershberger
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[So9q]

So9q added a comment.


  In T206560#6608418 , 
@Lucas_Werkmeister_WMDE wrote:
  
  > Another option to keep an eye on is QLever 
. It doesn’t support SPARQL Update yet 
(and while the stated Wikidata reload time of less than 24 hours is impressive, 
it’s not enough to replace live updates, especially since I believe it takes us 
more than 24 hours to //produce// an RDF dump anyways), but I’m told that 
update support is being worked on.
  
  I just wrote the developers of QLever regarding SPARQL Update support and 
encouraged them to write a grant proposal, see 
https://github.com/ad-freiburg/QLever/issues/375

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: So9q
Cc: So9q, Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, 
Andrawaag, Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, MPhamWMF, 
Jtm-lis, NavinRizwi, CBogen, Isaacandy, Demian, Nandana, Namenlos314, Lahi, 
Gq86, Bryandamon, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, 
_jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, 
PhotographerTom, suriyaa, Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, 
aude, Tobias1984, Darenwelsh, Dinoguy1000, Manybubbles, Foxtrott, brion, 
Mbch331, Rxy, MarkAHershberger
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Krabina]

Krabina added a comment.


  Interesting. From my (limited) experience, neo4j 
 seems to get a lot of attention.
  
  BTW: there was a discussion about triple store experiences at the SMWCon last 
year inlcuding blazegraph, virtuoso and jena: https://youtu.be/AB_dwxG_vEs

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Krabina
Cc: Krabina, Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, 
Gehel, Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, MPhamWMF, Jtm-lis, 
NavinRizwi, CBogen, Isaacandy, Demian, Nandana, Namenlos314, Lahi, Gq86, 
Bryandamon, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, 
suriyaa, Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Darenwelsh, Dinoguy1000, Manybubbles, Foxtrott, brion, Mbch331, 
Rxy, MarkAHershberger
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[MPhamWMF]

MPhamWMF added a subtask: T275398: Create an updated survey of graph backends 
for WDQS.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: MPhamWMF
Cc: Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, Gehel, 
Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, MPhamWMF, Jtm-lis, NavinRizwi, 
CBogen, Isaacandy, Demian, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Krabina, _jensen, 
rosalieper, Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, 
suriyaa, Psychoslave, tosfos, jkroll, Wikidata-bugs, Jdouglas, aude, 
Tobias1984, Darenwelsh, Dinoguy1000, Manybubbles, Foxtrott, brion, Mbch331, 
Rxy, MarkAHershberger
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Akuckartz]

Akuckartz added a comment.


  I tried to formulate a Wikidata use case for the development of the RDF* / 
RDF star specification: https://github.com/w3c/rdf-star/issues/29

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Akuckartz
Cc: Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, Gehel, 
Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Jtm-lis, NavinRizwi, CBogen, 
Isaacandy, Demian, DannyS712, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, 
Dinoguy1000, Manybubbles, Foxtrott, brion, Mbch331, Rxy, MarkAHershberger
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Lucas_Werkmeister_WMDE]

Lucas_Werkmeister_WMDE added a comment.


  Another option to keep an eye on is QLever 
. It doesn’t support SPARQL Update yet 
(and while the stated Wikidata reload time of less than 24 hours is impressive, 
it’s not enough to replace live updates, especially since I believe it takes us 
more than 24 hours to //produce// an RDF dump anyways), but I’m told that 
update support is being worked on.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE
Cc: Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, Gehel, 
Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Jtm-lis, NavinRizwi, CBogen, 
Isaacandy, Demian, DannyS712, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, 
Dinoguy1000, Manybubbles, Foxtrott, brion, Mbch331, Rxy, MarkAHershberger
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Aklapper]

Aklapper changed the status of subtask T206561: Evaluate Virtuoso as 
alternative to Blazegraph from Stalled to Open.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Aklapper
Cc: Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, Gehel, 
Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, Jtm-lis, NavinRizwi, CBogen, 
Isaacandy, Demian, DannyS712, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, 
Dinoguy1000, Manybubbles, Foxtrott, brion, Mbch331, Rxy, MarkAHershberger
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Gehel]

Gehel raised the priority of this task from "Medium" to "High".

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

WORKBOARD
  https://phabricator.wikimedia.org/project/board/891/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, Gehel, 
Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, NavinRizwi, CBogen, Isaacandy, 
Demian, darthmon_wmde, DannyS712, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, 
Dinoguy1000, Manybubbles, Foxtrott, brion, Mbch331, Rxy, MarkAHershberger
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Gehel]

Gehel added a comment.


  In T206560#6416757 , 
@Jecummings4 wrote:
  
  > I represent a research group at the Computer Science and Artificial 
Intelligence Laboratory at MIT. For the past year, we've been doing a lot of 
work with local copies Wikidata and have experienced our own share of 
frustrations with Blazegraph. We are currently looking for alternatives as 
well. We'd love to hear about the directions being taken here, give our own 
input as to what capabilities we would hope to find in an alternative, and, 
perhaps, volunteer our services to help with the development/transition. Our 
work is a little niche so our recommendations may not be representative of the 
general need and our group is manned mostly by undergraduate researchers but 
we'd love to help if we can.
  >
  > Please let me know who I can talk to specifically about this: 
jecum...@csail.mit.edu
  
  We're always interested in collaborations! We don't have documented formal 
requirements (that's part of what we need to do), but what comes to mind right 
now:
  
  - horizontal scaling
  - supports SPARQL (this might be a constraint that we could drop if we can't 
find a solution, but this would mean a world of pain for our users and for the 
whole ecosystem around WDQS)
  - supports SPARQL services, or a way to emulate them (we might want to review 
this requirement as well, having a backend service having dependencies on 
external services is problematic, we might want to implement services as a 
frontend)
  - OpenSource (obviously)
  - good performances in a context with both heavy reads and heavy writes
  - probably a lot of other things as well (it's late here, we need more time 
to formalize)
  
  Feel free to join the Search Platform office hours 
 to discuss this 
more synchronously!

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, Gehel, 
Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, NavinRizwi, CBogen, Isaacandy, 
Demian, darthmon_wmde, DannyS712, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, 
Dinoguy1000, Manybubbles, Foxtrott, brion, Mbch331, Rxy, MarkAHershberger
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Jecummings4]

Jecummings4 added a comment.


  I represent a research group at the Computer Science and Artificial 
Intelligence Laboratory at MIT. For the past year, we've been doing a lot of 
work with local copies Wikidata and have experienced our own share of 
frustrations with Blazegraph. We are currently looking for alternatives as 
well. We'd love to hear about the directions being taken here, give our own 
input as to what capabilities we would hope to find in an alternative, and, 
perhaps, volunteer our services to help with the development/transition. Our 
work is a little niche so our recommendations may not be representative of the 
general need and our group is manned mostly by undergraduate researchers but 
we'd love to help if we can.
  
  Please let me know who I can talk to specifically about this: 
jecum...@csail.mit.edu

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Jecummings4
Cc: Jecummings4, TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, Gehel, 
Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, NavinRizwi, CBogen, Isaacandy, 
Demian, darthmon_wmde, DannyS712, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, 
Dinoguy1000, Manybubbles, Foxtrott, brion, Mbch331, Rxy, MarkAHershberger
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Akuckartz]

Akuckartz added a project: MediaWiki-Stakeholders-Group.

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Akuckartz
Cc: TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, Gehel, 
Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, NavinRizwi, CBogen, Isaacandy, 
Demian, darthmon_wmde, DannyS712, Nandana, Namenlos314, Lahi, Gq86, Bryandamon, 
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Xmlizer, Steko, Samwilson, PhotographerTom, suriyaa, 
Psychoslave, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Darenwelsh, 
Dinoguy1000, Manybubbles, Foxtrott, brion, Mbch331, Rxy, MarkAHershberger
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Akuckartz]

Akuckartz added a comment.


  I think it is important to keep in mind that significant efforts are being 
made to unite the RDF and Property Graph communities. One aspect of this is the 
development of "RDF*" and "SPARQL*" (SPARQL star). BlazeGraph played and 
continues to play a positive role in this. This is the main paper explaining 
the concepts behind RDF* and SPARQL*: https://arxiv.org/pdf/1406.3399.pdf

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Akuckartz
Cc: TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, Gehel, 
Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, NavinRizwi, CBogen, darthmon_wmde, 
DannyS712, Nandana, Namenlos314, Lahi, Gq86, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Dinoguy1000, Manybubbles, 
Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T206560: [Epic] Evaluate alternatives to Blazegraph

[Akuckartz]

Akuckartz added a comment.


  What are the requirements?

TASK DETAIL
  https://phabricator.wikimedia.org/T206560

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Akuckartz
Cc: TomT0m, Akuckartz, Susannaanas, Addshore, Andrawaag, Gehel, 
Lucas_Werkmeister_WMDE, Aklapper, Smalyshev, NavinRizwi, CBogen, darthmon_wmde, 
DannyS712, Nandana, Namenlos314, Lahi, Gq86, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Dinoguy1000, Manybubbles, 
Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs