Gehel added a comment.
A few additional notes / context in no particular order: `streaming-updater-producer` is strongly coupled with the rest of the wikidata/query/rdf project. It might be possible to externalize it to it's own repo, but it will still have dependencies on the rest of the project. So for most changes in the wikidata/query/rdf project, we'll need to update that streaming-updater project as well. It seems to me that it will be more cumbersome than helpful. The streaming updater is likely going to require multiple independent deployments, for WDQS, but also for WCQS and potentially other future query services. My (limited) understanding of the usual pipelines is that we expect a 1-to-1 mapping between project source code, packaged artifact and deployment. This assumption is broken in our case, where the project source code generates multiple packaged artifacts, and each artifact generates potentially multiple independent deployments. We will need to continue to publish jars to Archiva anyway, as those jars are also consumed outside of WMF, by people running their own query service. Our use case seems to be different enough from the expectations that we probably need to discuss this more synchronously, so that we understand the various constraints and design principles better. TASK DETAIL https://phabricator.wikimedia.org/T265512 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Mstyles, Gehel Cc: dduvall, jeena, akosiaris, Aklapper, Gehel, Mstyles, Alter-paule, Beast1978, CBogen, Un1tY, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
_______________________________________________ Wikidata-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
