Mstyles added a comment.
For #1, that's is correct. We are currently downloading Flink from the internet. I don't think that's the best idea long term, but it seems fine for now. Currently for #2, "Build and verify streaming-updater-producer from source, tracking changes to your project repo." That already happens in a different process, via a weekly deploy to Archiva. I don't think we need to replicate that process in the pipeline. We can include it here, but that would mean having to separate the particular streaming-updater-producer project from the rest of the rdf projects. I think that's possible, but not necessary at this time. In regards to #3, "Build and publish a production deployable image that has Flink installed via the base image and has streaming-updater-producer installed into /opt/flink/usrlib.", that's correct, this is the image we want to use in the helm chart. I think the separate repository approach should be fine. We would still need to update the streaming-updater-producer jar version number in the blubber file, and that alone should be enough to trigger a change and produce a new image. Ideally, we wouldn't change any of the current build processes, unless we really need to. I don't think we need to. It seems that the solutions that you are recommending, hinge on having a Flink base image, either via a separate repository that we (the search team) create or via the official SRE base images. The part that is really important to our team is getting our docker image into the WMF docker registry so that we can use it to deploy our Flink cluster to the WMF Kubernetes cluster. Including the Java development process is a nice to have, but there are many Java projects in the same RDF repository that will still be using our established Java build and deploy process. Changing our Java process just for this particular Java project (the streaming-updater-producer) could lead to more complications down the line. TASK DETAIL https://phabricator.wikimedia.org/T265512 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Mstyles Cc: dduvall, jeena, akosiaris, Aklapper, Gehel, Mstyles, Alter-paule, Beast1978, CBogen, Un1tY, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
_______________________________________________ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
