Hi all, I have created the Project Idea Draft for the idea #1 (Improving Remoting over Kafka Plugin): https://docs.google.com/document/d/1CIgjz8IZxihYC6CKqE0pFuKljCKK3SPhKK87IpHs_38/edit?usp=sharing . Feedback will be appreciated (and thanks to all folks willing to be the mentors!). Regarding integration of Remoting with monitoring tools, it would be great if somebody else becomes a champion so that we balance the load a bit. I think that the idea for general monitoring project is useful though I am not sure how much can be already addressed, e.g. by existing Kafka <=> Prometheus integrations (e.g. this post <https://banzaicloud.com/blog/monitoring-kafka-prometheus/>).
As a side note, I have also reached out to the Jenkins X team. Their feedback is that they would rather prefer to see remoting communications over Kubernetes CRD <https://kubernetes.io/docs/concepts/extend-kubernetes/api-extension/custom-resources/>. We could definitely move some logic to CRD (Classloading, transfer of large files), but CRD is not a good choice for heavy RMI operations and log streaming. For log streaming there is a work for external logging in Cloud Native SIG, but it has neever been completed due to various reasons. I am not sure about embarking on this journey until JEP-207/212 are implemented. But we could create such project idea if anybody is willing to mentor it BR, Oleg On Sun, Jan 6, 2019 at 8:56 PM Jeff Pearce <[email protected]> wrote: > I’m willing to be a co-mentor on either of the two options, depending on > how many others are selected > > Sent from my iPhone > > On Jan 6, 2019, at 9:57 AM, Supun Wanniarachchi <[email protected]> > wrote: > > Sounds interesting. Last year we had a successful remoting project and it > would be nice to have a remoting project this year as well. I also would > try to find some spare time to help the project. > > On Fri, Jan 4, 2019 at 7:08 PM Pham Vu Tuan <[email protected]> > wrote: > >> Hi, >> >> After checking through Oleg's suggestions, I am thinking we can move it >> forward with 2 projects this year: >> - Project 1: Update Remoting over Kafka to support K8s - Current demo >> setup is using Docker compose, and I think K8s is more popular nowadays, >> maybe we can somehow integrate this. And if this setup is done, maybe auto >> provisioning of Kafka cluster can be more convinient? >> >> - Project 2: Integrating Remoting messaging with Prometheus monitoring - >> By this you mean we will do this for JNLP agents monitoring? To replace the >> traditional monitoring we are having in Jenkins master? I suggest we can >> rename it to "Integrating remoting with monitoring tools", because there >> are many monitoring tools out there (not only Prometheus), and we let the >> student choose one? We can also make the plugin generic such that user can >> integrate Jenkins with any monitoring system of their choice (but Im not >> sure it's doable). >> >> I can be the mentor for Project 1 (because I understand about remoting >> over Kafka), and can help for project 2 with other mentors (I think we need >> to have someone with deep understanding of remoting for this project). >> >> On Fri, Jan 4, 2019 at 8:44 AM Pham Vu Tuan <[email protected]> >> wrote: >> >>> Hi, I am happy to help as a mentor for GSoC this year. I will try to >>> check the details and get back to you about my ideas asap. I will join the >>> GSoC weekly meeting from next week so that we can discuss about this topic. >>> (Sorry for not attending the meeting last month, I was a bit busy + >>> holiday period). >>> >>> On Fri, Jan 4, 2019 at 7:33 AM Jeff Thompson <[email protected]> >>> wrote: >>> >>>> These sound like good projects. It would be nice to get a GSoC project >>>> going in Remoting. Last year’s project was a very good, productive one. >>>> >>>> At this time I don’t know that I can commit to being a primary mentor >>>> but I could help out some. >>>> >>>> Jeff Thompson >>>> >>>> On Jan 3, 2019, at 4:00 AM, Oleg Nenashev <[email protected]> >>>> wrote: >>>> >>>> I have also added the Jenkins Developers mailing list to Cc so that we >>>> can get more inputs and ideas >>>> >>>> On Thu, Jan 3, 2019 at 11:20 AM Oleg Nenashev <[email protected]> >>>> wrote: >>>> >>>>> Hi all, >>>>> >>>>> Just to follow-up on the Remoting topic, it would be great to have a >>>>> GSoC project idea for Remoting this year. You were interested in mentoring >>>>> a project in the area, so it would be great to get your feedback. >>>>> >>>>> One of the ideas I have is to continue improving Remoting over Kafka >>>>> to improve Remoting behavior in Docker and K8s environments. Examples: >>>>> >>>>> - Cloud API implementation for Kafka agents >>>>> - Simplify JAR cache warmup while building agent images >>>>> - Update Remoting over Kafka to improve support of Kubernetes >>>>> there >>>>> - Descriptions >>>>> - Connector logic using credentials from K8s >>>>> - Automatic provisioning of the Kafka cluster from the plugin >>>>> - etc. >>>>> - Create reference K8s specks and Helm charts for Remoting over >>>>> Kafka system >>>>> - Integrate Remoting messaging with Prometheus monitoring >>>>> - ... >>>>> >>>>> WDYT? If you are interested in such idea, we could create a project >>>>> idea draft together. I might not be available to be a mentor this year, >>>>> but >>>>> I will be happy to be a technical advisor in this project. >>>>> >>>>> Best regards, >>>>> Oleg >>>>> >>>>> >>>>> >>>> > > -- > Thank You & Best Regards, > > Supun Wanniarachchi | Software Engineer > > Sysco LABS | 55A Dharmapala Mw, Col. 03 > ( *Mobile*: +94716326119 | Blog: blog.supun.me) > > > [image: Github] <https://github.com/Supun94> [image: LinkedIn] > <https://www.linkedin.com/in/supun-wanniarachchi-21b37a97/> [image: > Twitter] <https://twitter.com/SuuPuuN> > > > -- > You received this message because you are subscribed to the Google Groups > "jenkinsci-gsoc-all-public" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To post to this group, send email to > [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/jenkinsci-gsoc-all-public/CAGUi3yW%2Bw62m5dA5szSiqjmxvTvhQQNgk7nFE2OKk%2BPQMV3K4w%40mail.gmail.com > <https://groups.google.com/d/msgid/jenkinsci-gsoc-all-public/CAGUi3yW%2Bw62m5dA5szSiqjmxvTvhQQNgk7nFE2OKk%2BPQMV3K4w%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > For more options, visit https://groups.google.com/d/optout. > > -- You received this message because you are subscribed to the Google Groups "Jenkins Developers" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-dev/CAPfivLD9BJev6HG44AMObw9h_gOk7Q4WTYb_FxPmkur5w%2Bm-rw%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
