Re: rewrite CI pipeline
Seems like there are some environmental-related differences. On Thu, 8 Dec 2022 at 18:56, Sai Boorlagadda wrote: > Kirk, > > I updated the github pipeline[1] to run unit tests across multiple JDK > implementations on the different OS to figure out if there are any JDK/OS > differences and seems like there are common tests that fail on > GithubActions. > > Sai > [1] > https://github.com/apache/geode/actions/runs/3519795068/jobs/5900102040 > > On Thu, 8 Dec 2022 at 12:18, Kirk Lund wrote: > >> Hey Sai, >> >> Quick update on this. On my Mac, I'm able to build and run all unit tests >> without any failures using the very latest Oracle Java 8 JDK. I'll try >> OpenJDK and Azul next. >> >> I do have a number of IntegrationTest failures. Most are BindException >> failures because some process is already bound to a port. One or two >> failures appear to be DNS related which may require either editing >> /etc/hosts or changing the test. Will update again after debugging these >> more. >> >> Cheers, >> Kirk >> >> On Fri, Dec 2, 2022 at 12:58 PM Kirk Lund wrote: >> >>> Sai, I'll be able to spend some time this weekend on these failing >>> tests. Hope to have some more news to share soon! >>> >>> -Kirk >>> >>> On Mon, Nov 21, 2022 at 4:35 PM Sai Boorlagadda < >>> sai.boorlaga...@gmail.com> wrote: >>> I was thinking it has to do with either JDK or ubuntu. I also tried 'temurin' and there were different sets of errors. So to see if the devs can shed some light on JDK dependency or any prior knowledge on choosing bellsoft distribution. Sai On Mon, 21 Nov 2022 at 16:25, Kirk Lund wrote: > It's also possible that these issues are specific to using OpenJDK 8 or > Ubuntu. I thought we were building and testing with CentOS before. > > On Mon, Nov 21, 2022 at 4:20 PM Kirk Lund wrote: > > > Looks like membership errors. Membership went through extensive changes > to > > be modularized as geode-membership, and VMware was still fixing some bugs > > in it when I left. These could be really difficult to solve for those of > us > > who have no experience with the new membership. > > > > I wonder if we could engage VMware for a little more help on these > > failures before they depart entirely? > > > > Last I heard there were also problems with using OpenJDK 8 but I don't > > know the details. VMware was using Liberica JDK 8 from Bellsoft. We may > > also need VMware to explain what the issue was with OpenJDK 8 so we can > > figure out what to do about it. > > > > On Mon, Nov 21, 2022 at 3:29 PM Sai Boorlagadda < > sai.boorlaga...@gmail.com> > > wrote: > > > >> Hello devs, > >> > >> I started a parallel activity to tease out CI work on using ASF jenkins > >> and > >> also Github actions (though GHA has several issues). I wanted to provide > >> some updates on these efforts and seek if others are interested to > >> collaborate. > >> > >> Jenkins - Was waiting for INFRA to create a high level folder[1] to host > >> all Geode jobs and have a basic unit test pipeline[2] that runs tests on > >> Ubuntu using Oracle JDK 8. While there are failing tests[3] that need > some > >> help, I am still exploring ways to write pipelines and include multiple > >> JDKs into a single JOB, so we can build using 8 while we test using 11. > >> > >> GHA - While it is super quick and easy to start writing a pipeline[4] > >> using > >> "matrix and strategy", There are few tests[5] failing consistently using > >> Adopt JDK 8 on Ubuntu. > >> > >> [1] https://ci-builds.apache.org/job/Geode/ > >> [2] > >> > >> > https://github.com/apache/geode/blob/4abcdc06af536e1188e0f8c432e9b768c175d8c0/.jenkins/Jenkinsfile > >> [3] https://ci-builds.apache.org/job/Geode/job/geode-develop/11/console > >> [4] https://github.com/apache/geode/pull/7870/files > >> [5] https://github.com/apache/geode/actions/runs/3515795079 > >> > > > >>>
Re: rewrite CI pipeline
Kirk, I updated the github pipeline[1] to run unit tests across multiple JDK implementations on the different OS to figure out if there are any JDK/OS differences and seems like there are common tests that fail on GithubActions. Sai [1] https://github.com/apache/geode/actions/runs/3519795068/jobs/5900102040 On Thu, 8 Dec 2022 at 12:18, Kirk Lund wrote: > Hey Sai, > > Quick update on this. On my Mac, I'm able to build and run all unit tests > without any failures using the very latest Oracle Java 8 JDK. I'll try > OpenJDK and Azul next. > > I do have a number of IntegrationTest failures. Most are BindException > failures because some process is already bound to a port. One or two > failures appear to be DNS related which may require either editing > /etc/hosts or changing the test. Will update again after debugging these > more. > > Cheers, > Kirk > > On Fri, Dec 2, 2022 at 12:58 PM Kirk Lund wrote: > >> Sai, I'll be able to spend some time this weekend on these failing tests. >> Hope to have some more news to share soon! >> >> -Kirk >> >> On Mon, Nov 21, 2022 at 4:35 PM Sai Boorlagadda < >> sai.boorlaga...@gmail.com> wrote: >> >>> I was thinking it has to do with either JDK or ubuntu. I also tried >>> 'temurin' >>> and there were different sets of errors. So to see if the devs can shed >>> some light on JDK dependency or any prior knowledge on choosing >>> bellsoft distribution. >>> >>> Sai >>> >>> On Mon, 21 Nov 2022 at 16:25, Kirk Lund wrote: >>> >>> > It's also possible that these issues are specific to using OpenJDK 8 or >>> > Ubuntu. I thought we were building and testing with CentOS before. >>> > >>> > On Mon, Nov 21, 2022 at 4:20 PM Kirk Lund wrote: >>> > >>> > > Looks like membership errors. Membership went through extensive >>> changes >>> > to >>> > > be modularized as geode-membership, and VMware was still fixing some >>> bugs >>> > > in it when I left. These could be really difficult to solve for >>> those of >>> > us >>> > > who have no experience with the new membership. >>> > > >>> > > I wonder if we could engage VMware for a little more help on these >>> > > failures before they depart entirely? >>> > > >>> > > Last I heard there were also problems with using OpenJDK 8 but I >>> don't >>> > > know the details. VMware was using Liberica JDK 8 from Bellsoft. We >>> may >>> > > also need VMware to explain what the issue was with OpenJDK 8 so we >>> can >>> > > figure out what to do about it. >>> > > >>> > > On Mon, Nov 21, 2022 at 3:29 PM Sai Boorlagadda < >>> > sai.boorlaga...@gmail.com> >>> > > wrote: >>> > > >>> > >> Hello devs, >>> > >> >>> > >> I started a parallel activity to tease out CI work on using ASF >>> jenkins >>> > >> and >>> > >> also Github actions (though GHA has several issues). I wanted to >>> provide >>> > >> some updates on these efforts and seek if others are interested to >>> > >> collaborate. >>> > >> >>> > >> Jenkins - Was waiting for INFRA to create a high level folder[1] to >>> host >>> > >> all Geode jobs and have a basic unit test pipeline[2] that runs >>> tests on >>> > >> Ubuntu using Oracle JDK 8. While there are failing tests[3] that >>> need >>> > some >>> > >> help, I am still exploring ways to write pipelines and include >>> multiple >>> > >> JDKs into a single JOB, so we can build using 8 while we test using >>> 11. >>> > >> >>> > >> GHA - While it is super quick and easy to start writing a >>> pipeline[4] >>> > >> using >>> > >> "matrix and strategy", There are few tests[5] failing consistently >>> using >>> > >> Adopt JDK 8 on Ubuntu. >>> > >> >>> > >> [1] https://ci-builds.apache.org/job/Geode/ >>> > >> [2] >>> > >> >>> > >> >>> > >>> https://github.com/apache/geode/blob/4abcdc06af536e1188e0f8c432e9b768c175d8c0/.jenkins/Jenkinsfile >>> > >> [3] >>> https://ci-builds.apache.org/job/Geode/job/geode-develop/11/console >>> > >> [4] https://github.com/apache/geode/pull/7870/files >>> > >> [5] https://github.com/apache/geode/actions/runs/3515795079 >>> > >> >>> > > >>> > >>> >>
Re: rewrite CI pipeline
Hey Sai, Quick update on this. On my Mac, I'm able to build and run all unit tests without any failures using the very latest Oracle Java 8 JDK. I'll try OpenJDK and Azul next. I do have a number of IntegrationTest failures. Most are BindException failures because some process is already bound to a port. One or two failures appear to be DNS related which may require either editing /etc/hosts or changing the test. Will update again after debugging these more. Cheers, Kirk On Fri, Dec 2, 2022 at 12:58 PM Kirk Lund wrote: > Sai, I'll be able to spend some time this weekend on these failing tests. > Hope to have some more news to share soon! > > -Kirk > > On Mon, Nov 21, 2022 at 4:35 PM Sai Boorlagadda > wrote: > >> I was thinking it has to do with either JDK or ubuntu. I also tried >> 'temurin' >> and there were different sets of errors. So to see if the devs can shed >> some light on JDK dependency or any prior knowledge on choosing >> bellsoft distribution. >> >> Sai >> >> On Mon, 21 Nov 2022 at 16:25, Kirk Lund wrote: >> >> > It's also possible that these issues are specific to using OpenJDK 8 or >> > Ubuntu. I thought we were building and testing with CentOS before. >> > >> > On Mon, Nov 21, 2022 at 4:20 PM Kirk Lund wrote: >> > >> > > Looks like membership errors. Membership went through extensive >> changes >> > to >> > > be modularized as geode-membership, and VMware was still fixing some >> bugs >> > > in it when I left. These could be really difficult to solve for those >> of >> > us >> > > who have no experience with the new membership. >> > > >> > > I wonder if we could engage VMware for a little more help on these >> > > failures before they depart entirely? >> > > >> > > Last I heard there were also problems with using OpenJDK 8 but I don't >> > > know the details. VMware was using Liberica JDK 8 from Bellsoft. We >> may >> > > also need VMware to explain what the issue was with OpenJDK 8 so we >> can >> > > figure out what to do about it. >> > > >> > > On Mon, Nov 21, 2022 at 3:29 PM Sai Boorlagadda < >> > sai.boorlaga...@gmail.com> >> > > wrote: >> > > >> > >> Hello devs, >> > >> >> > >> I started a parallel activity to tease out CI work on using ASF >> jenkins >> > >> and >> > >> also Github actions (though GHA has several issues). I wanted to >> provide >> > >> some updates on these efforts and seek if others are interested to >> > >> collaborate. >> > >> >> > >> Jenkins - Was waiting for INFRA to create a high level folder[1] to >> host >> > >> all Geode jobs and have a basic unit test pipeline[2] that runs >> tests on >> > >> Ubuntu using Oracle JDK 8. While there are failing tests[3] that need >> > some >> > >> help, I am still exploring ways to write pipelines and include >> multiple >> > >> JDKs into a single JOB, so we can build using 8 while we test using >> 11. >> > >> >> > >> GHA - While it is super quick and easy to start writing a pipeline[4] >> > >> using >> > >> "matrix and strategy", There are few tests[5] failing consistently >> using >> > >> Adopt JDK 8 on Ubuntu. >> > >> >> > >> [1] https://ci-builds.apache.org/job/Geode/ >> > >> [2] >> > >> >> > >> >> > >> https://github.com/apache/geode/blob/4abcdc06af536e1188e0f8c432e9b768c175d8c0/.jenkins/Jenkinsfile >> > >> [3] >> https://ci-builds.apache.org/job/Geode/job/geode-develop/11/console >> > >> [4] https://github.com/apache/geode/pull/7870/files >> > >> [5] https://github.com/apache/geode/actions/runs/3515795079 >> > >> >> > > >> > >> >
Re: rewrite CI pipeline
Sai, I'll be able to spend some time this weekend on these failing tests. Hope to have some more news to share soon! -Kirk On Mon, Nov 21, 2022 at 4:35 PM Sai Boorlagadda wrote: > I was thinking it has to do with either JDK or ubuntu. I also tried > 'temurin' > and there were different sets of errors. So to see if the devs can shed > some light on JDK dependency or any prior knowledge on choosing > bellsoft distribution. > > Sai > > On Mon, 21 Nov 2022 at 16:25, Kirk Lund wrote: > > > It's also possible that these issues are specific to using OpenJDK 8 or > > Ubuntu. I thought we were building and testing with CentOS before. > > > > On Mon, Nov 21, 2022 at 4:20 PM Kirk Lund wrote: > > > > > Looks like membership errors. Membership went through extensive changes > > to > > > be modularized as geode-membership, and VMware was still fixing some > bugs > > > in it when I left. These could be really difficult to solve for those > of > > us > > > who have no experience with the new membership. > > > > > > I wonder if we could engage VMware for a little more help on these > > > failures before they depart entirely? > > > > > > Last I heard there were also problems with using OpenJDK 8 but I don't > > > know the details. VMware was using Liberica JDK 8 from Bellsoft. We may > > > also need VMware to explain what the issue was with OpenJDK 8 so we can > > > figure out what to do about it. > > > > > > On Mon, Nov 21, 2022 at 3:29 PM Sai Boorlagadda < > > sai.boorlaga...@gmail.com> > > > wrote: > > > > > >> Hello devs, > > >> > > >> I started a parallel activity to tease out CI work on using ASF > jenkins > > >> and > > >> also Github actions (though GHA has several issues). I wanted to > provide > > >> some updates on these efforts and seek if others are interested to > > >> collaborate. > > >> > > >> Jenkins - Was waiting for INFRA to create a high level folder[1] to > host > > >> all Geode jobs and have a basic unit test pipeline[2] that runs tests > on > > >> Ubuntu using Oracle JDK 8. While there are failing tests[3] that need > > some > > >> help, I am still exploring ways to write pipelines and include > multiple > > >> JDKs into a single JOB, so we can build using 8 while we test using > 11. > > >> > > >> GHA - While it is super quick and easy to start writing a pipeline[4] > > >> using > > >> "matrix and strategy", There are few tests[5] failing consistently > using > > >> Adopt JDK 8 on Ubuntu. > > >> > > >> [1] https://ci-builds.apache.org/job/Geode/ > > >> [2] > > >> > > >> > > > https://github.com/apache/geode/blob/4abcdc06af536e1188e0f8c432e9b768c175d8c0/.jenkins/Jenkinsfile > > >> [3] > https://ci-builds.apache.org/job/Geode/job/geode-develop/11/console > > >> [4] https://github.com/apache/geode/pull/7870/files > > >> [5] https://github.com/apache/geode/actions/runs/3515795079 > > >> > > > > > >
Re: rewrite CI pipeline
I would not expect to see any differences between openjdk distributions. Anthony > On Nov 21, 2022, at 4:34 PM, Sai Boorlagadda > wrote: > > !! External Email > > I was thinking it has to do with either JDK or ubuntu. I also tried > 'temurin' > and there were different sets of errors. So to see if the devs can shed > some light on JDK dependency or any prior knowledge on choosing > bellsoft distribution. > > Sai > > On Mon, 21 Nov 2022 at 16:25, Kirk Lund wrote: > >> It's also possible that these issues are specific to using OpenJDK 8 or >> Ubuntu. I thought we were building and testing with CentOS before. >> >> On Mon, Nov 21, 2022 at 4:20 PM Kirk Lund wrote: >> >>> Looks like membership errors. Membership went through extensive changes >> to >>> be modularized as geode-membership, and VMware was still fixing some bugs >>> in it when I left. These could be really difficult to solve for those of >> us >>> who have no experience with the new membership. >>> >>> I wonder if we could engage VMware for a little more help on these >>> failures before they depart entirely? >>> >>> Last I heard there were also problems with using OpenJDK 8 but I don't >>> know the details. VMware was using Liberica JDK 8 from Bellsoft. We may >>> also need VMware to explain what the issue was with OpenJDK 8 so we can >>> figure out what to do about it. >>> >>> On Mon, Nov 21, 2022 at 3:29 PM Sai Boorlagadda < >> sai.boorlaga...@gmail.com> >>> wrote: >>> Hello devs, I started a parallel activity to tease out CI work on using ASF jenkins and also Github actions (though GHA has several issues). I wanted to provide some updates on these efforts and seek if others are interested to collaborate. Jenkins - Was waiting for INFRA to create a high level folder[1] to host all Geode jobs and have a basic unit test pipeline[2] that runs tests on Ubuntu using Oracle JDK 8. While there are failing tests[3] that need >> some help, I am still exploring ways to write pipelines and include multiple JDKs into a single JOB, so we can build using 8 while we test using 11. GHA - While it is super quick and easy to start writing a pipeline[4] using "matrix and strategy", There are few tests[5] failing consistently using Adopt JDK 8 on Ubuntu. [1] https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fci-builds.apache.org%2Fjob%2FGeode%2Fdata=05%7C01%7Cbakera%40vmware.com%7C313885015e604ec0189c08dacc217432%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C638046741303111474%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7Csdata=BcOk3bhLThh21s0iQAZmes4gab%2B8YpdIlnoVgTIlsb4%3Dreserved=0 [2] >> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fgeode%2Fblob%2F4abcdc06af536e1188e0f8c432e9b768c175d8c0%2F.jenkins%2FJenkinsfiledata=05%7C01%7Cbakera%40vmware.com%7C313885015e604ec0189c08dacc217432%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C638046741303111474%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7Csdata=9UvAI7RIV1caJJz70958WqyHNgkkN%2FMihHqONxUKiiw%3Dreserved=0 [3] https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fci-builds.apache.org%2Fjob%2FGeode%2Fjob%2Fgeode-develop%2F11%2Fconsoledata=05%7C01%7Cbakera%40vmware.com%7C313885015e604ec0189c08dacc217432%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C638046741303111474%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7Csdata=Kk1Nj%2FfusbTjMnBLQdpYoJk1mFSGNv0DaLYTmnrNUQE%3Dreserved=0 [4] https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fgeode%2Fpull%2F7870%2Ffilesdata=05%7C01%7Cbakera%40vmware.com%7C313885015e604ec0189c08dacc217432%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C638046741303267691%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7Csdata=psIl5Jj%2BZHWXfuv1LBj5V5GKbzoy%2FnN9AQFrIjks9Bo%3Dreserved=0 [5] https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fgeode%2Factions%2Fruns%2F3515795079data=05%7C01%7Cbakera%40vmware.com%7C313885015e604ec0189c08dacc217432%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C638046741303267691%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7Csdata=JJXdJ%2BQoGOtTdRw7kl8AoFCrilQ7KtCcXS7E6xUJBfU%3Dreserved=0 >>> >> > > !! External Email: This email originated from outside of the organization. Do > not click links or open attachments unless you recognize the sender.
Re: rewrite CI pipeline
I was thinking it has to do with either JDK or ubuntu. I also tried 'temurin' and there were different sets of errors. So to see if the devs can shed some light on JDK dependency or any prior knowledge on choosing bellsoft distribution. Sai On Mon, 21 Nov 2022 at 16:25, Kirk Lund wrote: > It's also possible that these issues are specific to using OpenJDK 8 or > Ubuntu. I thought we were building and testing with CentOS before. > > On Mon, Nov 21, 2022 at 4:20 PM Kirk Lund wrote: > > > Looks like membership errors. Membership went through extensive changes > to > > be modularized as geode-membership, and VMware was still fixing some bugs > > in it when I left. These could be really difficult to solve for those of > us > > who have no experience with the new membership. > > > > I wonder if we could engage VMware for a little more help on these > > failures before they depart entirely? > > > > Last I heard there were also problems with using OpenJDK 8 but I don't > > know the details. VMware was using Liberica JDK 8 from Bellsoft. We may > > also need VMware to explain what the issue was with OpenJDK 8 so we can > > figure out what to do about it. > > > > On Mon, Nov 21, 2022 at 3:29 PM Sai Boorlagadda < > sai.boorlaga...@gmail.com> > > wrote: > > > >> Hello devs, > >> > >> I started a parallel activity to tease out CI work on using ASF jenkins > >> and > >> also Github actions (though GHA has several issues). I wanted to provide > >> some updates on these efforts and seek if others are interested to > >> collaborate. > >> > >> Jenkins - Was waiting for INFRA to create a high level folder[1] to host > >> all Geode jobs and have a basic unit test pipeline[2] that runs tests on > >> Ubuntu using Oracle JDK 8. While there are failing tests[3] that need > some > >> help, I am still exploring ways to write pipelines and include multiple > >> JDKs into a single JOB, so we can build using 8 while we test using 11. > >> > >> GHA - While it is super quick and easy to start writing a pipeline[4] > >> using > >> "matrix and strategy", There are few tests[5] failing consistently using > >> Adopt JDK 8 on Ubuntu. > >> > >> [1] https://ci-builds.apache.org/job/Geode/ > >> [2] > >> > >> > https://github.com/apache/geode/blob/4abcdc06af536e1188e0f8c432e9b768c175d8c0/.jenkins/Jenkinsfile > >> [3] https://ci-builds.apache.org/job/Geode/job/geode-develop/11/console > >> [4] https://github.com/apache/geode/pull/7870/files > >> [5] https://github.com/apache/geode/actions/runs/3515795079 > >> > > >
Re: rewrite CI pipeline
It's also possible that these issues are specific to using OpenJDK 8 or Ubuntu. I thought we were building and testing with CentOS before. On Mon, Nov 21, 2022 at 4:20 PM Kirk Lund wrote: > Looks like membership errors. Membership went through extensive changes to > be modularized as geode-membership, and VMware was still fixing some bugs > in it when I left. These could be really difficult to solve for those of us > who have no experience with the new membership. > > I wonder if we could engage VMware for a little more help on these > failures before they depart entirely? > > Last I heard there were also problems with using OpenJDK 8 but I don't > know the details. VMware was using Liberica JDK 8 from Bellsoft. We may > also need VMware to explain what the issue was with OpenJDK 8 so we can > figure out what to do about it. > > On Mon, Nov 21, 2022 at 3:29 PM Sai Boorlagadda > wrote: > >> Hello devs, >> >> I started a parallel activity to tease out CI work on using ASF jenkins >> and >> also Github actions (though GHA has several issues). I wanted to provide >> some updates on these efforts and seek if others are interested to >> collaborate. >> >> Jenkins - Was waiting for INFRA to create a high level folder[1] to host >> all Geode jobs and have a basic unit test pipeline[2] that runs tests on >> Ubuntu using Oracle JDK 8. While there are failing tests[3] that need some >> help, I am still exploring ways to write pipelines and include multiple >> JDKs into a single JOB, so we can build using 8 while we test using 11. >> >> GHA - While it is super quick and easy to start writing a pipeline[4] >> using >> "matrix and strategy", There are few tests[5] failing consistently using >> Adopt JDK 8 on Ubuntu. >> >> [1] https://ci-builds.apache.org/job/Geode/ >> [2] >> >> https://github.com/apache/geode/blob/4abcdc06af536e1188e0f8c432e9b768c175d8c0/.jenkins/Jenkinsfile >> [3] https://ci-builds.apache.org/job/Geode/job/geode-develop/11/console >> [4] https://github.com/apache/geode/pull/7870/files >> [5] https://github.com/apache/geode/actions/runs/3515795079 >> >
Re: rewrite CI pipeline
Looks like membership errors. Membership went through extensive changes to be modularized as geode-membership, and VMware was still fixing some bugs in it when I left. These could be really difficult to solve for those of us who have no experience with the new membership. I wonder if we could engage VMware for a little more help on these failures before they depart entirely? Last I heard there were also problems with using OpenJDK 8 but I don't know the details. VMware was using Liberica JDK 8 from Bellsoft. We may also need VMware to explain what the issue was with OpenJDK 8 so we can figure out what to do about it. On Mon, Nov 21, 2022 at 3:29 PM Sai Boorlagadda wrote: > Hello devs, > > I started a parallel activity to tease out CI work on using ASF jenkins and > also Github actions (though GHA has several issues). I wanted to provide > some updates on these efforts and seek if others are interested to > collaborate. > > Jenkins - Was waiting for INFRA to create a high level folder[1] to host > all Geode jobs and have a basic unit test pipeline[2] that runs tests on > Ubuntu using Oracle JDK 8. While there are failing tests[3] that need some > help, I am still exploring ways to write pipelines and include multiple > JDKs into a single JOB, so we can build using 8 while we test using 11. > > GHA - While it is super quick and easy to start writing a pipeline[4] using > "matrix and strategy", There are few tests[5] failing consistently using > Adopt JDK 8 on Ubuntu. > > [1] https://ci-builds.apache.org/job/Geode/ > [2] > > https://github.com/apache/geode/blob/4abcdc06af536e1188e0f8c432e9b768c175d8c0/.jenkins/Jenkinsfile > [3] https://ci-builds.apache.org/job/Geode/job/geode-develop/11/console > [4] https://github.com/apache/geode/pull/7870/files > [5] https://github.com/apache/geode/actions/runs/3515795079 >
rewrite CI pipeline
Hello devs, I started a parallel activity to tease out CI work on using ASF jenkins and also Github actions (though GHA has several issues). I wanted to provide some updates on these efforts and seek if others are interested to collaborate. Jenkins - Was waiting for INFRA to create a high level folder[1] to host all Geode jobs and have a basic unit test pipeline[2] that runs tests on Ubuntu using Oracle JDK 8. While there are failing tests[3] that need some help, I am still exploring ways to write pipelines and include multiple JDKs into a single JOB, so we can build using 8 while we test using 11. GHA - While it is super quick and easy to start writing a pipeline[4] using "matrix and strategy", There are few tests[5] failing consistently using Adopt JDK 8 on Ubuntu. [1] https://ci-builds.apache.org/job/Geode/ [2] https://github.com/apache/geode/blob/4abcdc06af536e1188e0f8c432e9b768c175d8c0/.jenkins/Jenkinsfile [3] https://ci-builds.apache.org/job/Geode/job/geode-develop/11/console [4] https://github.com/apache/geode/pull/7870/files [5] https://github.com/apache/geode/actions/runs/3515795079
