Aha, thanks - I see what you mean now! From: Matthew Benedict de Detrich <[email protected]> Sent: Tuesday, January 24, 2023 3:21 PM To: [email protected] Subject: Re: Process for snapshots and nightlies
> If using Maven, do we still need to control the number of snapshots? There is an already existing job in Nexus which automates this for all Apache projects with the configuration that I mentioned earlier. On Tue, Jan 24, 2023 at 4:18 PM Keith Wansbrough <[email protected]<mailto:[email protected]>> wrote: I agree, let's put snapshots in Maven rather than Nexus. Thanks for the detailed analysis. If using Maven, do we still need to control the number of snapshots? Doing snapshots on a per-merged-PR basis rather than nightly makes a lot of sense, both for the reasons you state (most nightlies would be identical just now!) and because it would deliver a snapshot sooner when there is a change. Of course we should still run tests nightly, to catch any regressions in dependencies etc. Cheers, --KW 8-) -----Original Message----- From: PJ Fanning <[email protected]<mailto:[email protected]>> Sent: Tuesday, January 24, 2023 1:41 PM To: [email protected]<mailto:[email protected]> Cc: [email protected]<mailto:[email protected]> Subject: Re: Process for snapshots and nightlies Since maven snapshots appear to be the norm - my view is that if we can get the maven snapshot working then we can switch off the nightlies (after we see the snapshots are publishing ok). On Tue, 24 Jan 2023 at 13:22, Matthew Benedict de Detrich <[email protected]<mailto:[email protected]>.invalid> wrote: > > As a result of the ongoing work that's been happening to get Pekko > ready for release, more concretely > https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgith<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgith%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884428450%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=QP65FTIdi1yjb4SEq9%2BK4Iu2isZGNSiqOQ6775O48sw%3D&reserved=0> > ub.com<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fub.com%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884428450%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=DKaAbpiW4fLkSBsDiYsAWmP3foqOWDnxlQq77%2BoR39Y%3D&reserved=0>%2Fapache%2Fincubator-pekko%2Fpull%2F105%23discussion_r107191293 > 8&data=05%7C01%7Ckeith.wansbrough%40microsoft.com<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2F40microsoft.com%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884428450%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=uDaSO6e9joUMpG6xSPZbhITD1tVX%2FB7AxUra5Vfxldw%3D&reserved=0>%7C5fc708f926284ce5593d08dafe10bbcd%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101645113113343%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=MlgROoPKh9o0KVldS9rsHYIDaDJgjg1fXqODfuvquAY%3D&reserved=0 > I came to the conclusion that I think its a smart idea to clarify what our > process is going to be in regards to snapshots/nightlies. > > The current state of affairs is that we have a nightly job which > manually packages Pekko and then pushes the jar to the Apache > nightlies repository ( > https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fnigh<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fnigh%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884428450%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=te9KMyZddBTT0O5ZmfaevdICwVk6g446fFOjZlSeVXI%3D&reserved=0> > tlies.apache.org<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Ftlies.apache.org%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884584668%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=1UGYxWPWwGOCllqCVYEcVTpZRCqAebzDDVPv%2F6zrDiQ%3D&reserved=0>%2Fpekko%2F&data=05%7C01%7Ckeith.wansbrough%40microsof > t.com<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Ft.com%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884584668%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=mcvAPJKK5Hvqj%2Btadiul7Kc1XLTPdqPJY4wB8oEveqk%3D&reserved=0>%7C5fc708f926284ce5593d08dafe10bbcd%7C72f988bf86f141af91ab2d7cd01 > 1db47%7C1%7C0%7C638101645113113343%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4 > wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7 > C&sdata=qLuz83av%2FK84wZd4DF7BbbVNaMcsIgxb0y9p0ebj5EM%3D&reserved=0) > via rsync, see > https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgith<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgith%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884584668%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=7fUEccieWJqRtcPZp4eHc6yR8AxAMqJy7SqRrS5ouf0%3D&reserved=0> > ub.com<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fub.com%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884584668%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=V9ZAynvlQfU2Vb3DuSP0O3p2h9OF9J%2F8YDI%2FNwIyLC4%3D&reserved=0>%2Fapache%2Fincubator-pekko%2Fblob%2Fmain%2F.github%2Factions%2F > sync-nightlies%2Faction.yml&data=05%7C01%7Ckeith.wansbrough%40microsof > t.com<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Ft.com%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884584668%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=mcvAPJKK5Hvqj%2Btadiul7Kc1XLTPdqPJY4wB8oEveqk%3D&reserved=0>%7C5fc708f926284ce5593d08dafe10bbcd%7C72f988bf86f141af91ab2d7cd01 > 1db47%7C1%7C0%7C638101645113113343%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4 > wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7 > C&sdata=XV9v3OgmtfYswuagSWmhj8jFBVxA%2FbPeI79X01BuzOM%3D&reserved=0 > and > https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgith<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgith%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884584668%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=7fUEccieWJqRtcPZp4eHc6yR8AxAMqJy7SqRrS5ouf0%3D&reserved=0> > ub.com<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fub.com%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884584668%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=V9ZAynvlQfU2Vb3DuSP0O3p2h9OF9J%2F8YDI%2FNwIyLC4%3D&reserved=0>%2Fapache%2Fincubator-pekko%2Fblob%2Fmain%2F.github%2Fworkflows% > 2Fnightly-builds.yml&data=05%7C01%7Ckeith.wansbrough%40microsoft.com<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2F40microsoft.com%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884584668%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=5g8rhx0WhOhaFIaH24RezMqE%2FW7etFTtwlPLo%2Bbm%2Fv4%3D&reserved=0>%7 > C5fc708f926284ce5593d08dafe10bbcd%7C72f988bf86f141af91ab2d7cd011db47%7 > C1%7C0%7C638101645113113343%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMD > AiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata > =EFguvIuKu%2Fa7dWLbsoAcJn11QneGzXNjyRW3dq9StWM%3D&reserved=0 > for more details. > > While it's fantastic that we have a nightly system setup (especially > since it unblocks other Pekko modules from being able to update the > package to > org.apache.pekko) the current implementation of it raises a couple of > questions. The first more technical one is that we are using the > nightlies directory as a pseudo maven repository even though Apache > has its own Nexus repo that supports snapshots (see > https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Finfr<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Finfr%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884584668%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=fO%2Bw5S0WtHC5iogYJZy7JSMvrJlv8jkMvuFkDy%2FXC5c%3D&reserved=0> > a.apache.org<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fa.apache.org%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884584668%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=%2BQZ1KAcatdAAvA5E9FmId58hqcRnAX7ibUKaW%2FbZkLc%3D&reserved=0>%2Fpublishing-maven-artifacts.html&data=05%7C01%7Ckeith.wa > nsbrough%40microsoft.com<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2F40microsoft.com%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884584668%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=5g8rhx0WhOhaFIaH24RezMqE%2FW7etFTtwlPLo%2Bbm%2Fv4%3D&reserved=0>%7C5fc708f926284ce5593d08dafe10bbcd%7C72f988bf > 86f141af91ab2d7cd011db47%7C1%7C0%7C638101645113113343%7CUnknown%7CTWFp > bGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn > 0%3D%7C3000%7C%7C%7C&sdata=%2Fvfw6niA0D0sH39B8mQisfD3NYphl%2BoQFnK4vY% > 2BzkuI%3D&reserved=0 and > https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepo<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepo%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884584668%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Ck2qdhMmz5qDs2AfnVQwuLxHS5zOKf5e97CnvdGG0JY%3D&reserved=0> > sitory.apache.org<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fsitory.apache.org%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884584668%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=AhSTIqBNOQpOM%2BrijR6edG4v1ktILzWTPbbH4ibC0XY%3D&reserved=0>%2Fcontent%2Fgroups%2Fsnapshots%2F&data=05%7C01%7Ckei > th.wansbrough%40microsoft.com<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2F40microsoft.com%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884740897%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=WMB6VKgF20F25k6XwumldyN270xrHz%2BkWypuOGHzF4M%3D&reserved=0>%7C5fc708f926284ce5593d08dafe10bbcd%7C72f > 988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101645113113343%7CUnknown%7 > CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXV > CI6Mn0%3D%7C3000%7C%7C%7C&sdata=82xrBQWLHnwDYAcnPIOa6QH2%2FV9isqCBFR38 > 9QzlPqA%3D&reserved=0). In fact, after manually checking each Apache > project directory in the nightlies directories at > https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fnigh<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fnigh%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884740897%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=HsoIFmoJmbW6uCT8IG%2FScmlyCtfxVlYbfNvEFfd0O0w%3D&reserved=0> > tlies.apache.org<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Ftlies.apache.org%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884740897%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Sx%2BLEg%2F2qFuxCf3ywFxuGcIK5x6MTERXCzMlzE%2FJlZs%3D&reserved=0>%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2F40microsoft.com%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884740897%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=WMB6VKgF20F25k6XwumldyN270xrHz%2BkWypuOGHzF4M%3D&reserved=0>%7C > 5fc708f926284ce5593d08dafe10bbcd%7C72f988bf86f141af91ab2d7cd011db47%7C > 1%7C0%7C638101645113113343%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDA > iLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata= > %2F1tzQycyROl8Mg0Nl0gJxJw0MhBBDX72pJCsiieKrWE%3D&reserved=0 there is > no single other project that is publishing library jars here. The > content that appears to be published there roughly falls under one of > the following > > > * Build results, either executables, fatjars or some other output of a > build > > * Documentation > > * Microsite > > > This means from what I can tell, as of now we are the only project > that is publishing snapshots this way. I asked some various related > questions in the #asfinfra slack channel and they also said that any > kind of JVM snapshot/nightlies should be published to the maven repo, > not the nightlies directory (see > https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fthe-<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fthe-%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884740897%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=%2BhlwTLR1asUFgNfC4MIfhbrS5dKX1mwRUxyTYSVG%2Ffw%3D&reserved=0> > asf.slack.com<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fasf.slack.com%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884740897%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=bBOYl59fju0d6aCNC4NlBRw7%2BpAwM7OWxjyPhDXO6PI%3D&reserved=0>%2Farchives%2FCBX4TSBQ8%2Fp1674497939153149&data=05%7C01% > 7Ckeith.wansbrough%40microsoft.com<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2F40microsoft.com%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884740897%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=WMB6VKgF20F25k6XwumldyN270xrHz%2BkWypuOGHzF4M%3D&reserved=0>%7C5fc708f926284ce5593d08dafe10bbcd% > 7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101645113113343%7CUnkn > own%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwi > LCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=d0A25pkoFSu9k6b1ONE8BFw0%2Fow3MhK > %2BFvP7MMOSF08%3D&reserved=0 for thread trail). The only other > critical point here is regarding snapshot expiry (current nightlies > setup has a 30 day expiry) but they also confirmed that there already > exists a job on the Apache Nexus repo which performs snapshot expiry > with the following relevant settings > > > * Minimum snapshot count: 2 > > * Snapshot retention (days): 2 > > * Recurrence: Weekly > > > The main thing that was also mentioned in that Slack channel was when > using the Apache snapshot Nexus repo we should keep snapshots to > minimum required which then leads to the second point of how we should > handle snapshot creation that is useful/brings value (note that to me > snapshots are analogous to nightlies, it's just the latter describes a > specific way of creating snapshots). Since Pekko (and its related > modules) is a JVM library, not a > package/application/executable/database I think that nightly snapshot > creation is excessive. Nightlies make sense for projects that need to > be run because often the process of packaging/building it is > non-trivial and a large portion of users are not developers. On the > other hand with Pekko being a library, almost all of our users are > developers which use Pekko by adding it as a dependency to their build tool > (maven, gradle, sbt etc etc). > > Due to this, one of the main problems that nightlies are solving (i.e. > testing a change which hasn't been released yet) can be trivially done > by just pointing a checked out Pekko git repo to a specific point in > time and doing publishLocal which publishes the entire Pekko modules > to local ivy repo which can then be picked up by other JVM build tools > on that local machine (note that publishLocal was also added to the > useful sbt commands, see > https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgith<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgith%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884740897%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=jP4iPybBsRmOFlkWJBXJS45uFCHtxWroe4ASkOSLjR8%3D&reserved=0> > ub.com<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fub.com%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884740897%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=aihB2erTRLkcSFvea%2BhAOwdcs4z6J0Bj%2FWSphMw2HUA%3D&reserved=0>%2Fapache%2Fincubator-pekko%2Fpull%2F83&data=05%7C01%7Ckeith.wan > sbrough%40microsoft.com<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2F40microsoft.com%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884740897%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=WMB6VKgF20F25k6XwumldyN270xrHz%2BkWypuOGHzF4M%3D&reserved=0>%7C5fc708f926284ce5593d08dafe10bbcd%7C72f988bf8 > 6f141af91ab2d7cd011db47%7C1%7C0%7C638101645113113343%7CUnknown%7CTWFpb > GZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0 > %3D%7C3000%7C%7C%7C&sdata=YHT9o%2B22u3wyKn%2B%2FgKMvZzI8M2z9IIp2FdRuZo > mNarI%3D&reserved=0). The other typical use case that needs to be > handled is when someone needs to test a specific version/revision of > Pekko with a feature in a pre-production/production setting (i.e. not > a local machine) to see if its working as intended, snapshots in a > remote repository are helpful here. Snapshots are also handy when > having to deal with Pekko modules that require Pekko (some Pekko > modules such as pekko-http happen to have custom sbt code to lookup > the latest snapshot, see > https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgith<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgith%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884740897%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=jP4iPybBsRmOFlkWJBXJS45uFCHtxWroe4ASkOSLjR8%3D&reserved=0> > ub.com<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fub.com%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884740897%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=aihB2erTRLkcSFvea%2BhAOwdcs4z6J0Bj%2FWSphMw2HUA%3D&reserved=0>%2Fapache%2Fincubator-pekko-http%2Fblob%2Fmain%2Fproject%2FAkkaD > ependency.scala&data=05%7C01%7Ckeith.wansbrough%40microsoft.com<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2F40microsoft.com%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884740897%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=WMB6VKgF20F25k6XwumldyN270xrHz%2BkWypuOGHzF4M%3D&reserved=0>%7C5fc7 > 08f926284ce5593d08dafe10bbcd%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C > 0%7C638101645113113343%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJ > QIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=%2Fw > d0h7KzDMj8qaYQ%2B1GziIS0PFnxy76ryR9DGfjn4fw%3D&reserved=0 > and > https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgith<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgith%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884740897%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=jP4iPybBsRmOFlkWJBXJS45uFCHtxWroe4ASkOSLjR8%3D&reserved=0> > ub.com<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fub.com%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884740897%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=aihB2erTRLkcSFvea%2BhAOwdcs4z6J0Bj%2FWSphMw2HUA%3D&reserved=0>%2Fapache%2Fincubator-pekko-http%2Fblob%2Fmain%2Fproject%2FVersi > onGenerator.scala&data=05%7C01%7Ckeith.wansbrough%40microsoft.com<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2F40microsoft.com%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884740897%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=WMB6VKgF20F25k6XwumldyN270xrHz%2BkWypuOGHzF4M%3D&reserved=0>%7C5f > c708f926284ce5593d08dafe10bbcd%7C72f988bf86f141af91ab2d7cd011db47%7C1% > 7C0%7C638101645113113343%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiL > CJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=1s > D7BN5wjXaXMZ6x1NocUESJvUcJ9o%2B1de%2FTy%2FsXbaQ%3D&reserved=0, > although modifying that custom snapshot lookup code to also check > local ivy repositories also seems sensible). > > Given this, what to me personally makes sense is that snapshots should > be published when a PR is merged to main, at least for now since we > don't have that many PR's being merged, the amount of snapshots being > created is likely going to be less than nightly (on average) which > should satisfy the "minimum necessary". However I am perfectly happy > with keeping the current nightly build because there are other > considerations as well(i.e. should we deploy a snapshot only when a > nightly build + test runs?) and in the future when Pekko picks up steam this > can change. > > > On a similar note, a proposed ideal nice to have in the future would > be to implement a GitHub bot where a maintainer can trigger the bot > via a GitHub comment on a PR to trigger a snapshot of that specific PR > before it gets merged, this can then handle the use case of "I want to > test these changes on actual use case scenario before merging the PR". > Since Pekko build currently distinguishes between clean and unclean > artifacts via a timestamp (see > https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgith<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgith%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884740897%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=jP4iPybBsRmOFlkWJBXJS45uFCHtxWroe4ASkOSLjR8%3D&reserved=0> > ub.com<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fub.com%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884740897%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=aihB2erTRLkcSFvea%2BhAOwdcs4z6J0Bj%2FWSphMw2HUA%3D&reserved=0>%2Fapache%2Fincubator-pekko%2Fpull%2F125&data=05%7C01%7Ckeith.wa > nsbrough%40microsoft.com<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2F40microsoft.com%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884740897%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=WMB6VKgF20F25k6XwumldyN270xrHz%2BkWypuOGHzF4M%3D&reserved=0>%7C5fc708f926284ce5593d08dafe10bbcd%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101645113113343%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=KwXIqCcMKyp%2FR%2BxTp1MyGbwZvnW4Gu6zhJwJx6BYQVM%3D&reserved=0 > for a recent PR that fixes this) this also means that we can also separate > snapshots generated from PR's from snapshots generated by the main job > (whether that be nightly or after merge into main). > > What are everyones thoughts on this? > > -- > > Matthew de Detrich > > *Aiven Deutschland GmbH* > > Immanuelkirchstraße 26, 10405 Berlin > > Amtsgericht Charlottenburg, HRB 209739 B > > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen > > *m:* +491603708037 > > *w:* > aiven.io<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Faiven.io%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884897118%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=WoT73jmrWClF7rWL78N%2Fd4D6JMfa%2BsnfVsTO4a0RKXw%3D&reserved=0> > *e:* [email protected]<mailto:[email protected]> --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected]<mailto:[email protected]> For additional commands, e-mail: [email protected]<mailto:[email protected]> --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected]<mailto:[email protected]> For additional commands, e-mail: [email protected]<mailto:[email protected]> -- Matthew de Detrich Aiven Deutschland GmbH Immanuelkirchstraße 26, 10405 Berlin Amtsgericht Charlottenburg, HRB 209739 B Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen m: +491603708037 w: aiven.io<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Faiven.io%2F&data=05%7C01%7Ckeith.wansbrough%40microsoft.com%7C63133f336219439d40f108dafe1ea6c1%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638101704884897118%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=WoT73jmrWClF7rWL78N%2Fd4D6JMfa%2BsnfVsTO4a0RKXw%3D&reserved=0> e: [email protected]<mailto:[email protected]>
