Re: [squid-dev] Want to integrate squid github to Jenkins CI

2020-01-22 Thread Amos Jeffries
On 23/01/20 2:45 am, Justin Michael Schwartzbeck wrote:
> The SHA list sounds great. Thanks for that. I notice that 4.10 is not
> there? Is it not considered "stable" officially?
> 

Ah, seems a small bug in our server scripts. Fixed now.

Amos
___
squid-dev mailing list
squid-dev@lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-dev


Re: [squid-dev] Want to integrate squid github to Jenkins CI

2020-01-22 Thread Alex Rousskov
On 1/21/20 11:30 PM, Justin Michael Schwartzbeck wrote:
> 
> So I guess maybe I need to narrow this down a little bit more. Is there
> some programmatic way that I can get the *latest stable release*
> *version* and *source download link*?

If you want GitHub integration, then you should get all git tags from
the official Squid repository, filter/sort SQUID_X_Y release tags, find
the last tag, and checkout git sources using that tag.

Until the Squid Project starts using GitHub releases, your trigger will
probably have to be any repository modification. Such modifications are
infrequent so the amount of extra tag manipulation work (when the tag of
interest has not changes) will be small.


HTH,

Alex.
___
squid-dev mailing list
squid-dev@lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-dev


Re: [squid-dev] Want to integrate squid github to Jenkins CI

2020-01-22 Thread Justin Michael Schwartzbeck
The SHA list sounds great. Thanks for that. I notice that 4.10 is not
there? Is it not considered "stable" officially?

On Wed, Jan 22, 2020 at 4:50 AM Amos Jeffries  wrote:

> On 22/01/20 5:30 pm, Justin Michael Schwartzbeck wrote:
> > Hi Amos, thanks for replying.
> >
> > So I guess maybe I need to narrow this down a little bit more. Is there
> > some programmatic way that I can get the *latest stable release*
> > *version* and *source download link*?
> > Right now I can do this by navigating to the downloads page:
> > http://www.squid-cache.org/Versions/
> >
> > Scroll to "Stable Versions" under source code packages, and see that
> > 4.10 is the latest, along with a link.
> > I guess I could write a script to parse the HTML on that page and find
> > this information, but that is rather clunky, and if the page format ever
> > changes then my script will be broken. Is there another way that you are
> > aware of?
>
> There are several ways.
>
> 1) You can fetch the FTP directory listing from
> 
>
>
> 2) You can fetch the checksums file from that directory
>  and process it rather
> than the directory listing. This is sometimes easier for HTTP mirrors of
> the FTP service.
>
>
> Those contain only the latest 2 releases from each series. This way you
> can track when we change stable series - though manual review is advised
> at the changeover, so you may want to make that part just a notice for
> attention rather than an auto-build.
>
>
> Any permanent URLs you need linking back to the website for HTTP
> download, docs, or FTP archive (all released tarballs) can be
> synthesized from the version number.
>
>
> Amos
>
___
squid-dev mailing list
squid-dev@lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-dev


Re: [squid-dev] Want to integrate squid github to Jenkins CI

2020-01-22 Thread Amos Jeffries
On 22/01/20 5:30 pm, Justin Michael Schwartzbeck wrote:
> Hi Amos, thanks for replying.
> 
> So I guess maybe I need to narrow this down a little bit more. Is there
> some programmatic way that I can get the *latest stable release*
> *version* and *source download link*?
> Right now I can do this by navigating to the downloads page:
> http://www.squid-cache.org/Versions/
> 
> Scroll to "Stable Versions" under source code packages, and see that
> 4.10 is the latest, along with a link.
> I guess I could write a script to parse the HTML on that page and find
> this information, but that is rather clunky, and if the page format ever
> changes then my script will be broken. Is there another way that you are
> aware of?

There are several ways.

1) You can fetch the FTP directory listing from



2) You can fetch the checksums file from that directory
 and process it rather
than the directory listing. This is sometimes easier for HTTP mirrors of
the FTP service.


Those contain only the latest 2 releases from each series. This way you
can track when we change stable series - though manual review is advised
at the changeover, so you may want to make that part just a notice for
attention rather than an auto-build.


Any permanent URLs you need linking back to the website for HTTP
download, docs, or FTP archive (all released tarballs) can be
synthesized from the version number.


Amos
___
squid-dev mailing list
squid-dev@lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-dev


Re: [squid-dev] Want to integrate squid github to Jenkins CI

2020-01-21 Thread Justin Michael Schwartzbeck
Hi Amos, thanks for replying.

So I guess maybe I need to narrow this down a little bit more. Is there
some programmatic way that I can get the *latest stable release* *version*
and *source download link*?
Right now I can do this by navigating to the downloads page:
http://www.squid-cache.org/Versions/

Scroll to "Stable Versions" under source code packages, and see that 4.10
is the latest, along with a link.
I guess I could write a script to parse the HTML on that page and find this
information, but that is rather clunky, and if the page format ever changes
then my script will be broken. Is there another way that you are aware of?

Thank you for your patience.
-Justin

On Mon, Jan 20, 2020 at 7:22 PM Amos Jeffries  wrote:

> On 21/01/20 12:52 pm, agent_js03 wrote:
> > Hi all,
> >
> > I am putting together a squid + content filter solution using docker and
> > kubernetes.
> > Right now I am setting up a CI system in Jenkins so that when there is a
> new
> > release of squid, it will pull the code, build a new container,and then
> > publish the image to docker hub. So basically I am wanting to know how
> the
> > github works. I only want this for new release versions. For example, the
> > current latest release is 4.10:
> >
> > http://www.squid-cache.org/Versions/
> >
> > So when latest updates again, i.e. to 4.11, what happens on github? Is
> there
> > a latest tag that gets moved? Or does a certain branch get updated or
> > something? Looking for a way to trigger.
>
>
> Releases happen in a separate repository, the changes on the main
> repository appear as regular PRs to the vNN branches. So I do not think
> there is any specific trigger to use unless you are also happy
> rebuilding when backports happen (might be good, but YMMV).
>
> We do tag the release commit with a SQUID_* tag some time shortly after
> the release has actually bundled. So you could do a check for those
> every so often. Releases are intended to take place first weekend of
> each month - though as with this month there can be some delays caused
> by external situations.
>
>
> Amos
> ___
> squid-dev mailing list
> squid-dev@lists.squid-cache.org
> http://lists.squid-cache.org/listinfo/squid-dev
>
___
squid-dev mailing list
squid-dev@lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-dev


Re: [squid-dev] Want to integrate squid github to Jenkins CI

2020-01-20 Thread Amos Jeffries
On 21/01/20 12:52 pm, agent_js03 wrote:
> Hi all,
> 
> I am putting together a squid + content filter solution using docker and
> kubernetes.
> Right now I am setting up a CI system in Jenkins so that when there is a new
> release of squid, it will pull the code, build a new container,and then
> publish the image to docker hub. So basically I am wanting to know how the
> github works. I only want this for new release versions. For example, the
> current latest release is 4.10:
> 
> http://www.squid-cache.org/Versions/
> 
> So when latest updates again, i.e. to 4.11, what happens on github? Is there
> a latest tag that gets moved? Or does a certain branch get updated or
> something? Looking for a way to trigger.


Releases happen in a separate repository, the changes on the main
repository appear as regular PRs to the vNN branches. So I do not think
there is any specific trigger to use unless you are also happy
rebuilding when backports happen (might be good, but YMMV).

We do tag the release commit with a SQUID_* tag some time shortly after
the release has actually bundled. So you could do a check for those
every so often. Releases are intended to take place first weekend of
each month - though as with this month there can be some delays caused
by external situations.


Amos
___
squid-dev mailing list
squid-dev@lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-dev


[squid-dev] Want to integrate squid github to Jenkins CI

2020-01-20 Thread agent_js03
Hi all,

I am putting together a squid + content filter solution using docker and
kubernetes.
Right now I am setting up a CI system in Jenkins so that when there is a new
release of squid, it will pull the code, build a new container,and then
publish the image to docker hub. So basically I am wanting to know how the
github works. I only want this for new release versions. For example, the
current latest release is 4.10:

http://www.squid-cache.org/Versions/

So when latest updates again, i.e. to 4.11, what happens on github? Is there
a latest tag that gets moved? Or does a certain branch get updated or
something? Looking for a way to trigger.

Thanks a bunch,
-Justin



--
Sent from: 
http://squid-web-proxy-cache.1019090.n4.nabble.com/Squid-Development-f1042840.html
___
squid-dev mailing list
squid-dev@lists.squid-cache.org
http://lists.squid-cache.org/listinfo/squid-dev