Re: pike docker images

[Kevin Morgan]

Oh nice, I didn’t realize - I live in Vallastaden Linköping

Sent from my iPhone

> On 14 Feb 2024, at 19:14, Henrik Grubbstr*m (Lysator) @ Pike (-) developers 
> forum <10...@lyskom.lysator.liu.se> wrote:
> 
> 
>> 
>> Hi.
>> 
>> At Pike Conference 2017 it was decided that we ought to hold a
>> more informal meeting in Linköping ~ once every quarter. As the
>> 3 month mark from the latest conference is coming up soon,
>> it seems time to announce the first such meeting for 2024:
>> 
>>Pike Meet-up 2024-Q1
>>Date: 2024-02-17 (Sat)
>>Time: 10:00 - afternoon/evening
>>Place: Roxen IS AB
>   Storgatan 46
>>   Linköping
> 
> A reminder that the above is coming up in a few days.
> 
>/grubba

Re: pike docker images

[Henrik Grubbstr�m (Lysator) @ Pike (-) developers forum]

> Hi.
> 
> At Pike Conference 2017 it was decided that we ought to hold a
> more informal meeting in Linköping ~ once every quarter. As the
> 3 month mark from the latest conference is coming up soon,
> it seems time to announce the first such meeting for 2024:
> 
>   Pike Meet-up 2024-Q1
>   Date: 2024-02-17 (Sat)
>   Time: 10:00 - afternoon/evening
>   Place: Roxen IS AB
   Storgatan 46
>  Linköping

A reminder that the above is coming up in a few days.

/grubba

Re: pike docker images

[Henrik Grubbstr�m (Lysator) @ Pike (-) developers forum]

>>  Place: Roxen IS AB
>> S:t Larsgatan 22A
>
> I expect you mean Storgatan 46?

Right...

Re: pike docker images

[Marcus Comstedt (ACROSS) (Hail Ilpalazzo!) @ Pike (-) developers forum]

>   Place: Roxen IS AB
>  S:t Larsgatan 22A

I expect you mean Storgatan 46?

Re: pike docker images

[Henrik Grubbstr�m (Lysator) @ Pike (-) developers forum]

Hi.

At Pike Conference 2017 it was decided that we ought to hold a
more informal meeting in Linköping ~ once every quarter. As the
3 month mark from the latest conference is coming up soon,
it seems time to announce the first such meeting for 2024:

Pike Meet-up 2024-Q1
Date: 2024-02-17 (Sat)
Time: 10:00 - afternoon/evening
Place: Roxen IS AB
   S:t Larsgatan 22A
   Linköping

Welcome!

/grubba

Re: pike docker images

[Bertrand Lupart]

Hello,


> Ok, I think I have figured this out now.  You don't need to modify
> buildx itself, but if your docker host is not ppc64 you need to run
> this command line first:
> 
>  docker run --rm --privileged aptman/qus -s -- -p ppc64
> 
> Then you can make linux/ppc64 images with buildx (tested on arm64).

Seems like to work well, ppc64 image built and pushed.

Still have to figure how to share tags with other platforms, though.

Thanx !


Bertrand

Re: pike docker images

[Marcus Comstedt (ACROSS) (Hail Ilpalazzo!) @ Pike (-) developers forum]

Ok, I think I have figured this out now.  You don't need to modify
buildx itself, but if your docker host is not ppc64 you need to run
this command line first:

  docker run --rm --privileged aptman/qus -s -- -p ppc64

Then you can make linux/ppc64 images with buildx (tested on arm64).
Note that Pike 8.0.1116 is no longer available in sid, but 8.0.1738 is
there.

Re: pike docker images

[Martin Nilsson (Coppermist) @ Pike (-) developers forum]

Jag tror md5sum används i många processer som backup och
filöverföring. Jag har redan nämnt Amazon S3.

Re: pike docker images

[Bertrand Lupart]

Hello folks,


> On 4 Aug 2022, at 20:41, H William Welliver  wrote:
> 
> A quick update:
> 
> I’ve created a new docker organization called “pikelang”, to match the GitHub 
> organization. I’ve also put a request in to have it made an “OSS” 
> organization, which I hope will be approved and which should allow for a 
> larger number of members (the current limit is 3.)  
> 
> I’ll post an update here when there’s something to actually see. Until then, 
> please feel free to reply back with comments and suggestions.


Pike container images are now available at pikelang Dockerhub repo :

https://hub.docker.com/repository/docker/pikelang/pike/tags


Those are built using Debian and Alpine (for the -slim flavors) packages.

Feel free to play a bit with them. As always, comments and suggestions are 
welcome.

Re: pike docker images

[Marcus Comstedt (ACROSS) (Hail Ilpalazzo!) @ Pike (-) developers forum]

Yup, no problem at all.

https://hub.docker.com/r/zeldin/pike/tags

Re: pike docker images

[Bertrand Lupart]

> On 5 Aug 2022, at 16:38, Marcus Comstedt (ACROSS) (Hail Ilpalazzo!) @ Pike 
> (-) developers forum <10...@lyskom.lysator.liu.se> wrote:
> 
>> No luck with linux/ppc64 yet, need to have a closer look.
> 
> I got buildx running, and AFAICT this seems to be an omission in the
> moby/buildkit image that buildx is using.
> 
> ppc64 is missing in the lists here:
> 
> https://github.com/moby/buildkit/blob/master/util/archutil/Dockerfile
> 
> I'll see if I can patch it and make an updated buildkit image.


Could you build this image without buildx on a linux/ppc64 machine ?

https://github.com/bertrand-lupart/docker-pike/blob/993c96cf0a93719f9ed919af96ad900d99c498ac/docker/8.0.1116-ppc64/Dockerfile
 

Re: pike docker images

[Bertrand Lupart]

>> No luck with linux/ppc64 yet, need to have a closer look.
> 
> I got buildx running, and AFAICT this seems to be an omission in the
> moby/buildkit image that buildx is using.
> 
> ppc64 is missing in the lists here:
> 
> https://github.com/moby/buildkit/blob/master/util/archutil/Dockerfile
> 
> I'll see if I can patch it and make an updated buildkit image.

That’s where I’m stuck. My buildx v0.8.2 seems not to support linux/ppc64 :

$ docker build ls
[…] linux/amd64, linux/amd64/v2, linux/amd64/v3, linux/arm64, linux/riscv64, 
linux/ppc64le, linux/s390x, linux/386, linux/mips64le, linux/mips64, 
linux/arm/v7, linux/arm/v6

Re: pike docker images

[Marcus Comstedt (ACROSS) (Hail Ilpalazzo!) @ Pike (-) developers forum]

>No luck with linux/ppc64 yet, need to have a closer look.

I got buildx running, and AFAICT this seems to be an omission in the
moby/buildkit image that buildx is using.

ppc64 is missing in the lists here:

https://github.com/moby/buildkit/blob/master/util/archutil/Dockerfile

I'll see if I can patch it and make an updated buildkit image.

Re: pike docker images

[Marcus Comstedt (ACROSS) (Hail Ilpalazzo!) @ Pike (-) developers forum]

New kernel in place.  The image does work.

--8<--
vanadis:~% uname -a
Linux vanadis 5.15.55-gentoo #2 SMP Fri Aug 5 05:35:35 CEST 2022 riscv64 
GNU/Linux
vanadis:~% docker run -it --rm --user pike 
bertrandlupart/pike:8.0.1116-unofficial pike
Unable to find image 'bertrandlupart/pike:8.0.1116-unofficial' locally
8.0.1116-unofficial: Pulling from bertrandlupart/pike
a436e5274dc3: Pull complete 
75bdc1ea0c01: Pull complete 
9c69ab496924: Pull complete 
41a6657d58fb: Pull complete 
Digest: sha256:036a319f7132c6a65f94f898ea927dbb651c51d01707d0a8994140c25dc0e2de
Status: Downloaded newer image for bertrandlupart/pike:8.0.1116-unofficial
Pike v8.0 release 1116 running Hilfe v3.5 (Incremental Pike Frontend)
> 
--8<--

Re: pike docker images

[Marcus Comstedt (ACROSS) (Hail Ilpalazzo!) @ Pike (-) developers forum]

Docker built fine, but it looks like I'm missing some kernel modules
(like OVERLAY_FS) needed to start dockerd.  I'll get back after I
rebuild the kernel...

Re: pike docker images

[H William Welliver]

A quick update:

I’ve created a new docker organization called “pikelang”, to match the GitHub 
organization. I’ve also put a request in to have it made an “OSS” organization, 
which I hope will be approved and which should allow for a larger number of 
members (the current limit is 3.)  

I’ll post an update here when there’s something to actually see. Until then, 
please feel free to reply back with comments and suggestions.

Bill

Re: pike docker images

[Marcus Comstedt (ACROSS) (Hail Ilpalazzo!) @ Pike (-) developers forum]

I'm trying to build docker on my riscv hardware now.  We'll see
when/if it completes.  :-)

Re: pike docker images

[Bertrand Lupart]

> You can use use base containers I built if you want:
> 
> https://hub.docker.com/r/zeldin/debian/tags
> 
> They are built using debuerreotype, so they should be identical to
> Debian built ones.  There's also another guy making base containers
> for ppc64 and some other arches (including 32-bit ppc):
> 
> https://hub.docker.com/r/paleozogt/debian/tags
> 
> but those are a little old.

Got a linux/riscv64 container image built. Do you have any way to test it ?

https://hub.docker.com/layers/pike/bertrandlupart/pike/8.0.1116-unofficial/images/sha256-036a319f7132c6a65f94f898ea927dbb651c51d01707d0a8994140c25dc0e2de?context=repo

No luck with linux/ppc64 yet, need to have a closer look.

Re: pike docker images

[Marcus Comstedt (ACROSS) (Hail Ilpalazzo!) @ Pike (-) developers forum]

You can use use base containers I built if you want:

https://hub.docker.com/r/zeldin/debian/tags

They are built using debuerreotype, so they should be identical to
Debian built ones.  There's also another guy making base containers
for ppc64 and some other arches (including 32-bit ppc):

https://hub.docker.com/r/paleozogt/debian/tags

but those are a little old.

Re: pike docker images

[Bertrand Lupart]

Debian is offering ppc64le and riscv64 base container images, but not ppc64 :

https://hub.docker.com/_/debian 

I thought ppc64le would fit any 64 bit POWER machine ?

Anyhow, I used Debian packages as convenience to get fast results. Many other 
solutions could be used in the long run.

Re: pike docker images

[Bertrand Lupart]

> Btw, pike packages are indeed available for Debian/riscv64:
> https://packages.debian.org/sid/pike8.0-core

Yeah, just figured that, along with ppc64 and other oddities :)

Thanx

Re: pike docker images

[Bertrand Lupart]

>> Looks like your local install is missing the buildx Docker plugin. It’s 
>> used by the script to build multi-arch container images.
>> 
>> https://docs.docker.com/build/buildx/
> 
> Well, the documentation you pointed to says
> 
> | Docker Buildx is included in Docker Desktop for Windows, macOS, and
> | Linux.
> 
> and I do have Docker Desktop for macOS installed...
> 
> But I guess I can try the separate download later.

You should need to set buildx as the default builder :
$ docker buildx install

See the last section of :
https://docs.docker.com/build/buildx/install/


>> From your PPC64 machine, you should be able to run the container without 
>> building it :
>> $ docker run -it --rm --user pike bertrandlupart/pike:stable-latest pike
> 
> Eh, no, because you are not building any.
> 
> ---8<---
> hakua:~% docker run -it --rm --user pike bertrandlupart/pike:stable-latest 
> pike
> Unable to find image 'bertrandlupart/pike:stable-latest' locally
> stable-latest: Pulling from bertrandlupart/pike
> docker: no matching manifest for linux/ppc64 in the manifest list entries.
> See 'docker run --help'.
> hakua:~%
> ---8<---
> 
> You build them for linux/386, linux/amd64, linux/arm/v7, linux/arm64,
> linux/mips64le, linux/ppc64le, and linux/s390x, but not linux/ppc64.

In fact, this uses pre-compiled Debian Pike packages from Debian stable, which 
comes only in linux/ppc64le

Just discovered there is an unofficial linux/ppc64 package in sid, will try to 
build that. Is this a big endian version, or targetting broader POWER 
architectures than ppc64le ?
https://packages.debian.org/sid/pike8.0-core

Re: pike docker images

[Marcus Comstedt (ACROSS) (Hail Ilpalazzo!) @ Pike (-) developers forum]

Btw, pike packages are indeed available for Debian/riscv64:
https://packages.debian.org/sid/pike8.0-core

Re: pike docker images

[Marcus Comstedt (ACROSS) (Hail Ilpalazzo!) @ Pike (-) developers forum]

>Looks like your local install is missing the buildx Docker plugin. It’s used 
>by the script to build multi-arch container images.
>
>https://docs.docker.com/build/buildx/

Well, the documentation you pointed to says

| Docker Buildx is included in Docker Desktop for Windows, macOS, and
| Linux.

and I do have Docker Desktop for macOS installed...

But I guess I can try the separate download later.


>From your PPC64 machine, you should be able to run the container without 
>building it :
>$ docker run -it --rm --user pike bertrandlupart/pike:stable-latest pike

Eh, no, because you are not building any.

---8<---
hakua:~% docker run -it --rm --user pike bertrandlupart/pike:stable-latest pike
Unable to find image 'bertrandlupart/pike:stable-latest' locally
stable-latest: Pulling from bertrandlupart/pike
docker: no matching manifest for linux/ppc64 in the manifest list entries.
See 'docker run --help'.
hakua:~%
---8<---

You build them for linux/386, linux/amd64, linux/arm/v7, linux/arm64,
linux/mips64le, linux/ppc64le, and linux/s390x, but not linux/ppc64.

Re: pike docker images

[Bertrand Lupart]

Hello,


> Nice.  The script does not work for me though:
> 
> mikan:~/docker-pike% env DRYRUN=1 ./build-push.sh docker/8.0.1116
> building docker/8.0.1116
> [+] Building 0.0s (0/0)
> error: multiple platforms feature is currently not supported for docker 
> driver. Please switch to a different driver (eg. "docker buildx create --use")
> mikan:~/docker-pike%
> 
> Ideas?

Looks like your local install is missing the buildx Docker plugin. It’s used by 
the script to build multi-arch container images.

https://docs.docker.com/build/buildx/

Anyhow, the target audience wouldn’t use this behind-of-the-scene script (which 
should be replaced by a proper CI/CD pipeline), but directly use a container 
image from a registry :

https://hub.docker.com/r/bertrandlupart/pike/tags


> Btw, can we add linux/ppc64 to the arch list?  I'd like to have riscv
> too, but I guess it doesn't have docker yet…


Those are using Debian's Pike packages, and any architecture supported should 
be available (like linux/ppc64le)

From your PPC64 machine, you should be able to run the container without 
building it :
$ docker run -it --rm --user pike bertrandlupart/pike:stable-latest pike


The point here is that you have to trust containers from my registry. Would we 
provide containers and other cloud-native Pike solutions, it would be better to 
have them community-backed.


Concerning RISCV, would be a fun addition to this project. For now, seems like 
Debian an RISCV isn’t a thing, nor Pike Debian packages. Containers look usable 
on RISCV though :
https://carlosedp.medium.com/docker-containers-on-risc-v-architecture-5bc45725624b
 



Bertrand