Yes, you can use custom extensions with Docker.
There's the documentation listed by Steven, and if you want examples, here's my
shameless plug:
- I have a simple "branding" extension in my docker image (I never noticed
that I did not include it in my github repo, but I can send it if you want). -
And a custom SSO UI extension that replaces Guacamole's SSO bottom-left links
with more usual 'or loggin with...' buttons.
https://github.com/abesnier/guacamole-sso-ui. There is a little bit of html
code in there to look at.
It takes a bit of inspection of the html of the application to understand the
proper html meta tags to use (before, replace, after, after-children, etc...)
And once you have an extension, just make sure your container can access it.
Here's the documentation for the official image:
https://guacamole.apache.org/doc/gug/guacamole-docker.html#custom-extensions-and-guacamole-home
Cheers
Antoine