[Koha-devel] Bug 33092 - Add ability to search within a list

2024-04-28 Thread David Cook via Koha-devel
Hi all, Has anyone looked at this one? My first thought is that the list ID would need to be added to a repeatable subfield (e.g. 999$l) and indexed. That way it would be easy to allow any search engine query and then just wrap it like "() and (list_id=X)". But. it would mean that we'd

Re: [Koha-devel] Google OpenID Connect

2024-04-21 Thread David Cook via Koha-devel
The Google OpenID Connect specific functionality only targeted the OPAC. Probably because it’s the most common use case. (I wrote my own OpenID Connect integration for Koha about 10 years ago, and it only targeted the OPAC too.) However, Koha has a different more generic Oauth2/OpenID

Re: [Koha-devel] SelfCheckoutByLogin

2024-04-16 Thread David Cook via Koha-devel
Hi long_sam, Thanks for your reply. You’re right; SAML does have single log out functionality. However, from my understanding it’s a “front-channel logout” mechanism that requires the redirecting of the user in the browser. With OpenID Connect, the “back-channel logout” is a request

Re: [Koha-devel] SelfCheckoutByLogin

2024-04-15 Thread David Cook via Koha-devel
Part of the reason is that it’s considerably more complicated and error-prone. If you log in using Google OpenID Connect, the self-checkout browser will retain your Google user session beyond your Koha self-checkout user session. Also, when Koha goes back to Google to authenticate someone

Re: [Koha-devel] Finding invalid XML characters in Koha data via SQL

2024-04-15 Thread David Cook via Koha-devel
I’m just finishing up the next version of the plugin which finds problem bib records, problem item records, and lets you fix 1 bib record and its X problem item records at a time. I’ll be putting it up online sometime in the next couple weeks. (I’m away a lot these couple of weeks, so tough

Re: [Koha-devel] [Koha] Error 500 when searching in Koha 23.11.0

2024-04-14 Thread David Cook via Koha-devel
Hi Michael, I don't think your database was properly upgraded, and doing these manual corrections isn't really going to be enough unless you go line by line through the upgrade scripts and figure out all the things that were missed. If you're able to, I would go back and try the upgrade again.

Re: [Koha-devel] Finding invalid XML characters in Koha data via SQL

2024-04-12 Thread David Cook via Koha-devel
Of Magnus Enger via Koha-devel Sent: Friday, 12 April 2024 4:09 PM To: koha-devel@lists.koha-community.org Subject: Re: [Koha-devel] Finding invalid XML characters in Koha data via SQL Den 12.04.2024 04:13, skrev David Cook via Koha-devel: > I have a RepairRecord plugin, so I might do a vers

Re: [Koha-devel] Finding invalid XML characters in Koha data via SQL

2024-04-12 Thread David Cook via Koha-devel
David Cook via Koha-devel: > Hi all, > > I just wanted to share a (MariaDB) SQL report that I wrote for finding > bib records with invalid XML characters: > > select biblionumber from biblio_metadata where metadata REGEXP > '[^\\x{0009}\\x{000A}\\x{000D}\\x{0020}-\\x{D7

[Koha-devel] Bug 36586 - Self-checkouts will get CSRF errors if left inactive for 8 hours

2024-04-11 Thread David Cook via Koha-devel
Hi all, We recently noticed that self-checkouts will generate CSRF errors when left unattended for over 8 hours (the lifetime of the CSRF token). Our solution is to use a timer to refresh the page every 8 hours or so, but open to other ideas. This will potentially affect Vue.js driven

Re: [Koha-devel] Finding invalid XML characters in Koha data via SQL

2024-04-11 Thread David Cook via Koha-devel
Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595 From: Koha-devel On Behalf Of David Cook via Koha-devel Sent: Friday, 12 April 2024 11:36 AM To: 'Koha-devel' Subject: [Koha-devel] Finding invalid XML characters in Koha data

[Koha-devel] Finding invalid XML characters in Koha data via SQL

2024-04-11 Thread David Cook via Koha-devel
Hi all, I just wanted to share a (MariaDB) SQL report that I wrote for finding bib records with invalid XML characters: select biblionumber from biblio_metadata where metadata REGEXP '[^\\x{0009}\\x{000A}\\x{000D}\\x{0020}-\\x{D7FF}\\x{E000}-\\x{FFFD}\\x{1000 0}-\\x{10}]+'; Newer

Re: [Koha-devel] Update to Koha 23.11.04 fails

2024-04-11 Thread David Cook via Koha-devel
Hi Michael, I've noticed that a bunch of the database changes for the additional_contents table can half-complete and not fatally fail in very ungraceful ways. In this case, I'd say an earlier update probably failed to rename "idnew" to "id". Hopefully this was a test upgrade, because

[Koha-devel] XZ Utils backdoor for Linux

2024-04-03 Thread David Cook via Koha-devel
Hi all, This isn't related to Koha per se, but I thought I'd share it for anyone who hasn't seen it: https://en.wikipedia.org/wiki/XZ_Utils_backdoor All the more reason to have things like Kohacon so that we actually know each other. David Cook Senior Software Engineer Prosentient

Re: [Koha-devel] Elasticsearch sans Zebra

2024-03-27 Thread David Cook via Koha-devel
h and we have a process that deactivates zebra but we would love to see the change you proposed. I vaguely remember a bug where not having zebra running caused a problem (with background jobs i think) even if ES is in charge of indexing. cheers david (HKS3/www.koha-support.eu) On Mon, 25

[Koha-devel] Elasticsearch indexing does not handle exceptions well

2024-03-26 Thread David Cook via Koha-devel
Hi all, I'm re-indexing Elasticsearch and I notice occasionally Elasticsearch will throw an exception when committing (e.g. Elasticsearch exception thrown: Request), and Koha just ignores it. That means that whole commit gets missed, so a default of 5000 records don't get indexed. You

[Koha-devel] Elasticsearch sans Zebra

2024-03-24 Thread David Cook via Koha-devel
Hi all, I have started using Elasticsearch more with Koha, and we're at a point of wanting to use Elasticsearch without Zebra for Koha. I came across "Bug 21820 - Zebraqueue should not be added to when only Elasticsearch is used" and it seems like other people are interested in this too.

Re: [Koha-devel] Random XSLT knowledge

2024-03-10 Thread David Cook via Koha-devel
arcel _ Van: Koha-devel mailto:koha-devel-boun...@lists.koha-community.org> > namens David Cook via Koha-devel mailto:koha-devel@lists.koha-community.org> > Verzonden: vrijdag 8 maart 2024 03:02 Aan: 'Koha Devel' mailto:koha-devel@lists.koha-community.org> > Ond

[Koha-devel] SMTP servers requiring XOAUTH2

2024-03-07 Thread David Cook via Koha-devel
Hey folks, Is anyone using Koha with SMTP servers requiring XOAUTH2? It doesn't look like the Perl libraries used by Koha are anywhere near ready for it, but it looks like Postfix has an experimental plugin available: https://github.com/tarickb/sasl-xoauth2 or

[Koha-devel] Random XSLT knowledge

2024-03-07 Thread David Cook via Koha-devel
Hi all, I've been working on performance issues, and in the process I got looking at XSLTs. I just wanted to share that it's possible to pass strings to the XSLT's transform() method: -return $engine->transform($xmlrecord, $xslfilename ); #file or URL +return

[Koha-devel] PatternFly for design?

2024-03-04 Thread David Cook via Koha-devel
Hi all, Has anyone used PatternFly for designing? https://www.patternfly.org/ David Cook Senior Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595

[Koha-devel] Future of mod_security

2024-02-27 Thread David Cook via Koha-devel
Hi all, mod_security has had a troubled existence the past few years, but it looks like the company behind it has transferred it over to OWASP: https://owasp.org/blog/2024/01/09/ModSecurity.html Hopefully this means mod_security starts getting updated more. David Cook Senior

Re: [Koha-devel] Override sysprefs in Apache config

2024-02-26 Thread David Cook via Koha-devel
a message in the sysprefs if the staff client stating their likely override at the virtual host level. On Sun, 18 Feb 2024, 10:21 pm David Cook via Koha-devel, mailto:koha-devel@lists.koha-community.org> > wrote: Hi Magnus, Yeah, I was thinking it wouldn't make sense to affect the

[Koha-devel] DataTables 2.0.0

2024-02-20 Thread David Cook via Koha-devel
Hi all, I do not intend to draw your attention to this in any meaningful way. I just wanted to point out that DataTables 2.0.0 was released on February 15th 2024 (https://cdn.datatables.net/2.0.0/). Just squirrel away that information in the back of your brain for later. David Cook Senior

Re: [Koha-devel] Override sysprefs in Apache config

2024-02-18 Thread David Cook via Koha-devel
: Koha-devel On Behalf Of Magnus Enger via Koha-devel Sent: Friday, 16 February 2024 6:26 PM To: koha-devel@lists.koha-community.org Subject: Re: [Koha-devel] Override sysprefs in Apache config Hi! Den 16.02.2024 06:56, skrev David Cook via Koha-devel: > I think it might be partially bro

Re: [Koha-devel] Override sysprefs in Apache config

2024-02-15 Thread David Cook via Koha-devel
I think it might be partially broken. As per https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=16520 I added the following to the OPAC and the staff interface: RequestHeader add X-Koha-SetEnv "OVERRIDE_SYSPREF_LibraryName Potato\, Potato" It did indeed load into the OPAC.

[Koha-devel] Override sysprefs in Apache config

2024-02-15 Thread David Cook via Koha-devel
Hi all, I've read this wiki page and tried this many times, and never ever gotten it to work. Is there something missing from these instructions? https://wiki.koha-community.org/wiki/Override_sysprefs_in_Apache_config David Cook Senior Software Engineer Prosentient Systems Suite

[Koha-devel] Session corruption in koha-testing-docker master

2024-02-12 Thread David Cook via Koha-devel
Hi all, The last two days I've noticed that my session is getting corrupted while I'm working on master in koha-testing-docker. I'm not touching the session myself, but seemingly randomly the session gets all kinds of DIBC data stuffed into it, and Koha seems to be parse it and Koha throws a

Re: [Koha-devel] Growing size of koha/koha-testing:master

2024-02-06 Thread David Cook via Koha-devel
koha/koha-testing:master On 24-02-04 23:30, David Cook via Koha-devel wrote: > Do we know what’s contributing to this? After running `ncdu /` from inside KTD Debian 10 (the smallest image it seems) - 661 M /kohadevbox/Cypress - 347 M /kohadevbox/node_modules - 95 M /kohadevbox/misc4dev - 2

[Koha-devel] Growing size of koha/koha-testing:master

2024-02-04 Thread David Cook via Koha-devel
Hi all, I've noticed recently that koha/koha-testing:master has been steadily growing. At this point, it's about 4.37GB in size. For 21.11 I think it used to be about 2GB and 22.11 was 3.5GB. Do we know what's contributing to this? David Cook Senior Software Engineer Prosentient

[Koha-devel] January point releases

2024-02-01 Thread David Cook via Koha-devel
Hi all, I think the January point releases have been done. Just curious when we'll see those flow through to the main repository? Thanks, David Cook Senior Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899

Re: [Koha-devel] Dockerfile for koha/elasticsearch-icu:7.x image

2024-01-29 Thread David Cook via Koha-devel
can find the Dokerfiles here https://gitlab.com/koha-community/docker/koha-elasticsearch-icu and yes, they were just installing the ICU plugin El lun, 29 ene 2024 1:47, David Cook via Koha-devel mailto:koha-devel@lists.koha-community.org> > escribió: Hi all, Is there a pub

[Koha-devel] Dockerfile for koha/elasticsearch-icu:7.x image

2024-01-28 Thread David Cook via Koha-devel
Hi all, Is there a published version of the Dockerfile for the koha/elasticsearch-icu:7.x image? Is it just running "RUN /usr/share/elasticsearch/bin/plugin install --batch analysis-icu" or does it make other changes to the standard image as well? David Cook Senior Software Engineer

[Koha-devel] 22.11.12 having package dependency problems?

2024-01-23 Thread David Cook via Koha-devel
I help out a few libraries running 22.11 straight from the community, and two libraries lately have had Koha go down during automatic upgrades to 22.11.12-1. koha-common mostly installs but fails to complete due to unmet dependencies: apt install koha-common -s Reading package lists...

[Koha-devel] "Online access" vs "Online resources"

2023-11-27 Thread David Cook via Koha-devel
Hi all, Detail pages say "Online resources" but search results say "Online access". I don't know if I've never noticed before or what but I had a librarian raise it today. I think it makes sense to harmonise so that they're both the same, but how do we choose which one? I've raised a

Re: [Koha-devel] Using Elasticsearch in koha-testing-docker

2023-11-07 Thread David Cook via Koha-devel
env file. Le mar. 7 nov. 2023 à 03:55, David Cook via Koha-devel mailto:koha-devel@lists.koha-community.org> > a écrit : Hi all, I’m trying to use Elasticsearch in koha-testing-docker, and I would appreciate some assistance. Here’s the steps I’m taking: 1. Launch koha-testing

[Koha-devel] Using Elasticsearch in koha-testing-docker

2023-11-06 Thread David Cook via Koha-devel
Hi all, I'm trying to use Elasticsearch in koha-testing-docker, and I would appreciate some assistance. Here's the steps I'm taking: 1. Launch koha-testing-docker 2. Update Koha's sysprefs a. Change SearchEngine from "Zebra" to "Elasticsearch" at

Re: [Koha-devel] Last month before the release

2023-11-05 Thread David Cook via Koha-devel
to fix what they broke instead of fixing for them) and finally maybe have a live chat beginning of the cycle with RMaints and QA team to (re) explain how it works. Le vendredi 3 novembre 2023, David Cook via Koha-devel mailto:koha-devel@lists.koha-community.org> > a écrit : > It’s no

Re: [Koha-devel] Last month before the release

2023-11-05 Thread David Cook via Koha-devel
, responsibilize people (asking them to fix what they broke instead of fixing for them) and finally maybe have a live chat beginning of the cycle with RMaints and QA team to (re) explain how it works. Le vendredi 3 novembre 2023, David Cook via Koha-devel mailto:koha-devel@lists.koha-community.org> > a

Re: [Koha-devel] Last month before the release

2023-11-02 Thread David Cook via Koha-devel
It’s not clear to me though how you look at Jenkins runs. Is it going to https://dashboard.koha-community.org/ and then clicking on one of the badges to go to Jenkins like https://jenkins.koha-community.org/job/Koha_Master_U22/ and then clicking on “Latest Test Result”? David Cook Senior

Re: [Koha-devel] Last month before the release

2023-11-02 Thread David Cook via Koha-devel
What’s the best way to do this? I think Jenkins might send emails, but I think my mail server blocked it ages ago as spam. David Cook Senior Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595

Re: [Koha-devel] Memory footprint of Koha processes

2023-10-23 Thread David Cook via Koha-devel
Hi Philippe, I run quite a few Koha instances, so I feel your pain. A couple months ago I opened https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=34477 but I haven’t dedicated any time to work on it yet (and I have no plans to work on it anytime soon). The ORM eats up a lot

Re: [Koha-devel] Anyone else having issues attaching patches to Bugzilla?

2023-10-22 Thread David Cook via Koha-devel
Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595 From: Koha-devel On Behalf Of David Cook via Koha-devel Sent: Monday, 23 October 2023 1:47 PM To: 'David Nind' Cc: 'Koha Devel' Subject: Re: [Koha-devel] Anyone else having issues attaching patches to Bugzilla

[Koha-devel] I'm not getting your emails on bugs...

2023-10-22 Thread David Cook via Koha-devel
Hi all, It looks like my "bugmail has been disabled" for the last 10 days on Bugzilla, so if I haven't responded to a comment on Bugzilla, it's not because I'm ignoring you. It's because I'm not getting the emails. (If an administrator sees this, please re-enable my bugmail. Thanks!) I've

Re: [Koha-devel] Anyone else having issues attaching patches to Bugzilla?

2023-10-22 Thread David Cook via Koha-devel
Subject: Re: [Koha-devel] Anyone else having issues attaching patches to Bugzilla? Hi David. It's working for me, just signed of a patch - git bz attach -e X HEAD So it must be you! 8-) David Nind New Zealand On Mon, 23 Oct 2023 at 15:25, David Cook via Koha-devel mailto:koha

Re: [Koha-devel] Keycloak as Identity Provider using Koha's users

2023-10-22 Thread David Cook via Koha-devel
Sounds good. Thanks, Paul! David Cook Senior Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595 From: Paul Derscheid Sent: Friday, October 20, 2023 8:07 PM To: David Cook ; 'Koha Devel' Cc:

Re: [Koha-devel] Background jobs quirks

2023-10-19 Thread David Cook via Koha-devel
;ack() doing it. I do wonder if it’s “my $job = Koha::BackgroundJobs->find($args->{job_id});” I suppose we’ll see in the morning… David Cook Senior Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595

Re: [Koha-devel] Background jobs quirks

2023-10-19 Thread David Cook via Koha-devel
ons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595 From: Koha-devel mailto:koha-devel-boun...@lists.koha-community.org> > On Behalf Of David Cook via Koha-devel Sent: Thursday, October 19, 2023 2:41 PM To: 'Koha Devel' mailto:koha-devel@lists.koha-community.org> &

Re: [Koha-devel] Background jobs quirks

2023-10-18 Thread David Cook via Koha-devel
oint NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595 From: Koha-devel mailto:koha-devel-boun...@lists.koha-community.org> > On Behalf Of David Cook via Koha-devel Sent: Thursday, October 19, 2023 2:41 PM To: 'Koha Devel' mailto:koha-devel@lists.koha-community.org>

Re: [Koha-devel] Background jobs quirks

2023-10-18 Thread David Cook via Koha-devel
job_id});" I suppose we'll see in the morning. David Cook Senior Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595 From: Koha-devel On Behalf Of David Cook via Koha-devel Sent: Thurs

[Koha-devel] Background jobs quirks

2023-10-18 Thread David Cook via Koha-devel
Hi all, Have you seen something like the following in your worker-error.log? 20231018 07:44:06 instance-koha-worker-long_tasks: client (pid 3949888) killed by signal 13, respawning 20231019 07:21:26 instance-koha-worker-long_tasks: client (pid 4082852) killed by signal 13, respawning

[Koha-devel] MIssing emails for CC list?

2023-10-18 Thread David Cook via Koha-devel
Hi all, I'm used to getting emails for issues I'm CCed to, but I don't think I've gotten any for the last 1 week. Is this happening to anyone else or is it just me? I'm still getting emails addressed to koha-b...@lists.koha-community.org

[Koha-devel] Keycloak as Identity Provider using Koha's users

2023-10-18 Thread David Cook via Koha-devel
Hi all, I've posted the Keycloak extension for using Koha's user database as Keycloak's user datastore: https://gitlab.com/minusdavid/keycloak-user-storage-koha This effectively allows you to use Koha (version 22.11.03 and upwards) as an Identity Provider - mediated via Keycloak (version