Your message dated Wed, 02 Sep 2026 13:08:21 +0000
with message-id <[email protected]>
and subject line Bug#1145427: fixed in tokenizers 0.23.1+dfsg-2.1
has caused the Debian Bug report #1145427,
regarding tokenizers: use compact_str 0.10
to be marked as done.
This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.
(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact [email protected]
immediately.)
--
1145427: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1145427
Debian Bug Tracking System
Contact [email protected] with problems
--- Begin Message ---
Source: tokenizers
Version: 0.23.1+dfsg-2
Severity: important
Tags: patch
User: [email protected]
Usertags: compact-str-0.10
X-Debbugs-Cc: [email protected]
Dear maintainer,
I am preparing a rust-compact-str transition, which will be uploaded soon.
tokienizers needs a small patch for its Cargo.toml.
I have attached a debdiff fixing this, which can be uploaded at any time.
Best regards,
Simon Quigley
[email protected]
diff -Nru tokenizers-0.23.1+dfsg/debian/changelog
tokenizers-0.23.1+dfsg/debian/changelog
--- tokenizers-0.23.1+dfsg/debian/changelog 2026-08-10 21:46:56.000000000
-0500
+++ tokenizers-0.23.1+dfsg/debian/changelog 2026-08-24 18:44:58.000000000
-0500
@@ -1,3 +1,10 @@
+tokenizers (0.23.1+dfsg-2.1) unstable; urgency=medium
+
+ * Non-maintainer upload.
+ * Allow compact_str 0.10.
+
+ -- Simon Quigley <[email protected]> Mon, 24 Aug 2026 18:44:58 -0500
+
tokenizers (0.23.1+dfsg-2) unstable; urgency=medium
* Mask a test case for armhf and i386 to unblock migration.
diff -Nru tokenizers-0.23.1+dfsg/debian/patches/set_version.patch
tokenizers-0.23.1+dfsg/debian/patches/set_version.patch
--- tokenizers-0.23.1+dfsg/debian/patches/set_version.patch 2026-07-09
20:49:26.000000000 -0500
+++ tokenizers-0.23.1+dfsg/debian/patches/set_version.patch 2026-08-21
00:06:16.000000000 -0500
@@ -38,11 +38,13 @@
+monostate = "1.0"
ahash = { version = "0.8.11", features = ["serde"] }
dary_heap = { version = "0.3.6", features = ["serde"] }
- compact_str = { version = "0.9", features = ["serde"] }
-Index: tokenizers/tokenizers/src/models/bpe/word.rs
-===================================================================
---- tokenizers.orig/tokenizers/src/models/bpe/word.rs
-+++ tokenizers/tokenizers/src/models/bpe/word.rs
+-compact_str = { version = "0.9", features = ["serde"] }
++compact_str = { version = ">= 0.9, < 0.11", features = ["serde"] }
+
+ [features]
+ default = ["progressbar", "onig", "esaxx_fast"]
+--- a/tokenizers/src/models/bpe/word.rs
++++ b/tokenizers/src/models/bpe/word.rs
@@ -1,7 +1,8 @@
use super::Pair;
use ahash::AHashMap;
OpenPGP_signature.asc
Description: OpenPGP digital signature
--- End Message ---
--- Begin Message ---
Source: tokenizers
Source-Version: 0.23.1+dfsg-2.1
Done: Adrian Bunk <[email protected]>
We believe that the bug you reported is fixed in the latest version of
tokenizers, which is due to be installed in the Debian FTP archive.
A summary of the changes between this version and the previous one is
attached.
Thank you for reporting the bug, which will now be closed. If you
have further comments please address them to [email protected],
and the maintainer will reopen the bug report if appropriate.
Debian distribution maintenance software
pp.
Adrian Bunk <[email protected]> (supplier of updated tokenizers package)
(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing [email protected])
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512
Format: 1.8
Date: Mon, 31 Aug 2026 15:59:50 +0300
Source: tokenizers
Architecture: source
Version: 0.23.1+dfsg-2.1
Distribution: unstable
Urgency: medium
Maintainer: Debian Deep Learning Team <[email protected]>
Changed-By: Adrian Bunk <[email protected]>
Closes: 1145427
Changes:
tokenizers (0.23.1+dfsg-2.1) unstable; urgency=medium
.
* Non-maintainer upload.
.
[ Simon Quigley ]
* Allow compact_str 0.10. (Closes: #1145427)
Checksums-Sha1:
4132e85745589ac68860a290f9bdc6ec43f6e716 3143 tokenizers_0.23.1+dfsg-2.1.dsc
da611cdb575f5a9ef118da6bda804d4d86f9e418 5676
tokenizers_0.23.1+dfsg-2.1.debian.tar.xz
Checksums-Sha256:
9eb5f5fbc209f6082c1d82cd74aef9f184165d4dbaa73d32c0ea01c5c3fbbc33 3143
tokenizers_0.23.1+dfsg-2.1.dsc
e89b589d9c999f248dd4ab670cde4f4776a25d0b40f2ed62da82b1366dd39bf6 5676
tokenizers_0.23.1+dfsg-2.1.debian.tar.xz
Files:
ea140a2f780651dd476bfb6ce7e4be5c 3143 python optional
tokenizers_0.23.1+dfsg-2.1.dsc
cf320afa8479bc234f6f4160d0ea7117 5676 python optional
tokenizers_0.23.1+dfsg-2.1.debian.tar.xz
-----BEGIN PGP SIGNATURE-----
iQIzBAEBCgAdFiEEOvp1f6xuoR0v9F3wiNJCh6LYmLEFAmqVfooACgkQiNJCh6LY
mLHHkRAAuBMdIjhJU83SfhD86WR6MfRZXVg9kqE+MGgPw32HZVoCmORHtT0lqR8w
SE8+usKE99ImW6kYUR5xQQEFuOnaPXZQUxDlEQdo3hR/r9xvEkkXGQ07wdeeuGEX
DVpUIQmNn7X/kCp8rsKxzW7qomBfdGR2zZ4TNrKrXdaae7N2fIsAJDxvxwQ+RN01
HwrVKR5a3IY6rWZZBszRfs3/L1/wXBXOkorgYv7EXaZmbUQ3W8cEDuRxSVcdrwHg
3s9NiHRBg9GmO0rrwcXOefleu17BgQUnx0D5G2sHw5/0POVl/W5xkYaMJijoZhuu
IUlB7hpeS32IqMdaXU8XUH5GPrFJIFKncHKQMLHI9KjMxSOlEe+elqNBKfVdJK3x
Zri9Aqkp/ux0O9Mul1/IW9vBkomGJQ/DGmDENuzuByKSHOnejh+c/6f7J9m/3qs5
Bj+yhchS0043Ov26S7a5TKEDSupEPGQXnjEKMSPDWQcUZL8ZeS2WhwOq0LkBBjuv
vEFJJ+ShB/baL1M8mMAfclqRayg0A/3qoDS6RnrTUS+hoDLt+KBlZfCdOkhWDCRj
te37Gr4qHRWc4NN1kOmJwfO6DSaW81Buwpv9aOHgQiVlYKOKvabZW/+BxnO2CILm
DJx+ZiIT8/OQksqZ++okgY1P5LCgEDgr2uYOMn/Fcue5QYZ4kNA=
=RRgA
-----END PGP SIGNATURE-----
pgpAmIFgQZuSS.pgp
Description: PGP signature
--- End Message ---
