Script 'mail_helper' called by obssrc Hello community, here is the log from the commit of package python-tokenizers for openSUSE:Leap:16.0 checked in at 2025-04-07 13:58:33 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Comparing /work/SRC/openSUSE:Leap:16.0/python-tokenizers (Old) and /work/SRC/openSUSE:Leap:16.0/.python-tokenizers.new.1907 (New) ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Package is "python-tokenizers" Mon Apr 7 13:58:33 2025 rev:2 rq:1267573 version:0.21.1 Changes: -------- --- /work/SRC/openSUSE:Leap:16.0/python-tokenizers/python-tokenizers.changes 2025-03-19 11:55:49.532631667 +0100 +++ /work/SRC/openSUSE:Leap:16.0/.python-tokenizers.new.1907/python-tokenizers.changes 2025-04-07 13:58:54.930369463 +0200 @@ -1,0 +2,71 @@ +Wed Mar 19 18:26:11 UTC 2025 - Lucas Mulling <lucas.mull...@suse.com> + +- Update to 0.21.1: + * Update dev version and pyproject.toml + * Add feature flag hint to README.md + * Upgrade to PyO3 0.23 + * Fixing the README.md + * Fix typo in Split docstrings + * Fix typos + * Update documentation of Rust feature + * Fix panic in DecodeStream::step due to incorrect index usage + * Fixing the stream by removing the read_index altogether + * Fixing NormalizedString append when normalized is empty + * Update metadata as Python3.7 and Python3.8 support was dropped + * Add rustls-tls feature +- Remove define skip_python313 1 + +------------------------------------------------------------------- +Wed Mar 5 10:32:02 UTC 2025 - Christian Goll <cg...@suse.com> + +- disable python3.13 + +------------------------------------------------------------------- +Thu Jan 9 15:52:37 UTC 2025 - Andreas Schwab <sch...@suse.de> + +- Enable build on riscv64 + +------------------------------------------------------------------- +Wed Dec 18 14:20:07 UTC 2024 - Soc Virnyl Estela <uncomfyhaloma...@opensuse.org> + +- Update to version 0.21.0: + * More cache options. + * Disable caching for long strings. + * Testing ABI3 wheels to reduce number of wheels + * Adding an API for decode streaming. + * Decode stream python + * Fix encode_batch and encode_batch_fast to accept ndarrays again + +------------------------------------------------------------------- +Thu Nov 7 11:30:50 UTC 2024 - Soc Virnyl Estela <uncomfyhaloma...@opensuse.org> + +- Select only rust tier 1 arches. +- Update registry.tar.zst dependencies +- Update version to 0.20.3: + * fix pylist + * [MINOR:TYP] Fix docstrings +- Updates from 0.20.2: + * Bump cookie and express in /tokenizers/examples/unstable_wasm/www + * Fix off-by-one error in tokenizer::normalizer::Range::len + * Arg name correction: auth_token -> token + * Unsound call of set_var + * Add safety comments + * PyO3 0.22 +- Updates from 0.20.1: + * Update README.md + * fix benchmark file link + * [ignore_merges] Fix offsets + * Bump body-parser and express in /tokenizers/examples/unstable_wasm/www + * Bump serve-static and express in /tokenizers/examples/unstable_wasm/www + * Bump send and express in /tokenizers/examples/unstable_wasm/www + * Bump webpack from 5.76.0 to 5.95.0 in /tokenizers/examples/unstable_wasm/www + * Fix documentation build + * style: simplify string formatting for readability + +------------------------------------------------------------------- +Sun Nov 3 12:22:13 UTC 2024 - Soc Virnyl Estela <uncomfyhaloma...@opensuse.org> + +- Experiment with cargo vendor home registry. See documentation: + https://github.com/openSUSE-Rust/obs-service-cargo/blob/master/README.md#cargo-vendor-home-registry + +------------------------------------------------------------------- Old: ---- tokenizers-0.20.0.tar.gz vendor.tar.zst New: ---- registry.tar.zst tokenizers-0.21.1.tar.gz ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Other differences: ------------------ ++++++ python-tokenizers.spec ++++++ --- /var/tmp/diff_new_pack.dCzHIx/_old 2025-04-07 13:58:56.282426101 +0200 +++ /var/tmp/diff_new_pack.dCzHIx/_new 2025-04-07 13:58:56.282426101 +0200 @@ -1,7 +1,7 @@ # # spec file for package python-tokenizers # -# Copyright (c) 2024 SUSE LLC +# Copyright (c) 2025 SUSE LLC # # All modifications and additions to the file contributed by third parties # remain the property of their copyright owners, unless otherwise agreed @@ -15,28 +15,30 @@ # Please submit bugfixes or comments via https://bugs.opensuse.org/ # + %if 0%{?suse_version} && 0%{?suse_version} < 1550 %global force_gcc_version 13 %endif %{?sle15_python_module_pythons} Name: python-tokenizers -Version: 0.20.0 +Version: 0.21.1 Release: 0 Summary: Provides an implementation of today's most used tokenizers License: Apache-2.0 URL: https://github.com/huggingface/tokenizers Source0: https://github.com/huggingface/tokenizers/archive/refs/tags/v%{version}.tar.gz#/tokenizers-%{version}.tar.gz -Source1: vendor.tar.zst +Source1: registry.tar.zst BuildRequires: %{python_module devel} BuildRequires: %{python_module maturin} BuildRequires: %{python_module pip} BuildRequires: %{python_module setuptools} BuildRequires: cargo-packaging -BuildRequires: gcc%{?force_gcc_version}-c++ BuildRequires: fdupes +BuildRequires: gcc%{?force_gcc_version}-c++ BuildRequires: python-rpm-macros BuildRequires: zstd +ExclusiveArch: %{rust_tier1_arches} riscv64 Requires: python-huggingface-hub %python_subpackages @@ -55,9 +57,12 @@ needs. %prep -%autosetup -p1 -n tokenizers-%{version} -a1 +%autosetup -p1 -n tokenizers-%{version} +rm -rfv .cargo +tar xf %{S:1} -C $PWD %build +export CARGO_HOME=$PWD/.cargo export CARGO_NET_OFFLINE=true export CARGO_PROFILE_RELEASE_DEBUG=full export CARGO_PROFILE_RELEASE_SPLIT_DEBUGINFO=off @@ -80,6 +85,7 @@ %python_expand %fdupes %{buildroot}/%{$python_sitearch}/* %check +export CARGO_HOME=$PWD/.cargo %if 0%{?force_gcc_version} export CC="gcc-%{?force_gcc_version}" export CXX="g++-%{?force_gcc_version}" ++++++ _service ++++++ --- /var/tmp/diff_new_pack.dCzHIx/_old 2025-04-07 13:58:56.314427441 +0200 +++ /var/tmp/diff_new_pack.dCzHIx/_new 2025-04-07 13:58:56.318427609 +0200 @@ -2,12 +2,13 @@ <services> <service mode="manual" name="download_files" /> <service name="cargo_vendor" mode="manual"> - <param name="src">tokenizers*.tar.gz</param> + <param name="src">tokenizers-*.tar.gz</param> + <param name="method">registry</param> + <param name="update">true</param> <param name="compression">zst</param> + <param name="no-root-manifest">true</param> <param name="cargotoml">bindings/python/Cargo.toml</param> <param name="cargotoml">tokenizers/Cargo.toml</param> - <param name="respect-lockfile">false</param> - <param name="update">true</param> </service> </services> ++++++ tokenizers-0.20.0.tar.gz -> tokenizers-0.21.1.tar.gz ++++++ ++++ 7511 lines of diff (skipped)
