shuke987 opened a new pull request, #65541:
URL: https://github.com/apache/doris/pull/65541
### What problem does this PR solve?
Issue Number: N/A
Related PR: #60499, #63387
Problem Summary:
`test_python_udf_nlp_chinese` imports `jieba`, but `py_udf_complex.zip` only
contained the five project Python modules. The UDF runs on BE Python runtimes,
so installing `jieba` on the regression runner does not satisfy the dependency.
Every recent master and branch-4.1 P0 occurrence therefore returned the
case-authored "jieba package not installed" diagnostic at the first
segmentation assertion.
This PR makes the test artifact self-contained:
- bundles the CPython runtime subset of `jieba==0.42.1` required for
segmentation, TF-IDF, and POS tagging
- includes jieba's MIT license
- adds a deterministic builder that verifies the upstream source archive
SHA-256 and normalizes zip metadata
- preserves the five existing UDF modules byte-for-byte and does not change
the Groovy case or golden output
The optional Paddle `lac_small` model and Jython-only `.p` models are
excluded, reducing the generated artifact from approximately 18 MB for the full
package to approximately 5 MB.
### Release note
None
### Check List (For Author)
- Test
- [x] Regression test
- `test_python_udf_nlp_chinese` passed twice with `parallel=1`,
`suiteParallel=1`, and `actionParallel=1` on the authorized build-matched debug
environment using CPython 3.10.12.
- Both runs exercised all ten existing NLP query tags with no golden
changes.
- [x] Manual test
- Rebuilt the zip twice from the checksum-pinned source archive and
verified byte-identical output.
- Verified `unzip -t`, required directory entries, extracted import
with user site packages disabled, source-file identity, segmentation output,
and builder syntax.
- Behavior changed:
- [x] No.
- Does this need documentation?
- [x] No.
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
