QuakeWang opened a new pull request, #8235:
URL: https://github.com/apache/paimon/pull/8235
### Purpose
Lumina vector writers used `lumina.index.dimension` for both ARRAY and
VECTOR fields. For VECTOR fields, the schema already carries the fixed length,
so falling back to the default dimension could make write validation and index
metadata disagree with the actual field type.
This PR resolves the effective dimension from `VectorType#getLength()`,
rejects explicit dimension conflicts, and builds native Lumina options from the
resolved dimension so PQ options are capped against the real dimension.
`ArrayType<FLOAT>` continues to use `lumina.index.dimension`.
### Tests
- `mvn -pl paimon-lumina -am -DfailIfNoTests=false
-Dtest=LuminaVectorGlobalIndexWriterTest,LuminaVectorOptionsTest test`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
