jackylee-ch commented on PR #10163: URL: https://github.com/apache/paimon/pull/10163#issuecomment-5825743176
Thanks @Akash3121. JSON: fixed — added `_records_for_json` to convert the numpy arrays pandas produces for the embedding column into native lists before `json.dumps`, plus a unit test serializing an ndarray embedding column. Ranking: `execute_local()` returns a `RoaringBitmap64`, so rows come back in row-id order and the read path exposes no per-row scores for the CLI to re-sort — a read-layer property shared by all consumers. I'd rather fix ordering in the scan layer (emit `ScoredGlobalIndexResult` by score) as a follow-up than sort in the CLI. Does that split sound right? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
