xiaochen-zhou commented on PR #9635: URL: https://github.com/apache/seatunnel/pull/9635#issuecomment-3128095918
I think we can start by reducing the embedding precision from double to float. The precision loss isn’t just happening with Zhipu—it’s actually an issue with almost all models where the embedding type is returned as double, like [Qianfan](https://cloud.baidu.com/doc/WENXINWORKSHOP/s/alj562vvu) <img width="1195" height="387" alt="image" src="https://github.com/user-attachments/assets/3013d94e-8820-4e6c-acd0-32de2b14513c"; /> [openai model：](https://platform.openai.com/docs/guides/embeddings) <img width="693" height="776" alt="image" src="https://github.com/user-attachments/assets/818dab13-e6ec-4442-8dd9-11063b720fe3"; /> So, as a quick fix, we can switch to float for now and add a note in the docs to let users know. @Hisoka-X -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
