qining-mj commented on PR #26932: URL: https://github.com/apache/flink/pull/26932#issuecomment-3231615743
> Thank you for sharing. If so, could you help us understand why new modules like DeepSeek and Qwen are being introduced into the Flink repository? > > By the way, would you mind sharing how you use Flink to build ML pipelines at your company? Have you encountered any challenges that Flink currently cannot address? > > Your feedback will help us continuously improve Flink’s AI capabilities — we really appreciate your insights! Thank you for your response. In the healthcare industry, different hospitals and companies often deploy various AI models, such as those from DeepSeek, Qwen, OpenAI, as well as custom-trained models. In our data processing workflows using Flink and Paimon, we need to support multiple model providers. However, currently, Flink 2.1 only offers built-in support for OpenAI. To address this limitation, we extended Flink 2.1 by integrating support for DeepSeek, Qwen, and Tencent Hunyuan models. After running these extensions in production for some time, they have proven to be highly stable. Therefore, we believe contributing this implementation back to the community would benefit others and make it easier to maintain moving forward. Regarding the use of large language models (LLMs) with Flink in healthcare—such as model application scenarios, specific demands, and more—we have gathered substantial insights and requirements. We will share these details via Jira in the coming days to help further improve Flink’s AI capabilities. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
