Rahul Battacharya created FLINK-38708:
-----------------------------------------
Summary: Support LLM bulk APIs to the ML_Predict
Key: FLINK-38708
URL: https://issues.apache.org/jira/browse/FLINK-38708
Project: Flink
Issue Type: Improvement
Components: Library / Machine Learning
Reporter: Rahul Battacharya
need ML_predict to call LLM's batch apis and not synchronous apis which are
twice the cost.
the batch apis expect a JSONL file and will return a batchid which we can send
downstream for some other process to track.
the proposed design doc was here
[https://docs.google.com/document/d/1U-eSuKwi5vIgAPt6ZBvb-RcbcRJiRy0e/]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
