GitHub user CRZbulabula added a comment to the discussion: Support for 
Timestral and Tirex-2 in AINode

Thanks for opening #19272 and #19273 and clarifying the deployment approach. 
Deferring the Timestral download until an explicit `LOAD MODEL` addresses the 
unsolicited startup download, and the inactive/activating states make the 
proposed lifecycle easier to assess. I am reviewing the implementation details 
in the PRs and will keep code-specific feedback there.

The weights' licensing conditions still apply, though. Please link the [exact 
checkpoint 
license](https://huggingface.co/mistralai/Timestral-209M/blob/main/LICENSE) in 
the user-facing setup instructions and explain the revenue restriction before 
users initiate the download; executing `LOAD MODEL` does not itself establish 
eligibility. Keeping the weights outside our distributions and the feature 
optional gives us a concrete proposal to assess under the [ASF 
optional-dependency 
policy](https://www.apache.org/legal/resolved.html#optional), but we should 
resolve whether this download workflow is acceptable with the PMC/ASF Legal 
before treating that question as settled. The existing Moirai2 behavior should 
be reviewed separately as well.

Thanks also for clarifying that jitCast can use existing extension points 
without DataNode source changes. Could you share a minimal adapter/invocation 
example and the exact JDK, TornadoVM backend dependencies, and JVM flags used? 
jitCast currently targets Java 22, so the deployment requirements still need to 
be explicit alongside IoTDB's Java 17 baseline. GPU memory ownership, 
cancellation, and resource cleanup are worth testing when inference shares the 
database process.

For the performance study, a comparison of embedded jitCast, co-located AINode, 
and remote AINode with matching checkpoints, precision, and workloads would be 
particularly useful. Warmed-up inference latency together with the impact on 
concurrent reads and writes would help separate execution-engine gains from 
data-transfer savings.

GitHub link: 
https://github.com/apache/iotdb/discussions/19270#discussioncomment-19611765

----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]

Reply via email to