[
https://issues.apache.org/jira/browse/CAMEL-26400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18134740#comment-18134740
]
Claus Ibsen commented on CAMEL-26400:
-------------------------------------
Feedback from the local-model benchmark (qwen3.6:35b on Ollama, run r24 on Oct
29-30), the first series with this change.
The model used camel_eval_expression more: 63 calls, against 24 in the run
before (r23). It used predicate in 21 calls and headers in 6, and never
variables or resultType. Two calls had a wrong argument name, and the model
fixed both on the next call. No step of the series failed because of this
change, so this is not a regression report.
A few answers could guide a model better:
* With a JSON body passed as text, {{$\{body[lines].size()\}}} answers "the
body is text (a String): unmarshal it first". That is right for a route, but
the model cannot unmarshal inside the tool. In one step it sent the same call
10 times in a row.
* On a JSON text body, {{$\{body.lines.size()\}}} calls String.lines(), and the
answer is "Method with name: size() not found on bean:
java.util.stream.ReferencePipeline$Head".
* jsonpath with no body answers "json string can not be null or empty" (3
calls).
* With no body, {{$\{body} == null}} answers false, also with "body": null.
* {{$\{header.CamelRedeliveryCounter\}}} gives nullResult with the note "a
header, property or variable that is not set". The model then tried
exchangeProperty instead. The note could point to the new headers argument.
I opened CAMEL-26411 as a follow-up for these.
> camel-jbang-mcp - camel_eval_expression cannot set headers, variables,
> resultType or predicate mode, so an XPath function such as string() or
> boolean() fails and header or variable lookups come back null
> -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: CAMEL-26400
> URL: https://issues.apache.org/jira/browse/CAMEL-26400
> Project: Camel
> Issue Type: Improvement
> Components: camel-jbang, camel-jbang-mcp
> Affects Versions: 4.23.0
> Reporter: Federico Mariani
> Assignee: Federico Mariani
> Priority: Major
> Fix For: 4.24.0
>
>
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
