Claus Ibsen created CAMEL-25371:
-----------------------------------

             Summary: camel-jbang-mcp - validating the same content again is a 
repeated call, and validating the file as it is on disk says so
                 Key: CAMEL-25371
                 URL: https://issues.apache.org/jira/browse/CAMEL-25371
             Project: Camel
          Issue Type: Improvement
          Components: camel-jbang
            Reporter: Claus Ibsen


A model stuck on a validation error validates the same content again and again 
and gets the same full answer each time. Found in the local-model benchmark 
(r5): in three steps that used all 20 tool calls, {{camel_validate_source}} was 
called with byte-identical content 16, 10 and 10 times. The repeated-call note 
(from the third identical call) only covers tools marked deterministic, and 
camel_validate_source is not, as without content it reads the file on disk, 
which changes.

In one of those steps, the content the model validated was the file as it 
already was on disk: the edit it meant to make was not in it, and nothing said 
so.

Proposal:
* A tool can be deterministic for a call that passes a given argument: 
camel_validate_source with content is. The third identical call is then 
answered with the note, plus what to do instead: change the line the error 
names, then validate the changed content or write it.
* When the content given to camel_validate_source is the file on disk 
unchanged, the answer says so ("an edit you meant to make is not in it").

_Claude Code on behalf of davsclaus_



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to