luigidemasi opened a new issue, #114:
URL: https://github.com/apache/camel-kit/issues/114

   > Imported from 
[luigidemasi/camel-kit#260](https://github.com/luigidemasi/camel-kit/issues/260),
 opened by [Croway](https://github.com/Croway) on 2026-10-20.
   
   ---
   
   ## Problem
   
   Nothing in the generated `AGENTS.md` or the shared iron laws says that 
deliverables belong in the project directory.
   Agents that prefer to "verify empirically first" build and test the 
application in a scratch directory and copy it into
   the project at the end. If the session ends first (a turn or token limit, a 
crash, the user stopping it), the project is
   left without any of the work.
   
   The only guidance about other directories points the other way: 
`camel-execute/guides/environment-probe.md` (correctly,
   for a throwaway probe) says "Generate the skeleton in a **temporary 
directory**. Never write probe files into the real
   project directory" with `mktemp -d /tmp/camel-kit-probe-XXXXXX`.
   
   ## Evidence
   
   camel-evals, `mule-weather-migration` task (MuleSoft to Camel 4.22.1, Camel 
Main), GLM 5.3 with OpenCode 1.19.3 and
   `camel-kit init --ai opencode` (0.4.1), 45-minute turn limit, 3 trials:
   
   - 2 of 3 trials built the complete application (routes, 
`application.properties`, mock HTTP and SMTP servers) under
     `/tmp/opencode/` and ran out of time before copying it to `camel/`. Their 
scores were 0.27 and 0.22 against 0.83-0.92
     for every other trial of the same model; every grader that inspects the 
project scored 0.
   - One trial stated the plan explicitly: "I'll verify dependency 
auto-detection empirically with a scratch test app in
     /tmp/opencode (mirroring my planned design ...) before writing the real 
deliverable."
   - Neither failed trial loaded `environment-probe.md`, so the habit is the 
model's own, but nothing in the workspace
     instructions corrects it. Claude Code trials with the same model also used 
`/tmp` for experiments, but wrote their
     routes into `camel/` about halfway through the turn and kept iterating 
there.
   
   ## Proposal
   
   - [ ] Add a law or rule to the generated `AGENTS.md` (all targets), for 
example: "Write the deliverables into the
         project from the start and iterate on them in place. Scratch 
directories are for throwaway probes only; nothing
         outside the project counts as delivered."
   - [ ] Mirror it in `skills/shared/iron-laws.md`, next to the 
environment-probe exception.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to