DanielLeens commented on issue #12539: URL: https://github.com/apache/seatunnel/issues/12539#issuecomment-5892236363
Classification: E / SeaTunnel CLI planner intent routing. Correction to the earlier source-location question: current `dev` at `4c874e2a4061aea9d5db65e74edeb211b498fe27` does contain `seatunnel-cli/seatunnel_cli/agents.py` and `seatunnel-cli/benchmark/execution.py`. The reported `PLANNER_SYSTEM` wording is present: PLAN is limited to a short signal list while CHAT covers everything else, so this is an in-repository CLI issue rather than a missing-module blocker. The benchmark evidence is a valid signal, but it does not yet prove prompt wording is the sole cause because outcomes vary by run. Keep the hard logs/error CHAT override. Before changing the planner prompt, add the versioned smoke preset from #12534, record the exact model, temperature, task isolation/history behavior, and run the same multi-trial matrix before and after. The acceptance metric is a reduction in `non-config result: chat` for unambiguous pipeline requests without converting diagnostic requests into PLAN. No label or assignment change in this pass. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
