SEZ9 opened a new issue, #11508:
URL: https://github.com/apache/seatunnel/issues/11508

   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue) and found no 
similar issues.
   
   ### What happened
   
   Two cases where the SeaTunnel CLI (`seatunnel-cli`) fails on or rejects 
valid input, found while running an accuracy benchmark of the CLI across 7 LLM 
providers/models:
   
   **1. Bedrock: newer Claude models reject the `temperature` inference 
parameter**
   
   Newer Claude models on AWS Bedrock (e.g. `us.anthropic.claude-sonnet-5`) 
reject the `temperature` inference parameter with:
   
   ```
   botocore.errorfactory.ValidationException: An error occurred 
(ValidationException) when
   calling the ConverseStream operation: The model returned the following 
errors:
   `temperature` is deprecated for this model.
   ```
   
   `BedrockProvider.chat` / `chat_stream` always send `temperature`, so **every 
CLI call fails** for these models — the CLI is unusable with them.
   
   **2. `validate_hocon` misreports SeaTunnel engine template variables as 
unresolved environment variables**
   
   The local validator treats every `${xxx}` placeholder as an environment 
variable. But SeaTunnel's file sinks support engine-resolved template variables 
`${now}`, `${uuid}`, `${transactionId}` in `file_name_expression` (documented 
in [LocalFile sink 
docs](https://github.com/apache/seatunnel/blob/dev/docs/en/connectors/sink/LocalFile.md)).
 A valid config such as:
   
   ```hocon
   sink {
     LocalFile {
       path = "/data/out"
       custom_filename = true
       file_name_expression = "${now}"
       ...
     }
   }
   ```
   
   is rejected with `ERROR: Unresolved environment variables: now. Set them 
before running: export now=<value>`, and the CLI's auto-fix loop then "fixes" a 
config that was never broken.
   
   ### SeaTunnel Version
   
   dev (seatunnel-cli @ 59ada4ec0)
   
   ### SeaTunnel Config
   
   See above.
   
   ### Running Command
   
   ```
   ANTHROPIC_MODEL=us.anthropic.claude-sonnet-5 AI_PROVIDER=bedrock seatunnel 
"generate any pipeline"   # case 1
   # case 2: generate a LocalFile sink config with file_name_expression = 
"${now}", then /check
   ```
   
   ### Error Exception
   
   See above.
   
   ### Zeta or Flink or Spark Version
   
   _No response_
   
   ### Java or Scala Version
   
   Python 3.10+ (seatunnel-cli)
   
   ### Screenshots
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to