gnodet-bot commented on PR #26954:
URL: https://github.com/apache/camel/pull/26954#issuecomment-5866434209

   ## ๐ŸŸก Local IT results for `b4b7410f52ccc5966989c29dedbaa9087abda936`
   
   Ran integration tests locally (without `-Dci.env.name`) for the ollama 
container upgrade from `0.34.2` โ†’ `0.34.4`.
   
   **Test-infra module**: `camel-test-infra-ollama`
   **Component tested**: `camel-langchain4j-chat`
   
   ### Results: 13/14 passed, 1 timeout
   
   | Test | Time | Status |
   |------|------|--------|
   | testSendMessage | 5.7s | โœ… |
   | testSendChatMessage | 6.4s | โœ… |
   | testSendMultipleMessages | 13.7s | โœ… |
   | testSendMultipleMessagesRagEnrich | 9.3s | โœ… |
   | testSendMultipleMessagesRagHeader | 2.9s | โœ… |
   | testSendMessageWithPromptRagEnrich | 17.1s | โœ… |
   | testSendMessageWithPromptRagHeader | 2.7s | โœ… |
   | testSimpleMessageWithEnrichRAG | 3.5s | โœ… |
   | testSimpleMessageWithHeaderhRAG | 6.3s | โœ… |
   | testSendEmptyMessage | 0.1s | โœ… |
   | testSendMultipleEmpty | 0.1s | โœ… |
   | testSendMessageEmptyVariables | 0.0s | โœ… |
   | testSendMessageEmptyPrompt | 0.1s | โœ… |
   | **testSendMessageWithPrompt** | **181.5s** | โŒ timeout |
   
   ### Analysis
   
   The `testSendMessageWithPrompt` failure is **not a regression from the 
version bump**. It's a resource limitation: the test asks Ollama to generate a 
full recipe ("Create a recipe for an oven dish with potato, tomato, feta, olive 
oil"), which requires substantial LLM inference time. The test uses a 60-second 
HTTP timeout (`OllamaTestSupport` โ†’ `timeout(ofSeconds(60))`), but CPU-only 
inference took ~181 seconds on this machine.
   
   All other tests โ€” including RAG, multi-turn, multi-message, and empty/error 
cases โ€” passed cleanly with `ollama:0.34.4`. The new container version is 
compatible.
   
   <details><summary>Failure details</summary>
   
   ```
   [ERROR] LangChain4jChatIT.testSendMessageWithPrompt:154 ยป CamelExecution
   Exception occurred during execution on the exchange
   Caused by: dev.langchain4j.exception.TimeoutException: request timed out
     at 
dev.langchain4j.http.client.jdk.JdkHttpClient.execute(JdkHttpClient.java:82)
     at dev.langchain4j.model.ollama.OllamaClient.chat(OllamaClient.java:118)
     at 
dev.langchain4j.model.ollama.OllamaChatModel.doChat(OllamaChatModel.java:41)
   Tests run: 14, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 252.1 s
   ```
   
   </details>
   
   > _Local integration tests run by Hermes on behalf of @gnodet_
   > _Tests run without `-Dci.env.name` to include ITs disabled on GitHub 
Actions CI_
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to