[jira] [Resolved] (CAMEL-20722) camel-kafka: reduce KafkaBreakOnFirstError tests are too unreliable for CIs

2024-05-08 Thread JV Singh (Jira)


 [ 
https://issues.apache.org/jira/browse/CAMEL-20722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

JV Singh resolved CAMEL-20722.
--
Resolution: Fixed

local builds have been quite stable for a while, and last CI tests were clean 
after this:  [https://github.com/apache/camel/pull/14060] 

I suggest we observe this for a few more rounds on CI

> camel-kafka: reduce KafkaBreakOnFirstError tests are too unreliable for CIs
> ---
>
> Key: CAMEL-20722
> URL: https://issues.apache.org/jira/browse/CAMEL-20722
> Project: Camel
>  Issue Type: Task
>  Components: camel-kafka
>Affects Versions: 4.4.1, 4.5.0
>Reporter: Otavio Rodolfo Piske
>Assignee: JV Singh
>Priority: Major
>  Labels: help-wanted
> Fix For: 4.x
>
> Attachments: build-log.txt
>
>
> All the tests named KafkaBreakOnFirst.*IT are unreliable when running on the 
> CI. They fail often, sometimes in multiple archs.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Work started] (CAMEL-20722) camel-kafka: reduce KafkaBreakOnFirstError tests are too unreliable for CIs

2024-05-08 Thread JV Singh (Jira)


 [ 
https://issues.apache.org/jira/browse/CAMEL-20722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on CAMEL-20722 started by JV Singh.

> camel-kafka: reduce KafkaBreakOnFirstError tests are too unreliable for CIs
> ---
>
> Key: CAMEL-20722
> URL: https://issues.apache.org/jira/browse/CAMEL-20722
> Project: Camel
>  Issue Type: Task
>  Components: camel-kafka
>Affects Versions: 4.4.1, 4.5.0
>Reporter: Otavio Rodolfo Piske
>Assignee: JV Singh
>Priority: Major
>  Labels: help-wanted
> Fix For: 4.x
>
> Attachments: build-log.txt
>
>
> All the tests named KafkaBreakOnFirst.*IT are unreliable when running on the 
> CI. They fail often, sometimes in multiple archs.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (CAMEL-20722) camel-kafka: reduce KafkaBreakOnFirstError tests are too unreliable for CIs

2024-05-08 Thread JV Singh (Jira)


[ 
https://issues.apache.org/jira/browse/CAMEL-20722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844544#comment-17844544
 ] 

JV Singh commented on CAMEL-20722:
--

Since local builds have been quite stable for a while, and last CI tests were 
clean after this:  [https://github.com/apache/camel/pull/14060] 

I suggest we observe this for a few more rounds on CI, just in case we find 
another random failure

[~orpiske] , you can take a call when it's ok to mark this as closed

> camel-kafka: reduce KafkaBreakOnFirstError tests are too unreliable for CIs
> ---
>
> Key: CAMEL-20722
> URL: https://issues.apache.org/jira/browse/CAMEL-20722
> Project: Camel
>  Issue Type: Task
>  Components: camel-kafka
>Affects Versions: 4.4.1, 4.5.0
>Reporter: Otavio Rodolfo Piske
>Assignee: JV Singh
>Priority: Major
>  Labels: help-wanted
> Fix For: 4.x
>
> Attachments: build-log.txt
>
>
> All the tests named KafkaBreakOnFirst.*IT are unreliable when running on the 
> CI. They fail often, sometimes in multiple archs.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Work stopped] (CAMEL-20722) camel-kafka: reduce KafkaBreakOnFirstError tests are too unreliable for CIs

2024-05-08 Thread JV Singh (Jira)


 [ 
https://issues.apache.org/jira/browse/CAMEL-20722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on CAMEL-20722 stopped by JV Singh.

> camel-kafka: reduce KafkaBreakOnFirstError tests are too unreliable for CIs
> ---
>
> Key: CAMEL-20722
> URL: https://issues.apache.org/jira/browse/CAMEL-20722
> Project: Camel
>  Issue Type: Task
>  Components: camel-kafka
>Affects Versions: 4.4.1, 4.5.0
>Reporter: Otavio Rodolfo Piske
>Assignee: JV Singh
>Priority: Major
>  Labels: help-wanted
> Fix For: 4.x
>
> Attachments: build-log.txt
>
>
> All the tests named KafkaBreakOnFirst.*IT are unreliable when running on the 
> CI. They fail often, sometimes in multiple archs.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Work started] (CAMEL-20722) camel-kafka: reduce KafkaBreakOnFirstError tests are too unreliable for CIs

2024-05-07 Thread JV Singh (Jira)


 [ 
https://issues.apache.org/jira/browse/CAMEL-20722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on CAMEL-20722 started by JV Singh.

> camel-kafka: reduce KafkaBreakOnFirstError tests are too unreliable for CIs
> ---
>
> Key: CAMEL-20722
> URL: https://issues.apache.org/jira/browse/CAMEL-20722
> Project: Camel
>  Issue Type: Task
>  Components: camel-kafka
>Affects Versions: 4.4.1, 4.5.0
>Reporter: Otavio Rodolfo Piske
>Assignee: JV Singh
>Priority: Major
>  Labels: help-wanted
> Fix For: 4.x
>
> Attachments: build-log.txt
>
>
> All the tests named KafkaBreakOnFirst.*IT are unreliable when running on the 
> CI. They fail often, sometimes in multiple archs.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (CAMEL-20680) camel-kafka: reduce KafkaBreakOnFirstErrorSeekIssueIT test duration

2024-05-07 Thread JV Singh (Jira)


[ 
https://issues.apache.org/jira/browse/CAMEL-20680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844541#comment-17844541
 ] 

JV Singh commented on CAMEL-20680:
--

Assigning back to [~orpiske] who created this , to review and close. 

> camel-kafka: reduce KafkaBreakOnFirstErrorSeekIssueIT test duration
> ---
>
> Key: CAMEL-20680
> URL: https://issues.apache.org/jira/browse/CAMEL-20680
> Project: Camel
>  Issue Type: Task
>  Components: camel-kafka
>Affects Versions: 4.4.1, 4.5.0
>Reporter: Otavio Rodolfo Piske
>Assignee: Otavio Rodolfo Piske
>Priority: Major
>  Labels: help-wanted
> Fix For: 4.x
>
> Attachments: image-2024-05-01-08-13-28-056.png
>
>
> The test KafkaBreakOnFirstErrorSeekIssueIT takes a very long time to run. 
> This consumes unnecessary resources from ASF CI. We should investigate how to 
> improve it to it runs quickly.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (CAMEL-20680) camel-kafka: reduce KafkaBreakOnFirstErrorSeekIssueIT test duration

2024-05-07 Thread JV Singh (Jira)


 [ 
https://issues.apache.org/jira/browse/CAMEL-20680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

JV Singh resolved CAMEL-20680.
--
Resolution: Fixed

This specific test was fixed via pull request: 
[https://github.com/apache/camel/pull/14008]

There a drastic reduction in test execution time. Subsequent pull request 
re-enabled this and related set of tests: 
https://github.com/apache/camel/pull/14060/commits

> camel-kafka: reduce KafkaBreakOnFirstErrorSeekIssueIT test duration
> ---
>
> Key: CAMEL-20680
> URL: https://issues.apache.org/jira/browse/CAMEL-20680
> Project: Camel
>  Issue Type: Task
>  Components: camel-kafka
>Affects Versions: 4.4.1, 4.5.0
>Reporter: Otavio Rodolfo Piske
>Assignee: JV Singh
>Priority: Major
>  Labels: help-wanted
> Fix For: 4.x
>
> Attachments: image-2024-05-01-08-13-28-056.png
>
>
> The test KafkaBreakOnFirstErrorSeekIssueIT takes a very long time to run. 
> This consumes unnecessary resources from ASF CI. We should investigate how to 
> improve it to it runs quickly.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Assigned] (CAMEL-20680) camel-kafka: reduce KafkaBreakOnFirstErrorSeekIssueIT test duration

2024-05-07 Thread JV Singh (Jira)


 [ 
https://issues.apache.org/jira/browse/CAMEL-20680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

JV Singh reassigned CAMEL-20680:


Assignee: Otavio Rodolfo Piske  (was: JV Singh)

> camel-kafka: reduce KafkaBreakOnFirstErrorSeekIssueIT test duration
> ---
>
> Key: CAMEL-20680
> URL: https://issues.apache.org/jira/browse/CAMEL-20680
> Project: Camel
>  Issue Type: Task
>  Components: camel-kafka
>Affects Versions: 4.4.1, 4.5.0
>Reporter: Otavio Rodolfo Piske
>Assignee: Otavio Rodolfo Piske
>Priority: Major
>  Labels: help-wanted
> Fix For: 4.x
>
> Attachments: image-2024-05-01-08-13-28-056.png
>
>
> The test KafkaBreakOnFirstErrorSeekIssueIT takes a very long time to run. 
> This consumes unnecessary resources from ASF CI. We should investigate how to 
> improve it to it runs quickly.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Work started] (CAMEL-20680) camel-kafka: reduce KafkaBreakOnFirstErrorSeekIssueIT test duration

2024-05-07 Thread JV Singh (Jira)


 [ 
https://issues.apache.org/jira/browse/CAMEL-20680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on CAMEL-20680 started by JV Singh.

> camel-kafka: reduce KafkaBreakOnFirstErrorSeekIssueIT test duration
> ---
>
> Key: CAMEL-20680
> URL: https://issues.apache.org/jira/browse/CAMEL-20680
> Project: Camel
>  Issue Type: Task
>  Components: camel-kafka
>Affects Versions: 4.4.1, 4.5.0
>Reporter: Otavio Rodolfo Piske
>Assignee: JV Singh
>Priority: Major
>  Labels: help-wanted
> Fix For: 4.x
>
> Attachments: image-2024-05-01-08-13-28-056.png
>
>
> The test KafkaBreakOnFirstErrorSeekIssueIT takes a very long time to run. 
> This consumes unnecessary resources from ASF CI. We should investigate how to 
> improve it to it runs quickly.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (CAMEL-20680) camel-kafka: reduce KafkaBreakOnFirstErrorSeekIssueIT test duration

2024-05-06 Thread JV Singh (Jira)


[ 
https://issues.apache.org/jira/browse/CAMEL-20680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17843706#comment-17843706
 ] 

JV Singh commented on CAMEL-20680:
--

Hi [~orpiske] , noted. I meant to do that soon, after running these tests 
repeatedly to ensure that they were consistently stable with these changes. 

So far the results look good. 

You can assign these issues to me if that's ok. 

> camel-kafka: reduce KafkaBreakOnFirstErrorSeekIssueIT test duration
> ---
>
> Key: CAMEL-20680
> URL: https://issues.apache.org/jira/browse/CAMEL-20680
> Project: Camel
>  Issue Type: Task
>  Components: camel-kafka
>Affects Versions: 4.4.1, 4.5.0
>Reporter: Otavio Rodolfo Piske
>Priority: Major
>  Labels: help-wanted
> Fix For: 4.x
>
> Attachments: image-2024-05-01-08-13-28-056.png
>
>
> The test KafkaBreakOnFirstErrorSeekIssueIT takes a very long time to run. 
> This consumes unnecessary resources from ASF CI. We should investigate how to 
> improve it to it runs quickly.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Comment Edited] (CAMEL-20722) camel-kafka: reduce KafkaBreakOnFirstError tests are too unreliable for CIs

2024-05-06 Thread JV Singh (Jira)


[ 
https://issues.apache.org/jira/browse/CAMEL-20722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17843688#comment-17843688
 ] 

JV Singh edited comment on CAMEL-20722 at 5/6/24 9:12 AM:
--

[~orpiske] , my pleasure to contribute, as i've used Apache Camel and plan to 
use it in future projects too. 

After the recent commits for this and related ticket CAMEL-20680, I now get 
clean test runs fairly consistently (taking 21-23 minutes consistently on my 
local development env). 

See attached output for example: [^build-log.txt]

^CC: [~davsclaus]^ 


was (Author: jvsingh):
[~orpiske] , my pleasure to contribute, as i've used Apache Camel and plan to 
use it in future projects too. 

After the recent commits for this and related ticket [CAMEL-20680], I now get 
clean test runs fairly consistently (taking 21-23 minutes consistently on my 
local development env). 

See attached output for example. 

> camel-kafka: reduce KafkaBreakOnFirstError tests are too unreliable for CIs
> ---
>
> Key: CAMEL-20722
> URL: https://issues.apache.org/jira/browse/CAMEL-20722
> Project: Camel
>  Issue Type: Task
>  Components: camel-kafka
>Affects Versions: 4.4.1, 4.5.0
>Reporter: Otavio Rodolfo Piske
>Priority: Major
>  Labels: help-wanted
> Fix For: 4.x
>
> Attachments: build-log.txt
>
>
> All the tests named KafkaBreakOnFirst.*IT are unreliable when running on the 
> CI. They fail often, sometimes in multiple archs.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (CAMEL-20722) camel-kafka: reduce KafkaBreakOnFirstError tests are too unreliable for CIs

2024-05-06 Thread JV Singh (Jira)


[ 
https://issues.apache.org/jira/browse/CAMEL-20722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17843688#comment-17843688
 ] 

JV Singh commented on CAMEL-20722:
--

[~orpiske] , my pleasure to contribute, as i've used Apache Camel and plan to 
use it in future projects too. 

After the recent commits for this and related ticket [CAMEL-20680], I now get 
clean test runs fairly consistently (taking 21-23 minutes consistently on my 
local development env). 

See attached output for example. 

> camel-kafka: reduce KafkaBreakOnFirstError tests are too unreliable for CIs
> ---
>
> Key: CAMEL-20722
> URL: https://issues.apache.org/jira/browse/CAMEL-20722
> Project: Camel
>  Issue Type: Task
>  Components: camel-kafka
>Affects Versions: 4.4.1, 4.5.0
>Reporter: Otavio Rodolfo Piske
>Priority: Major
>  Labels: help-wanted
> Fix For: 4.x
>
> Attachments: build-log.txt
>
>
> All the tests named KafkaBreakOnFirst.*IT are unreliable when running on the 
> CI. They fail often, sometimes in multiple archs.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (CAMEL-20722) camel-kafka: reduce KafkaBreakOnFirstError tests are too unreliable for CIs

2024-05-06 Thread JV Singh (Jira)


 [ 
https://issues.apache.org/jira/browse/CAMEL-20722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

JV Singh updated CAMEL-20722:
-
Attachment: build-log.txt

> camel-kafka: reduce KafkaBreakOnFirstError tests are too unreliable for CIs
> ---
>
> Key: CAMEL-20722
> URL: https://issues.apache.org/jira/browse/CAMEL-20722
> Project: Camel
>  Issue Type: Task
>  Components: camel-kafka
>Affects Versions: 4.4.1, 4.5.0
>Reporter: Otavio Rodolfo Piske
>Priority: Major
>  Labels: help-wanted
> Fix For: 4.x
>
> Attachments: build-log.txt
>
>
> All the tests named KafkaBreakOnFirst.*IT are unreliable when running on the 
> CI. They fail often, sometimes in multiple archs.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (CAMEL-20722) camel-kafka: reduce KafkaBreakOnFirstError tests are too unreliable for CIs

2024-05-05 Thread JV Singh (Jira)


[ 
https://issues.apache.org/jira/browse/CAMEL-20722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17843580#comment-17843580
 ] 

JV Singh commented on CAMEL-20722:
--

There are still occasional and sporadic failures in some integration tests when 
run locally. 

I made another set of changes in this pull request (increase timeout to 10 sec 
from 3 sec) 

https://github.com/apache/camel/pull/14052

> camel-kafka: reduce KafkaBreakOnFirstError tests are too unreliable for CIs
> ---
>
> Key: CAMEL-20722
> URL: https://issues.apache.org/jira/browse/CAMEL-20722
> Project: Camel
>  Issue Type: Task
>  Components: camel-kafka
>Affects Versions: 4.4.1, 4.5.0
>Reporter: Otavio Rodolfo Piske
>Priority: Major
>  Labels: help-wanted
> Fix For: 4.x
>
>
> All the tests named KafkaBreakOnFirst.*IT are unreliable when running on the 
> CI. They fail often, sometimes in multiple archs.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (CAMEL-20686) camel-core: review File tests for incorrectly shared resources

2024-05-04 Thread JV Singh (Jira)


[ 
https://issues.apache.org/jira/browse/CAMEL-20686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17843429#comment-17843429
 ] 

JV Singh commented on CAMEL-20686:
--

Hi [~orpiske] , [~davsclaus] , 

I did some searches through the camel-core code and spotted some such examples. 
I might keep making changes and create pull requests if there are no objections

> camel-core: review File tests for incorrectly shared resources
> --
>
> Key: CAMEL-20686
> URL: https://issues.apache.org/jira/browse/CAMEL-20686
> Project: Camel
>  Issue Type: Task
>  Components: camel-core
>Affects Versions: 4.6.0
>Reporter: Otavio Rodolfo Piske
>Priority: Major
>  Labels: help-wanted
> Fix For: 4.x
>
>
> We have lots of file tests in core that run in parallel and try to write to 
> the same file. This leads to a lot of flakiness in file tests.
>  
> Look for tests doing things like {{testFile("output.txt")}} or 
> {{testFile("input.txt")}} or other similar repetitive names (i.e.: 
> {{{}foo{}}}, {{{}bar{}}}, etc) should be considered suspicious and need 
> careful review.
>  
> The tests should be adjusted to one of the following (in order of preference):
>  * Use separate resources for each test (i.e: "{{{}input." + 
> TestClass.class.getSimpleName() + ".txt"{}}})
>  * Use JUnit's 5 temporary file provider
>  * Use resource locks via JUnit's {{@ResourceLock}} annotation.
>  * Or Isolated if safe to do so



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (CAMEL-20680) camel-kafka: reduce KafkaBreakOnFirstErrorSeekIssueIT test duration

2024-05-01 Thread JV Singh (Jira)


[ 
https://issues.apache.org/jira/browse/CAMEL-20680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842620#comment-17842620
 ] 

JV Singh commented on CAMEL-20680:
--

Proposed fix is in this pull request: 
[https://github.com/apache/camel/pull/14008]

For repeated tests, I expect this to reduce execution times by over 80% 

 

> camel-kafka: reduce KafkaBreakOnFirstErrorSeekIssueIT test duration
> ---
>
> Key: CAMEL-20680
> URL: https://issues.apache.org/jira/browse/CAMEL-20680
> Project: Camel
>  Issue Type: Task
>  Components: camel-kafka
>Affects Versions: 4.4.1, 4.5.0
>Reporter: Otavio Rodolfo Piske
>Priority: Major
>  Labels: help-wanted
> Fix For: 4.x
>
> Attachments: image-2024-05-01-08-13-28-056.png
>
>
> The test KafkaBreakOnFirstErrorSeekIssueIT takes a very long time to run. 
> This consumes unnecessary resources from ASF CI. We should investigate how to 
> improve it to it runs quickly.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (CAMEL-20680) camel-kafka: reduce KafkaBreakOnFirstErrorSeekIssueIT test duration

2024-05-01 Thread JV Singh (Jira)


[ 
https://issues.apache.org/jira/browse/CAMEL-20680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842592#comment-17842592
 ] 

JV Singh commented on CAMEL-20680:
--

{{Hi [~orpiske] , [~davsclaus] }}

{{KafkaBreakOnFirstErrorSeekIssueIT }}succeeds but is unusual because it 
consistently takes over *450* seconds to run whereas other tests take under 50 
seconds on an average (another odd test took around 100 sec). 

To rule out the time taken for download of docker images, I ran the tests 
repeatedly after deleting the local images - with this, 
{{KafkaBreakOnFirstErrorSeekIssueIT }}consistently took approximately 700 
seconds _(compared to 450 sec when docker images are already downloaded)_ 

 

!image-2024-05-01-08-13-28-056.png!  

This means, around 250 seconds are necessary purely for fetching and setting up 
the docker images locally. So, the remaining 450 seconds remain to be optimised 
_({+}assuming{+} these are not deleted every single time on ASF CI 
environment)._ 

For now, I have identified this method as the bottleneck: 
KafkaBreakOnFirstErrorSeekIssueIT::{*}publishMessagesToKafka{*}

I have some refactoring in mind for this and might submit a pull request if 
there are no objections. 

Best regards, 

JV 

 

> camel-kafka: reduce KafkaBreakOnFirstErrorSeekIssueIT test duration
> ---
>
> Key: CAMEL-20680
> URL: https://issues.apache.org/jira/browse/CAMEL-20680
> Project: Camel
>  Issue Type: Task
>  Components: camel-kafka
>Affects Versions: 4.4.1, 4.5.0
>Reporter: Otavio Rodolfo Piske
>Priority: Major
>  Labels: help-wanted
> Fix For: 4.x
>
> Attachments: image-2024-05-01-08-13-28-056.png
>
>
> The test KafkaBreakOnFirstErrorSeekIssueIT takes a very long time to run. 
> This consumes unnecessary resources from ASF CI. We should investigate how to 
> improve it to it runs quickly.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (CAMEL-20680) camel-kafka: reduce KafkaBreakOnFirstErrorSeekIssueIT test duration

2024-05-01 Thread JV Singh (Jira)


 [ 
https://issues.apache.org/jira/browse/CAMEL-20680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

JV Singh updated CAMEL-20680:
-
Attachment: image-2024-05-01-08-13-28-056.png

> camel-kafka: reduce KafkaBreakOnFirstErrorSeekIssueIT test duration
> ---
>
> Key: CAMEL-20680
> URL: https://issues.apache.org/jira/browse/CAMEL-20680
> Project: Camel
>  Issue Type: Task
>  Components: camel-kafka
>Affects Versions: 4.4.1, 4.5.0
>Reporter: Otavio Rodolfo Piske
>Priority: Major
>  Labels: help-wanted
> Fix For: 4.x
>
> Attachments: image-2024-05-01-08-13-28-056.png
>
>
> The test KafkaBreakOnFirstErrorSeekIssueIT takes a very long time to run. 
> This consumes unnecessary resources from ASF CI. We should investigate how to 
> improve it to it runs quickly.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (CAMEL-20680) camel-kafka: reduce KafkaBreakOnFirstErrorSeekIssueIT test duration

2024-04-30 Thread JV Singh (Jira)


[ 
https://issues.apache.org/jira/browse/CAMEL-20680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842487#comment-17842487
 ] 

JV Singh commented on CAMEL-20680:
--

Turns out, the timeout failures with these tests are quite random. 

In my case, this particular test succeeded 
{code:java}
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.03 s 
-- in 
org.apache.camel.component.kafka.integration.KafkaBreakOnFirstErrorReplayOldMessagesIT
[INFO] Running 
org.apache.camel.component.kafka.integration.KafkaBreakOnFirstErrorSeekIssueIT
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 457.6 s 
-- in 
org.apache.camel.component.kafka.integration.KafkaBreakOnFirstErrorSeekIssueIT{code}
but a few other random ones failed with a similar error:
{code:java}
[INFO] Running 
org.apache.camel.component.kafka.integration.KafkaBreakOnFirstErrorWithBatchUsingAsyncCommitManagerIT
[ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 38.90 s 
<<< FAILURE! -- in 
org.apache.camel.component.kafka.integration.KafkaBreakOnFirstErrorWithBatchUsingAsyncCommitManagerIT
[ERROR] 
org.apache.camel.component.kafka.integration.KafkaBreakOnFirstErrorWithBatchUsingAsyncCommitManagerIT.kafkaBreakOnFirstErrorBasicCapability
 -- Time elapsed: 5.010 s <<< ERROR!
org.awaitility.core.ConditionTimeoutException: Condition with Lambda expression 
in 
org.apache.camel.component.kafka.integration.KafkaBreakOnFirstErrorWithBatchUsingAsyncCommitManagerIT
 was not fulfilled within 3 seconds.{code}
I think it is quite likely for the elapsed times of these tests to vary based 
on CI / build server spec, network speed etc. 

> camel-kafka: reduce KafkaBreakOnFirstErrorSeekIssueIT test duration
> ---
>
> Key: CAMEL-20680
> URL: https://issues.apache.org/jira/browse/CAMEL-20680
> Project: Camel
>  Issue Type: Task
>  Components: camel-kafka
>Affects Versions: 4.4.1, 4.5.0
>Reporter: Otavio Rodolfo Piske
>Priority: Major
>  Labels: help-wanted
> Fix For: 4.x
>
>
> The test KafkaBreakOnFirstErrorSeekIssueIT takes a very long time to run. 
> This consumes unnecessary resources from ASF CI. We should investigate how to 
> improve it to it runs quickly.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (CAMEL-20722) camel-kafka: reduce KafkaBreakOnFirstError tests are too unreliable for CIs

2024-04-30 Thread JV Singh (Jira)


[ 
https://issues.apache.org/jira/browse/CAMEL-20722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842474#comment-17842474
 ] 

JV Singh commented on CAMEL-20722:
--

Many (but not all) KafkaBreakOnFirst*IT integration tests fail with this or a 
similar error: ... _was not fulfilled within 3 seconds._

 
{code:java}
[ERROR] 
org.apache.camel.component.kafka.integration.KafkaBreakOnFirstErrorWithBatchUsingSyncCommitManagerIT.kafkaBreakOnFirstErrorBasicCapability
 -- Time elapsed: 5.782 s <<< ERROR!
org.awaitility.core.ConditionTimeoutException: Condition with Lambda expression 
in 
org.apache.camel.component.kafka.integration.KafkaBreakOnFirstErrorWithBatchUsingSyncCommitManagerIT
 was not fulfilled within 3 seconds.{code}
 

 

> camel-kafka: reduce KafkaBreakOnFirstError tests are too unreliable for CIs
> ---
>
> Key: CAMEL-20722
> URL: https://issues.apache.org/jira/browse/CAMEL-20722
> Project: Camel
>  Issue Type: Task
>  Components: camel-kafka
>Affects Versions: 4.4.1, 4.5.0
>Reporter: Otavio Rodolfo Piske
>Priority: Major
>  Labels: help-wanted
> Fix For: 4.x
>
>
> All the tests named KafkaBreakOnFirst.*IT are unreliable when running on the 
> CI. They fail often, sometimes in multiple archs.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)