On 1/7/26 18:48, Khem Raj wrote:
> Hi Gyorgy
>
> When running on slower emalations ( without kvm ) e.g. qemuriscv64 one
> test
> fails like below, I think the timeout should be laxed a bit to ensure
> that these
> are considered.
>

Alright, will take a look at that.

> + Exception Group Traceback (most recent call last):
>   |   File "/usr/lib/python3-h2/ptest/tests/test_basic_logic.py", line
> 824, in test_changing_max_frame_size
>   |    
> @settings(suppress_health_check=[HealthCheck.function_scoped_fixture])
>   |                ^^^^^^^^^^^^^^^^^^^^^^
>   |   File "/usr/lib/python3.13/site-packages/hypothesis/core.py",
> line 2234, in wrapped_test
>   |     raise the_error_hypothesis_found
>   | hypothesis.errors.FlakyFailure: Hypothesis
> test_changing_max_frame_size(self=<tests.test_basic_logic.TestBasicClient
> object at 0x3f9769e580>, frame_factory=<tests.helpers.FrameFactory
> object at 0x3f9696e7b0>, frame_size=3623515) produces unreliable
> results: Falsified on the first call but did not on a subsequent one
> (1 sub-exception)
>   | Falsifying example: test_changing_max_frame_size(
>   |     self=<tests.test_basic_logic.TestBasicClient object at
> 0x3f9769e580>,
>   |     frame_factory=<tests.helpers.FrameFactory object at 0x3f9696e7b0>,
>   |     frame_size=3623515,
>   | )
>   | Unreliable test timings! On an initial run, this test took
> 638.89ms, which exceeded the deadline of 200.00ms, but on a subsequent
> run it took 153.78 ms, which did not. If you expect this sort of
> variability in your test timings, consider turning deadlines off for
> this test by setting deadline=None.
>   +-+---------------- 1 ----------------
>     | Traceback (most recent call last):
>     |   File "/usr/lib/python3.13/site-packages/hypothesis/core.py",
> line 1200, in _execute_once_for_engine
>     |     result = self.execute_once(data)
>     |   File "/usr/lib/python3.13/site-packages/hypothesis/core.py",
> line 1140, in execute_once
>     |     result = self.test_runner(data, run)
>     |   File "/usr/lib/python3.13/site-packages/hypothesis/core.py",
> line 824, in default_executor
>     |     return function(data)
>     |   File "/usr/lib/python3.13/site-packages/hypothesis/core.py",
> line 1097, in run
>     |     return test(*args, **kwargs)
>     |   File "/usr/lib/python3-h2/ptest/tests/test_basic_logic.py",
> line 824, in test_changing_max_frame_size
>     |    
> @settings(suppress_health_check=[HealthCheck.function_scoped_fixture])
>     |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
>     |   File "/usr/lib/python3.13/site-packages/hypothesis/core.py",
> line 1031, in test
>     |     raise DeadlineExceeded(
>     |         datetime.timedelta(seconds=runtime), self.settings.deadline
>     |     )
>     | hypothesis.errors.DeadlineExceeded: Test took 638.89ms, which
> exceeds the deadline of 200.00ms. If you expect test cases to take
> this long, you can use @settings(deadline=...) to either set a higher
> deadline, or to disable it with deadline=None.
>     +------------------------------------

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#123232): 
https://lists.openembedded.org/g/openembedded-devel/message/123232
Mute This Topic: https://lists.openembedded.org/mt/117138532/21656
Group Owner: [email protected]
Unsubscribe: https://lists.openembedded.org/g/openembedded-devel/unsub 
[[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-

Reply via email to