Hi Gyorgy

When running on slower emalations ( without kvm ) e.g. qemuriscv64 one test
fails like below, I think the timeout should be laxed a bit to ensure that
these
are considered.

+ Exception Group Traceback (most recent call last):
  |   File "/usr/lib/python3-h2/ptest/tests/test_basic_logic.py", line 824,
in test_changing_max_frame_size
  |
@settings(suppress_health_check=[HealthCheck.function_scoped_fixture])
  |                ^^^^^^^^^^^^^^^^^^^^^^
  |   File "/usr/lib/python3.13/site-packages/hypothesis/core.py", line
2234, in wrapped_test
  |     raise the_error_hypothesis_found
  | hypothesis.errors.FlakyFailure: Hypothesis
test_changing_max_frame_size(self=<tests.test_basic_logic.TestBasicClient
object at 0x3f9769e580>, frame_factory=<tests.helpers.FrameFactory object
at 0x3f9696e7b0>, frame_size=3623515) produces unreliable results:
Falsified on the first call but did not on a subsequent one (1
sub-exception)
  | Falsifying example: test_changing_max_frame_size(
  |     self=<tests.test_basic_logic.TestBasicClient object at
0x3f9769e580>,
  |     frame_factory=<tests.helpers.FrameFactory object at 0x3f9696e7b0>,
  |     frame_size=3623515,
  | )
  | Unreliable test timings! On an initial run, this test took 638.89ms,
which exceeded the deadline of 200.00ms, but on a subsequent run it took
153.78 ms, which did not. If you expect this sort of variability in your
test timings, consider turning deadlines off for this test by setting
deadline=None.
  +-+---------------- 1 ----------------
    | Traceback (most recent call last):
    |   File "/usr/lib/python3.13/site-packages/hypothesis/core.py", line
1200, in _execute_once_for_engine
    |     result = self.execute_once(data)
    |   File "/usr/lib/python3.13/site-packages/hypothesis/core.py", line
1140, in execute_once
    |     result = self.test_runner(data, run)
    |   File "/usr/lib/python3.13/site-packages/hypothesis/core.py", line
824, in default_executor
    |     return function(data)
    |   File "/usr/lib/python3.13/site-packages/hypothesis/core.py", line
1097, in run
    |     return test(*args, **kwargs)
    |   File "/usr/lib/python3-h2/ptest/tests/test_basic_logic.py", line
824, in test_changing_max_frame_size
    |
@settings(suppress_health_check=[HealthCheck.function_scoped_fixture])
    |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    |   File "/usr/lib/python3.13/site-packages/hypothesis/core.py", line
1031, in test
    |     raise DeadlineExceeded(
    |         datetime.timedelta(seconds=runtime), self.settings.deadline
    |     )
    | hypothesis.errors.DeadlineExceeded: Test took 638.89ms, which exceeds
the deadline of 200.00ms. If you expect test cases to take this long, you
can use @settings(deadline=...) to either set a higher deadline, or to
disable it with deadline=None.
    +------------------------------------
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#123228): 
https://lists.openembedded.org/g/openembedded-devel/message/123228
Mute This Topic: https://lists.openembedded.org/mt/117138532/21656
Group Owner: [email protected]
Unsubscribe: https://lists.openembedded.org/g/openembedded-devel/unsub 
[[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-

Reply via email to