John Roesler created KAFKA-10202:
------------------------------------

             Summary: SmokeTest should provide a machanism to generate 
continuously AND verify the result
                 Key: KAFKA-10202
                 URL: https://issues.apache.org/jira/browse/KAFKA-10202
             Project: Kafka
          Issue Type: Improvement
          Components: streams, system tests
            Reporter: John Roesler


Several system tests use the SmokeTestDriver, but they have to choose between 
generating for a fixed period of time (say, two minutes) before verifying 
results OR generating until cancelled with no verification.

It's not impossible to implement "generate until cancelled and then verify", 
and doing so would both speed up tests that are just blocked by the two-minute 
generation period AND decrease flakiness in other tests, when they can't 
complete all their operations within the deadline before verification begins.

One ides is to revamp the smoke test driver's verification logic to make it 
consume the input and determine the expected results, so that the verifier can 
be run as a separate process instead of passing the expected results straight 
from the generator to the verifier. This is how the RelationalSmokeTest works.

An alternative is to register a signal handler so that we can signal the driver 
to stop generating and start verifying.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to