Geoff Anderson created KAFKA-4140:
-------------------------------------

             Summary: Update system tests to allow running tests in parallel
                 Key: KAFKA-4140
                 URL: https://issues.apache.org/jira/browse/KAFKA-4140
             Project: Kafka
          Issue Type: Improvement
            Reporter: Geoff Anderson
            Assignee: Geoff Anderson


The framework used to run system tests will soon have the capability to run 
tests in parallel. In our validations, we've found significant speedup with 
modest increase in the size of the worker cluster, as well as much better usage 
of the cluster resources.

A few updates to the kafka system test services and tests are needed to take 
full advantage of this:

1) cluster usage annotation - this provides a hint to the framework about what 
cluster resources to set aside for a given test, and lets the driver 
efficiently use the worker cluster.
2) eliminate a few canonical paths on the test driver. This is fine when tests 
are run serially, but in parallel, different tests end up colliding on these 
paths. The primary culprits here are security_config.py, and minikdc.py




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to