[ https://issues.apache.org/jira/browse/KAFKA-440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13438113#comment-13438113 ]
Neha Narkhede commented on KAFKA-440: ------------------------------------- Also, when I run the test, the data validation fails - 2012-08-20 12:18:50,193 - INFO - ====================================================== 2012-08-20 12:18:50,194 - INFO - validating data matched 2012-08-20 12:18:50,194 - INFO - ====================================================== 2012-08-20 12:18:50,196 - INFO - See /home/nnarkhed/Projects/kafka-440/system_test/replication_testsuite/testcase_1/msg_id_missing_in_consumer.log for missing MessageID (kafka_system_test_utils) 2012-08-20 12:18:50,196 - INFO - ================================================ 2012-08-20 12:18:50,196 - INFO - collecting logs from remote machines 2012-08-20 12:18:50,196 - INFO - ================================================ 2012-08-20 12:18:52,415 - INFO - ================================================= 2012-08-20 12:18:52,416 - INFO - TEST REPORTS 2012-08-20 12:18:52,416 - INFO - ================================================= 2012-08-20 12:18:52,416 - INFO - test_case_name : testcase_1 2012-08-20 12:18:52,416 - INFO - test_class_name : ReplicaBasicTest 2012-08-20 12:18:52,416 - INFO - validation_status : 2012-08-20 12:18:52,416 - INFO - Validate for data matched : FAILED 2012-08-20 12:18:52,416 - INFO - Validate leader election successful : PASSED But when I look at /home/nnarkhed/Projects/kafka-440/system_test/replication_testsuite/testcase_1/msg_id_missing_in_consumer.log, it is empty. Another observation - 2012-08-20 12:17:14,227 - INFO - ====================================================== 2012-08-20 12:17:14,227 - INFO - starting brokers 2012-08-20 12:17:14,228 - INFO - ====================================================== 2012-08-20 12:17:14,228 - INFO - field not found: clientPort (system_test_utils) 2012-08-20 12:17:14,228 - INFO - starting broker in host [localhost] on client port [] (kafka_system_test_utils) It complains that it cannot find clientPort while starting kafka broker. But clientPort is applicable only to zookeeper, not kafka. I think that is the reason it doesn't print out the Kafka server port above. > Create a regression test framework for distributed environment testing > ---------------------------------------------------------------------- > > Key: KAFKA-440 > URL: https://issues.apache.org/jira/browse/KAFKA-440 > Project: Kafka > Issue Type: Task > Reporter: John Fung > Assignee: John Fung > Labels: replication-testing > Fix For: 0.8 > > Attachments: kafka-440-v1.patch, kafka-440-v2.patch, > kafka-440-v3.patch, kafka-440-v5.patch > > > Initial requirements: > 1. The whole test framework is preferably coded in Python (a common scripting > language which has well supported features) > 2. Test framework driver should be generic (distributed environment can be > local host) > 3. Test framework related configurations are defined in JSON format > 4. Test environment, suite, case definitions may be defined in the following > levels: > 4-a entity_id is used as a key for looking up related config from different > levels > 4-b Cluster level defines: entity_id, hostname, kafka_home, java_home, ... > 4-c Test suite / case level defines: > 4-c-1 zookeeper: entity_id, clientPort, dataDir, log_filename, > config_filename > 4-c-2 broker: entity_id, port, log.file.size, log.dir, log_filename, > config_filename > 4-c-3 producer: entity_id, topic, threads, compression-codec, > message-size, log_filename, config_filename -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira