cameronlee314 opened a new pull request #1324: SAMZA-2481: Improve memory usage 
in samza-core unit tests
URL: https://github.com/apache/samza/pull/1324
 
 
   Symptom: `samza-core` requires `maxHeapSize` set to 4g when running unit 
tests. Otherwise, the test suite may hang or fail (especially in the CI 
pipeline).
   Cause: `TestZkMetadataStore` has some tests around large values being 
written to zookeeper. That test uses an embedded zookeeper which does a lot of 
debug logging. The current logging impl for samza-core unit tests is the log4j 
v1 impl, which somehow defaults to DEBUG logging.
   Changes: Use log4j2 logging impl for unit tests, since it seems to default 
to ERROR logging. We don't need the unit tests of the committed code to report 
DEBUG logging.
   Tests: `./gradlew :samza-core:test` no longer hangs with a lower memory 
allocation. Before this change, it would hang.
   API changes: log4j2 version increased from `2.11.0` to `2.12.0`, so any apps 
depending on `samza-log4j2` will transitively pull in the new version.
   Upgrade/usage instructions: N/A

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to