This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 19777f1 Decreases cassandra memory requirement during Integration
tests (#17524)
19777f1 is described below
commit 19777f170ff7d5c10a333b9c0b99ac3e46afdfc9
Author: Jarek Potiuk <[email protected]>
AuthorDate: Tue Aug 10 08:54:00 2021 +0200
Decreases cassandra memory requirement during Integration tests (#17524)
Seems that Cassandra was the main reason why a lot of memory
was used during our integration tests. This has been overlooked
before but seems that cassandra will always take as much as 25%
of available memory by default and it meant for the GitHub public
runners it was ~2 GB. Also for the self-hosted runners, even if
they had a lot of memory, cassandra could eat up big chunk of the
memory.
With the settings added in PR Cassandra will take ~750 MB of memory
total.
---
scripts/ci/docker-compose/integration-cassandra.yml | 3 +++
1 file changed, 3 insertions(+)
diff --git a/scripts/ci/docker-compose/integration-cassandra.yml
b/scripts/ci/docker-compose/integration-cassandra.yml
index 50fcbd5..0465bde 100644
--- a/scripts/ci/docker-compose/integration-cassandra.yml
+++ b/scripts/ci/docker-compose/integration-cassandra.yml
@@ -19,6 +19,9 @@ version: "2.2"
services:
cassandra:
image: cassandra:3.0
+ environment:
+ HEAP_NEWSIZE: 128M
+ MAX_HEAP_SIZE: 256M
volumes:
- /dev/urandom:/dev/random # Required to get non-blocking entropy
source
- cassandra-db-volume:/var/lib/cassandra
