[
https://issues.apache.org/jira/browse/CASSANDRA-15014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16764881#comment-16764881
]
Alex Petrov edited comment on CASSANDRA-15014 at 2/11/19 2:44 PM:
------------------------------------------------------------------
In summary, there was a problem with retention resulting from schema change:
since it was executed on the main thread, we were retaining a bunch of thread
locals. Attaching a screenshot showing that we retain mere 12mb after full test
run.
I did test it on several environments and it seems that circleci is still
timing out because of GC pressure. I've decided to simplify runs and just have
each test executing in its own JVM to avoid GC contention alltogether.
I've also added an ant task to conveniently run distributed tests without test
list and have improved a shutdown process.
|[2.2|https://github.com/apache/cassandra/compare/2.2...ifesdjeen:CASSANDRA-15014-2.2]|[test
run|https://circleci.com/workflow-run/8b1aae41-e279-405b-b5e5-12808179daa2]|
|[3.0|https://github.com/apache/cassandra/compare/3.0...ifesdjeen:CASSANDRA-15014-3.0]|[test
run|https://circleci.com/workflow-run/53ad7477-7d5e-4c23-8634-be4def9e95b9]|
|[3.11|https://github.com/apache/cassandra/compare/3.11...ifesdjeen:CASSANDRA-15014-3.11]|[test
run|https://circleci.com/workflow-run/e41d800f-e39d-4f1d-a2bd-99e61c8a0675]|
|[trunk|https://github.com/apache/cassandra/compare/trunk...ifesdjeen:CASSANDRA-15014-trunk]|[test
run|https://circleci.com/workflow-run/6a326c41-8ffd-4307-b62f-b1bff3e15fce]|
was (Author: ifesdjeen):
In summary, there was a problem with retention resulting from schema change:
since it was executed on the main thread, we were retaining a bunch of thread
locals. Attaching a screenshot showing that we retain mere 12mb after full test
run.
I did test it on several environments and it seems that circleci is still
timing out because of GC pressure. I've decided to simplify runs and just have
each test executing in its own JVM to avoid GC contention alltogether.
I've also added an ant task to conveniently run distributed tests without test
list and have improved a shutdown process.
|[patch|https://github.com/apache/cassandra/compare/2.2...ifesdjeen:CASSANDRA-15014-2.2]|[test
run|https://circleci.com/workflow-run/8b1aae41-e279-405b-b5e5-12808179daa2]|
|[patch|https://github.com/apache/cassandra/compare/3.0...ifesdjeen:CASSANDRA-15014-3.0]|[test
run|https://circleci.com/workflow-run/53ad7477-7d5e-4c23-8634-be4def9e95b9]|
|[patch|https://github.com/apache/cassandra/compare/3.11...ifesdjeen:CASSANDRA-15014-3.11]|[test
run|https://circleci.com/workflow-run/e41d800f-e39d-4f1d-a2bd-99e61c8a0675]|
|[patch|https://github.com/apache/cassandra/compare/trunk...ifesdjeen:CASSANDRA-15014-trunk]|[test
run|https://circleci.com/workflow-run/6a326c41-8ffd-4307-b62f-b1bff3e15fce]|
> Unit tests failure on trunk
> ---------------------------
>
> Key: CASSANDRA-15014
> URL: https://issues.apache.org/jira/browse/CASSANDRA-15014
> Project: Cassandra
> Issue Type: Bug
> Components: Test/unit
> Reporter: Dinesh Joshi
> Assignee: Alex Petrov
> Priority: Major
> Attachments: Screen Shot 2019-02-11 at 12.30.19.png
>
>
> Currently org.apache.cassandra.distributed.test.DistributedReadWritePathTest
> is failing on trunk with the following error -
> {code:java}
> [junit-timeout] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
> [junit-timeout] Testsuite:
> org.apache.cassandra.distributed.test.DistributedReadWritePathTest
> [junit-timeout] Exception in thread "main" java.lang.OutOfMemoryError:
> Metaspace
> [junit-timeout] Testsuite:
> org.apache.cassandra.distributed.test.DistributedReadWritePathTest
> [junit-timeout] Testsuite:
> org.apache.cassandra.distributed.test.DistributedReadWritePathTest Tests run:
> 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0 sec
> [junit-timeout]
> [junit-timeout] Testcase:
> org.apache.cassandra.distributed.test.DistributedReadWritePathTest:readWithSchemaDisagreement:
> Caused an ERROR
> [junit-timeout] Forked Java VM exited abnormally. Please note the time in the
> report does not reflect the time until the VM exit.
> [junit-timeout] junit.framework.AssertionFailedError: Forked Java VM exited
> abnormally. Please note the time in the report does not reflect the time
> until the VM exit.
> [junit-timeout] at java.util.Vector.forEach(Vector.java:1275)
> [junit-timeout] at java.util.Vector.forEach(Vector.java:1275)
> [junit-timeout] at java.lang.Thread.run(Thread.java:748)
> [junit-timeout]
> [junit-timeout]
> [junit-timeout] Test
> org.apache.cassandra.distributed.test.DistributedReadWritePathTest FAILED
> (crashed)
> [junitreport] Processing /tmp/cassandra/build/test/TESTS-TestSuites.xml to
> /tmp/null1041131060
> [junitreport] Loading stylesheet
> jar:file:/usr/share/ant/lib/ant-junit.jar!/org/apache/tools/ant/taskdefs/optional/junit/xsl/junit-frames.xsl
> [junitreport] Transform time: 277ms
> [junitreport] Deleting: /tmp/null1041131060{code}
> I have noticed sporadic failures in the
> org.apache.cassandra.distributed.test.* suite.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org
