[
https://issues.apache.org/jira/browse/DRILL-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17394318#comment-17394318
]
Vitalii Diravka edited comment on DRILL-7973 at 8/10/21, 9:59 PM:
------------------------------------------------------------------
[~cgivre] You can monitor the current status of the
[branch|https://github.com/vdiravka/drill/commits/DRILL-7973]. I performed
separate CI build run for every change to make sure it enhances the successful
builds probability.
I am going to open PR soon.
It will include the following improvements:
* added _fail-fast: false_ fot the CI to avoid build failures once other build
is failed:
[https://github.community/t/error-the-operation-was-canceled-in-ci/166506/3]
[https://stackoverflow.com/questions/61070925/github-actions-disable-auto-cancel-when-job-fails]
https://docs.github.com/en/actions/reference/workflow-syntax-for-github-actions#jobsjob_idstrategyfail-fast
[https://github.community/t/why-a-matrix-step-will-be-canceled-if-another-one-failed/16184]
* Clean memory for the container running:
[https://github.com/actions/virtual-environments/issues/1918]
* Fix for Cassandra connection timeout in scope of Test Container
* Update Maven Version _3.6.3_ -> _3.8.1_
* Update _actions/cache@v1 -> actions/cache@v2_
* Decrease Heap size for CI builds _-DmemoryMb=1600_
* Add info how to enable github Debug logging:
[https://docs.github.com/en/actions/managing-workflow-runs/enabling-debug-logging]
[https://github.community/t/ci-access-to-shell-session/17250]
https://issues.apache.org/jira/browse/INFRA-20945
was (Author: vitalii):
[~cgivre] You can monitor the current status of the
[branch|https://github.com/vdiravka/drill/commits/DRILL-7973]. I performed
separate CI build run for every change to make sure it enhances the successful
builds probability.
I am going to open PR soon.
It will include the following improvements:
* added _fail-fast: false_ fot the CI to avoid build failures once other build
is failed:
[https://github.community/t/error-the-operation-was-canceled-in-ci/166506/3]
[https://stackoverflow.com/questions/61070925/github-actions-disable-auto-cancel-when-job-fails]
https://docs.github.com/en/actions/reference/workflow-syntax-for-github-actions#jobsjob_idstrategyfail-fast
[https://github.community/t/why-a-matrix-step-will-be-canceled-if-another-one-failed/16184]
* Clean memory for the container running:
[https://github.com/actions/virtual-environments/issues/1918]
* Fix for Cassandra connection timeout in scope of Test Container
* Update Maven Version _3.6.3_ -> _3.8.1_
* Update _actions/cache@v1 -> actions/cache@v2_
* Decrease Heap size for CI builds _-DmemoryMb=1600_
* Add info how to enable github Debug logging:
[https://docs.github.com/en/actions/managing-workflow-runs/enabling-debug-logging]
[https://github.community/t/ci-access-to-shell-session/17250]
https://issues.apache.org/jira/browse/INFRA-20945
> Fix GitHub CI intermittent failures
> -----------------------------------
>
> Key: DRILL-7973
> URL: https://issues.apache.org/jira/browse/DRILL-7973
> Project: Apache Drill
> Issue Type: Sub-task
> Components: Tools, Build & Test
> Affects Versions: 1.19.0
> Reporter: Vitalii Diravka
> Assignee: Vitalii Diravka
> Priority: Major
> Fix For: 1.20.0
>
>
> *The memory issue:*
> I got locally:
> {code:java}
> [INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.264
> s - in org.apache.drill.exec.work.metadata.TestServerMetaProvider
> [ERROR] Tests run: 19, Failures: 0, Errors: 2, Skipped: 0, Time elapsed:
> 7.713 s <<< FAILURE! - in org.apache.drill.exec.record.vector.TestValueVector
> [ERROR]
> org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation
> Time elapsed: 0.084 s <<< ERROR!
> java.lang.Exception: Unexpected exception,
> expected<org.apache.drill.exec.exception.OversizedAllocationException> but
> was<org.apache.drill.exec.exception.OutOfMemoryException>
> at
> org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation(TestValueVector.java:107)
> Caused by: io.netty.util.internal.OutOfDirectMemoryError: failed to allocate
> 2147483644 byte(s) of direct memory (used: 872415232, max: 2621440000)
> at
> org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation(TestValueVector.java:107)[ERROR]
>
> org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation
> Time elapsed: 0.013 s <<< ERROR!
> java.lang.Exception: Unexpected exception,
> expected<org.apache.drill.exec.exception.OversizedAllocationException> but
> was<org.apache.drill.exec.exception.OutOfMemoryException>
> at
> org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation(TestValueVector.java:165)
> Caused by: io.netty.util.internal.OutOfDirectMemoryError: failed to allocate
> 2147483647 byte(s) of direct memory (used: 872415232, max: 2621440000)
> at
> org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation(TestValueVector.java:165)
> {code}
> for the command:
> {code:java}
> drill$ mvn install -V -ntp -DdirectMemoryMb=2500 -DmemoryMb=2000{code}
> and
> {code:java}
> [INFO] Running org.apache.drill.exec.work.metadata.TestServerMetaProvider
> [ERROR] Tests run: 19, Failures: 0, Errors: 2, Skipped: 0, Time elapsed:
> 6.358 s <<< FAILURE! - in org.apache.drill.exec.record.vector.TestValueVector
> [ERROR]
> org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation
> Time elapsed: 0.048 s <<< ERROR!
> java.lang.Exception: Unexpected exception,
> expected<org.apache.drill.exec.exception.OversizedAllocationException> but
> was<org.apache.drill.exec.exception.OutOfMemoryException>
> at
> org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation(TestValueVector.java:107)
> Caused by: io.netty.util.internal.OutOfDirectMemoryError: failed to allocate
> 2147483644 byte(s) of direct memory (used: 989855744, max: 2936012800)
> at
> org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation(TestValueVector.java:107)[ERROR]
>
> org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation
> Time elapsed: 0.008 s <<< ERROR!
> java.lang.Exception: Unexpected exception,
> expected<org.apache.drill.exec.exception.OversizedAllocationException> but
> was<org.apache.drill.exec.exception.OutOfMemoryException>
> at
> org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation(TestValueVector.java:165)
> Caused by: io.netty.util.internal.OutOfDirectMemoryError: failed to allocate
> 2147483647 byte(s) of direct memory (used: 989855744, max: 2936012800)
> at
> org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation(TestValueVector.java:165)
> {code}
> for the command:
> {code:java}
> mvn install -V -ntp -DdirectMemoryMb=2800 -DmemoryMb=2000{code}
> There are also intermittent failures for several test cases, details in
> comments.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
