[jira] [Updated] (DRILL-7973) Increase direct memory for Drill build in CI to prevent OutOfMemoryException

Thu, 15 Jul 2021 14:27:13 -0700 


     [ 
https://issues.apache.org/jira/browse/DRILL-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vitalii Diravka updated DRILL-7973:
-----------------------------------
    Description: 
I got locally:
{code:java}
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.264 s 
- in org.apache.drill.exec.work.metadata.TestServerMetaProvider
[ERROR] Tests run: 19, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 7.713 
s <<< FAILURE! - in org.apache.drill.exec.record.vector.TestValueVector
[ERROR] 
org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation 
 Time elapsed: 0.084 s  <<< ERROR!
java.lang.Exception: Unexpected exception, 
expected<org.apache.drill.exec.exception.OversizedAllocationException> but 
was<org.apache.drill.exec.exception.OutOfMemoryException>
        at 
org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation(TestValueVector.java:107)
Caused by: io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 
2147483644 byte(s) of direct memory (used: 872415232, max: 2621440000)
        at 
org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation(TestValueVector.java:107)[ERROR]
 
org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation
  Time elapsed: 0.013 s  <<< ERROR!
java.lang.Exception: Unexpected exception, 
expected<org.apache.drill.exec.exception.OversizedAllocationException> but 
was<org.apache.drill.exec.exception.OutOfMemoryException>
        at 
org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation(TestValueVector.java:165)
Caused by: io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 
2147483647 byte(s) of direct memory (used: 872415232, max: 2621440000)
        at 
org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation(TestValueVector.java:165)
{code}
for the command:
{code:java}
drill$ mvn install -V -ntp -DdirectMemoryMb=2500 -DmemoryMb=2000{code}
and 
{code:java}
[INFO] Running org.apache.drill.exec.work.metadata.TestServerMetaProvider
[ERROR] Tests run: 19, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 6.358 
s <<< FAILURE! - in org.apache.drill.exec.record.vector.TestValueVector
[ERROR] 
org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation 
 Time elapsed: 0.048 s  <<< ERROR!
java.lang.Exception: Unexpected exception, 
expected<org.apache.drill.exec.exception.OversizedAllocationException> but 
was<org.apache.drill.exec.exception.OutOfMemoryException>
        at 
org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation(TestValueVector.java:107)
Caused by: io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 
2147483644 byte(s) of direct memory (used: 989855744, max: 2936012800)
        at 
org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation(TestValueVector.java:107)[ERROR]
 
org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation
  Time elapsed: 0.008 s  <<< ERROR!
java.lang.Exception: Unexpected exception, 
expected<org.apache.drill.exec.exception.OversizedAllocationException> but 
was<org.apache.drill.exec.exception.OutOfMemoryException>
        at 
org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation(TestValueVector.java:165)
Caused by: io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 
2147483647 byte(s) of direct memory (used: 989855744, max: 2936012800)
        at 
org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation(TestValueVector.java:165)
{code}
for the command:
{code:java}
mvn install -V -ntp -DdirectMemoryMb=2800 -DmemoryMb=2000
{code}

  was:
I got locally:
{code:java}
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.264 s 
- in org.apache.drill.exec.work.metadata.TestServerMetaProvider
[ERROR] Tests run: 19, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 7.713 
s <<< FAILURE! - in org.apache.drill.exec.record.vector.TestValueVector
[ERROR] 
org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation 
 Time elapsed: 0.084 s  <<< ERROR!
java.lang.Exception: Unexpected exception, 
expected<org.apache.drill.exec.exception.OversizedAllocationException> but 
was<org.apache.drill.exec.exception.OutOfMemoryException>
        at 
org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation(TestValueVector.java:107)
Caused by: io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 
2147483644 byte(s) of direct memory (used: 872415232, max: 2621440000)
        at 
org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation(TestValueVector.java:107)[ERROR]
 
org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation
  Time elapsed: 0.013 s  <<< ERROR!
java.lang.Exception: Unexpected exception, 
expected<org.apache.drill.exec.exception.OversizedAllocationException> but 
was<org.apache.drill.exec.exception.OutOfMemoryException>
        at 
org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation(TestValueVector.java:165)
Caused by: io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 
2147483647 byte(s) of direct memory (used: 872415232, max: 2621440000)
        at 
org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation(TestValueVector.java:165)
{code}
for the command:
{code:java}
drill$ mvn install -V -ntp -DdirectMemoryMb=2800 -DmemoryMb=2000
{code}


> Increase direct memory for Drill build in CI to prevent OutOfMemoryException
> ----------------------------------------------------------------------------
>
>                 Key: DRILL-7973
>                 URL: https://issues.apache.org/jira/browse/DRILL-7973
>             Project: Apache Drill
>          Issue Type: Sub-task
>          Components: Tools, Build &amp; Test
>    Affects Versions: 1.19.0
>            Reporter: Vitalii Diravka
>            Assignee: Vitalii Diravka
>            Priority: Minor
>             Fix For: 1.20.0
>
>
> I got locally:
> {code:java}
> [INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.264 
> s - in org.apache.drill.exec.work.metadata.TestServerMetaProvider
> [ERROR] Tests run: 19, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 
> 7.713 s <<< FAILURE! - in org.apache.drill.exec.record.vector.TestValueVector
> [ERROR] 
> org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation
>   Time elapsed: 0.084 s  <<< ERROR!
> java.lang.Exception: Unexpected exception, 
> expected<org.apache.drill.exec.exception.OversizedAllocationException> but 
> was<org.apache.drill.exec.exception.OutOfMemoryException>
>         at 
> org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation(TestValueVector.java:107)
> Caused by: io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 
> 2147483644 byte(s) of direct memory (used: 872415232, max: 2621440000)
>         at 
> org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation(TestValueVector.java:107)[ERROR]
>  
> org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation
>   Time elapsed: 0.013 s  <<< ERROR!
> java.lang.Exception: Unexpected exception, 
> expected<org.apache.drill.exec.exception.OversizedAllocationException> but 
> was<org.apache.drill.exec.exception.OutOfMemoryException>
>         at 
> org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation(TestValueVector.java:165)
> Caused by: io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 
> 2147483647 byte(s) of direct memory (used: 872415232, max: 2621440000)
>         at 
> org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation(TestValueVector.java:165)
> {code}
> for the command:
> {code:java}
> drill$ mvn install -V -ntp -DdirectMemoryMb=2500 -DmemoryMb=2000{code}
> and 
> {code:java}
> [INFO] Running org.apache.drill.exec.work.metadata.TestServerMetaProvider
> [ERROR] Tests run: 19, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 
> 6.358 s <<< FAILURE! - in org.apache.drill.exec.record.vector.TestValueVector
> [ERROR] 
> org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation
>   Time elapsed: 0.048 s  <<< ERROR!
> java.lang.Exception: Unexpected exception, 
> expected<org.apache.drill.exec.exception.OversizedAllocationException> but 
> was<org.apache.drill.exec.exception.OutOfMemoryException>
>         at 
> org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation(TestValueVector.java:107)
> Caused by: io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 
> 2147483644 byte(s) of direct memory (used: 989855744, max: 2936012800)
>         at 
> org.apache.drill.exec.record.vector.TestValueVector.testFixedVectorReallocation(TestValueVector.java:107)[ERROR]
>  
> org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation
>   Time elapsed: 0.008 s  <<< ERROR!
> java.lang.Exception: Unexpected exception, 
> expected<org.apache.drill.exec.exception.OversizedAllocationException> but 
> was<org.apache.drill.exec.exception.OutOfMemoryException>
>         at 
> org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation(TestValueVector.java:165)
> Caused by: io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 
> 2147483647 byte(s) of direct memory (used: 989855744, max: 2936012800)
>         at 
> org.apache.drill.exec.record.vector.TestValueVector.testVariableVectorReallocation(TestValueVector.java:165)
> {code}
> for the command:
> {code:java}
> mvn install -V -ntp -DdirectMemoryMb=2800 -DmemoryMb=2000
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to