[
https://issues.apache.org/jira/browse/RANGER-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18082304#comment-18082304
]
Dineshkumar Yadav commented on RANGER-5605:
-------------------------------------------
Root Cause Analysis: Docker Build Failure — OutOfMemoryError: Java heap space
The build fails during packaging of the schema-registry-plugin module with
java.lang.OutOfMemoryError: Java heap space.
Root Cause:
Insufficient JVM heap in ranger-build.sh: MAVEN_OPTS was hardcoded to -Xms2g
-Xmx2g, which is insufficient for this module. The schema-registry-plugin
transitively pulls in software.amazon.awssdk:bundle:2.29.52 — a monolithic JAR
(~500 MB on disk) that requires significant heap to process during the
maven-shade-plugin packaging phase (Building jar:
ranger-3.0.0-SNAPSHOT-schema-registry-plugin.jar).
> Fix Ranger build failure when triggered through Docker
> ------------------------------------------------------
>
> Key: RANGER-5605
> URL: https://issues.apache.org/jira/browse/RANGER-5605
> Project: Ranger
> Issue Type: Task
> Components: Ranger
> Reporter: Dineshkumar Yadav
> Assignee: Dineshkumar Yadav
> Priority: Major
>
> While building Ranger using the commands below:
> {{docker compose -f docker-compose.ranger-build.yml build}}
> {{docker compose -f docker-compose.ranger-build.yml up}}
> the build fails with the following error:
> {code:java}
> ranger-build | [WARNING] The assembly descriptor contains a filesystem-root
> relative reference, which is not cross platform compatible /
> ranger-build | [INFO] Building tar:
> /home/ranger/src/target/ranger-3.0.0-SNAPSHOT-elasticsearch-plugin.tar.gz
> ranger-build | [INFO] Building tar:
> /home/ranger/src/target/ranger-3.0.0-SNAPSHOT-audit-ingestor.tar.gz
> ranger-build | [INFO] Building tar:
> /home/ranger/src/target/ranger-3.0.0-SNAPSHOT-audit-dispatcher.tar.gz
> ranger-build | [INFO] Building jar:
> /home/ranger/src/target/ranger-3.0.0-SNAPSHOT-schema-registry-plugin.jar
> ranger-build | [1216.203s][warning][gc,alloc] pool-110-thread-1: Retried
> waiting for GCLocker too often allocating 333 words
> ranger-build | Exception in thread "pool-110-thread-7"
> java.lang.OutOfMemoryError: Java heap space
> ranger-build | at
> java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1617)
> ranger-build | at
> java.base/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
> ranger-build | at
> java.base/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062)
> ranger-build | at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122)
> ranger-build | at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
> ranger-build | at java.base/java.lang.Thread.run(Thread.java:840)
> ranger-build | Cleaning up unclosed ZipFile for archive
> /home/ranger/.m2/repository/software/amazon/awssdk/bundle/2.29.52/bundle-2.29.52.jar
> ranger-build | Exception in thread "pool-110-thread-12"
> java.lang.OutOfMemoryError: Java heap space
> ranger-build | at
> java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1617)
> ranger-build | at
> java.base/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
> ranger-build | at
> java.base/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062)
> ranger-build | at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122)
> ranger-build | at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
> ranger-build | at java.base/java.lang.Thread.run(Thread.java:840)
> ranger-build | [INFO]
> ------------------------------------------------------------------------
> ranger-build | [INFO] Reactor Summary for ranger 3.0.0-SNAPSHOT:
> ranger-build | [INFO]
> ranger-build | [INFO] ranger .............................................
> SUCCESS [ 5.032 s]
> ranger-build | [INFO] Credential Support .................................
> SUCCESS [ 7.376 s]
> ranger-build | [INFO] Audit Component ....................................
> SUCCESS [ 7.638 s]
> ranger-build | [INFO] Ranger Authorization API ...........................
> SUCCESS [ 3.719 s]
> ranger-build | [INFO] ranger-common-utils ................................
> SUCCESS [ 3.350 s]
> ranger-build | [INFO] ranger-plugin-classloader ..........................
> SUCCESS [ 2.154 s]
> ranger-build | [INFO] User Group Synchronizer Util .......................
> SUCCESS [ 3.529 s]
> ranger-build | [INFO] Common library for Plugins .........................
> SUCCESS [ 20.941 s]
> ranger-build | [INFO] Ranger Audit Destination - auditserver .............
> SUCCESS [ 2.990 s]
> ranger-build | [INFO] Ranger Audit Destination - CloudWatch ..............
> SUCCESS [ 2.383 s]
> ranger-build | [INFO] Ranger Audit Destination - Elasticsearch ...........
> SUCCESS [ 4.250 s]
> ranger-build | [INFO] Ranger Audit Destination - Hadoop FileSystem .......
> SUCCESS [ 2.700 s]
> ranger-build | [INFO] Ranger Audit Destination - Kafka ...................
> SUCCESS [ 1.895 s]
> ranger-build | [INFO] Ranger Audit Destination - Log4j ...................
> SUCCESS [ 1.776 s]
> ranger-build | [INFO] Ranger Audit Destination - Solr ....................
> SUCCESS [ 2.526 s]
> ranger-build | [INFO] Ranger Audit Destination - ORC Util ................
> SUCCESS [ 2.139 s]
> ranger-build | [INFO] Ranger Plugins Audit ...............................
> SUCCESS [ 0.086 s]
> ranger-build | [INFO] Installer Support Component ........................
> SUCCESS [ 1.372 s]
> ranger-build | [INFO] Ranger Audit Server Common .........................
> SUCCESS [ 2.486 s]
> ranger-build | [INFO] Ranger Audit Dispatcher Common .....................
> SUCCESS [ 5.577 s]
> ranger-build | [INFO] Ranger Audit Dispatcher HDFS .......................
> SUCCESS [ 11.178 s]
> ranger-build | [INFO] Ranger Audit Dispatcher Solr .......................
> SUCCESS [ 5.387 s]
> ranger-build | [INFO] Ranger Audit Dispatcher App ........................
> SUCCESS [ 11.960 s]
> ranger-build | [INFO] Ranger Audit Dispatcher Parent .....................
> SUCCESS [ 0.113 s]
> ranger-build | [INFO] ranger-authn .......................................
> SUCCESS [ 3.299 s]
> ranger-build | [INFO] Ranger Audit Ingestor ..............................
> SUCCESS [ 13.156 s]
> ranger-build | [INFO] Ranger Audit Server Parent .........................
> SUCCESS [ 0.088 s]
> ranger-build | [INFO] authz-embedded .....................................
> SUCCESS [ 6.304 s]
> ranger-build | [INFO] Ranger Authorization Remote Client .................
> SUCCESS [ 3.131 s]
> ranger-build | [INFO] Credential Builder .................................
> SUCCESS [ 3.308 s]
> ranger-build | [INFO] Embedded Web Server Invoker ........................
> SUCCESS [ 3.863 s]
> ranger-build | [INFO] Jdbc SQL Connector .................................
> SUCCESS [ 1.314 s]
> ranger-build | [INFO] Ranger Util ........................................
> SUCCESS [ 11.597 s]
> ranger-build | [INFO] Ldap Config Check Tool .............................
> SUCCESS [ 1.804 s]
> ranger-build | [INFO] Atlas Security Plugin ..............................
> SUCCESS [ 8.853 s]
> ranger-build | [INFO] Atlas Security Plugin Shim .........................
> SUCCESS [ 4.853 s]
> ranger-build | [INFO] Ranger HA Common Library ...........................
> SUCCESS [ 3.854 s]
> ranger-build | [INFO] Elasticsearch Security Plugin Shim .................
> SUCCESS [ 2.109 s]
> ranger-build | [INFO] Elasticsearch Security Plugin ......................
> SUCCESS [ 5.267 s]
> ranger-build | [INFO] ranger-examples ....................................
> SUCCESS [ 0.068 s]
> ranger-build | [INFO] Ranger Examples - Conditions and ContextEnrichers ..
> SUCCESS [ 3.500 s]
> ranger-build | [INFO] Ranger Examples - Ranger Plugin for SampleApp ......
> SUCCESS [ 2.173 s]
> ranger-build | [INFO] ranger-intg ........................................
> SUCCESS [ 4.615 s]
> ranger-build | [INFO] sample-client ......................................
> SUCCESS [ 2.662 s]
> ranger-build | [INFO] Ranger Examples - SampleApp ........................
> SUCCESS [ 0.991 s]
> ranger-build | [INFO] Apache Ranger Examples Distribution ................
> SUCCESS [ 3.276 s]
> ranger-build | [INFO] HBase Security Plugin Shim .........................
> SUCCESS [ 12.781 s]
> ranger-build | [INFO] HBase Security Plugin ..............................
> SUCCESS [ 12.550 s]
> ranger-build | [INFO] Hdfs Security Plugin ...............................
> SUCCESS [ 10.778 s]
> ranger-build | [INFO] Hdfs Security Plugin Shim ..........................
> SUCCESS [ 1.469 s]
> ranger-build | [INFO] Hive Security Plugin ...............................
> SUCCESS [ 27.536 s]
> ranger-build | [INFO] Hive Security Plugin Shim ..........................
> SUCCESS [ 5.709 s]
> ranger-build | [INFO] KAFKA Security Plugin ..............................
> SUCCESS [ 6.598 s]
> ranger-build | [INFO] KAFKA Security Plugin Shim .........................
> SUCCESS [ 1.601 s]
> ranger-build | [INFO] ranger-metrics .....................................
> SUCCESS [ 5.546 s]
> ranger-build | [INFO] Key Management Service .............................
> SUCCESS [ 21.521 s]
> ranger-build | [INFO] KMS Security Plugin ................................
> SUCCESS [ 11.591 s]
> ranger-build | [INFO] KMS Security Plugin Shim ...........................
> SUCCESS [ 5.336 s]
> ranger-build | [INFO] Knox Security Plugin Shim ..........................
> SUCCESS [ 4.296 s]
> ranger-build | [INFO] Knox Security Plugin ...............................
> SUCCESS [ 14.860 s]
> ranger-build | [INFO] Kudu Security Plugin ...............................
> SUCCESS [ 2.190 s]
> ranger-build | [INFO] Kylin Security Plugin ..............................
> SUCCESS [ 7.741 s]
> ranger-build | [INFO] Kylin Security Plugin Shim .........................
> SUCCESS [ 3.375 s]
> ranger-build | [INFO] NestedStructure Security Plugin ....................
> SUCCESS [ 6.303 s]
> ranger-build | [INFO] NiFi Security Plugin ...............................
> SUCCESS [ 7.749 s]
> ranger-build | [INFO] NiFi Registry Security Plugin ......................
> SUCCESS [ 5.477 s]
> ranger-build | [INFO] Ozone Security Plugin ..............................
> SUCCESS [ 10.712 s]
> ranger-build | [INFO] OZONE Security Plugin Shim .........................
> SUCCESS [ 3.647 s]
> ranger-build | [INFO] ranger-pdp .........................................
> SUCCESS [ 5.842 s]
> ranger-build | [INFO] Presto Security Plugin .............................
> SUCCESS [ 5.485 s]
> ranger-build | [INFO] Presto Security Plugin Shim ........................
> SUCCESS [ 2.153 s]
> ranger-build | [INFO] SchemaRegistry Security Plugin .....................
> SUCCESS [ 11.045 s]
> ranger-build | [INFO] SOLR Security Plugin ...............................
> SUCCESS [ 7.133 s]
> ranger-build | [INFO] SOLR Security Plugin Shim ..........................
> SUCCESS [ 3.349 s]
> ranger-build | [INFO] Sqoop Security Plugin ..............................
> SUCCESS [ 4.992 s]
> ranger-build | [INFO] Sqoop Security Plugin Shim .........................
> SUCCESS [ 1.607 s]
> ranger-build | [INFO] Storm Security Plugin ..............................
> SUCCESS [ 5.664 s]
> ranger-build | [INFO] Storm Security Plugin shim .........................
> SUCCESS [ 1.736 s]
> ranger-build | [INFO] Tag Synchronizer ...................................
> SUCCESS [ 9.514 s]
> ranger-build | [INFO] Ranger Tools .......................................
> SUCCESS [ 5.472 s]
> ranger-build | [INFO] Ranger Security Plugin for Trino ...................
> SUCCESS [ 6.908 s]
> ranger-build | [INFO] YARN Security Plugin ...............................
> SUCCESS [ 3.397 s]
> ranger-build | [INFO] YARN Security Plugin Shim ..........................
> SUCCESS [ 2.361 s]
> ranger-build | [INFO] Unix Authentication Client .........................
> SUCCESS [ 3.832 s]
> ranger-build | [INFO] Security Admin Web Application .....................
> SUCCESS [04:49 min]
> ranger-build | [INFO] Unix User Group Synchronizer .......................
> SUCCESS [ 11.071 s]
> ranger-build | [INFO] Unix Authentication Service ........................
> SUCCESS [ 7.721 s]
> ranger-build | [INFO] Apache Ranger Distribution .........................
> FAILURE [07:38 min]
> ranger-build | [INFO]
> ------------------------------------------------------------------------
> ranger-build | [INFO] BUILD FAILURE
> ranger-build | [INFO]
> ------------------------------------------------------------------------
> ranger-build | [INFO] Total time: 20:40 min
> ranger-build | [INFO] Finished at: 2026-05-20T07:49:51Z
> ranger-build | [INFO]
> ------------------------------------------------------------------------
> ranger-build | [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-assembly-plugin:2.6:single (default) on
> project ranger-distro: Failed to create assembly: Error creating assembly
> archive schema-registry-plugin: Problem creating jar: Execution exception:
> Java heap space -> [Help 1]
> ranger-build | [ERROR]
> ranger-build | [ERROR] To see the full stack trace of the errors, re-run
> Maven with the -e switch.
> ranger-build | [ERROR] Re-run Maven using the -X switch to enable full debug
> logging.
> ranger-build | [ERROR]
> ranger-build | [ERROR] For more information about the errors and possible
> solutions, please read the following articles:
> ranger-build | [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
> ranger-build | [ERROR]
> ranger-build | [ERROR] After correcting the problems, you can resume the
> build with the command
> ranger-build | [ERROR] mvn <args> -rf :ranger-distro {code}
> {{}}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
