Oh my - robot downloads the csar's during distribution tests so I really hope we arent trying to make these CSAR's into multi-Gigabyte monsters.
Not that robot should limit what we do but its a thing that would have to change if we want to support such large CSARs. Seems like the CSAR should have a pointer to a repository not the actual artifact when they are that large but I am not a feature designer. Brian -----Original Message----- From: [email protected] <[email protected]> On Behalf Of Andrew Fenner Sent: Tuesday, November 12, 2019 12:48 PM To: [email protected]; SONSINO, OFIR <[email protected]> Subject: [onap-discuss] [sdc] Onboarding BIG csars Hi, I want to onboard a big to very big package into SDC. My package is formatted OK and then I just increased the size of the "image" file to see what happened. At ~50MB I had to increase the parameter commitlog_segment_size_in_mb in cassandra. Then I tried ~500MB (I'm aiming for 5GB) and I've consistently got an out of memory error in sdc-onboarding (see below) I have increased the size of the container to 8GB and the memory allowed to the jvm to 6g and it still gave OOM The question is is there a limit to the size of a package we can onboard so these can be seen as faults or am I just trying to do something impossible. Thanks /Andrew Caused by: java.lang.OutOfMemoryError: Java heap space at java.util.Arrays.copyOf(Arrays.java:3236) at java.io.ByteArrayOutputStream.grow(ByteArrayOutputStream.java:118) at java.io.ByteArrayOutputStream.ensureCapacity(ByteArrayOutputStream.java:93) at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:153) at com.amdocs.zusammen.utils.fileutils.FileUtils.copyLarge(FileUtils.java:208) at com.amdocs.zusammen.utils.fileutils.FileUtils.copyLarge(FileUtils.java:196) at com.amdocs.zusammen.utils.fileutils.FileUtils.copy(FileUtils.java:190) at com.amdocs.zusammen.utils.fileutils.FileUtils.toByteArray(FileUtils.java:166) at com.amdocs.zusammen.plugin.ZusammenPluginUtil.convertToElementEntity(ZusammenPluginUtil.java:111) at com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.createElement(CassandraCollaborationStorePluginImpl.java:377) at com.amdocs.zusammen.adaptor.outbound.impl.CollaborationAdaptorImpl.createElement(CollaborationAdaptorImpl.java:618) at com.amdocs.zusammen.core.impl.item.CollaborativeElementCommandFactory.lambda$init$2(CollaborativeElementCommandFactory.java:45) at com.amdocs.zusammen.core.impl.item.CollaborativeElementCommandFactory$$Lambda$143/1578021023.apply(Unknown Source) at com.amdocs.zusammen.core.impl.item.ElementCommandAbstarctFactory.executeCommand(ElementCommandAbstarctFactory.java:38) at com.amdocs.zusammen.core.impl.item.CollaborativeStoreElementVisitor.visit(CollaborativeStoreElementVisitor.java:42) at com.amdocs.zusammen.core.impl.item.ElementHierarchyTraverser.traverse(ElementHierarchyTraverser.java:36) at com.amdocs.zusammen.core.impl.item.ElementHierarchyTraverser.lambda$traverse$0(ElementHierarchyTraverser.java:38) at com.amdocs.zusammen.core.impl.item.ElementHierarchyTraverser$$Lambda$162/1775979591.accept(Unknown Source) at java.util.ArrayList.forEach(ArrayList.java:1257) at com.amdocs.zusammen.core.impl.item.ElementHierarchyTraverser.traverse(ElementHierarchyTraverser.java:37) at com.amdocs.zusammen.core.impl.item.ElementManagerImpl.save(ElementManagerImpl.java:168) at com.amdocs.zusammen.adaptor.inbound.impl.item.ElementAdaptorImpl.save(ElementAdaptorImpl.java:127) at org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.saveElement(ZusammenConnectorImpl.java:369) at org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.saveElement(ZusammenAdaptorImpl.java:132) at org.openecomp.sdc.vendorsoftwareproduct.dao.impl.zusammen.OrchestrationTemplateCandidateDaoZusammenImpl.update(OrchestrationTemplateCandidateDaoZusammenImpl.java:210) at org.openecomp.sdc.vendorsoftwareproduct.services.impl.filedatastructuremodule.CandidateServiceImpl.updateCandidateUploadData(CandidateServiceImpl.java:310) at org.openecomp.sdc.vendorsoftwareproduct.impl.orchestration.OrchestrationTemplateCSARHandler.updateCandidateData(OrchestrationTemplateCSARHandler.java:84) at org.openecomp.sdc.vendorsoftwareproduct.impl.orchestration.BaseOrchestrationTemplateHandler.upload(BaseOrchestrationTemplateHandler.java:76) at org.openecomp.sdc.vendorsoftwareproduct.impl.OrchestrationTemplateCandidateManagerImpl.upload(OrchestrationTemplateCandidateManagerImpl.java:71) at org.openecomp.sdcrests.vsp.rest.services.OrchestrationTemplateCandidateImpl.processOnboardPackage(OrchestrationTemplateCandidateImpl.java:156) at org.openecomp.sdcrests.vsp.rest.services.OrchestrationTemplateCandidateImpl.upload(OrchestrationTemplateCandidateImpl.java:105) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#19447): https://lists.onap.org/g/onap-discuss/message/19447 Mute This Topic: https://lists.onap.org/mt/54467928/21656 Group Owner: [email protected] Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
