MorgenFreeMan opened a new issue, #619: URL: https://github.com/apache/incubator-hugegraph-toolchain/issues/619
### Problem Type (问题类型) exception / error (异常报错) ### Before submit - [X] I had searched in the [issues](https://github.com/apache/hugegraph-toolchain/issues) and found no similar issues. ### Environment (环境信息) - Server Version: 1.3.0 - Toolchain Version: 1.3.0 - Data Size: 600万点，1亿边 ### Your Question (问题描述) 为postgresql的数据源导入： struct.json { "edges": [ { "label": "包含", "source": [ "instance_id" ], "target": [ "association_instance_id" ], "input": { "type": "jdbc", "vendor": "POSTGRESQL", "driver": "org.postgresql.Driver", "url": "jdbc:postgresql://***", "database": "tool_316_ads_pre", "custom_sql": "SELECT id, instance_id, association_instance_id FROM tool_316_ads_pre.tool_316_ads_pre.instance_relations_new where association_name ='包含'", "username": "***", "password": "***", "batch_size": 500 }, "selected": [ "instance_id", "association_instance_id" ] } ] } schema.groovy： schema.vertexLabel("对象").usePrimaryKeyId().properties("object_id","object_name","object_type_id","object_type","object_classification","object_classification_second","instance_id","instance_name","area_code","area_name","plate_code","plate_name","indicator_classification","entity_type","entity_name","parent_entity_name","query_field").primaryKeys("instance_id").ifNotExist().create(); schema.edgeLabel("包含").sourceLabel("对象").targetLabel("对象").properties("instance_id","association_instance_id").ifNotExist().create(); 其中： instance_relations_new的数据量为2亿+ 服务器信息：8核32G，仅部署了hugegraph 其中修改了hugegraph-server.sh 的 MIN_MEM=28G MAX_MEM=30G 报错信息： [root@0079 bin]# sh hugegraph-loader.sh -g hugegraph_bqw_test -s /opt/data/hugegraph/apache-hugegraph-toolchain-incubating-1.3.0/apache-hugegraph-loader-incubating-1.3.0/example/prod/schema.groovy -f /opt/data/hugegraph/apache-hugegraph-toolchain-incubating-1.3.0/apache-hugegraph-loader-incubating-1.3.0/example/prod/struct-instance_releation.json -h 127.0.0.1 -p 58080 --clear-all-data false --batch-insert-threads 32 --max-conn 128 --max-conn-per-route 64 SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/opt/data/hugegraph/apache-hugegraph-toolchain-incubating-1.3.0/apache-hugegraph-loader-incubating-1.3.0/lib/log4j-slf4j-impl-2.18.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/opt/data/hugegraph/apache-hugegraph-toolchain-incubating-1.3.0/apache-hugegraph-loader-incubating-1.3.0/lib/apache-hugegraph-loader-incubating-1.3.0-shaded.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/opt/data/hugegraph/apache-hugegraph-toolchain-incubating-1.3.0/apache-hugegraph-loader-incubating-1.3.0/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] WARNING: sun.reflect.Reflection.getCallerClass is not supported. This will impact performance. WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.codehaus.groovy.reflection.CachedClass (file:/opt/data/hugegraph/apache-hugegraph-toolchain-incubating-1.3.0/apache-hugegraph-loader-incubating-1.3.0/lib/apache-hugegraph-loader-incubating-1.3.0-shaded.jar) to method java.lang.Object.finalize() WARNING: Please consider reporting this to the maintainers of org.codehaus.groovy.reflection.CachedClass WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release >> HugeGraphLoader worked in NORMAL MODE vertices/edges loaded this time : 9月 02, 2024 9:15:05 下午 org.postgresql.core.v3.ConnectionFactoryImpl openConnectionImpl 信息: [eab64aa1-bfba-4921-bd24-feaff46dddb8] Try to connect. IP: 19.25.160.38:8000 9月 02, 2024 9:15:05 下午 org.postgresql.core.v3.ConnectionFactoryImpl openConnectionImpl 信息: [172.18.65.225:34592/19.25.160.38:8000] Connection is established. ID: eab64aa1-bfba-4921-bd24-feaff46dddb8 9月 02, 2024 9:15:05 下午 org.postgresql.core.v3.ConnectionFactoryImpl openConnectionImpl 信息: Connect complete. ID: eab64aa1-bfba-4921-bd24-feaff46dddb8 Exception in thread "Thread-1" java.lang.OutOfMemoryError: Java heap space Failed to load, cause: java.lang.OutOfMemoryError: Java heap space ### Vertex/Edge example (问题点 / 边数据举例) _No response_ ### Schema [VertexLabel, EdgeLabel, IndexLabel] (元数据结构) _No response_ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
