HTHou commented on issue #2217: URL: https://github.com/apache/iotdb/issues/2217#issuecomment-747830594
Hi, I have tried to reproduce the same write load in newest `rel/0.11` branch as you described, 40 storage groups, 1500 measurements per group with 4 GB JVM memory size and the default configuration. However I didn't see any reject exception. There may be a reason that the default JVM memory size of IoTDB only use 1/4 of physical memory size, which is 2GB as you described before. If you would like to change it, you can modify the `MAX_HEAP_SIZE` in `iotdb-env.sh`. Also, there is another config you could change, which is `primitive_array_size` in `iotdb-engine.properties`. You may modify the number smaller like 32. Or their is another solution, but not the best one, for you to use. Set `enable_mem_control` to false, set `memtable_size_threshold` to 15000000. If you do this, there won't be any reject exception thrown. By the way, we are working on the improvement of memory control strategy now. Your feedback does provide us a great case to do this research. Thank you so much again! ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
