Hi,
I guess the problem in "setSwapPath(...)", it is not the path for
persistence.
Try to do something like this:
storePath="/data/ignite2/swap/"
cfg.setDataStorageConfiguration(
new DataStorageConfiguration()
.setWriteThrottlingEnabled(true)
.setPageSize(4 * 1024)
.setStoragePath(storePath)
.setWalPath(storePath + "/wal")
.setWalArchivePath(storePath + "/archive")
.setDefaultDataRegionConfiguration(
new DataRegionConfiguration()
.setPersistenceEnabled(true)
.setInitialSize(2L * 1024 * 1024 * 1024)
.setMaxSize(10L * 1024 * 1024 * 1024)
)
);
Are you sure what you need so strong guaranteed? (WALMode.DEFAULT)
The WALMode.DEFAULT mode provides the strictness of the protection, but
it is the slowest onе.
Use LOG_ONLY mode for data loading. More info about wal mode see:
https://apacheignite.readme.io/docs/write-ahead-log
On 25.02.2018 12:14, VT wrote:
Hi Stan,
The setting is very simple and straightforward, as follows.
DataStorageConfiguration dsCfg = new DataStorageConfiguration();
dsCfg.setWalMode(WALMode.DEFAULT);
dsCfg.setPageSize(4 * 1024);
dsCfg.setWriteThrottlingEnabled(true);
..
DataRegionConfiguration regionCfg1 = new DataRegionConfiguration();
regionCfg1.setName("region_1");
regionCfg1.setInitialSize(2L * 1024 * 1024 * 1024);
regionCfg1.setMaxSize(10L * 1024 * 1024 * 1024);
regionCfg1.setCheckpointPageBufferSize(2L * 1024 * 1024 * 1024);
regionCfg1.setPageEvictionMode(DataPageEvictionMode.RANDOM_2_LRU);
regionCfg1.setPersistenceEnabled(true);
regionCfg1.setSwapPath("/data/ignite2/swap/"); //SSD
...
cacheCfg.setDataRegionName("region_1");
cacheCfg.setName(CacheName);
cacheCfg.setWriteSynchronizationMode(CacheWriteSynchronizationMode.FULL_ASYNC);
cacheCfg.setCacheMode(CacheMode.PARTITIONED);
cacheCfg.setCopyOnRead(false);
...
I used DataStreammer very simply, like the following.
IgniteDataStreamer stmr.addData(key, value);
I have tried multiple settings such as perNodeBufferSize,
perNodeParallelOperations. Still very slow. Please help. Thanks!
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
