Hi Michael, Yes, I heard from Ignite SQL experts that Ignite thin client is not optimal for data loading yet. However, there is already some work in progress to speed up the loading and batching of a myriad of rows.
Vladimir, could you please step in and comment here. — Denis > On Dec 14, 2017, at 1:02 AM, Michael Jay <[email protected]> wrote: > > Hello, I am a new Ignite leaner. I want to insert 50,000,000 rows into a > table. Here,i got a problem. > When one host and one sever node, the speed of insert is about 2,000,000 per > minute, the usage of cpu is 30-40%; however two hosts and two sever nodes, > about 100,000 per minute,and the usage of cpu is only 5%. It's so slow,what > can i do to improve the performance? Thanks. > > my default-config.xml: > <bean class="org.apache.ignite.configuration.IgniteConfiguration"> > <property name="peerClassLoadingEnabled" value="true"/> > <property name="clientMode" value="false"/> > <property name="memoryConfiguration"> > <bean > class="org.apache.ignite.configuration.MemoryConfiguration"> > <property name="defaultMemoryPolicySize" > value="19327352832"/> > > <property name="concurrencyLevel" value="16"/> > > <property name="pageSize" value="4096"/> > </bean> > </property> > <property name="cacheConfiguration"> > <list> > > <bean > class="org.apache.ignite.configuration.CacheConfiguration"> > <property name="name" value="*"/> > <property name="cacheMode" > value="PARTITIONED"/> > <property name="queryParallelism" > value="4"/> > > <property name="atomicityMode" value="ATOMIC"/> > <property name="backups" value="0"/> > <property name="writeThrough" > value="false"/> > <property name="readThrough" value="false"/> > <property name="writeBehindEnabled" > value="false"/> > > <property name="rebalanceBatchSize" > value="#{256L * 1024 * 1024}"/> > > <property name="rebalanceThrottle" > value="0"/> > > <property > name="rebalanceThreadPoolSize" value="8"/> > > <property name="copyOnRead" > value="false"/> > </bean> > </list> > </property> > > <property name="discoverySpi"> > <bean > class="org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi"> > <property name="ipFinder"> > > <bean > class="org.apache.ignite.spi.discovery.tcp.ipfinder.multicast.TcpDiscoveryMulticastIpFinder"> > > <property name="addresses"> > <list> > > > <value>10x.x.x.226:47500..47509</value> > > <value>10x.x.x.75:47500..47509</value> > </list> > </property> > </bean> > </property> > </bean> > </property> > </bean> > </beans> > > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/
