Anyway, until the thin client is optimized I would suggest you to use the client-based JDBC driver with “streaming” setting on for the preloading needs: https://apacheignite-sql.readme.io/docs/jdbc-client-driver
— Denis > On Dec 15, 2017, at 10:09 AM, Denis Magda <[email protected]> wrote: > > Hi Michael, > > Yes, I heard from Ignite SQL experts that Ignite thin client is not optimal > for data loading yet. However, there is already some work in progress to > speed up the loading and batching of a myriad of rows. > > Vladimir, could you please step in and comment here. > > — > Denis > >> On Dec 14, 2017, at 1:02 AM, Michael Jay <[email protected]> wrote: >> >> Hello, I am a new Ignite leaner. I want to insert 50,000,000 rows into a >> table. Here,i got a problem. >> When one host and one sever node, the speed of insert is about 2,000,000 per >> minute, the usage of cpu is 30-40%; however two hosts and two sever nodes, >> about 100,000 per minute,and the usage of cpu is only 5%. It's so slow,what >> can i do to improve the performance? Thanks. >> >> my default-config.xml: >> <bean class="org.apache.ignite.configuration.IgniteConfiguration"> >> <property name="peerClassLoadingEnabled" value="true"/> >> <property name="clientMode" value="false"/> >> <property name="memoryConfiguration"> >> <bean >> class="org.apache.ignite.configuration.MemoryConfiguration"> >> <property name="defaultMemoryPolicySize" >> value="19327352832"/> >> >> <property name="concurrencyLevel" value="16"/> >> >> <property name="pageSize" value="4096"/> >> </bean> >> </property> >> <property name="cacheConfiguration"> >> <list> >> >> <bean >> class="org.apache.ignite.configuration.CacheConfiguration"> >> <property name="name" value="*"/> >> <property name="cacheMode" >> value="PARTITIONED"/> >> <property name="queryParallelism" >> value="4"/> >> >> <property name="atomicityMode" value="ATOMIC"/> >> <property name="backups" value="0"/> >> <property name="writeThrough" >> value="false"/> >> <property name="readThrough" value="false"/> >> <property name="writeBehindEnabled" >> value="false"/> >> >> <property name="rebalanceBatchSize" >> value="#{256L * 1024 * 1024}"/> >> >> <property name="rebalanceThrottle" >> value="0"/> >> >> <property >> name="rebalanceThreadPoolSize" value="8"/> >> >> <property name="copyOnRead" >> value="false"/> >> </bean> >> </list> >> </property> >> >> <property name="discoverySpi"> >> <bean >> class="org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi"> >> <property name="ipFinder"> >> >> <bean >> class="org.apache.ignite.spi.discovery.tcp.ipfinder.multicast.TcpDiscoveryMulticastIpFinder"> >> >> <property name="addresses"> >> <list> >> >> >> <value>10x.x.x.226:47500..47509</value> >> >> <value>10x.x.x.75:47500..47509</value> >> </list> >> </property> >> </bean> >> </property> >> </bean> >> </property> >> </bean> >> </beans> >> >> >> >> >> -- >> Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >
