Streaming mode for thin JDBC driver is expected in Apache Ignite 2.5. Meanwhile you can load data using thick driver which support streaming, and then switch to thin driver for normal operations it you prefer it over thick one.
On Fri, Dec 15, 2017 at 9:09 PM, Denis Magda <[email protected]> wrote: > Hi Michael, > > Yes, I heard from Ignite SQL experts that Ignite thin client is not > optimal for data loading yet. However, there is already some work in > progress to speed up the loading and batching of a myriad of rows. > > Vladimir, could you please step in and comment here. > > — > Denis > > > On Dec 14, 2017, at 1:02 AM, Michael Jay <[email protected]> wrote: > > > > Hello, I am a new Ignite leaner. I want to insert 50,000,000 rows into a > > table. Here,i got a problem. > > When one host and one sever node, the speed of insert is about 2,000,000 > per > > minute, the usage of cpu is 30-40%; however two hosts and two sever > nodes, > > about 100,000 per minute,and the usage of cpu is only 5%. It's so > slow,what > > can i do to improve the performance? Thanks. > > > > my default-config.xml: > > <bean class="org.apache.ignite.configuration.IgniteConfiguration"> > > <property name="peerClassLoadingEnabled" value="true"/> > > <property name="clientMode" value="false"/> > > <property name="memoryConfiguration"> > > <bean > > class="org.apache.ignite.configuration.MemoryConfiguration"> > > <property name="defaultMemoryPolicySize" > value="19327352832"/> > > > > <property name="concurrencyLevel" > value="16"/> > > > > <property name="pageSize" value="4096"/> > > </bean> > > </property> > > <property name="cacheConfiguration"> > > <list> > > > > <bean > > class="org.apache.ignite.configuration.CacheConfiguration"> > > <property name="name" value="*"/> > > <property name="cacheMode" > value="PARTITIONED"/> > > <property name="queryParallelism" > value="4"/> > > > > <property name="atomicityMode" value="ATOMIC"/> > > <property name="backups" value="0"/> > > <property name="writeThrough" > value="false"/> > > <property name="readThrough" > value="false"/> > > <property name="writeBehindEnabled" > value="false"/> > > > > <property > name="rebalanceBatchSize" value="#{256L * 1024 * 1024}"/> > > > > <property name="rebalanceThrottle" > value="0"/> > > > > <property > name="rebalanceThreadPoolSize" value="8"/> > > > > <property name="copyOnRead" > value="false"/> > > </bean> > > </list> > > </property> > > > > <property name="discoverySpi"> > > <bean > > class="org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi"> > > <property name="ipFinder"> > > > > <bean > > class="org.apache.ignite.spi.discovery.tcp.ipfinder.multicast. > TcpDiscoveryMulticastIpFinder"> > > > > <property name="addresses"> > > <list> > > > > > <value>10x.x.x.226:47500..47509</value> > > > <value>10x.x.x.75:47500..47509</value> > > </list> > > </property> > > </bean> > > </property> > > </bean> > > </property> > > </bean> > > </beans> > > > > > > > > > > -- > > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ > >
