Re: Unable to load more than 5g data through sqlline

Hello! Looks like you have allowed more heap/offheap memory for Ignite than your operating system can allocate. Are you sure you're not starting multiple nodes on same box? Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Unable to load more than 5g data through sqlline

Hi Debashis, Sorry for late answer. How much RAM does your server have? You configured your data region with 7 gb max size. This size defines how much RAM could be allocated for the region. If your server has not enough RAM the OS cannot allocate enough for Ignite and kills it. With persistence

Re: Unable to load more than 5g data through sqlline

Also at the same time the ignite node is restarting -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Unable to load more than 5g data through sqlline

Hi , I am using the sql line utility to do this . Also the exact error that am getting is ignite.sh : line 181: 1387 killed "$JAVA" ${JVM_OPTS} ${QUIET} "${RESTART_SUCCESS_OPT}" ${JMX_MON} \ -DIGNITE_HOME="${IGNITE_HOME}" \ -DIGNITE_PROG_NAME="$0" ${JVM_XOPTS}

Re: Unable to load more than 5g data through sqlline

a different machine is fine all you need to do is build a client using either java, c++,.net, scala, and probably powershell as well i have something like this in .Net and can parallel load files (one per thread in a pool of 10 threads) using (var ldr =

Re: Unable to load more than 5g data through sqlline

Hi , I am running sql line from a differnt machine which is not related to the cluster also . Tried with smaller chunks but difficulty is after around 2.5 gb the issue persists. Thanks & Regards Debashis Sinha -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Unable to load more than 5g data through sqlline

a better option would be to drop sqlline and write your own client that reads the csv files and loads into the database. This way you can have multiple threads loading multiple files concurrently and each load you setup the parameters for the streamer including batch sizes and flush frequency.

Re: Unable to load more than 5g data through sqlline

Hi Debashis, Is sqlline started on the same machine? Perhaps sqlline ate all the available memory but the system decided to kill Ignite. Could you split incoming data into relatively small chunks and try it out? вт, 30 окт. 2018 г. в 23:07, debashissinha : > < >

Unable to load more than 5g data through sqlline