Re: Question about write speed.

2018-12-31 Thread Denis Magda
Hello,

Here is a list of optimizations to try. All of them are related to Ignite
memory and persistence:
https://apacheignite.readme.io/docs/durable-memory-tuning

But first things firsts, Ignite is a distributed database - ensure you have
more than 1 node in your deployment. Better throughput comes once the
scalability aspects are utilized.

--
Denis

On Fri, Dec 28, 2018 at 8:01 PM yangjiajun <1371549...@qq.com> wrote:

> Hello.
>
> I use ignite 2.6  as a sql database and enable persistence(full_sync).I
> only
> start one node.All tables are replicated.I use streaming while insert
> data.The write speed is about 5~6k records per table.Is such speed
> normal?Can I improve it?
>
> Here is my config file:
> example-default.xml
> <
> http://apache-ignite-users.70518.x6.nabble.com/file/t2059/example-default.xml>
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>


Re: Question about write speed.

2018-12-29 Thread Ilya Kasnacheev
Hello!

I have gathered some hints in this e-mail:
http://apache-ignite-users.70518.x6.nabble.com/Ignite-Performance-Issues-when-seeding-data-from-Spark-tp25551p25596.html

Regards,
-- 
Ilya Kasnacheev


сб, 29 дек. 2018 г. в 07:01, yangjiajun <1371549...@qq.com>:

> Hello.
>
> I use ignite 2.6  as a sql database and enable persistence(full_sync).I
> only
> start one node.All tables are replicated.I use streaming while insert
> data.The write speed is about 5~6k records per table.Is such speed
> normal?Can I improve it?
>
> Here is my config file:
> example-default.xml
> <
> http://apache-ignite-users.70518.x6.nabble.com/file/t2059/example-default.xml>
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>


Re: Question about write speed.

2018-12-29 Thread Mikael

Hi!

5-6k records per what ? second ? anyway, it's not easy to answer, what 
kind of index if any, how big values you have and so on, 6000 records 
per second sound ok but could be faster.


Any normal usage would be with multiple nodes, if you are going to use 
just 1 node you do not have much use of Ignite, there are faster solutions.


Not sure I get the idea with the settings, a replicated cache will only 
have one copy anyway if you only have 1 node.


What is it you want to do and what kind of performance do you need ? can 
you use multiple nodes and load balance the writing between them ?


I have an application that writes around 15000+ records per second on a 
single node with streaming without problems (affinity string keys and 
small values, <100 bytes), and it can handle around 5000 entries per 
second with put( set), all with persistence enabled.


Mikael

Den 2018-12-29 kl. 05:01, skrev yangjiajun:

Hello.

I use ignite 2.6  as a sql database and enable persistence(full_sync).I only
start one node.All tables are replicated.I use streaming while insert
data.The write speed is about 5~6k records per table.Is such speed
normal?Can I improve it?

Here is my config file:
example-default.xml




--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/



Question about write speed.

2018-12-28 Thread yangjiajun
Hello.

I use ignite 2.6  as a sql database and enable persistence(full_sync).I only
start one node.All tables are replicated.I use streaming while insert
data.The write speed is about 5~6k records per table.Is such speed
normal?Can I improve it?

Here is my config file:
example-default.xml
 
 



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/