Hi Woo, AddData() add entry to one of local buffer according to key affinity, then buffer is sent to server node that is primary for all buffer keys.
On Thu, Apr 20, 2017 at 8:16 AM, woo charles <ignite.charl...@gmail.com> wrote: > When I call addData() in streamer. this data will send & buffer in server > node. is that correct? > If I correct, this data will buffer in random server node or only the one > it directly connected? > > 2017-04-19 18:33 GMT+08:00 Andrey Mashenkov <andrey.mashen...@gmail.com>: > >> It may have effect if you prepare data for streamer (call addData) slowly >> and it is possible to utilize more resources for it. Of course remote nodes >> should be able to bear pressure of data. >> Performance can increased, but usually slightly as network will be a >> bottleneck. >> >> >> On Wed, Apr 19, 2017 at 12:29 PM, woo charles <ignite.charl...@gmail.com> >> wrote: >> >>> Is that mean the performance of input data will not affect if I use 2 >>> IgniteDataStreamer(2 >>> client program) to input data as they use the same queue in remote >>> nodes? >>> >>> 2017-04-19 10:02 GMT+08:00 Andrey Mashenkov <andrey.mashen...@gmail.com> >>> : >>> >>>> Hi Woo, >>>> >>>> IgniteDataStreamer uses per node buffer to make bulk cache updates >>>> that shows much better throughput than single updates. >>>> Also, IgniteDataStreamer send jobs to remote nodes, to utilize >>>> multiple threads on remote nodes. >>>> >>>> In multi-node grid IgniteDataStreamer usually shows better results >>>> than single updates in from multiple threads. >>>> >>>> >>>> >>>> On Wed, Apr 19, 2017 at 4:30 AM, woo charles <ignite.charl...@gmail.com >>>> > wrote: >>>> >>>>> When I try to input data(80 table, each 10000 records) to a cluster >>>>> with 3 server node(each 2 gb), it only has a small change in time if multi >>>>> thread is performed >>>>> (ie. max decrease from 8s to 6.5s if using IgniteCache) >>>>> >>>>> Is it normal? >>>>> >>>>> Also, I found that multi thread do not affect the data input speed in >>>>> IgniteDataStreamer. >>>>> >>>>> Is it true? >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>> >>>> >>>> -- >>>> Best regards, >>>> Andrey V. Mashenkov >>>> >>> >>> >> >> >> -- >> Best regards, >> Andrey V. Mashenkov >> > > -- Best regards, Andrey V. Mashenkov
