Hi,
These parameters looks strange to me:
<property name="queryParallelism" value="25"/>
<property name="partitions" value="2048"/>
Why have you set them?
Can you share logs and the code that you use?
Thanks,
Evgenii
пн, 27 янв. 2020 г. в 01:53, v-shaal <[email protected]>:
> I am working with kafka streamer which at start with putting 10k rec/sec
> and
> after around 1 Million records in cache it slows down to 2000rec/sec to 500
> to 100. I am not getting hold of whats getting wrong.
> If its to do with dataPages, Threads or something else.
>
> *Following are the logs :*
>
> Metrics for local node (to disable set 'metricsLogFrequency' to 0)
> ^-- Node [id=367b9688, uptime=00:50:00.246]
> ^-- H/N/C [hosts=5, nodes=6, CPUs=80]
> ^-- CPU [cur=4.6%, avg=23.52%, GC=0%]
> ^-- PageMemory [pages=12052]
> ^-- Heap [used=3222MB, free=77.04%, comm=4085MB]
> ^-- Off-heap [used=47MB, free=99.93%, comm=10576MB]
> ^-- sysMemPlc region [used=0MB, free=99.21%, comm=40MB]
> ^-- default region [used=0MB, free=100%, comm=256MB]
> ^-- 500MB_Region region [used=46MB, free=99.91%, comm=10240MB]
> ^-- TxLog region [used=0MB, free=100%, comm=40MB]
> ^-- Outbound messages queue [size=0]
> ^-- Public thread pool [active=0, idle=0, qSize=0]
> ^-- System thread pool [active=0, idle=6, qSize=0]
> [2020-01-27 09:48:19,368][INFO ][grid-timeout-worker-#39][IgniteKernal]
> FreeList [name=null, buckets=256, dataPages=8527, reusePages=0]
>
> *Cache Config
> *
> <property name="cacheConfiguration">
> <list>
> </bean>
> <bean
> class="org.apache.ignite.configuration.CacheConfiguration">
> <property name="name" value="AllEvents"/>
> <property name="dataRegionName" value="500MB_Region"/>
> <property name="cacheMode" value="PARTITIONED"/>
> <property name="queryParallelism" value="25"/>
> <property name="affinity">
> <bean
>
> class="org.apache.ignite.cache.affinity.rendezvous.RendezvousAffinityFunction">
> <property name="excludeNeighbors" value="true"/>
> <property name="partitions" value="2048"/>
> </bean>
> </property>
> </bean>
> </list>
> </property>
>
> *Ignite and Data region config*
>
> <bean class="org.apache.ignite.configuration.IgniteConfiguration">
>
>
> <property name="publicThreadPoolSize" value="64"/>
>
> <property name="systemThreadPoolSize" value="32"/>
>
> <property name="dataStorageConfiguration">
> <bean
> class="org.apache.ignite.configuration.DataStorageConfiguration">
> <property name="dataRegionConfigurations">
> <list>
>
> <bean
> class="org.apache.ignite.configuration.DataRegionConfiguration">
>
> <property name="name" value="500MB_Region"/>
>
>
> <property name="initialSize" value="#{10L * 1024 *
> 1024 * 1024}"/>
>
>
> <property name="maxSize" value="#{50L * 1024 * 1024
> * 1024}"/>
>
>
> </bean>
> </list>
> </property>
> </bean>
> </property>
>
>
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>
