Re: kafka-connect and apache-ignite

2021-05-17 Thread akorensh
Hi, You do not need to run the sink connector and ignite cluster on the same node. The igniteCfg property points to the connector's ignite configuration file. https://ignite.apache.org/docs/latest/extensions-and-integrations/streaming/kafka-streamer (see step 3) Use the discovery sect

CacheEntryProcessor ClassNotFoundException after 2.7.6 -> 2.10.0 Upgrade

2021-05-17 Thread ihalilaltun
Hi igniters, recenlty we have upgraded from 2.7.6 to 2.10.0 and some of cacheentryprocessors started to act wierd. We have following cacheentryprocessor RockScoreUpdateProcessor.java when the processor i

kafka-connect and apache-ignite

2021-05-17 Thread shubhamshirur
Is it compulsive to run sink-connector and ignite-cluster on same node? If not what changes I should make in my ignite cfg file. Thank you -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

How to deal with data expiration time flexibly

2021-05-17 Thread 38797715
Hello team, At present, only a few simple expiration policies can be configured, such as CreatedExpiryPolicy. If want to use a field value to determine the expiration time of the data, what should we do? Or what interface is there for extension?

Re: Data replication from kafka-topic to ignite cluster

2021-05-17 Thread shubhamshirur
Thank you sir for replying. I have added ignite-core.jar and I have mentioned its path in plugin.path. This particular jar is loaded in while connector instantiation I have checked it in the log. Can you please enlighten me on this ? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Data synchronization after node restart

2021-05-17 Thread 38797715
Hello, We know that the control script has an idle_verify command can be used to verify the potential inconsistency between the primary and backup. Well, since there are WAL and WAL archives, they can be used for historical data balancing. So why can't WAL ensure the consistency between the p

Re: concurrency issues in entry processor

2021-05-17 Thread Данилов Семён
I tried reproducing your issue but with no avail. What version of Apache Ignite do you use? Kind regards, Semyon. 17.05.2021, 11:03, "kimec.ethome.sk" : > Hi Semyon, > > the cache configuration is: > > CacheConfiguration> cc = new > CacheConfiguration<>(); > cc.setName("fancyCache"); > cc.setAto

Re: Migration from Apache ignite 2.7.0 to 2.10.0

2021-05-17 Thread Stephen Darlington
There are no blockers as far as I’m aware, but, of course, you’d want to do your own due diligence in a test environment. > On 17 May 2021, at 06:00, BEELA GAYATRI wrote: > > Dear Team, > >We are planning to migrate Apache 2.7.0 to 2.10.0. We have seen few > warnings in 2.10.0 release not

Re: Data replication from kafka-topic to ignite cluster

2021-05-17 Thread Stephen Darlington
The error says that it can’t find “org/apache/ignite/internal/util/typedef/internal/A” and that’s in ignite-core. So, despite putting it somewhere sensible, it doesn’t seem to be able to find ignite-core.jar. Check your environment, make sure it’s in your CLASSPATH. > On 15 May 2021, at 10:20,

Re: Execute Ignite Callable Jobs with set priorities

2021-05-17 Thread Stephen Darlington
> As mentioned in job scheduling documentation, collisionAPI will take care of > job scheduling when jobs arrive at destination node. Lets say I use > PriorityQueueCollisionSpi and send three jobs with priorities 5, 7 and 10 to > one node, then that node will execute job with priority 10 first then

Re: concurrency issues in entry processor

2021-05-17 Thread kimec.ethome.sk
Hi Semyon, the cache configuration is: CacheConfiguration> cc = new CacheConfiguration<>(); cc.setName("fancyCache"); cc.setAtomicityMode(CacheAtomicityMode.ATOMIC); cc.setCacheMode(CacheMode.PARTITIONED); cc.setBackups(1); cc.setRebalanceMode(CacheRebalanceMode.SYNC); cc.setPartitionLossPolic

Re: concurrency issues in entry processor

2021-05-17 Thread Данилов Семён
Hello, Kamil! Could you please provide your cache configuration? Kind regards, Semyon. 17.05.2021, 09:10, "kimec.ethome.sk" : > Greetings, > > we have recently run into a concurrency issue in an entry processor. > > Suppose we have a cache that is IgniteCache String>>. > Entries in this cache ar