FW: Conditional data Preloading from third party persistence
Sending again to reflect in portal !
Thanks and Regards,
Kamlesh Joshi
From: Kamlesh Joshi
Sent: 21 June 2021 17:25
To: user@ignite.apache.org
Subject: Conditional data Preloading from third party persistence
Hi Igniters,
Am trying to preload certain data from third party persistence, but am getting
below error while doing that. I have been using below snippet for the same. Can
anyone guide, if am doing something wrong here. Any specific changes needed to
be done on data model side?
IgniteCache cache = ignite.cache(cacheName);
cache.loadCache(new IgniteBiPredicate() {
@Override
public boolean apply(String k, Customer v) {
if ("".equalsIgnoreCase(v.getFirstName())) {
return true;
} else {
return false;
}
}
});
Custom data model jars are already available on cluster class path.
org.apache.ignite.IgniteException: Failed to load cache: CustomerCache
at
org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2.execute(GridClosureProcessor.java:1858)
~[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.job.GridJobWorker$2.call(GridJobWorker.java:568)
~[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:6820)
[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.job.GridJobWorker.execute0(GridJobWorker.java:562)
[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.job.GridJobWorker.body(GridJobWorker.java:491)
[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.job.GridJobProcessor.processJobExecuteRequest(GridJobProcessor.java:1125)
[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.job.GridJobProcessor$JobExecutionListener.onMessage(GridJobProcessor.java:1923)
[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1569)
[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:1197)
[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.managers.communication.GridIoManager.access$4200(GridIoManager.java:127)
[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.managers.communication.GridIoManager$9.run(GridIoManager.java:1093)
[ignite-core-2.7.6.jar:2.7.6]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[?:1.8.0_271]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[?:1.8.0_271]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_271]
Caused by: org.apache.ignite.IgniteException: Failed to load cache:
CustomerCache
at
org.apache.ignite.internal.util.IgniteUtils.convertException(IgniteUtils.java:1029)
[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.cache.GridCacheAdapter$LoadCacheJob.localExecute(GridCacheAdapter.java:5681)
~[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.cache.GridCacheAdapter$LoadCacheJobV2.localExecute(GridCacheAdapter.java:5725)
~[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.cache.GridCacheAdapter$TopologyVersionAwareJob.execute(GridCacheAdapter.java:6361)
~[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.compute.ComputeJobAdapter.call(ComputeJobAdapter.java:132)
~[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2.execute(GridClosureProcessor.java:1855)
~[ignite-core-2.7.6.jar:2.7.6]
... 14 more
Caused by: org.apache.ignite.IgniteCheckedException: Failed to load cache:
CustomerCache
at
org.apache.ignite.internal.processors.cache.store.GridCacheStoreManagerAdapter.loadCache(GridCacheStoreManagerAdapter.java:543)
~[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtCacheAdapter.localLoadCache(GridDhtCacheAdapter.java:630)
~[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.cache.GridCacheProxyImpl.localLoadCache(GridCacheProxyImpl.java:222)
~[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.cache.GridCacheAdapter$LoadCacheJob.localExecute(GridCacheAdapter.java:5676)
~[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.cache.GridCacheAdapter$LoadCacheJobV2.localExecute(GridCacheAdapter.java:5725)
~[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.cache.GridCacheAdapter$TopologyVersionAwareJob.execute(GridCacheAdapter.java:6361)
~[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.comp
Re: Scan query ClassNotFoundException
Hello!
Key/value classes need to be manually deployed to server node but the
listener code itself may be peer loaded from client.
Regards,
--
Ilya Kasnacheev
пт, 18 июн. 2021 г. в 10:31, ict.management.trexon <
ict.management.tre...@gmail.com>:
> If I were to do this, it would mean that peerClassLoading cannot work with
> scan queries, as the class, POJO in this case, should be known on the
> server
> node side.
> Instead, like this, it works:
> @Override
> public boolean apply(Integer e1, BinaryObject e2) {
> SimplePojo sp = e2.deserialize(SimplePojo.class.getClassLoader());
> return sp.getId().equals(idToFind);
> }
> look this:
> e2.deserialize(SimplePojo.class.getClassLoader());
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>
Conditional data Preloading from third party persistence
Hi Igniters,
Am trying to preload certain data from third party persistence, but am getting
below error while doing that. I have been using below snippet for the same. Can
anyone guide, if am doing something wrong here. Any specific changes needed to
be done on data model side?
IgniteCache cache = ignite.cache(cacheName);
cache.loadCache(new IgniteBiPredicate() {
@Override
public boolean apply(String k, Customer v) {
if ("".equalsIgnoreCase(v.getFirstName())) {
return true;
} else {
return false;
}
}
});
Custom data model jars are already available on cluster class path.
org.apache.ignite.IgniteException: Failed to load cache: CustomerCache
at
org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2.execute(GridClosureProcessor.java:1858)
~[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.job.GridJobWorker$2.call(GridJobWorker.java:568)
~[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:6820)
[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.job.GridJobWorker.execute0(GridJobWorker.java:562)
[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.job.GridJobWorker.body(GridJobWorker.java:491)
[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.job.GridJobProcessor.processJobExecuteRequest(GridJobProcessor.java:1125)
[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.job.GridJobProcessor$JobExecutionListener.onMessage(GridJobProcessor.java:1923)
[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1569)
[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:1197)
[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.managers.communication.GridIoManager.access$4200(GridIoManager.java:127)
[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.managers.communication.GridIoManager$9.run(GridIoManager.java:1093)
[ignite-core-2.7.6.jar:2.7.6]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[?:1.8.0_271]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[?:1.8.0_271]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_271]
Caused by: org.apache.ignite.IgniteException: Failed to load cache:
CustomerCache
at
org.apache.ignite.internal.util.IgniteUtils.convertException(IgniteUtils.java:1029)
[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.cache.GridCacheAdapter$LoadCacheJob.localExecute(GridCacheAdapter.java:5681)
~[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.cache.GridCacheAdapter$LoadCacheJobV2.localExecute(GridCacheAdapter.java:5725)
~[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.cache.GridCacheAdapter$TopologyVersionAwareJob.execute(GridCacheAdapter.java:6361)
~[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.compute.ComputeJobAdapter.call(ComputeJobAdapter.java:132)
~[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2.execute(GridClosureProcessor.java:1855)
~[ignite-core-2.7.6.jar:2.7.6]
... 14 more
Caused by: org.apache.ignite.IgniteCheckedException: Failed to load cache:
CustomerCache
at
org.apache.ignite.internal.processors.cache.store.GridCacheStoreManagerAdapter.loadCache(GridCacheStoreManagerAdapter.java:543)
~[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtCacheAdapter.localLoadCache(GridDhtCacheAdapter.java:630)
~[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.cache.GridCacheProxyImpl.localLoadCache(GridCacheProxyImpl.java:222)
~[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.cache.GridCacheAdapter$LoadCacheJob.localExecute(GridCacheAdapter.java:5676)
~[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.cache.GridCacheAdapter$LoadCacheJobV2.localExecute(GridCacheAdapter.java:5725)
~[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.cache.GridCacheAdapter$TopologyVersionAwareJob.execute(GridCacheAdapter.java:6361)
~[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.compute.ComputeJobAdapter.call(ComputeJobAdapter.java:132)
~[ignite-core-2.7.6.jar:2.7.6]
at
org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2.execute(GridClosureProcessor.java:1855)
~[
[ANNOUNCE] Apache IGNITE python thin client (pyignite) 0.5.0 released
The Apache Ignite Community is pleased to announce the release of Apache IGNITE python thin client (pyignite) 0.5.0. This new release of python thin client contains new cool features: Namely: 1. Transactions support 2. Expiry policy support. 3. Performance improvement of asyncio version 4. Few bug-fixes For the full list of changes, you can refer to the RELEASE_NOTES. https://ignite.apache.org/releases/pyignite/0.5.0/release_notes.html You can install this version using pip >> pip install pyignite==0.5.0 Alternatively, you can download sources and binary packages (wheels) from here: https://dist.apache.org/repos/dist/release/ignite/pyignite/0.5.0/ Please let us know if you have any problems https://ignite.apache.org/community/resources.html#ask Regards, Ivan Daschinsky on behalf of the Apache Ignite community.
Re: Cannot start ignite nodes with shared memory - Ignite version 2.10.0
Also, as I know, shmem is not recommended to use. Shmem will not be used in Ignite 3. пн, 21 июн. 2021 г. в 15:30, Ilya Kazakov : > Hello, as I can see no one from the community wants to take this ticket. > Try to ask on dev-list: d...@ignite.apache.org > > ср, 2 июн. 2021 г. в 05:11, sarahsamji : > >> Hi, is there a fix expected for this issue in the next release? >> >> >> >> -- >> Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >> >
Re: Cannot start ignite nodes with shared memory - Ignite version 2.10.0
Hello, as I can see no one from the community wants to take this ticket. Try to ask on dev-list: d...@ignite.apache.org ср, 2 июн. 2021 г. в 05:11, sarahsamji : > Hi, is there a fix expected for this issue in the next release? > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >
