Thin client access Ignite cluster with ZooKeeper Discovery

[38797715]

Hello,

For the Ignite cluster with ZooKeeper Discovery, if want to access the 
cluster through thin client, is there an example of ClientAddressFinder?

Re: Exception on CacheEntryProcessor invoke (2.10.0)

[ihalilaltun]

Hi,

I've run more detailed tests during the weekend and i can surely tell that
problem is not related to the migrated data. With a new cluster setup and
with 0 data we can still get the error.

what i have in my mind is this; with the new version there may be a new
configuration parameter that has to be set in order cacheentryprocessors to
be DEPLOYED in SHARED mode to all cluster nodes, but i cannot find such a
parameter.

so at this point my problem becomes to this; is there a configuration
parameter that forces all cacheentroprocessors the be deployed on every
cluster node from client by force? 

following is the cluster and client configuration;
client-server-configs.zip

  

when the client nodes starts and run necessary jobs -containing
cacaheentryprocessors- first 1 or 2 cacheentryprocessors are deploed to both
clusters after that new cacaheentryprocessors starts to get
classnotfoundexception and cluster nodes keeps giving following warnings;


[2021-05-24T15:36:00,010][WARN
][sys-stripe-4-#5][GridDeploymentPerVersionStore] Failed to load peer class
(ignore if class got undeployed during preloading)
[alias=com.segmentify.lotr.frodo.cacheentryprocessor.ShiftPromotionCountersEntryProcessor,
dep=SharedDeployment [rmv=false, super=GridDeployment [ts=1621870560005,
depMode=SHARED, clsLdr=GridDeploymentClassLoader
[id=627410f9971-f4e082a1-4012-4720-bcbb-e438359221e1, singleNode=false,
nodeLdrMap=HashMap
{db22a85d-37a5-45c4-ae63-bdd535eaca44=75f020f9971-db22a85d-37a5-45c4-ae63-bdd535eaca44},
p2pTimeout=5000, usrVer=0, depMode=SHARED, quiet=false],
clsLdrId=627410f9971-f4e082a1-4012-4720-bcbb-e438359221e1, userVer=0,
loc=false,
sampleClsName=com.segmentify.lotr.frodo.cacheentryprocessor.ShiftPromotionCountersEntryProcessor,
pendingUndeploy=false, undeployed=false, usage=0]]]
[2021-05-24T15:36:00,103][WARN
][sys-stripe-2-#3][GridDeploymentPerVersionStore] Failed to load peer class
(ignore if class got undeployed during preloading)
[alias=com.segmentify.lotr.frodo.cacheentryprocessor.RockScoreResetProcessor,
dep=SharedDeployment [rmv=false, super=GridDeployment [ts=1621870560100,
depMode=SHARED, clsLdr=GridDeploymentClassLoader
[id=a27410f9971-f4e082a1-4012-4720-bcbb-e438359221e1, singleNode=false,
nodeLdrMap=HashMap
{db22a85d-37a5-45c4-ae63-bdd535eaca44=75f020f9971-db22a85d-37a5-45c4-ae63-bdd535eaca44},
p2pTimeout=5000, usrVer=0, depMode=SHARED, quiet=false],
clsLdrId=a27410f9971-f4e082a1-4012-4720-bcbb-e438359221e1, userVer=0,
loc=false,
sampleClsName=com.segmentify.lotr.frodo.cacheentryprocessor.RockScoreResetProcessor,
pendingUndeploy=false, undeployed=false, usage=0]]]
[2021-05-24T15:36:00,180][WARN
][sys-stripe-1-#2][GridDeploymentPerVersionStore] Failed to load peer class
(ignore if class got undeployed during preloading)
[alias=com.segmentify.lotr.frodo.cacheentryprocessor.RockScoreResetProcessor,
dep=SharedDeployment [rmv=false, super=GridDeployment [ts=1621870560171,
depMode=SHARED, clsLdr=GridDeploymentClassLoader
[id=f27410f9971-f4e082a1-4012-4720-bcbb-e438359221e1, singleNode=false,
nodeLdrMap=HashMap
{db22a85d-37a5-45c4-ae63-bdd535eaca44=75f020f9971-db22a85d-37a5-45c4-ae63-bdd535eaca44},
p2pTimeout=5000, usrVer=0, depMode=SHARED, quiet=false],
clsLdrId=f27410f9971-f4e082a1-4012-4720-bcbb-e438359221e1, userVer=0,
loc=false,
sampleClsName=com.segmentify.lotr.frodo.cacheentryprocessor.RockScoreResetProcessor,
pendingUndeploy=false, undeployed=false, usage=0]]]
[2021-05-24T15:36:00,202][WARN
][sys-stripe-1-#2][GridDeploymentPerVersionStore] Failed to load peer class
(ignore if class got undeployed during preloading)
[alias=com.segmentify.lotr.frodo.cacheentryprocessor.RockScoreResetProcessor,
dep=SharedDeployment [rmv=false, super=GridDeployment [ts=1621870560191,
depMode=SHARED, clsLdr=GridDeploymentClassLoader
[id=137410f9971-f4e082a1-4012-4720-bcbb-e438359221e1, singleNode=false,
nodeLdrMap=HashMap
{db22a85d-37a5-45c4-ae63-bdd535eaca44=75f020f9971-db22a85d-37a5-45c4-ae63-bdd535eaca44},
p2pTimeout=5000, usrVer=0, depMode=SHARED, quiet=false],
clsLdrId=137410f9971-f4e082a1-4012-4720-bcbb-e438359221e1, userVer=0,
loc=false,
sampleClsName=com.segmentify.lotr.frodo.cacheentryprocessor.RockScoreResetProcessor,
pendingUndeploy=false, undeployed=false, usage=0]]]
[2021-05-24T15:36:00,308][WARN
][sys-stripe-1-#2][GridDeploymentPerVersionStore] Failed to load peer class
(ignore if class got undeployed during preloading)
[alias=com.segmentify.lotr.frodo.cacheentryprocessor.RockScoreResetProcessor,
dep=SharedDeployment [rmv=false, super=GridDeployment [ts=1621870560302,
depMode=SHARED, clsLdr=GridDeploymentClassLoader
[id=337410f9971-f4e082a1-4012-4720-bcbb-e438359221e1, singleNode=false,
nodeLdrMap=HashMap
{db22a85d-37a5-45c4-ae63-bdd535eaca44=75f020f9971-db22a85d-37a5-45c4-ae63-bdd535eaca44},
p2pTimeout=5000, usrVer=0, depMode=SHARED, quiet=false],
clsLdrId=337410f9971-f4e082a1-4012-4720-bcbb-e438359221e1, userVer=0,

unsubscribe

[Mohammed Hagag]

On Mon, May 24, 2021, 14:50 Naveen  wrote:

> HI
>
> We are using Ignite 2.8.1
>
> when we run select * table, it throws below exception, how ever querying
> for
> a specific key works fine.
> what could have gone wrong here ? Anything we can make out with these ids
> mentioned below
> Error: Failed to execute map query on remote node
> [nodeId=3db2b3e5-21ae-46ad-9b14-cf3a1c8171de, errMsg=Failed to execute SQL
> query. General error: "class
> org.apache.ignite.binary.BinaryObjectException:
> Cannot find schema for object with compact footer
> [typeName=org.ignite.model.curated.Account, typeId=-2143671743,
> missingSchemaId=319535867, existingSchemaIds=[-284217025, -131460726,
> 738773736, -361085461, 130249633, -1686791135, 670818893, 1018521906,
> -978489660, 1225415027, 1484800635, 469100171]]"; SQL statement:
>
> [2021-05-24 16:42:58,117][WARN
> ][client-connector-#78][CacheObjectBinaryProcessorImpl] Schema is missing
> while no metadata updates are in progress (will wait for schema update
> within timeout defined by IGNITE_WAIT_SCHEMA_UPDATE system property)
> [typeId=-2143671743, missingSchemaId=319535867, pendingVer=3,
> acceptedVer=3,
> binMetaUpdateTimeout=3]
>
> Thanks
>
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>

Re: select * throws cannot find schema for object with compact footer

[Alex Plehanov]

Hello,

Probably related to [1] (Fixed in Ignite 2.9)

[1]: https://issues.apache.org/jira/browse/IGNITE-13192

пн, 24 мая 2021 г. в 18:55, Naveen :

> When I tried to retrieve the fields of the binary object it does throw
> exception, after deleting all such records, it started working fine. We do
> have these records earlier also and worked fine, never had any issues, not
> sure what has caused this issue all of a sudden
>
> Thanks
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>

Re: select * throws cannot find schema for object with compact footer

[Naveen]

When I tried to retrieve the fields of the binary object it does throw
exception, after deleting all such records, it started working fine. We do
have these records earlier also and worked fine, never had any issues, not
sure what has caused this issue all of a sudden

Thanks



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: System.InvalidOperationException: 'No coercion operator is defined between types 'Apache.Ignite.Core.Impl.Binary.BinaryObjectBuilder' and 'System.DateTime'

[Ilya Kasnacheev]

Hello!

Maybe you are doing something wrong which only becomes apparent in the
persistent setup.

Can you share a runnable reproducer project which exhibits the behavior?

Regards,
-- 
Ilya Kasnacheev


пт, 21 мая 2021 г. в 20:20, Josh Katz :

> Hi Ilya,
>
>
>
> I’m getting this exception when calling ICache Get method to retrieve the
> object from the Cache. (The object has a DateTime property)
>
> I have no special configuration other than persistence enabled. In another
> project we didn’t use persistence and did not encounter this issue.
>
> Can you please clarify if this issue is only happening when using
> persistence? I’m going to try the IBinarizable approach from the docs.
>
>
>
> Thanks,
>
>
>
> Josh Katz
>
> Dodge & Cox | 415-262-7520
>
>
>
>
>
>
>
> *From:* Ilya Kasnacheev 
> *Sent:* Friday, May 21, 2021 2:02 AM
> *To:* user@ignite.apache.org
> *Subject:* Re: System.InvalidOperationException: 'No coercion operator is
> defined between types 'Apache.Ignite.Core.Impl.Binary.BinaryObjectBuilder'
> and 'System.DateTime'
>
>
>
> *This is an EXTERNAL EMAIL. Stop and think before clicking a link or
> opening attachments.*
>
> Hello!
>
>
>
> For starters, it looks like you're putting a BinaryObjectBuilder into
> cache instead of BinaryObjectBilder.Build() return value.
>
>
>
> Regards,
>
> --
>
> Ilya Kasnacheev
>
>
>
>
>
> пт, 21 мая 2021 г. в 01:46, Josh Katz <
> josh.katz.contrac...@dodgeandcox.com>:
>
> Using .NET UnitTest to connect to the cluster and persistence enabled.
>
> Put works without errors. When calling Get we get the following exception:
>
> System.InvalidOperationException: 'No coercion operator is defined between
> types 'Apache.Ignite.Core.Impl.Binary.BinaryObjectBuilder' and
> 'System.DateTime'
>
>
>
> We are using System.Runtime.Serialization for the DateTime property with
> DataMemberAttribute.
>
>
>
> Thanks,
>
>
>
> *Josh Katz*
>
> *Dodge & Cox*
>
> 555 California Street | 40th floor | San Francisco, CA 94104
>
> 415-262-7520
>
>
>
> josh.katz.contrac...@dodgeandcox.com
>
> www.dodgeandcox.com
>
>
>
>
> --
>
> Please follow the hyperlink to important disclosures.
> https://www.dodgeandcox.com/disclosures/email_disclosure_funds.html
>
>

Re: Exception on CacheEntryProcessor invoke (2.10.0)

[Ilya Kasnacheev]

Hello!

If you can provide steps to reproduce, I can try to do that.

Regards,
-- 
Ilya Kasnacheev


пт, 21 мая 2021 г. в 18:45, ihalilaltun :

> hi
>
> the case can be reproduced only by upgrading from 2.7.6 to 2.10.0 with
> existing data. can you run that kind of reproduce step?
>
>
>
> -
> İbrahim Halil Altun
> Senior Software Engineer @ Segmentify
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>

Re: select * throws cannot find schema for object with compact footer

[Ilya Kasnacheev]

Hello!

Please refer to
https://ignite.apache.org/docs/latest/key-value-api/binary-objects#recommendations-on-binary-objects-tuning

It seems that some of the rows in the table has a layout of data which is
not present on any of nodes. So Ignite does not know how to unpack these
rows into columns.

Maybe you have lost the contents of binary_meta directory on the nodes or
something like that.

Regards,
-- 
Ilya Kasnacheev


пн, 24 мая 2021 г. в 15:50, Naveen :

> HI
>
> We are using Ignite 2.8.1
>
> when we run select * table, it throws below exception, how ever querying
> for
> a specific key works fine.
> what could have gone wrong here ? Anything we can make out with these ids
> mentioned below
> Error: Failed to execute map query on remote node
> [nodeId=3db2b3e5-21ae-46ad-9b14-cf3a1c8171de, errMsg=Failed to execute SQL
> query. General error: "class
> org.apache.ignite.binary.BinaryObjectException:
> Cannot find schema for object with compact footer
> [typeName=org.ignite.model.curated.Account, typeId=-2143671743,
> missingSchemaId=319535867, existingSchemaIds=[-284217025, -131460726,
> 738773736, -361085461, 130249633, -1686791135, 670818893, 1018521906,
> -978489660, 1225415027, 1484800635, 469100171]]"; SQL statement:
>
> [2021-05-24 16:42:58,117][WARN
> ][client-connector-#78][CacheObjectBinaryProcessorImpl] Schema is missing
> while no metadata updates are in progress (will wait for schema update
> within timeout defined by IGNITE_WAIT_SCHEMA_UPDATE system property)
> [typeId=-2143671743, missingSchemaId=319535867, pendingVer=3,
> acceptedVer=3,
> binMetaUpdateTimeout=3]
>
> Thanks
>
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>

Re: Unable fetch Ignite JMX metrics

[Stephen Darlington]

Any reason you can’t use the OpenCensus exporter rather than using JMX?

More here: Setting Up Prometheus for Apache Ignite and GridGain 


Regards,
Stephen

> On 24 May 2021, at 06:15, Kamlesh Joshi  wrote:
> 
> Hi Team,
>  
> Any update on this please ?
>  
> Thanks and Regards,
> Kamlesh Joshi
>  
> From: Kamlesh Joshi 
> Sent: 13 May 2021 13:11
> To: 'user@ignite.apache.org' 
> Subject: RE: Unable fetch Ignite JMX metrics
>  
> Hi Igniters,
>  
> After getting the latest source code of JMX exporter, below mentioned issue 
> (details in the trailing) is resolved. However, new one has showed up as 
> below. Seems to be from Ignite source. Could anyone please check and provide 
> a workaround for this ?
>  
> SEVERE: JMX scrape failed: javax.management.RuntimeMBeanException: 
> getMBeanInfo threw RuntimeException
> at 
> com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1384)
> at 
> com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:920)
> at 
> javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1462)
> at 
> javax.management.remote.rmi.RMIConnectionImpl.access$300(RMIConnectionImpl.java:76)
> at 
> javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1309)
> at 
> javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1401)
> at 
> javax.management.remote.rmi.RMIConnectionImpl.getMBeanInfo(RMIConnectionImpl.java:905)
> at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
> at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:357)
> at sun.rmi.transport.Transport$1.run(Transport.java:200)
> at sun.rmi.transport.Transport$1.run(Transport.java:197)
> at java.security.AccessController.doPrivileged(Native Method)
> at sun.rmi.transport.Transport.serviceCall(Transport.java:196)
> at 
> sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:568)
> at 
> sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:826)
> at 
> sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$0(TCPTransport.java:683)
> at java.security.AccessController.doPrivileged(Native Method)
> at 
> sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:682)
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> at 
> sun.rmi.transport.StreamRemoteCall.exceptionReceivedFromServer(StreamRemoteCall.java:283)
> at 
> sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:260)
> at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:161)
> at com.sun.jmx.remote.internal.PRef.invoke(Unknown Source)
> at 
> javax.management.remote.rmi.RMIConnectionImpl_Stub.getMBeanInfo(Unknown 
> Source)
> at 
> javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.getMBeanInfo(RMIConnector.java:1079)
> at io.prometheus.jmx.JmxScraper.scrapeBean(JmxScraper.java:131)
> at io.prometheus.jmx.JmxScraper.doScrape(JmxScraper.java:118)
> at io.prometheus.jmx.JmxCollector.collect(JmxCollector.java:547)
> at 
> io.prometheus.client.CollectorRegistry$MetricFamilySamplesEnumeration.findNextElement(CollectorRegistry.java:207)
> at 
> io.prometheus.client.CollectorRegistry$MetricFamilySamplesEnumeration.nextElement(CollectorRegistry.java:240)
> at 
> io.prometheus.client.CollectorRegistry$MetricFamilySamplesEnumeration.nextElement(CollectorRegistry.java:161)
> at 
> io.prometheus.client.exporter.common.TextFormat.write004(TextFormat.java:65)
> at 
> io.prometheus.client.exporter.common.TextFormat.writeFormat(TextFormat.java:47)
> at 
> io.prometheus.client.exporter.HTTPServer$HTTPMetricHandler.handle(HTTPServer.java:72)
> at com.sun.net.httpserver.Filter$Chain.doFilter(Filter.java:79)
> at sun.net.httpserver.AuthFilter.doFilter(AuthFilter.java:83)
> at com.sun.net.httpserver.Filter$Chain.doFilter(Filter.java:82)
> at 
> sun.net.httpserver.ServerImpl$Exchange$LinkHandler.handle(ServerImpl.java:675)
> at com.sun.net.httpserver.Filter$Chain.doFilter(Filter.java:79)
> at sun.net.httpserver.ServerImpl$Exchange.run(ServerImpl.java:647)
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at 
> 

select * throws cannot find schema for object with compact footer

[Naveen]

HI 

We are using Ignite 2.8.1

when we run select * table, it throws below exception, how ever querying for
a specific key works fine.
what could have gone wrong here ? Anything we can make out with these ids
mentioned below
Error: Failed to execute map query on remote node
[nodeId=3db2b3e5-21ae-46ad-9b14-cf3a1c8171de, errMsg=Failed to execute SQL
query. General error: "class org.apache.ignite.binary.BinaryObjectException:
Cannot find schema for object with compact footer
[typeName=org.ignite.model.curated.Account, typeId=-2143671743,
missingSchemaId=319535867, existingSchemaIds=[-284217025, -131460726,
738773736, -361085461, 130249633, -1686791135, 670818893, 1018521906,
-978489660, 1225415027, 1484800635, 469100171]]"; SQL statement:

[2021-05-24 16:42:58,117][WARN
][client-connector-#78][CacheObjectBinaryProcessorImpl] Schema is missing
while no metadata updates are in progress (will wait for schema update
within timeout defined by IGNITE_WAIT_SCHEMA_UPDATE system property)
[typeId=-2143671743, missingSchemaId=319535867, pendingVer=3, acceptedVer=3,
binMetaUpdateTimeout=3]

Thanks





--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/