Hello,
Looks like you have you have nodes on different hosts with same ports. Do
you have other exceptions in log? Even if he failed to connect to this node
through localhost address, it should try to connect to other addresses of
node fc2bcbe5-2a4b-406b-b60d-69a445f52fd9. Also, on which addreses
Have you checked this link:
https://apacheignite-fs.readme.io/docs/file-system ?
You need to configure IGFS for hadoop and Ignite should use Hadoop api to
work with Kerberos
Evgenii
--
View this message in context:
Hi,
Please share full logs from all nodes so I can help in investigating of your
problem.
Evgenii
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Activating-Cluster-taking-too-long-tp16093p16099.html
Sent from the Apache Ignite Users mailing list archive at
Hi,
It's possible to provide settings with String:
Evgenii
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Provide-persistence-settings-inline-for-Cassandra-KeyValuePersistenceSettings-tp14724p14802.html
Sent from
Hi,
Could you provide your config files and logs?
Evgenii
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Ignite-not-conneting-to-remote-node-if-Using-FQDN-tp14634p14801.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Hi,
Please provide logs from Ignite nodes, so we could investigate them.
Evgenii
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/ignite-can-not-find-other-ignite-clients-with-attched-config-xml-tp14613p14749.html
Sent from the Apache Ignite Users mailing list
Hi,
Yes, TopologyValidator was implemented exactly for these things.
Also, it's possible to listen for EVT_CACHE_REBALANCE_PART_DATA_LOST events
and implement some logic on it, but I think that TopologyValidator is better
solution.
Evgenii
--
View this message in context:
Hi,
If you want, you can work without POJO at all. It's possible to work wih
BinaryObjects: https://apacheignite.readme.io/docs/binary-marshaller
Here is working example:
http://apache-ignite-users.70518.x6.nabble.com/SQL-queries-with-BinaryObject-td5636.html
Evgenii
--
View this message in
You don't need to use Visor tasks to get statistics.
Try this:
ignite.cluster().metrics()
or
ignite.cluster().node(node).metrics()
Evgeniii
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/How-does-node-vistor-task-can-work-tp15095p15121.html
Sent from the
Hi,
On user operations use Ignite.cache instead of Ignite.getOrCreateCache. it
will throw an exception if cache doesn't exist.
Or, you can get list of cache names by Ignite.cacheNames().
Evgenii
--
View this message in context:
Hi,
I've tried to put same values to local ignite node without client and
spring, it works without any problems.
Could you share logs from both server and client node?
Evgenii
--
View this message in context:
Hi,
It's not clear what do you want to do, but javadoc for QuerySqlFunction
contains some sample code for usage it:
https://ignite.apache.org/releases/mobile/org/apache/ignite/cache/query/annotations/QuerySqlFunction.html
How do you want to use HA with cluster singleton?
What do you mean by
It works for me without hangs, here is log:
Created Ignite cache: IgniteCacheProxy [delegate=GridDhtAtomicCache
[defRes=org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache$1@72f46e16,
near=null, super=GridDhtCacheAdapter
duplicate for
http://apache-ignite-developers.2346864.n4.nabble.com/It-seems-WebSession-s-removeAttribute-does-not-support-HttpSessionBindingListener-td19184.html
--
View this message in context:
Hi,
Have you enabled spring transaction support, as it described here?
https://ignite.apache.org/releases/2.0.0/javadoc/org/apache/ignite/transactions/spring/SpringTransactionManager.html
Evgenii
--
View this message in context:
Hi,
Please properly subscribe to the mailing list so that the community can
receive email notifications for your messages. To subscribe, send empty
email to user-subscr...@ignite.apache.org and follow simple instructions in
the reply.
I tried your code, but it's works without problems for me.
Ok, then send full reproducer as a maven project, I will try it with spring.
I don't have AppConfig.class.
Evgenii
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Putting-a-multi-level-object-into-Ignite-cache-hangs-on-put-tp14086p14134.html
Sent from the
Hi,
In this message after some information also printed a full stacktrace for
this exception. Just check your log closely.
If you don't have this stacktrace, please, share full logs with us.
Evgenii
--
View this message in context:
Hi,
You're trying to put in option "query", which have a type Query, a value,
which have a type String.
Do you have a registry bean #query1?
This documentation has a descriptions for parameters:
http://camel.apache.org/ignite.html
Evgenii
--
View this message in context:
Hi,
You've got instance of BinaryObject, not instance of
com.coupang.ignite.fds.model.DiscountCouponOrderItem.
To get instance of this class you need to deserialise BinaryObject value by
invoking oldVal.deserialize()
Evgenii
--
View this message in context:
Hi,
I tried to run your code on Linux, but everything works fine for me. One
thing - I don't see SSL configuration in your config files, while your log
contains information that SSL was enabled. Is the same behavior reproducible
without SSL?
Also, I see that you use both ipv4 and ipv6, possibly
Have you checked this page: http://camel.apache.org/ignite.html ?
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Ignite-with-Camel-tp13687p16030.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Hi,
Please properly subscribe to the mailing list so that the community can
receive email notifications for your messages. To subscribe, send empty
email to user-subscr...@ignite.apache.org and follow simple instructions in
the reply.
How are you trying to access server? What error code and
Hi,
Please properly subscribe to the mailing list so that the community can
receive email notifications for your messages. To subscribe, send empty
email to user-subscr...@ignite.apache.org and follow simple instructions in
the reply.
If you want to use java code in SQL queries as custom
Hi,
This issue already was fixed, here is a ticket:
https://issues.apache.org/jira/browse/IGNITE-5225
Evgenii
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Threads-leaks-problem-tp13828p13962.html
Sent from the Apache Ignite Users mailing list archive at
Hi,
It's not clear what you want to do. Why don't you just use simple sql
queries? Why do you think that you need @QuerySQLFunction?
Evgenii
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Ignite-Custom-Java-Code-calling-tp13819p14032.html
Sent from the Apache
Hi,
You can specify localHost in IgniteConfiguration:
https://ignite.apache.org/releases/2.0.0/javadoc/org/apache/ignite/configuration/IgniteConfiguration.html#setLocalHost(java.lang.String).
For example:
Evgenii
--
View this message in context:
It contains not only streams, but instruments for CEP too.
Maybe it's would be easier if you will describe what you actually need?
Thanks,
Evgenii
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/CEP-example-tp13235p13525.html
Sent from the Apache Ignite Users
Hi,
Explicit configuration is not required, connector starts up automatically
and listens on port 8080.
Which http code have you got when you accessing it by one of the methods
from api? From example, curl http://:8080/ignite?cmd=version.
Also, try access rest api directly from the server, for
Hi,
Please properly subscribe to the mailing list so that the community can
receive email notifications for your messages. To subscribe, send empty
email to user-subscr...@ignite.apache.org and follow simple instructions in
the reply.
This example works for me without problems. Did you change
Hi,
Are you sure that your cache was not accessed in the same time by another
nodes/threads? Are you sure that rebalance was finished?
Could you share some simple reproducer with us?
I've tried to reproduce same behavior, but OFFHEAP, PRIMARY & BACKUP was
equal to each other. Also, right
Hi,
SensorDataGenerator doesn't start Ignite node, so you should have only 1
server and 1 client node in topology:
Topology snapshot [ver=2, servers=1, clients=1, CPUs=4, heap=6.8GB]
Check it, most probably you have one more running server node on your host.
Also, your topology version is 46,
Do you run the example in IDE? Most likely it incorrectly resolves transitive
dependencies - this exception happens if ignite-indexing.jar is on
classpath, but H2 is not.
I'm using Intellij Idea and everything works fine.
--
View this message in context:
Hi,
Create static inner class for EntryProcessor instead of lambda, it looks
like when lambda contains objects from outer class it could lead to
stackoverflow at the serialization.
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Check QueryEntity class, it contains tableName property.
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Hi,
1) There is no possibility to limit Persistent Store size right now, but you
always can use separate disk volume with size 300GB for your case to use it
for Persistent Store.
2) Well it's not usual to use case, but after stopping node you can clear
data from work folder or just invoke
peerClassLoading used only for compute, for example for sharing job classes
between nodes, it's not working for objects that put into cache. If you want
to work without this classes on nodes, take a look to BinaryObjects:
https://apacheignite.readme.io/v2.0/docs/binary-marshaller
Evgenii
--
Hi,
I don't see in your query defined cacheName and type parameters. If cache
name not provided, default cache will be used.
You can find all this information in the documentation:
https://apacheignite.readme.io/docs/rest-api#section-sql-query-execute
Also, have you checked logs from Ignite
Hi,
Please properly subscribe to the mailing list so that the community can
receive email notifications for your messages. To subscribe, send empty
email to user-subscr...@ignite.apache.org and follow simple instructions in
the reply.
You can find a lot of example for .Net here
Hi,
Non-static nested classes that implement Serializable must be defined in an
enclosing class that is also serializable. Non-static nested classes retain
an implicit reference to an instance of their enclosing class. If the
enclosing class is not serializable, the Java serialization mechanism
Hi,
I've added Thread.sleep(200) to Jobs to simulate a small load.
Here is what I've got:
1node: 1 Task 2000 Jobs ~25 sec
2nodes(on the same machine): 1 Task 2000 Jobs ~13 sec
What I want to say here - this overhead will be not noticeable on real Jobs.
What about some configuration changes -
>The backups which is mentioned in the documentation, how do I define which
node is the primary node and >which node is the backup node.
It defined by Affinity Function, you can read about it here:
https://apacheignite.readme.io/docs/affinity-collocation#section-affinity-function
>I will have a
Hi,
Could you describe your benchmarks? So we can understand whats could be
wrong here.
If the value is fetched from a remote node, you will always get a copy. If
you get the value locally, you can force Ignite to return the stored
instance by setting CacheConfiguration.setCopyOnRead(false)
Hi,
Here is a description of all thread pools:
https://apacheignite.readme.io/v2.1/docs/thread-pools
You can try to reduce their size, but do it carefully, these changes could
lead to performance degradation.
If you will never use visor or rest-api you can also set
ConnectorConfiguration to
Hi,
Please properly subscribe to the mailing list so that the community can
receive email notifications for your messages. To subscribe, send empty
email to user-subscr...@ignite.apache.org and follow simple instructions in
the reply.
Which Java versions do you use in both cases? In eclipse and
Hi,
To investigate this issue we need some additional information from your
nodes:
1. Persistence config from all nodes.
2. Catalog structure from C:\Data\IPD\WAL\ and from pathes from other nodes.
3. Checkpoint files from work/db/{NODE_ID}/cp - they are have a small size.
Evgenii
--
View
Hi,
This timeout is for the whole transaction, but when for the transaction you
usually need to take locks on different nodes. So, when the transaction was
succeeded in acquiring locks on one node, it sends remaining timeout o next
node, to acquire locks on it.
For example, when you see
Hi Colin,
I would suggest you send a new message to user list with a detailed
description of your use case, I think the community could check it and give
some comments.
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Hi Marco,
Why don't you want to use an Ignite persistence:
https://apacheignite.readme.io/docs/distributed-persistent-store or at least
Cache Store for a 3rd party DB:
https://apacheignite.readme.io/docs/3rd-party-store ?
By using Ignite persistence you will get everything you want here without
gunman524, I didn't say anything like that.
I said that if you want to access cache from CQ, you need to start a new
thread
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
It's not recommended to access caches from listeners. It's a general practice
to create a new thread after you get an event.
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Looks like you witnessed this issue:
https://issues.apache.org/jira/browse/IGNITE-6555
Which is already fixed and will be available in 2.4 release
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Try to start a new thread and access cache from it.
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
For using slf4j, you need to have a configure file, as it showed in the
message, default it's config/java.util.logging.properties, so, you can add
this file to this path or try to configure slf4j:
https://www.slf4j.org/docs.html
Ignite slf4 logger constructor also have another constructor - new
Hi,
As I see in this error message:
Failed to resolve default logging config file:
config/java.util.logging.properties Console logging handler is not
configured.
You don't have java.util.logging.properties config file for SLF4j. I've
checked 2.3.0 binaries and this file exists in folder
Is it possible that in dequeuePortionIds you will have the same keys(at least
one the same key) for scanCache in different threads? If it's possible, I
think it's pretty easy to face a deadlock here with
_getCurrentMax(customerMaxCache, queryScan), while I suppose 2 different
Scans could have the
Do you have indexed types for cache "sharedRDDProducer"?
like
cacheCfg.setIndexedTypes(String.class, String.class);
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Hi,
What happened here: other node tried to connect to the node via address
cc3a7x2183.nhnsystem.com/10.112.96.139:5 and were not succeeded. After
it node tried to connect via other address, that was resolved by a node at a
start - 127.0.0.1:5. Of course, as these 2 nodes on the separate
Hi,
I've checked code and it looks like the current implementation of
ReentrantLock doesn't have proper processing of failoverSafe flag. I've
created ticket for it's implementation:
https://issues.apache.org/jira/browse/IGNITE-8810.
As for workaround, you can use reentrantLock without
Hi Chris,
How do you map compute tasks to nodes?
Well, it's possible that 2 nodes in your cluster always stores more data
than others, that's why you face these spikes, it could happen in case of by
your affinity key, too much data could be collocated. You can check it by
using
Hi,
I've created a ticket or zookeper version upgrade:
https://issues.apache.org/jira/browse/IGNITE-8433.
Thanks,
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Hi, in case when you use:
ScanQuery scan = new ScanQuery<>((key, value) -> {
System.out.println(key + “ = “ + value);
return true;
})
I think the problem is that you created ScanQuery while
your cache is IgniteCache
Hi Humphrey,
>What will happen if at a later point I want to scale back up to 4
replica's?
>- So what will happen with the data it finds in the existing directory (and
probably are old), how does it handle this?
It depends on the time when the node was down. If it was a short period of
time
Hi,
Looks like logs from the server is still not full. If you've checked them
and you sure that you don't have any exceptions in it before witnessing this
problem, then, I think that you could have some connection problems or a
long GC pause. Do you have any network monitoring? Also, I would
>There are several clients connected by VPN, is it possible to the client's
restart regularly causing ignite socket communication to a certain degree of
obstruction and becoming more and more serious as time goes by?
Does this mean that it's impossible to connect from server to client nodes
Hi,
> Right now we are running 4 nodes (same physical system)
Do you mean that you run 4 nodes on the same physical machine and after
this, you add 2 additional nodes on the same physical machine?
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Hey Pim,
Looks like your question was already answered here:
http://apache-ignite-users.70518.x6.nabble.com/CacheStoreAdapter-write-and-delete-are-not-being-called-by-Ignite-s-GridCacheStoreManager-td19624.html
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Hi,
I think now you need to start and commit transaction manually in your code:
em.getTransaction().begin();
em.getTransaction().commit();
At least I've tried it some time ago and it worked. Please check this
example on github:
Hi,
As for now, it's not possible to query objects if they're stored as
collection like IgniteCache
>, so, I'd recommend changing the way how you
store objects in cache - it will be pretty the same if you will store it
like IgniteCache
Evgenii
--
Sent from:
Hi,
As per java doc of DataRegionConfiguration.setMaxSize - maxSize Maximum data
region size in bytes. For sure, it won't work properly with such a small
memory size(128 and 1024 bytes). Ignite even have validation for this
parameter and it should be not less than 10mb at least.
Have you checked
Hi,
Are you sure that you access the same cache that is used for l2? Try to
invoke Ignite.cacheNames() - it will give you a list of caches in the
cluster, using that, you can check that use right cache.
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Hi,
It's ok for the case when you run without backups, because you lose
partitions here.
Do you start a new cache each time or reuse the cache from the different
run? When you use persistence, Ignite persists cache's metadata on disk and
if you change cache configuration after that, these
Hi,
Is this issue reproducible? Can you share logs from all nodes and code of
the service?
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
As for now, web agent can't connect to the secure Ignite cluster, this
functionality should be available with version 2.7
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Hi,
1. Have you tried to run it without -Dignite.job.shared.classloader=false ?
It definitely has a performance impact.
2. Are Ignite nodes placed on the same machines as Hadoop? If not, it will
add a huge network interaction.
3. What is the amount of the data that you have in hdfs? If it's not
Hi,
At first, you may take a look at Ignite 2.0 migration guide:
https://cwiki.apache.org/confluence/display/IGNITE/Apache+Ignite+2.0+Migration+Guide
Also, the main difference in configuration between these versions is related
to the memory configuration, so take a look at this section from
Hi,
In your case, you, most possibly use Id as key, and it could be Long or Int.
So, you just need to get it by this key. The example you provided describes
the case with complex primary key.
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Hi,
What do you mean by " system memory cache also grows "? How do you see this?
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Hi,
1) You can somehow signal it from your application where you invoke
loadCache method or from CacheStore implementation
2) loadCache is sync method and when it will be finished, all preloading
will be finished on all nodes
3) You can listen to the topology changes and check count of the
You need to find field "ht" in your objects.
It's needed to have the same files for both client and server nodes.
I've asked in the previous message to provide logs from client nodes, could
you please share it?
Thanks,
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Hi,
First of all, you need to check that all data is collocated since by default
join will be performed on each node on the collocated data.
Also, I don't see FROM in UPDATE grammar in H2:
http://www.h2database.com/html/grammar.html#update
So, I would recommend to rewrite it using subquery.
if skipStore flag is enabled, then data won't be propagated to the store
are you sure that you have writeThrough flag enabled?
Additionally, you need to check your CacheStore implementation, if you don't
have any ideas, you can post it here, the community will check it.
Evgenii
--
Sent
If it really starts to use addresses other that pre-configured, you should
share your configurations and full logs from all nodes, the community will
check it.
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>By the way - I wonder what is the right way to reset an Ignite instance to
the initial state (the one I have when Ignite is just installed)?
You should delete work and db directories.
>I could not activate the new cluster. When control.sh
--baseline tried to connect to the cluster it hung
How much data do you have? What is the amount of heap and offheap memory?
Can you share the reproducer with the community?
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
When you deploy the service, it serializes the object of this service and
puts it to the internal cache. At the moment when it should be redeployed,
it will take this object from the cache and deserialize it.
So, if after change your object still can be deserialized using the new
version of the
Hi,
Looks like you try to access local cache metrics on client node, which will
be empty, because clients doesn't store cache. Try to use
CacheClusterMetricsMXBeanImpl instead.
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Hi,
There are metaCacheCfg and dataCacheCfg in
IgniteConfiguration.FileSystemConfiguration, which allows to configure
caches for IGFS. Inside this configuration you can set DataRegion with
persistence.
Have you tried this?
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Hi,
>but why one of my ignite nodes went down abnormally?
Can you share logs with the community so somebody could take a look into it?
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Hi,
Are you sure that you use proper service? I mean from the client node. I've
just checked this case and everything works fine.
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
If you just started 3 nodes and you have topology version 20, then, probably,
you have started visor started somewhere, because even daemon nodes can
store topology version.
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Hi,
How often do you access it? Maybe it would be better to calculate it each
time you access it in getter method?
Alternatively, you can implement Binarylizable interface and calculate this
column there, before serializing it.
Evgenii
--
Sent from:
Hi,
Can you show the topology which Visor prints?
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Hi,
it's a really bad idea to do cache operations in Discovery thread. If you
want to add something to the cache, you can start a new thread and do this
operation inside the new thread.
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Hi,
Do you mean Ignite Queue? Or just your data structure that stored in simple
Ignite cache?
> Store data in another format let's say JSON and provide backwards
> compatibility at code level.
There is no need for this, Ignite internally stores everything as
BinaryObject and this format supports
Sorry, here is the link for the BinaryObject doc:
https://apacheignite.readme.io/docs/binary-marshaller
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Hi,
Well, it depends on a lot of things - if you have small amount of the data,
which can easily fit in memory on each node, then, you can use Replicated
cache.
On the other hand, if you have quite big dataset, you may consider using
Partitioned cache and executing affinity runs.
Evgenii
--
Hi,
Do you have connectivity between nodes? Have you checked that all nodes are
reachable and there are no long GC pauses?
Can you share the full logs from all nodes?
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Hi,
What is the execution time of just a single query without UNION?
Evgenii
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Hi,
> already running on high heap space (up to 10GB)
I wouldn't say that 10GB is a high heap usage, so, it shouldn't be a
problem.
> It’s on windows VMs, with HDD disks, and by-chance some windows VMs could
> run multiple instances of this application.
More likely running multiple Ignite
1 - 100 of 110 matches
Mail list logo