Re: Distributed query is too slow.

I've just ran your tests, the project attached. Could you please, in turn, send your? This will help understand what goes wrong. Thanks! ignite-perf-test.zip -Dmitry. -- View this message in context:

Re: Error CacheConfig

Hi, You need to configure indexing to use queries. For that you may use CacheConfiguration.setIndexedTypes() or setup QueryEntity [1, 2]. For example, if you configuring cache with Integer key and String value: CacheConfiguration cfg = new CacheConfiguration<>("cache-name");

Re: Distributed query is too slow.

Hi Vladimir, When you run test on single node it works just locally, without node communication overhead. Good point will be to test on client node. In that case, even with one server node, query will be sent over network with all that communication stuff. Also, if cache is REPLICATED, query

Re: Flink Streamer Compatibility.

ignite-flink is a thin, one-class module, and yes, it's compatible with newest Apache Flink versions. -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Flink-Streamer-Compatibility-tp10727p10755.html Sent from the Apache Ignite Users mailing list archive

Re: java.lang.NoClassDefFoundError: Could not initialize class org.apache.ignite.sink.flink.IgniteSink$SinkContext$Holder

Hi, Check that file in path igniteCfgFile that you pass to IgniteSink constructor is available. If class initialization failed NoClassDefFoundError will be thrown. Also verify if IgniteSink$SinkContext$Holder.class is present in ignite-flink-2.0.jar. -Dmitry. -- View this message in

Re: java.lang.NoClassDefFoundError: Could not initialize class org.apache.ignite.sink.flink.IgniteSink$SinkContext$Holder

Is it possible to provide reproducible example? -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/java-lang-NoClassDefFoundError-Could-not-initialize-class-org-apache-ignite-sink-flink-IgniteSink-Sir-tp10703p10750.html Sent from the Apache Ignite Users

Re: java.lang.NoClassDefFoundError: Could not initialize class org.apache.ignite.sink.flink.IgniteSink$SinkContext$Holder

Hi, I tried your sample and it works fine to me. In case of initialization error, exception would be thrown on IgniteSink constructor invocation step, but it looks like Holder was successfully intialized, but failed later. Could you please attach logs for provided example? -Dmitry. -- View

Re: Ignite client connections hanged

Hi Raja, Could you please attach logs for updated and not updated client, and thread dump for hanged client? - Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-client-connections-hanged-tp10561p10595.html Sent from the Apache Ignite Users mailing

Re: Node hangs while accessing cache from Compute Task

Hi, This is a correct behavior. It's not allowed to use cache API in CacheEntryProcessor, query listeners, interceptors and so forth, because it leads to deadlocks. In your example it looks like (threads T1, T2): T1 put entry -> T1 lock entry -> T1 call listener -> T1 execute job -> T1 wait for

Re: Issue in starting IgniteSinkConnector with Distributed Worker mode

Hi, I'm not quite familiar with Kafka connector, but I'm going to figure it out and come back to help you. Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Issue-in-starting-IgniteSinkConnector-with-Distributed-Worker-mode-tp10647p10664.html

Re: Flink Streamer

Hi, I'm not quite familiar with Flink and Kafka connectors, but I'm going to figure them out and come back to help you. Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Flink-Streamer-tp10650p10663.html Sent from the Apache Ignite Users

Re: Distributed job scheduling

Hi Sergei, Unfortunately IgniteScheduler doesn't provide such guarantees. You will have to write your own implementation based on top of compute tasks and ComputeTaskSession, or use external job submission from client. Thanks. -Dmitry. -- View this message in context:

Re: Index Maintenance During Transactions

Hi, After each transaction all affected indexes are rebuilt, and this behavior is not configurable for now. - Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Index-Maintenance-During-Transactions-tp10088p10095.html Sent from the Apache Ignite Users

Re: errors when building from source,?

Hi! It seems that dependency is broken. Try remove it from maven repository and rebuild. For more information please refer http://stackoverflow.com/questions/13846357/can-maven-3-redownload-broken-files-instead-of-failing-the-build -- View this message in context:

Re: Server Node Stops Unexpectedly

Hi, Node could be segmented if it doesn't respond during some time. The most common reasons for that: 1) Long GC pause. 2) Operation system could slow down process (f.e. starts swap to disk process memory). 3) Network issues. To find out the actual reason you should take GC logs

Re: Job scheduling in apache ignite for single node system

Hi, could you please describe your use case a bit more detailed? If I understand correctly you want to send jobs into another JVM processes? What's the point of such solution? -- View this message in context:

Re: Cache Memory Behavior \ GridDhtLocalPartition

Hi, To get to know what cache represents CacheMetricsMXBean you can call name() method of it. And yes, it's worth to check if that entries cause your problem. -- View this message in context:

Re: Memory consumption in apache ignite

Hi, The main point of doing that was not to give data classes to server, that it would be unable to deserialize values on his size and force to use binary format. But if server doesn't know classes (data classes are not available in classpath) the only way to enable SQL queries is via

Re: Cluster can not let more than one client to do continuous queries

Hi, I'm not able to reproduce exact your issue, but found that there problem if enabled peer class loading [1]. Could you please give me al your configurations and full logs? And it would be very helpful if you create toy project which reproduces the problem. Thanks! [1]:

Re: Restarting Tomcat container and Rebalancing

Hi, You can get to know if rebalancing is started/finished only via events and how you'll use this information is up to you :) Thanks! -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Restarting-Tomcat-container-and-Rebalancing-tp9033p9128.html Sent from the

Re: while updating the cache, can I get notification

Don't continuous queries[1] suite your case? [1] https://apacheignite.readme.io/docs/continuous-queries -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/while-updating-the-cache-can-I-get-notification-tp9122p9125.html Sent from the Apache Ignite Users mailing

Re: How to apply the distributed lock on all the ignite remote instances

Hi, could you please describe in more details what do you want to achieve? If you want to aquire a distributed lock on some key you may use pessimistic transaction with REPEATEABLE_READ isolation level [1] on transactional cache. [1]

Re: Cluster can not let more than one client to do continuous queries

Hi, What do you mean "another client can not join the cluster to do continuous queries"? Is there some specific error? Could you please provide logs from client and server? -- View this message in context:

Re: Cluster can not let more than one client to do continuous queries

Hi, Thanks for the reproducer, but it works for both tests. I think your issue entails in too large timeouts, for example, you set 5 min timeout for join, so it may take too long to connect. Is there any reason for such decision? -- View this message in context:

Re: Cache Memory Behavior \ GridDhtLocalPartition

Hi, Yes, you're right, this is a cache that holds data for distributed datastructures, and IgniteQueue as well. Is it possible that you add items to queue faster than poll? TxCommittedVersionsSize and TxRolledbackVersionsSize are common for all caches and just store versions of finished

Re: Cluster can not let more than one client to do continuous queries

>From logs that you sent I see discovery issue: unsuccessful first connect and long retry. Please do the following: in discovery config leave only server address and reset timeouts to default value. Small timeouts will force client fail fast and do not wait response from server. -- View this

Re: Problem with v for listening updates

Hi Andry! Continuous query for performance reasons tries to avoid deserialization of binary values and reads cached data. Each time when you invoke CacheEntryEvent.getOldValue() you read just the same instance that was last deserialized, and it's actually returned by get() operation. So why it

Re: Memory consumption in apache ignite

Please describe how data are stored on disk that you measured as 370 Mbytes? Are they compressed? How many fields each entry has? The comparison may not be correct. Ignite stores entries in a different way than relational database, f.e. for each field it spends 4 bytes, so if you have 10 fields,

Re: Memory consumption in apache ignite

Approximate calculation for custom object overhead on heap will look like: entries = N fields number = flds header size = 24 fields id size = 4 BinaryObjectImpl = 40 byte arr header 16 + len 4 = 20 (at least, omitted padding) N*(24 + flds*4 + 40 + 20) = 4*N*(21 + flds), so for one entry with one

Re: BinaryObjectException after Ignite restarts

Hi, This could be if in client discovery configuration only one server node address set, that is restarted. In this case clients are unsuccessful in connecting to stopped node and are shutting down. -- View this message in context:

Re: How can I save the job result which was ran on server which lost the connection.

Hi, Try job checkpointing [1]. [1] https://apacheignite.readme.io/docs/checkpointing -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/How-can-I-save-the-job-result-which-was-ran-on-server-which-lost-the-connection-tp9462p9479.html Sent from the Apache Ignite

Re: Affinity not based on the fields in the key

Hi! Could you please give/describe some simple example of your usage? I can't actually get your point. Thanks! -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Affinity-not-based-on-the-fields-in-the-key-tp9450p9480.html Sent from the Apache Ignite Users

Re: Cache stopped

Hi, Cache could be stopped when was called IgniteCache.close(), IgniteCache.destroy() or node is stopping. Please, attach logs to find out your reason. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Cache-stopped-tp9503p9509.html Sent from the Apache Ignite

Re: BinaryObject and String.intern

This won't give you any benefit, because Strings will be marshaled and stored in binary format. In other words you'll get a binary copy of your string, which is managed just like any other object. -- View this message in context:

Re: 答复: class org.apache.ignite.binary.BinaryObjectException: Wrong value has been set

You may use BinaryObjectBuilder#setField(String, T, Class) to explicitly set argument type. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/class-org-apache-ignite-binary-BinaryObjectException-Wrong-value-has-been-set-tp9829p9832.html Sent from the Apache Ignite

Re: 答复: BinaryObject and String.intern

Actually no, because Ignite internally will store it as a BinaryObject and will send to other nodes in a binary format as well, where all string fields will be unmarshaled without intern(). -- View this message in context:

Re: Near cache can be used with SQL Database

Yes, it's possible. You may start from here [1]. [1] http://apacheignite.gridgain.org/docs/odbc-driver -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Near-cache-can-be-used-with-SQL-Database-tp9805p9840.html Sent from the Apache Ignite Users mailing list

Re: Error with ignite-rest-http

It looks like you have another version of Jetty in classpath. Do you have IGNITE_HOME environment variable set? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Error-with-ignite-rest-http-tp9835p9838.html Sent from the Apache Ignite Users mailing list archive

Re: Affinity

Could you please add ignite-client.xml as well? Thanks! -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Affinity-tp9744p9815.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: 答复: 回复：BinaryObject and String.intern

Hi Shawn, BitSet will be marshaled using BitSet.writeObject() serialization implementation. In other words, if this approach saves your memory in heap, it will save it in Ignite as well. If you save collection of strings, Ignite will not check for duplicates as JVM does, and as mentioned Alexey,

Re: compute SQL returned data.

You can use compute tasks [1], in which invoke SQL query and process results. [1] https://apacheignite.readme.io/docs/compute-grid -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/compute-SQL-returned-data-tp9890p9893.html Sent from the Apache Ignite Users

Re: compute SQL returned data.

Hi Shawn, For map-reduce operations is most suitable ComputeTask [1], which has map/reduce methods. In map() method you may select nodes on which start processing according to key (refer Ignite.affinity() [2,3]). Result will be reduced and returned to the client. In summary, client invokes SQL

Re: Efficient way to get partial data of a cache entry

Probably 1 and 3 would be the most effective ways if you're getting objects on affinity node [1], not use CacheMemoryMode#OFFHEAP_VALUES mode and CacheConfiguration.setCopyOnRead() is set to false (for query also with Query.setLocal() set to true). But copyOnRead = false flag could be the cause

Re: Afinity Key

Yes, that's right. Could you, please, describe more detailed what exact problem you faced with? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Re-Afinity-Key-tp9774p9794.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Variation in BinaryObjectImpl object size with number of entries

When heap size exceeds 32Gb reference compression is disabled, now JVM uses 64-bit references. What's your version of JVM? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Variation-in-BinaryObjectImpl-object-size-with-number-of-entries-tp9673p9678.html Sent from

Re: Variation in BinaryObjectImpl object size with number of entries

What arguments do you pass to JVM when load 39M entries? What is the heap size in that case? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Variation-in-BinaryObjectImpl-object-size-with-number-of-entries-tp9673p9674.html Sent from the Apache Ignite Users

Re: Does Ignite support query and index the embedded object column?

Hi, Check out this answer [1]. [1] http://apache-ignite-users.70518.x6.nabble.com/Querying-over-fields-in-the-object-inside-Cache-value-td9426.html -- View this message in context:

Re: Error while writethrough operation in Ignite

Could you please share a simple reproducer? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Error-while-writethrough-operation-in-Ignite-tp9696p9716.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: NullPointerException on ScanQuery

Hi Alper, This is caused because of race. NPE happens between two events: removing affinity nodes and change cache state to STOPPED. In other words: 1. Remove affinity nodes; -- Start scan query. 2. Start exchange; 3. Change cache state. I've opened a ticket for that [1]. [1]

Re: IgniteDataStreamer with Continuous Query

Hi Ankit, Yes, you can use ContinuousQuery with DataStreamer. Code samples you may found here [1] and [2]. [1] https://github.com/apache/ignite/blob/master/examples/src/main/java/org/apache/ignite/examples/streaming/StreamTransformerExample.java [2]

Re: Error while writethrough operation in Ignite

Val, Of course it's possible, but why Ignite should restrict this case? Why not to build such update request: UPDATE table_name SET col1=1, col2=2, col3=3 WHERE (col1=1 AND col2=1 AND col3=1) ? -- View this message in context:

Re: Make changes to cache entry before data rebalanicng.

No, but you can subscribe on such events: EventType.EVT_CACHE_REBALANCE_OBJECT_LOADED, EventType.EVT_CACHE_REBALANCE_OBJECT_UNLOADED [1] and, for example, update another cache with some metadata. [1] https://apacheignite.readme.io/v1.8/docs/events -- View this message in context:

Re: Affinity Key

Hi Tejas, You may do the following: cache1.put(eqID, value1); or cache1.put(new AffinityKey<>(pk0, eqID), value2); cache2.put(new AffinityKey<>(pk, eqID), value2); In that case keys in Cache 2 will be collocated with keys in Cache 1. -- View this message in context:

Re: Affinity Key

Tejas, What is your use-case? AffinityKey helps collocate related data. F.e. if you have Person and Organization entities and want that Person`s related to Organization was resided on the same node, you may use AffinityKey: // Organizations. Organization org1 = new

Re: Get a Key from cache vs SQL Indexed parameter search performance

Hi Oru, If you need just key/value operations then simple get() will be much faster than SQL queries. Because indexing, parsing and processing query consumes resources. But if you need quite often search for cache entities by their fields, using of SQL + indexes is preferable, because no need to

Re: Error while writethrough operation in Ignite

That happens because key and value fields mapped to the same DB columns. You should use at least one unique column for value mapping. Ignite throws away all fields from value that intersect with key fields. -- View this message in context:

Re: Apache Ignite Query Entity String Array

Hi, You need to set value="L[java.lang.String;" and for querying you may use array_contains function. For example: ... WHERE array_contains(ABC, ?); Thanks! -Dmitry. -- View this message in context:

Re: [GridCachePartitionExchangeManager] Pending transaction deadlock detection futures

Hi, What operations in visorcmd you did? Please attach thread dumps (when cluster hangs) and logs from all nodes. Thanks! -Dmitry. -- View this message in context:

Re: Can I let Ignite to do rebalance at a particular time?

Hi, Sorry, I confused you. For proper rebalance work you need to set rebalance mode to SYNC or ASYNC, rebalance delay to -1 and call IgniteCache.rebalance() on each node that participate in cache. The better way to do this is via compute broadcast task. Rebalance mode NONE disables rebalancing

Re: ignite messaging disconnection behaviour

Hi Kevin, It seems that async mode has no effect for message sending, I've wrote a suggestion to fix this in dev list. But for now you could delegate message sending to separate thread just to release your main thread. I'll send follow up message to you with ticket number, if or when it will be

Re: cache replication factor

Hi Tuco, You're speaking about PARTITIONED cache with custom number of backups [1, 2]. You may specify how many copies partition will have. For example, You have 3 nodes and number of backups set to 1, that means each partition has 1 copy on other node. In other words, if one node failed - you'll

Re: NullPointerException when using IGFS

Joe, It seems a bug, I've filed a ticket [1]. Could you please check if this problem exists in 1.8 version? [1] https://issues.apache.org/jira/browse/IGNITE-4862 Thanks! -Dmitry. -- View this message in context:

Re: [GridCachePartitionExchangeManager] Pending transaction deadlock detection futures

Hi, Do you use custom build? In logs Ignite version 1.6.12, but it uses stripped pool, which was introduced only in 1.8.2 and 1.9. Also there was a node stall, because of many disk operations (swap file). This doesn't lead to hang, but may reduce cache performance. Besides log files also thread

Re: NullPointerException when using IGFS

Hi, Thanks for testing, hadoop specialists will fix it. Please use sequentialReadsBeforePrefetch = 64 as a workaround for now. Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/NullPointerException-when-using-IGFS-tp11328p11486.html Sent from

Re: Monitoring Cache - Data counters, Cache Data Size

Hi Binti, First of all, cache metrics must be enabled with CacheConfiguration.setStatisticsEnabled(true). But size and keySize show local values anyway, that looks like a bug. I've filed a ticket for that [1]. If you want, feel free to contribute. [1]

Re: Insert data in hdfs using ignite

Hi Prashant, Check if HADOOP_HOME set and add slash to the end of secondary file system uri (). Also it's not recommended to use hadoop-setup.sh script, follow instructions in readme [1]. [1] https://apacheignite-fs.readme.io/docs/installing-on-apache-hadoop -Dmitry. -- View this message in

Re: Can I inject resource bean from Spring into IgniteClosure

Hi, You may inject spring bean into IgniteCallable as well, just mark it transient and annotate with @SpringResource. There is no performance drop on services in comparison with compute, roughly speaking service is the same as compute job. So spring bean injection should work for both cases,

Re: Distributed callables: passing data and getting back results

Hi, Yes, you're right. You need to start Spring application and Ignite after that, ignite.sh is unable to start spring context. Thanks! -Dmitry. -- View this message in context:

Re: Can I let Ignite to do rebalance at a particular time?

Hi, Yes, you can set for caches that you want CacheConfiguration.setRebalanceMode(CacheRebalanceMode.NONE), and call IgniteCache.rebalance() when you need. To schedule rebalancing you may refer IgniteScheduler [1]. -Dmitry. [1] https://apacheignite.readme.io/v1.9/docs/cron-based-scheduling

Re: REST API authentication

Hi Ivan, REST API is based on Jetty server, so you need to configure SSL connector and certificates. Please refer [1, 2] for details. [1] https://apacheignite.readme.io/docs/rest-api#general-configuration [2] https://wiki.eclipse.org/Jetty/Howto/Configure_SSL -Dmitry. -- View this message in

Re: Apache Ignite with log4J2 KafkaAppender - class not found

Hi, I suppose you need kafka log4j appender [1] in classpath. [1] https://mvnrepository.com/artifact/org.apache.kafka/kafka-log4j-appender -Dmitry. -- View this message in context:

Re: ignite messaging disconnection behaviour

Hi Kevin, You may use IgniteMessaging in async mode: IgniteMessaging msg = ignite.message().withAsync(); msg.sendOrdered("my-topic", objectToSend, 1); In that case you'll not wait for sending message and reconnections in if there was a failure. -Dmitry. -- View this message in context:

Re: ignite messaging disconnection behaviour

Hi Kevin, Unfortunately community decided to leave it as is, because messages are sent asynchronously by design, but connection establishing is not. That was made intentionally and user should take it into account and resolve depending on concrete situation. Thanks! -Dmitry. -- View this

Re: data consistency in atomic mode

Hi, In FULL_SYNC mode client will retry update to new primary node. So yes, cache will be consistent. -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/data-consistency-in-atomic-mode-tp11719p11723.html Sent from the Apache Ignite Users mailing list

Re: Stoppin listen for topics in Ignite

What do you mean saying "all messages"? How do you detect that all messages were sent? -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Stoppin-listen-for-topics-in-Ignite-tp11604p11724.html Sent from the Apache Ignite Users mailing list archive at

Re: When is CacheStoreAdapter sessionEnd method called?

Hi, This method is called on transaction commit or rollback. Check that cache has atomicity mode TRANSACTIONAL and you always call Transaction.commit() or Transaction.rollback() for explicit transactions. If it doesn't help, please attach pet project that reproduces this issue, because in my

Re: LocalDateTime field being ignored on Cassandra write through

Hi, please share your configurations. -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/LocalDateTime-field-being-ignored-on-Cassandra-write-through-tp11986p12000.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: What is the difference between starting a node using Java application, and manual starting?

Hi, If under manually started you mean using ignite.sh(.bat) script, then there actually is no difference, because at the end it calls the same Ignition.start() method (Spring configured app as well). But with programmatic starting you can run more than one node in single JVM. This may be useful

Re: Ignite Affinity & Binary Configuration Issues

Hi Addo, There is no need to explicitly specify IdentityResolver. On marshaling step, hash code is got from object and recorded in BinaryObject, and it will be used for any affinity mapping, e.g. affinity run. Use IdentityResolver if you need customize hash code calculation, f.e. exclude some

RE: OOM when using Ignite as HDFS Cache

Hi, The correct way here would be to understand where actually problem occurs and after that make decisions on how to solve it. > I also notice that Ignite write through file block size is set to 64MB. I > mean I write a file to Ignite with block size to 4GB, but I finally found > it on HDFS

Re: Index

Hi Sambhav, You may find created indexes using web-console [1]. [1] https://ignite.apache.org/addons.html#web-console -Dmitry -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Index-tp11969p11980.html Sent from the Apache Ignite Users mailing list archive at

Re: ScanQuery log all entries

Hi Sam, 1. Yes getAll() will bring all values to an on-heap collection, which may lead to OOME, so it should be used with caution. 2. Any query returns QueryCursor that lazily iterates over entries. You may do 1000 iterations over cursor and accumulate result in some collection. This will be just

Re: OOM when using Ignite as HDFS Cache

Hi Shuai, Could you please take heap dump on OOME and find what objects consume memory? There would be a lot of byte[] objects, please find the nearest GC root for them. Thanks! -Dmitry. -- View this message in context:

Re: LocalDateTime field being ignored on Cassandra write through

Guilherme, You may track feature development here [1] or contribute it by yourself. [1] https://issues.apache.org/jira/browse/IGNITE-5013 -Dmitry. -- View this message in context:

Re: LocalDateTime field being ignored on Cassandra write through

Hi Guilherme, Now Ignite Cassandra store has hard mappings from java to Cassandra types: org.apache.ignite.cache.store.cassandra.common.PropertyMappingHelper#JAVA_TO_CASSANDRA_MAPPING If type is not in this map - it will be serialized. LocalDateTime is not there for compatibility reasons, and no

Re: Issue in starting IgniteSinkConnector with Distributed Worker mode

Hi, Could you please attach logs and thread dumps (in case of hang) if problem is still relevant? -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Issue-in-starting-IgniteSinkConnector-with-Distributed-Worker-mode-tp10647p11161.html Sent from the

Re: data consistency in atomic mode

Yes, you're correct, in this case atomic cache could be inconsistent and transactional cache will provide consistency guarantees. -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/data-consistency-in-atomic-mode-tp11719p11746.html Sent from the Apache

Re: NameNode sync using DUAL_ASYNC mode on IGFS

Hi, You may use it in cases when you use temporary files that should be removed after node stop, or any other data that don't require persistence. -Dmitry. -- View this message in context:

Re: Compute calls happening on client node

Hi, You just need to specify cluster group: ignite.compute(ignite.cluster().forServers()).run(new IgniteRunnable() { @Override public void run() { System.out.println("This will be processed on server nodes only"); } }); There a various of

Re: LocalDateTime field being ignored on Cassandra write through

Hi, I tried your configuration and it works fine for me. Please check attached project. I used Cassandra v3.0.13. cassandra-test.zip -Dmitry. -- View this message in context:

Re: ScanQuery log all entries

Hi, Yes, you understand correctly. Here is example: private static void sqlQuery() { IgniteCache, Person> cache = Ignition.ignite().cache(PERSON_CACHE); // SQL clause which selects salaries based on range. String sql = "salary > ? and salary <= ?";

Re: Error while building application

Hi, Please share full build log and pom.xml. Thanks! -Dmitry -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Error-while-building-application-tp12027p12035.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: ScanQuery log all entries

Sam, Cursor iterator will go over whole result, but it will not hold in memory all dataset, just part limited by page size. In other words, it fetches 1024 entries, and when iterator points after last entry - loads another page with 1024 entries. So you shouldn't worry when results arrived - they

Re: IgniteAtomicSequence durability

Hi Mike, All atomics may be configured with IgniteConfiguration.setAtomicConfiguration() or Ignite.atomicSequence(), where you can specify number of backups, or set it as REPLICATED, but cannot configure persistent store. Only Ignite 2.1 can persist datastructures on disk. Thanks! -Dmitry.

Re: Update cache fail with IgniteInterruptedException

Hi Aaron, It looks like node is stopping. Do you have NODE FAILED, SEGMENTED or LEFT messages in logs? Thanks! -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Update-cache-fail-with-IgniteInterruptedException-tp16224p16226.html Sent from the Apache Ignite

Re: In which scenario the ignite nodes will shutdown by itself

Hi Aaron, Do you have long GC pauses? As Bob said, large queries or transactions could move a lot of data to on-heap. F.e. regular SELECT will get all dataset into heap on server node and will respond to client with pages. But first of all try to find a reason of node segmentation first, it could

Re: In which scenario the ignite nodes will shutdown by itself

Hi, Node may stop if it was segmented out of the cluster. Usually this happens because of long GC or network pauses, when node doesn't respond longer than failureDetectionTimeout. Please, attach Ignite (with -DIGNITE_QUIET=false JVM flag) and GC logs, this will help to understand more. Thanks!

Re: Strange problems with Ignite native Persistence when Data exceeds Memory

Hi Roger, It looks like not all data could fit in memory and pages started to swap into disk. This means that too many pages marked as dirty that causes more often and longer checkpointing, that with WAL writes may significantly slowdown data uploading. Please attach Ignite and GC logs and try to

Re: Use SLF4J in Ignite

Hi, Check where IGNITE_HOME env variable points to, Ignite may load libraries out of there. Thanks! -Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Use-SLF4J-in-Ignite-tp16179p16199.html Sent from the Apache Ignite Users mailing list archive at

Re: Error while starting service grid with persistent store enabled

Hi, The big slowdown gives writing WAL into disk. You may increase throughput by setting lower fail safe requirements: set PersistentStoreConfigiration.setWalMode() to LOG_ONLY (data may be lost on power off) or BACKGROUND (data may be lost on process crash), or increase available memory and set

  1   2   3   >