Re: Index on complex value object

2017-04-10 Thread Evgenii Zhuravlev
No, you couldn't create index like this at now. There is an issue for this improvement in Apache Ignite's Jira, I will find that issue and update thread with it. 2017-04-10 18:16 GMT+03:00 waterg : > Hello, > > If I have the following list as value in cache: > >

Re: Index on complex value object

2017-04-11 Thread Evgenii Zhuravlev
> Hi Evgenii, thank you for getting back. When you find the issue in Jira, > would you do me a favor to post the link on this thread? > Thank you. > > Best, > Jessie > > On Mon, Apr 10, 2017 at 1:37 PM, Evgenii Zhuravlev [via Apache Ignite > Users] <[hidden email] > <

Re: Failing DataStreamer beacuse of minor version change

2017-04-21 Thread Evgenii Zhuravlev
Hi, Minor topology version changes when you creating or removing caches and at late affinity. Yes, you see this error in log because minor topoly was changed while datastreamer was running, but you didn't lose any data. According to javadoc

Re: Error while running query against Ignite Server Node

2017-04-21 Thread Evgenii Zhuravlev
Alper, Did you lose any data or you just got the same error in log? You could get the same error when minor version of topology was changed during DataStreamer's flushing Evgneii 2017-04-18 16:29 GMT+03:00 Alper Tekinalp : > Hi Nikolai, > > By saying: > > > This exception

Re: Failing DataStreamer beacuse of minor version change

2017-04-21 Thread Evgenii Zhuravlev
. > > On Fri, Apr 21, 2017 at 2:10 PM, Evgenii Zhuravlev > <e.zhuravlev...@gmail.com> wrote: > > Hi, > > > > Minor topology version changes when you creating or removing caches and > at > > late affinity. > > > > Yes, you see this error in log b

Re: Ignite errors in log

2017-04-18 Thread Evgenii Zhuravlev
> > > > > HOST_IP1:47500..47509 > HOST_IP2:47500..47509 > > > > > > > > > > > On Tue, Apr 18,

Re: Ignite errors in log

2017-04-18 Thread Evgenii Zhuravlev
Hi, Could you check that destination node accessible from current node via one of this addresses(remote_host/remote_host:47102, /0:0:0:0:0:0:0:1%lo:47102, /127.0.0.1:47102?) Do you have problems only with one node, or you have same messages about another nodes and on another nodes? Please

Re: How to add a new host to the existing distributed cache ?

2017-07-10 Thread Evgenii Zhuravlev
Hi, You were answered on SO: https://stackoverflow.com/questions/44993521/adding-new-host-to-apache-ignite-data-grid/45007166#45007166 If you have any related questions, lets continue discussion there. Evgenii 2017-07-08 20:18 GMT+03:00 gagansab : > Hi all, > > I have just

Re: Data not loading with Ignite DataStreamer

2017-07-13 Thread Evgenii Zhuravlev
Hi, answered you on SO: https://stackoverflow.com/questions/45029434/ignite-datastreamer-not-loading-data/45075192#45075192 Evgenii 2017-07-11 9:32 GMT+03:00 Aiden <1994hsekar1...@gmail.com>: > Hello Humphrey, > > I don't think that is the issue here. Still i checked with ur suggestion, > but

Re: Question about QueryTextField

2017-07-20 Thread Evgenii Zhuravlev
Well, it works for me. Please share the reproducer and I will check it. Evgenii 2017-07-20 10:10 GMT+03:00 iostream : > When I use search as -> "A:123" it does not give me any result even though > there is a cache entry with A = 123. Can somebody please help me? > > > >

Re: Question about QueryTextField

2017-07-19 Thread Evgenii Zhuravlev
Hi, As it said in JavaDoc, you can use @QueryTextField as annotation on fields Evgenii 2017-07-19 11:46 GMT+03:00 iostream : > Hi, > > Instead of performing a text query on the entire cache object as mentioned > here

Re: Question about QueryTextField

2017-07-19 Thread Evgenii Zhuravlev
Yeah, it's clear now. You can use query syntax from Apache Lucene: https://lucene.apache.org/core/2_9_4/queryparsersyntax.html Name of the field, in this case, should be in uppercase. For example: "A:query" Evgenii 2017-07-19 12:01 GMT+03:00 iostream : > I know how to

Re: Camel-Ignite cache query : Could not find a suitable setter for property: query

2017-06-29 Thread Evgenii Zhuravlev
Hi, ---The query used for QUERY operations (as a producer) or to launch the continuous query (as a consumer) Do you use query as a producer or as a consumer? Evgenii 2017-06-29 17:20 GMT+03:00 austin solomon : > Hi Evgenii, > > As you said I did not had registry

Re: Marshalling exception on continuous query

2017-04-25 Thread Evgenii Zhuravlev
Hi, Which List implementation do you use? Are you sure that it's implement Serializable? List not implement Serializable by itself. Evgenii 2017-04-24 19:18 GMT+03:00 Alper Tekinalp : > Hi. > > I try to implement continuous query and it works fine on single node but > on

Re: Marshalling exception on continuous query

2017-04-25 Thread Evgenii Zhuravlev
+03:00 Alper Tekinalp <al...@evam.com>: > Hi Evgenii. > > If you mean "List events = e.getValue();" it is ArrayList. > > On Tue, Apr 25, 2017 at 12:21 PM, Evgenii Zhuravlev < > e.zhuravlev...@gmail.com> wrote: > >> Hi, >> >> Which Lis

Re: Setting MemoryConfiguration

2017-08-01 Thread Evgenii Zhuravlev
With the default configuration, clients don't use offheap memory. If you will configure MemoryConfiguration and create LOCAL cache - they will use offHeap memory Evgenii 2017-07-31 17:55 GMT+03:00 Amit Pundir : > Thanks but does that mean client nodes do *not* use the

Re: Caused by: org.h2.jdbc.JdbcSQLException: General error: "java.lang.IllegalMonitorStateException: Attempted to release write lock while not holding it

2017-08-08 Thread Evgenii Zhuravlev
I would suggest updating to the last version of java and check if it will work. I can't reproduce same behavior with your code, but I use java 1.8.0_121-b13. Please share results after updating. Evgenii 2017-08-08 15:28 GMT+03:00 Ankit Singhai : > PFA log. No luck even by

Re: Caused by: org.h2.jdbc.JdbcSQLException: General error: "java.lang.IllegalMonitorStateException: Attempted to release write lock while not holding it

2017-08-08 Thread Evgenii Zhuravlev
I tried your code with java 1.7.0_80-b15 and everything works fine. Also, check that you use right config file - you provided a file with name ignite-config.xml.xml, but in the code, you use ignite-config-login.xml. Evgenii 2017-08-08 16:44 GMT+03:00 Evgenii Zhuravlev <e.zhuravlev...@gmail.

Re: How Cache Management Works

2017-05-18 Thread Evgenii Zhuravlev
Hi, It's managed by Affinity function, you can read about it here: https://apacheignite.readme.io/docs/affinity-collocation#section-affinity-function Evgenii 2017-05-18 9:16 GMT+03:00 rushi_rashi : > Hi, > > I have a cache partitioned on 4 nodes and having 6 ignite

Re: Hadoop and Ignite, Problem grid cache

2017-06-23 Thread Evgenii Zhuravlev
Hi Mimmo, Local node's value of 'java.net.preferIPv4Stack' system property differs from remote node's (all nodes in topology should have identical value) [locPreferIpV4=true, rmtPreferIpV4=null, locId8=2df6b461, rmtId8=927af8bb, rmtAddrs=[slave-1/0:0:0:0:0:0:0:1%lo, /127.0.0.1, /192.168.30.22]]

Re: Process write key

2017-05-18 Thread Evgenii Zhuravlev
Hi, I didn't find any logs like this in TcpCommunicationSp(and in other classes too)i. Did you modify the source code if ignite? Evgenii 2017-05-18 19:34 GMT+03:00 yucigou : > Hi, > > Our Ignite (version 1.7) log file size goes up sharply, from the level of > KB > to 10GB.

Re: Error while passing arraylist as argument to INSERT data into Ignite cache using pyodbc

2017-05-23 Thread Evgenii Zhuravlev
Hi, It's could be a problem with encoding, did you try to use utf8? 2017-05-23 7:58 GMT+03:00 rishi007bansod : > If instead of id_list i.e. list of ids, if I pass single parameter(not > list) > as argument as follows, > > *cursor = connection.cursor() > select_string=

Re: Client Server Persistent Store Fault Tolerance

2017-05-22 Thread Evgenii Zhuravlev
Hi, In current implementation write-behind store can lose writes even if only one nodes fails. This can be improved by adding backup queues [1], but it's not implemented yet. Also, it's possible to get inconsistent state in this case. Only synchronous write-through can guarantee that there are

Re: How to set custom REST http port in Ignite?

2017-05-29 Thread Evgenii Zhuravlev
Hi, it was already discussed here: http://apache-ignite-users.70518.x6.nabble.com/Change-default-tcp-ports-for-Apache-Ignite-td158.html Evgenii 2017-05-29 15:46 GMT+03:00 ignitedFox : > Hi, > > I have ignite 1.9.0 set and I have enabled REST by copying the folder >

Re: Client Server Persistent Store Fault Tolerance

2017-05-29 Thread Evgenii Zhuravlev
Hi, So, you stopped node, transaction was rolled back. You don't have inconsistent data. What did you expect? In this case you should handle this exception and run transaction again. Evgenii 2017-05-29 7:53 GMT+03:00 rickynauvaldy : > So I've been trying to

Re: Apache Ignite: Failed to unmarshal discovery data

2017-05-29 Thread Evgenii Zhuravlev
Hi, answered you here: https://stackoverflow.com/questions/44155694/apache-ignite-failed-to-unmarshal-discovery-data/44238855#44238855 Evgenii 2017-05-25 11:24 GMT+03:00 brent : > I'm trying to use the Ignite Jdbc connection; with my goal to be able to > call > the cache

Re: Cache has been stopped

2017-06-02 Thread Evgenii Zhuravlev
Hi, I think you should find the reason why nodes segmented at first. As you have small heap size(044Gb per node), it's most likely that nodes segmentation was cause by GC pressure, you can check it by turning on GC logs. As you see, (CPU [cur=31.33%, avg=1.42%, GC=50.87%]) , your CPU spends more

Re: Incorrect number of arguments for type KafkaStreamer<K,V>; it cannot be parameterized with arguments <String, String, String>

2017-06-02 Thread Evgenii Zhuravlev
Hi, since Ignite-1.9 KafkaStreamer has 2 parameters since ignite-1.9, so, use KafkaStreamer kafkaStreamer = new KafkaStreamer<>(); Evgenii 2017-06-02 15:45 GMT+03:00 ignitedFox : > Hi, > > I use ignite 1.9 > > here is my code; > > > > > Eclipse says

Re: Client Server Persistent Store Fault Tolerance

2017-06-02 Thread Evgenii Zhuravlev
You have 2998 instead of 3000, because 2 of your transactions were rolled back. You should handle this exceptions and run transaction again, if it was rolled back. It's not inconsistent data. 2017-06-02 6:01 GMT+03:00 rickynauvaldy <ricky.nauva...@sci.ui.ac.id>: > Evgenii Zhurav

Re: Client Server Persistent Store Fault Tolerance

2017-06-01 Thread Evgenii Zhuravlev
>so that the other clients are missing the value that they should write (they didn't show any error/exception) I don't understand, which values are they missing? When transaction should be rolled back, nodes will re-read values from db, because, when you use write-through, it has consistent

Re: Where can I find example-ignite.xml for ignite sink connector?

2017-05-03 Thread Evgenii Zhuravlev
Hi, You can find it in ignite-kafka module in src/test/resources folder. 2017-05-03 9:14 GMT+03:00 blasteralfred : > seen it here also https://apacheignite-mix.readme.io/v1.9/docs/kafka- > streamer > > > > -- > View this message in context: http://apache-ignite-users. >

Re: NoSuchMethodError: org.apache.curator.framework.api.CreateBuilder.creatingParentContainersIfNeeded()

2017-05-02 Thread Evgenii Zhuravlev
Hi, First of all, I would highly recommend to use spark that built with scala 2.11 instead of 2.10, because you use ignite that built with scala 2.11. Please double check that you moved all ZooKeeper module related libs from “{apache_build}/libs/optional/ignite-zookeper” into

Re: OOME on 2-node cluster with visor running repeatedly, Ignite 1.9

2017-05-04 Thread Evgenii Zhuravlev
Hi, As i see, you run visor in internal mode, so, it creates a node each time. Are you sure that you stop them properly? Why do you need to start new visor each time? Just use already started visor. Evgenii 2017-05-04 11:57 GMT+03:00 tysli2016 : > Got

Re: How to configure a QueryEntity for a BinaryObject

2017-09-20 Thread Evgenii Zhuravlev
If you're configuring QueryEntity, you don't need to add to the configuration indexedTypes too. It's just different ways to configure Indexes and queryable fields. Evgenii 2017-09-20 10:10 GMT+03:00 Savagearts : > I failed to configure the binaryobject ignitecache. My

Re: Hadoop Accelerator doesn't work when use SnappyCodec compression

2017-10-17 Thread Evgenii Zhuravlev
Have you tried to remove from path libraries from ${HADOOP_HOME}/lib/native and add only /usr/lib64/ folder? 2017-10-17 12:18 GMT+03:00 C Reid <reidddc...@outlook.com>: > Tried, and did not work. > > -- > *From:* Evgenii Zhuravlev <e.zhuravlev.

Re: Hadoop Accelerator doesn't work when use SnappyCodec compression

2017-10-16 Thread Evgenii Zhuravlev
Hi, Have you checked "hadoop checknative -a" ? What it shows for snappy? Evgenii 2017-10-17 7:12 GMT+03:00 C Reid : > Hi all igniters, > > I have tried many ways to include native jar and snappy jar, but > exceptions below kept thrown. (I'm sure the hdfs and yarn

Re: JDBCThinDriver features

2017-10-13 Thread Evgenii Zhuravlev
Hi, All these parameters can be configured in Template, which can be applied to the created table. The template is just a CacheConfiguration from your config xml file. For example, it can contain "*" in cache name property, like a wildcard. So, it does not need to add these parameters right to

Re: Java 9

2017-10-13 Thread Evgenii Zhuravlev
Paolo, As most frameworks and platforms, Ignite contains low-level logic, which was changed in Java 9. For example, in Java 9 application classloader is not a UrlClassLoader anymore, while in ignite-hadoop we used methods from UrlClassLoader for implementing class loading logic. So, --add-opens

Re: Java 9

2017-10-13 Thread Evgenii Zhuravlev
Fri, Oct 13, 2017 at 9:34 AM, Alexey Kuznetsov <akuznet...@apache.org> > wrote: > >> Evgenii, >> >> Hadoop is an optional module. >> How about ignite-core? Could it be started under Java 9? >> >> On Fri, Oct 13, 2017 at 2:21 PM, Evgenii Zhuravlev < >&

Re: ignite cron scheduling in cluster

2017-08-29 Thread Evgenii Zhuravlev
Hi, There is no such functionality out of the box right now, but you can implement something like this with your own. For example, run broadcast on all nodes to scheduleLocal jobs which will check after starting that only one of them will run and all other just will finish. But in this case, you

Re: Task management - MapReduce & ForkJoin performance penalty

2017-08-30 Thread Evgenii Zhuravlev
Also, maybe it's better to compare your current solution with Ignite on some real tasks? Or at least more approximate to the real use case Evgenii

Re: Task management - MapReduce & ForkJoin performance penalty

2017-08-30 Thread Evgenii Zhuravlev
Hi, I don't really understand, what you've tried to measure here? If you run two nodes on the same machine you will have more context switching of the CPU. In this case, your CPU run internal Ignite Threads not from only one node, but from 2 nodes. Additionally, when you use more that one node -

Re: Ignite sql queries working transactionally

2017-08-30 Thread Evgenii Zhuravlev
In the nearest release should be fixed https://issues.apache.org/ jira/browse/IGNITE-6044 and in the subsequent release will be added support for transactional SQl. 2017-08-30 12:36 GMT+03:00 kotamrajuyashasvi : > Hi > > Thanks for the response > > I still do not

Re: Task management - MapReduce & ForkJoin performance penalty

2017-09-05 Thread Evgenii Zhuravlev
I think it was planned at the end of October. Evgenii 2017-09-05 17:41 GMT+03:00 ihorps : > hi, @ezhuravlev > > This is what I'm looking for, many thanks! > > Some hints when v2.3 is planned to be release (I can't find it on wiki)? > > I'd rather wait for this API in Ignite

Re: copyOnRead to false

2017-09-05 Thread Evgenii Zhuravlev
Hi, I want to clarify about usage copyOnRead=False: As far as I know, It should help in 1.x releases, with the default configuration, when entries stored in onheap and in 2.x releases, with onHeapCacheEnabled=true(it's not default). I think we should mention this in the documentation. Also, it

Re: Task management - MapReduce & ForkJoin performance penalty

2017-09-05 Thread Evgenii Zhuravlev
But of course, it could be changed. The community didn't decide yet if wiki doesn't have information about it. 2017-09-05 17:46 GMT+03:00 Evgenii Zhuravlev <e.zhuravlev...@gmail.com>: > I think it was planned at the end of October. > > Evgenii > > 2017-09-05 17:41 G

Re: client thread dumps

2017-09-05 Thread Evgenii Zhuravlev
Hi, I think it's a collection of objects from previous exchanges. By default, GridCachePartitionExchangeManager stores 1000 objects, but since version 2.1 it's possible to reduce this size. I would recommend you to update to version 2.1 and try to reduce this property:

Re: Kerberos installation

2017-08-28 Thread Evgenii Zhuravlev
Hi, take a look for a KerberosHadoopFileSystemFactory,it can be used in kerberized hadoop env: KerberosHadoopFileSystemFactory delegate = new KerberosHadoopFileSystemFactory(); delegate.setKeyTab("foo.keytab"); delegate.setKeyTabPrincipal("foo"); delegate.setReloginInterval(0); Evgenii

Re: Cassandra failing to ReadThrough using Cache.get(key) without preloading

2017-08-31 Thread Evgenii Zhuravlev
Hi, Looks like config files and code were not attached. Please add it to the thread. Evgenii 2017-08-30 23:47 GMT+03:00 Kenan Dalley : > According to everything that I've read, hooking up Cassandra with Ignite > should allow for doing a lazy load of the Cache using the

Re: Cassandra failing to ReadThrough using Cache.get(key) without preloading

2017-08-31 Thread Evgenii Zhuravlev
Great news! Thank you for the update. Evgenii 2017-08-31 16:47 GMT+03:00 Kenan Dalley : > Wow. Ok. After I spent about 30-45 minutes getting it put together and > looking pretty, too. > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >

Re: Configuring path of binary_meta, db directories etc

2017-08-31 Thread Evgenii Zhuravlev
Hi, Please check org.apache.ignite.configuration.IgniteConfiguration#setWorkDirectory. As for now, there is no option to specify a custom path only for binary metadata. Kind regards, Evgenii 2017-08-31 15:17 GMT+03:00 userx : > Hi, > > How can we configure a customized path

Re: memory increases on heap

2017-09-04 Thread Evgenii Zhuravlev
Hi, answered you here: http://apache-ignite-users.70518.x6.nabble.com/client-thread-dumps-tc16658.html Evgenii 2017-09-04 17:09 GMT+03:00 ignite_user2016 : > Hello Igniters, > > We have 2 instances on ignite ( 2.0) in production, we mostly used ignite > for spring cache.

Re: client thread dumps

2017-09-04 Thread Evgenii Zhuravlev
>I am also seeing frequent GC in GC monitor, wondering what it can relate to >that is with CPU spike ? I think these spikes could be related to the GC, yes. But they also could be related to the work that happens on this node. Could you describe how you use this node? Which operation do you

Re: Ignite 2.0 out of memory

2017-09-01 Thread Evgenii Zhuravlev
This error is not about heap memory, it indicates that you started more threads within one process that it's allowed by OS. On Linux you can play with ulimit to overcome the issue. Also, how many nodes you have on the one machine? How many visor clients on it machine? Could you share logs from

Re: Cassandra failing to ReadThrough using Cache.get(key) without preloading

2017-09-01 Thread Evgenii Zhuravlev
I would recommend changing ignite .getOrCreateCache(new CacheConfiguration( Application.TEST_CACHE_NAME))) to ignite .cache(Application.TEST_CACHE_NAME) just to check if you really accessing the same cache that was creating from your xml file and

Re: History, multiple source systems, Data Vault using Ignite...

2017-08-29 Thread Evgenii Zhuravlev
Hi, Yes, it's possible to implement storage for previous values in Ignite. For example, you can use listener of ContinuousQuery with @IgniteAsyncCallback for updating values in your cache. When value updated, you can put previous value(which will be available in this event listener) in another

Re: 1 processing node, n partition nodes

2017-08-29 Thread Evgenii Zhuravlev
Hi, What do you mean by 1 node that processing data? If you want to store data on several nodes and run some compute jobs that use data from these caches only on one node, then I could say that it a bad idea - it will lead to a lot of data moving between nodes. It's better to use affinityCall to

Re: How to configure off heap and "native" distributed persistence

2017-08-29 Thread Evgenii Zhuravlev
Are you sure that you try to set it for IgniteConfiguration and not for CacheConfiguration? Evgenii 2017-08-29 16:36 GMT+03:00 matt : > OK thanks Evgenii. For the persistence, I'm trying the Java example here: >

Re: How to configure off heap and "native" distributed persistence

2017-08-29 Thread Evgenii Zhuravlev
Hi, By default, since version 2.0 Ignite use Off heap memory, so you don't need to configure it explicitly. No, you don't need additional dependencies to use persistent store Evgenii 2017-08-29 16:05 GMT+03:00 matt : > I found doc references via Google search to >

Re: How to configure off heap and "native" distributed persistence

2017-08-29 Thread Evgenii Zhuravlev
Yes, Ignite support native persistence, documentation for this was mentioned in your first message Simple configuration for enabling it: Evgenii 2017-08-29 18:16 GMT+03:00 matt : > Maybe I'm not understanding this correctly but doesn't Ignite support a >

Re: affinityRun then invoke

2017-08-30 Thread Evgenii Zhuravlev
Hi, It's not necessary to use affinityRun when you invoke EntryProcessor - EntryProcessor allows for processing data directly on primary nodes. I would recommend you to check this example: https://github.com/apache/ ignite/blob/master/examples/src/main/java/org/apache/

Re: IgniteCache.localEntries(CachePeekMode... peekModes) result

2017-09-01 Thread Evgenii Zhuravlev
Hi, > when we call cache.*localEntires *and we get the Iterable ,V

Re: Task management - MapReduce & ForkJoin performance penalty

2017-09-05 Thread Evgenii Zhuravlev
Hi, Here is a ticket for exactly what you want, it's in progress right now: https://issues.apache.org/jira/browse/IGNITE-5037 If you don't want to wait till it will be implemented, you can use affinityCall(...) or affinityRun(...) and somehow reduce result after it will be returned. Evgenii

Re: Hadoop Accelerator doesn't work when use SnappyCodec compression

2017-10-19 Thread Evgenii Zhuravlev
But ignite just couldn't load them, it's > strange. > -- > *From:* Evgenii Zhuravlev <e.zhuravlev...@gmail.com> > *Sent:* 17 October 2017 21:25 > > *To:* user@ignite.apache.org > *Subject:* Re: Hadoop Accelerator doesn't work when use SnappyCodec > compression > > Have

Re: Grid freezing

2017-10-23 Thread Evgenii Zhuravlev
Hi! How many nodes do you have? How many CPUs? Could you provide a code of com.company.node.ignite.IgnitePortionDequeuer or at least a dequeuePortions method? Evgenii 2017-10-20 0:24 GMT+03:00 smurphy : > threaddump.tdump >

Fwd: Hadoop Accelerator doesn't work when use SnappyCodec compression

2017-10-24 Thread Evgenii Zhuravlev
-- Forwarded message -- From: Evgenii Zhuravlev <e.zhuravlev...@gmail.com> Date: 2017-10-20 12:31 GMT+03:00 Subject: Re: Hadoop Accelerator doesn't work when use SnappyCodec compression To: C Reid <reidddc...@outlook.com> I've run a few days ago hive, hadoo

Re: Grid freezing

2017-10-24 Thread Evgenii Zhuravlev
Looks like possible deadlock. Please add timeout for transactions and check it with deadlock detection, as described here: https://apacheignite.readme.io/docs/transactions#section-deadlock-detection Evgenii 2017-10-23 21:16 GMT+03:00 smurphy : > IgnitePortionDequeuer.java

Re: Local node and remote node have different version numbers

2017-11-29 Thread Evgenii Zhuravlev
Hi, In this case, you should specify ports for addresses, for example: 10.23.153.56:47500 Evgenii 2017-11-29 18:20 GMT+03:00 Rajarshi Pain : > Hi, > > I was working on Ignite 2,3, and my colleague is working on 1.8. We are > running different application on our local

Re: Local node and remote node have different version numbers

2017-11-30 Thread Evgenii Zhuravlev
e error if > we both running it on the time in our system. > > On Wed 29 Nov, 2017, 21:04 Evgenii Zhuravlev, <e.zhuravlev...@gmail.com> > wrote: > >> Hi, >> >> In this case, you should specify ports for addresses, for example: >> >> 10.23.153.56:47500

Re: Local node and remote node have different version numbers

2017-11-30 Thread Evgenii Zhuravlev
2017-11-30 16:30 GMT+03:00 Evgenii Zhuravlev <e.zhuravlev...@gmail.com>: > So, don't use multi cast ip finder at all. > > 2017-11-30 15:27 GMT+03:00 Rajarshi Pain <rajarsh...@gmail.com>: > >> The code is in client machine so can not share the code, config is there

Re: Local node and remote node have different version numbers

2017-11-30 Thread Evgenii Zhuravlev
league is using the multicast ip that given in ignite > website. > > On Thu 30 Nov, 2017, 15:44 Evgenii Zhuravlev, <e.zhuravlev...@gmail.com> > wrote: > >> Are you sure that you are using not Multicast IP finder? Please share >> configuration for all nodes that find ea

Re: the balance between read and write.

2017-12-01 Thread Evgenii Zhuravlev
with which exception? 2017-12-02 9:56 GMT+03:00 Marco : > the question is about the scalablities and flexabilities of the framework > for > realtime data processing and reporting. I tried single node ignite 2.3, it > simply crashed when 100 concurrent quries were applied

Re: the balance between read and write.

2017-12-01 Thread Evgenii Zhuravlev
Hi Marco, First of all, I would suggest updating to the latest Ignite version - 2.3, it will definitely show much better performance and it's more stable. As for the question about write - yes, it's better to use Ignite data streamer if you need to write a lot of new entries in the cache.

Re: "HandshakeException: Remote node ID is not as expected" occurs when tested with 1000 clients

2017-12-05 Thread Evgenii Zhuravlev
It's a known problem, which doesn't affect anything https://issues.apache.org/jira/browse/IGNITE-4939 Evgenii 2017-12-05 7:53 GMT+03:00 yonggu.lee : > I go to the machine where cannot be connected (cc3a7x2183), and found the > following exception message > >

Re: TcpCommunicationSpi : IgniteCheckedException: Failed to connect to node

2017-12-13 Thread Evgenii Zhuravlev
Looks like you have some communication problems, since on the address 172.16.100.57:47100 node see not needed node. Please share logs from all nodes, it will help to understand a problem. Evgenii 2017-12-13 13:45 GMT+03:00 golgoti : > Hi there, > > We do have an app with 4

Re: Using event to reconnect spring created cache client to server

2017-11-16 Thread Evgenii Zhuravlev
The solution that I shared earlier is recommended I think. Regards, Evgenii 2017-11-16 17:31 GMT+03:00 Guilherme Melo : > Is there a recommended pattern for reconnecting continuous queries after a > disconnect event? > > Thanks ! > > Cheers, > > Guilherme Melo >

Re: what's best practice of “in” operator?

2017-11-19 Thread Evgenii Zhuravlev
Hi, it should be replaced with joins. Find more information here: https://apacheignite-sql.readme.io/docs/performance-and-debugging#section-sql-performance-and-usability-considerations Evgenii 2017-11-19 16:34 GMT+03:00 Aurora <2565003...@qq.com>: > Ignite 2.2: > > common sql: select p.*

Re: Transactions and IgniteQueue

2017-11-03 Thread Evgenii Zhuravlev
Hi Arun, As for now, IgniteTransaction works only for caches. You can find information about it in documentation: https://apacheignite.readme.io/docs/transactions#section-ignitetransactions Evgenii 2017-11-03 12:43 GMT+03:00 arunkjn : > Hi, > > I am using an optimistic

Re: Ignite Cluster Disconnects After Idle Time

2017-11-03 Thread Evgenii Zhuravlev
Unfortunately, it's not enough data to determine the problem. As I said earlier, please provide full logs from all nodes. Also, it would be great to see your config files. Regards, Evgenii 2017-11-03 13:29 GMT+03:00 Ramzinator : > Updated above post with logs. Text was

Re: Why do I get table not found exception when trying do execute SQL on some tables but not others...

2017-11-03 Thread Evgenii Zhuravlev
Hi, Most likely that this table was created not in Public schema, but in sql schema by cache name. To check this you can run H2 Debug console - just start ignite with JVM parameter -DIGNITE_H2_DEBUG_CONSOLE=true Regards, Evgenii 2017-11-03 17:42 GMT+03:00 Tobias Eriksson

Re: Transactions and IgniteQueue

2017-11-03 Thread Evgenii Zhuravlev
Yes, you could see it in the javadoc for Transaction class: 2017-11-03 14:43 GMT+03:00 arunkjn : > Thanks Evgenii. > > If I get a TransactionOptimisticException during the transaction will it be > thrown at the time of tx.commit() ? > > > > -- > Sent from:

Re: Transactions and IgniteQueue

2017-11-03 Thread Evgenii Zhuravlev
-11-03 17:36 GMT+03:00 Evgenii Zhuravlev <e.zhuravlev...@gmail.com>: > Yes, you could see it in the javadoc for Transaction class: > > > 2017-11-03 14:43 GMT+03:00 arunkjn <arun...@gmail.com>: > >> Thanks Evgenii. >> >> If I get a Transact

Re: Using event to reconnect spring created cache client to server

2017-11-02 Thread Evgenii Zhuravlev
Hi, I don't really understand, what do you mean. At first, a client will try to reconnect to the cluster with the same id and without EVT_CLIENT_NODE_RECONNECTED event. Only if it does not succeed with this, it starts to connect to the cluster with a new id and generates this event. What do you

Re: Ignite Cluster Disconnects After Idle Time

2017-11-02 Thread Evgenii Zhuravlev
Hi, Could you share logs from all nodes? Do you have a firewall configured? Evgenii 2017-11-02 18:44 GMT+03:00 Ramzinator : > Hi all, > > I'm facing hanging issues with my ignite cluster after I leave it idle for > 20 mins. > > The scenario is as follows: > > I have 3

Re: Where is release notes for 2.3

2017-11-02 Thread Evgenii Zhuravlev
Hi, Just checked the link you provided and everything works fine. Which error code do you get? Could you check this link again? Regards, Evgenii 2017-11-01 20:28 GMT+03:00 Timofey Fedyanin : > Hi! > > URL from downloads page is bad (https://ignite.apache.org/ >

Re: Ignite 2.3 still not support group_concat

2017-11-02 Thread Evgenii Zhuravlev
Hi James, Nice catch! Yes, it's not supported yet. Looks like it was mistakenly added to the documentation in version 2.3. Just suggested deleting this page from the doc. It should be removed soon. Regards, Evgenii 2017-11-02 4:53 GMT+03:00 james wu : > The new ignite 2.3

Re: Using event to reconnect spring created cache client to server

2017-11-09 Thread Evgenii Zhuravlev
Hey, Which exception threw there? Could you share stacktrace? Does here really client reconnects to the same cluster, or it was after the server node was restarted? Evgenii 2017-11-09 18:34 GMT+03:00 guillMelo : > Hello, > I am sorry If I am not being clear, my goal is

Re: Failed to parse query: exception with Scala

2017-11-08 Thread Evgenii Zhuravlev
I don't really get, what you trying to do here: val sharedRDDConsumer = igniteContext.fromCache("sharedRDDProducer") it looks like a mistake Here is example of using ignite sql from spark in java:

Re: How to scale out Ignite?

2017-11-06 Thread Evgenii Zhuravlev
Hi, 1. What do you mean by "when"? I'm sure that you can find all needed information here: https://apacheignite.readme.io/docs/service-grid. Also, I don't understand why do you think that affinityCall is dangerous. 2. Well, everything should scale automatically. For a partitioned cache, you can

Re: IP finder returned empty addresses list on Yarn

2017-11-06 Thread Evgenii Zhuravlev
Hi, To check if Ignite uses this default-config.xml file, you can just break this xml(for example remove closing of tag). If Ignite will still start without problems, then it uses a different config file. Also, do you really need to use MulticastIpFinder? I think you can use Static IP Based

Re: Out of memory error

2017-12-01 Thread Evgenii Zhuravlev
Hi Dmitriy, Looks like you configured memory policy and memory configuration that are not used by your caches. Also, it looks like your cache use default memory configuration, try to add to the memoryConfiguration and to the memoryPolicy configuration Evgenii 2017-12-01 16:42 GMT+03:00 Alexey

Re: read/persist a huge cache by its affinity key

2017-12-01 Thread Evgenii Zhuravlev
Well, then you can start other Ignite cluster with enabled persistence and move data from the first cluster to the second one. Evgenii 2017-12-01 18:31 GMT+03:00 Marco : > yes, that way works, but the question is how to output 30m out without > restart? I didn't enable

Re: the balance between read and write.

2017-12-01 Thread Evgenii Zhuravlev
I don't understand how it will work in your case if you will have 2 separate clusters. I think you can just add more machines to the cluster and this problem will be resolved. Evgenii 2017-12-01 18:35 GMT+03:00 Marco : > is that worthy a try that initate 2 ignite

Re: Index performance

2017-12-04 Thread Evgenii Zhuravlev
Hi, Please share benchmarks code, it's hard to understand why you can't load CPU for 100% without your code. But I see one thing, that definitely could lead to performance problems - you've set - this could lead to a lot of context switching since every query could be executed in 48 threads.

Re: Index performance

2017-12-04 Thread Evgenii Zhuravlev
ance or CPU usage maximum change on 5% > > In parallel discusion here http://apache-ignite-users.70518.x6.nabble.com/ > Ignite-poor-performance-td18670.html one of users suggest to > use parallelism > > With best regards > Alisher Alimov > alimovalis...@gmail.com > > O

Re: "HandshakeException: Remote node ID is not as expected" occurs when tested with 1000 clients

2017-12-11 Thread Evgenii Zhuravlev
It's not the best solution for this problem, that's why this PR was not merged yet. Evgenii 2017-12-11 12:33 GMT+03:00 yonggu.lee : > After applying related pull request > (https://github.com/apache/ignite/pull/1814), the exception disappeared. > > > > -- > Sent from:

Re: How to access Apache Ignite service grid services from a J2ee application server

2017-10-25 Thread Evgenii Zhuravlev
Hi, Have you tried to use TcpDiscoveryVmIpFinder instead of TcpDiscoveryMulticastIpFinder ? Evgenii 2017-07-29 12:20 GMT+03:00 tmp : > Thanks for the node on singleton bean, i did so and it seems to be > responding > now. > > Please NOTE that I am using "

Re: Grid freezing

2017-10-26 Thread Evgenii Zhuravlev
Is it possible that you run DequeuePortionsCallable with timeout? Evgenii 2017-10-26 6:40 GMT+03:00 smurphy : > I added a transaction timeout of 1 millis and a transation size of 100 > (transaction is Optimistic and Serializable)... > > I see no

Re: Question Ignite Memory Consumption / Object size (Apache Ignite .NET)

2017-10-24 Thread Evgenii Zhuravlev
Hi Mario, You have 7 indexed fields, I think it could be a reason of high memory consumption. As for estimating memory size - I would recommend loading various sized data several times and measuring Memory consumed by it. It will help you to understand approximate needed memory size. These

Re: Modify the underlying IgniteRDD Cache

2017-10-31 Thread Evgenii Zhuravlev
Well, all changes in Ignite cache (regardless whether they were caused by another RDD or external changes in cache) will be visible to RDD users immediately. Most possible this happened because you set different types for keys and values in ignite native api and ignite rdd. I've checked this

  1   2   3   4   5   6   >