Continuous queries and duplicates

2018-11-23 Thread Sobolewski, Krzysztof
Hi, I'm wanting to use a ContinuousQuery and there is a slight issue with how it transitions from the initial query to the notifications phase. It turns out that if there are additions to the cache happening while the continuous query runs, an entry may be reported twice - once by the initial

Re: Read SQL table via cache api

2018-11-23 Thread yongjec
Hi Andrei, Thank you for your reply. Here is the server log. However, I do not see any relevant information in it. The cache get request was made from the client between line 117 (client joins the topology) and 127 (client leaves the topology). ignite-db357bff.log

Re: Read SQL table via cache api

2018-11-23 Thread yongjec
Another observation is that if I take out the effective_date field (Timestamp) from the key, and use only the Int and Double columns as the primary keys, the server finds it without any problem. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Ignite 2.7

2018-11-23 Thread Andrey Davydov
Hello, When 2.7 release will be available? We have some problems with https://issues.apache.org/jira/browse/IGNITE-7972 in CI process of our system (test runner server is not powerful enough and we get NPE from Ignite on every third build attempt =((( ) Andrey.

Re: Read SQL table via cache api

2018-11-23 Thread aealexsandrov
Hi, Could you please set -DIGNITE_QUIET=false to turn off the quiet mode and re-attach the logs? BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Read SQL table via cache api

2018-11-23 Thread yongjec
Hi Andrei, I captured below logs with the -DIGNITE_QUIET=false flag. There is a 5-hour difference between the two time zones. Server Log ignite-ef771a6b.log Client Log ignite-86fd5276.log

Re: IgniteBiPredicate anonymous class - ClassNotFoundException

2018-11-23 Thread Maxim.Pudov
I guess you have 2 nodes, but only one of them has that class in its classpath. Check out this article: https://apacheignite.readme.io/docs/zero-deployment#section-peer-class-loading -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Does it affect the put, get, query operation when add or remove a node?

2018-11-23 Thread aealexsandrov
Hi, The general answer is yes because the rebalancing of data will be started and you will not be able to process data until partition map exchange will not be completed. https://apacheignite.readme.io/docs/rebalancing

Re: Read SQL table via cache api

2018-11-23 Thread aealexsandrov
Hi, I don't think that it's possible to understand a reason without logs. Please attach them here or possible if you can reproduce it then you may file a Jira issue and attach logs there with a full description of the problem. BR, Andrei -- Sent from:

Re: Does it affect the put, get, query operation when add or remove a node?

2018-11-23 Thread Justin Ji
Great, thank you very much! -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: can ignite accelerate sparkOnHive

2018-11-23 Thread Jörn Franke
I think the more important question is why you need this. There are many different ways on accelerating warehouse depending on what you want to achieve. > Am 23.11.2018 um 07:56 schrieb lk_hadoop : > > hi all, > I think use hive as DW and use spark do some OLAP on hive is quite common > .

Re: Local messaging not happening asynchronously

2018-11-23 Thread Evgenii Zhuravlev
Hi, It is an optimization, that runs operations which could be executed locally, in user thread. The same will work for cache operations too. First of all, do you really need to send a message to all nodes, including the local? You can send the message to the remote nodes only, it will

Re: Suppressing reflective serialisation in Ignite

2018-11-23 Thread Pavel Tupitsyn
Hi Raymond, Exceptions implement ISerializable, and are serialized that way in Ignite. However, there is no "fallback" mechanism that you ask about (I should file a ticket, this is a good catch). So the workaround is to use .NET BinaryFormatter to serialize non-IBInarizable types and write them

Ignite Query Slow

2018-11-23 Thread Skollur
Hello I have ignite server running with 2 nodes. Each node has 30 cache stores with one table in each with REPLICATE configured. Found query is taking longer to return when simultaneous 100 requests were sent to ignite. In the first iteration the query is quick. But as number of hits more, same

Re: Ignite Query Slow

2018-11-23 Thread Evgenii Zhuravlev
Hi, >From your description, it looks like it could be a long GC pause. How much heap do you have? Can you collect GC logs from analysis? Evgenii пт, 23 нояб. 2018 г. в 22:02, Skollur : > Hello > > I have ignite server running with 2 nodes. Each node has 30 cache stores > with one table in each

Re: Suppressing reflective serialisation in Ignite

2018-11-23 Thread Pavel Tupitsyn
Sorry, I'm wrong. You can of course just call writer.WriteObject(..) as a fallback, no need for BinaryFormatter. Your only goal is to throw exception for *some* types, right? On Fri, Nov 23, 2018 at 8:37 PM Pavel Tupitsyn wrote: > Hi Raymond, > > Exceptions implement ISerializable, and are

Re: In which case will ignite run following sql?

2018-11-23 Thread Evgenii Zhuravlev
Hi, Ignite doesn't run a query like this internally. It's executed in client-connector pool, which means that one of your JDBC or ODBC drivers send this query. How often do you see something like that? Evgenii чт, 22 нояб. 2018 г. в 15:13, yangjiajun <1371549...@qq.com>: > Hello. > > I found a

Re: Does a Ignite Cache return size metrics for a cache in local mode

2018-11-23 Thread Evgenii Zhuravlev
Hi, Answered you on stackoverflow: https://stackoverflow.com/questions/53193997/does-a-ignite-cache-return-metrics-for-a-cache-in-local-mode/53453990#53453990 Evgenii пн, 19 нояб. 2018 г. в 12:39, Paddy : > I posted this on Stack Overflow a while back, but this is probably a better > place for

Re: Ignite startu is very slow

2018-11-23 Thread Evgenii Zhuravlev
Hi, How many heap do you have? >From logs I see, that before this, cluster was not stopped properly and the checkpoint was not saved to the disk. Because of that, after the start, nodes started to applying WAL changes( https://apacheignite.readme.io/docs/write-ahead-log). It took 1491578ms,

Re: LIKE operator issue in Ignite Database

2018-11-23 Thread Evgenii Zhuravlev
Hi, Do you have a small reproducer for this? I've tried to create a simple one(see attached), but it works for me. Evgenii чт, 22 нояб. 2018 г. в 12:18, Shravya Nethula < shravya.neth...@aline-consulting.com>: > Hi, > > We are trying to execute the following select queries with LIKE operator:

Ignite Query Slow

2018-11-23 Thread Skollur
Hello I have ignite server running with 2 nodes. Each node has 30 cache stores with one table in each with REPLICATE configured. Found query is taking longer to return when simultaneous 100 requests were sent to ignite. In the first iteration the query is quick. But as number of hits more, same

Re: Why drop table operations affect all update operations.

2018-11-23 Thread Evgenii Zhuravlev
Hi, "DROP table" operation also destroying an underlying cache. This change should be properly synchronized between all the nodes, that's why it sends a special Discovery message to all nodes with the new minor topology change. Without this, not all nodes in the cluster will know about stopping

Re: Does ignite keep loading result when the jdbc thin connection is dead?

2018-11-23 Thread Evgenii Zhuravlev
Hi, What do you mean by "Ignite does not release memory"? What kind of memory it still consume? Do you mean heap? Evgenii чт, 22 нояб. 2018 г. в 15:55, yangjiajun <1371549...@qq.com>: > Hello. > > I use jdbc thin connection to access ignite with lazy mode.Ignite does not > release memory after

Re: In which case will ignite run following sql?

2018-11-23 Thread yangjiajun
Hello,thanks for response. I see 79 logs like this in about 40w ignite's logs.Such queries are targeting on different tables and some of them has where conditions.These logs warn these queries are taking long time.My application only has sqls like 'select * from XXX'.I also try to execute above

Re: In which case will ignite run following sql?

2018-11-23 Thread yangjiajun
Hello. I think I find the case.I do a delete test and then see such logs. ezhuravlev wrote > Hi, > > Ignite doesn't run a query like this internally. It's executed in > client-connector pool, which means that one of your JDBC or ODBC drivers > send this query. How often do you see something

Re: Does ignite keep loading result when the jdbc thin connection is dead?

2018-11-23 Thread yangjiajun
Hello. Yes.I mean heap memory.I used dbeaver to run a table scan query on a table which has millions data.My query caused ignite exhaust its heap so I kill my connection.But ignite did not release its heap memory.I guess ignite was still trying to load result of my query.Is my guess right?

Re: IgniteBiPredicate anonymous class - ClassNotFoundException

2018-11-23 Thread joseheitor
Thanks, Maxim - it is working. Tips for others landing on this post... I fixed my problem by: - Enabling peer classloading () on each node - Building a JAR with my model classes and manually deploying them on each server node's /libs folder -- Sent from:

Re: [RESOLVED] Passing parameters to IgniteBiPredicate

2018-11-23 Thread joseheitor
Please ignore my previous post - it is working correctly: String date = "2018-10-21"; ScanQuery filter = new ScanQuery<>( new IgniteBiPredicate() { @Override public boolean apply(Integer key, Transaction trans) {