Re: UPDATE query with JOIN

2018-10-08 Thread Justin Ji
Thank for your reply! I sure I have indexed the devId, here is the output of EXPLAIN: [SELECT __Z0.DEVID AS __C0_0, __Z0.ISONLINE AS __C0_1, __Z0.MQTTTIME AS __C0_2 FROM "device_online_status".T_DEVICE_ONLINE_STATUS __Z0 /*

Re: Re-deploying a continuous query after all server nodes restart

2018-10-08 Thread DanieleBosetti
Hi, thanks for replying! I double-checked my case, and (I was quite wrong); the client keeps receiving updates from the CQ after the first server is restarted. (maybe it could be useful to add a case in the examples section, like "ContinuousQueryFailover"? I could try doing that eventually)

Re: Remote Listeners in C#.Net Ignite

2018-10-08 Thread Ilya Kasnacheev
Hello! It seems that RemoteListen() is not implemented in C# yet. I suggest implementing that part of functionality on Java side. Regards, -- Ilya Kasnacheev пт, 5 окт. 2018 г. в 15:53, Hemasundara Rao < hemasundara@travelcentrictechnology.com>: > Hi All, > > I have requirement of when

Re: Affinity function and partition aware database loading

2018-10-08 Thread Ilya Kasnacheev
Hello! As far as I could understand, you have affinity data in your rows, but it is not a column but computable over several columns. In this case you can create your own AffinityFunction inheriting from RendezvousAffinityFunction. In general, creating a new AffinityFunction is a monumental

Blog post "Introduction to the Apache(R) Ignite™ community structure"

2018-10-08 Thread Dmitriy Pavlov
Hi Apache Ignite Enthusiasts, I'm happy to announce a new post about Apache Ignite https://www.gridgain.com/resources/blog/introduction-apacher-ignitetm-community-structure - "Introduction to the Apache® Ignite™ community structure." This post is a translated version of the Habr post. Thanks

RE: Services not initializing in persistence enabled cluster nodes

2018-10-08 Thread Maxim.Pudov
Your case is well described in docs https://apacheignite.readme.io/docs/baseline-topology#section-adding-new-node Hope, it will help. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Spark Ignite Data Load failing On Large Cache

2018-10-08 Thread ApacheUser
Hi,I am testing large Ignite Cache of 900GB, on 4 node VM(96GB RAM, 8CPU and 500GB SAN Storage) Spark Ignite Cluster .It happened tow times after reaching 350GB plus one or two nodes not processing data load and the data load is stopped. Please advise, the CLuster , Server and Client Logs

Spark Ignite Data Load failing On Large Cache

2018-10-08 Thread ApacheUser
Hi,I am testing large Ignite Cache of 900GB, on 4 node VM(96GB RAM, 8CPU and 500GB SAN Storage) Spark Ignite Cluster .It happened tow times after reaching 350GB plus one or two nodes not processing data load and the data load is stopped. Please advise, the CLuster , Server and Client Logs

Re: Affinity function and partition aware database loading

2018-10-08 Thread Maxim.Pudov
Hello, If you want to benefit from partition aware data loading, you must set up an affinity key field, without it SQL will make a full scan every time. If you don't plan to use SQL on Ignite's side, then you can set up a custom AffinityFunction

Re: ScanQuery failing on Client Mode

2018-10-08 Thread Ilya Kasnacheev
Hello! Yes, it will cause problems if it is not available on server node. Cache key-value classes are not peer loaded. You can still use withKeepBinary() on cache and do continuous queries on BinaryObject's. Regards, -- Ilya Kasnacheev пт, 5 окт. 2018 г. в 18:50, kvenkatramtreddy : > Hi, > >

Re: UPDATE query with JOIN

2018-10-08 Thread Evgenii Zhuravlev
Hi, Are you sure that you have index for devId field? Evgenii пн, 8 окт. 2018 г. в 12:23, Justin Ji : > Hi Alexander - > > I have tried the SQL you suggested, but the performance got worse, I do not > know why? > > 1. "update t_device_module set isOnline=1, mqttTime=" + >

Re: UPDATE query with JOIN

2018-10-08 Thread Justin Ji
Hi Alexander - I have tried the SQL you suggested, but the performance got worse, I do not know why? 1. "update t_device_module set isOnline=1, mqttTime=" + System.currentTimeMillis() / 1000 + " where devId in ('0001', '0002', ..., '2048')"; The SQL may take 600ms for 2048 records. 2."update

Re: UPDATE query with JOIN

2018-10-08 Thread Justin Ji
Hi Alexander - I have tried the SQL you suggested, but the performance got worse, I do not know why? 1. "update t_device_module set isOnline=1, mqttTime=" + System.currentTimeMillis() / 1000 + " where devId in ('0001', '0002', ..., '2048')"; The SQL may take 600ms for 2048 records. 2."update

Re: BUG - .net decimal type creating ignite table produces double

2018-10-08 Thread Ilya Kasnacheev
Hello! Is it a follow-up of http://apache-ignite-users.70518.x6.nabble.com/net-decimal-being-stored-as-Other-in-ignite-td24227.html#a24239 ? If we are talking about HTTP JSON REST, then JSON does not have any decimal type, it only has Double. Therefore I imagine that numbers will be represented

Re: odbc caches - cannot browse

2018-10-08 Thread Ilya Kasnacheev
Hello! ODBC driver should allow you to show all *tables* in their schemas and browse them. Note that you need to have tables and not just plain caches. If it doesn't, please guide me what is the software you are using. Is it Microsoft Excel? What is the version? Regards, -- Ilya Kasnacheev

Re: How to schedule and ignite service to run every 5 seconds?

2018-10-08 Thread Ilya Kasnacheev
Hello! ignite-schedule works with CRON expressions and cron4j underneath, which does not support granularity finer than one minute. Regards, -- Ilya Kasnacheev пн, 8 окт. 2018 г. в 8:13, the_palakkaran : > The default scheduling happens every 1 minute. Is it possible to override > it > and

Re: Is it possible to schedule an ignite service?

2018-10-08 Thread Ilya Kasnacheev
Hello! In Service.execute() method you can simply implement a sleep/run loop. You do not have to return from this method. You can also use ignite-schedule for that I guess. Regards, -- Ilya Kasnacheev пн, 8 окт. 2018 г. в 7:06, the_palakkaran : > Hi, > > Is it possible to schedule an ignite

Re: Is there a way for ignite cache to know data update in DB and refresh ?

2018-10-08 Thread Ilya Kasnacheev
Hello! In general, databases do not provide push-based APIs to notify you about changes (Ignite being an exception here with its Continuous Queries). So the answer is "no" in general. It is not implemented and it's not obvious how it could be. There are third party solutions for a limited

Re: Does Ignite support GPB serialized data

2018-10-08 Thread Ilya Kasnacheev
Hello! Ignite does not have special support for protocol buffers. You are welcome to implement Binarylizable or Externalizable interfaces on your objects to specify serialization for them. You can also specify BinarySerializer for types that you do not control by putting them into

Re: Spark 2.3 Structured Streaming With Ignite

2018-10-08 Thread Stephen Darlington
There’s a ticket and a patch but it doesn’t work “out of the box” yet. https://issues.apache.org/jira/browse/IGNITE-9357 Regards, Stephen > On 5 Oct 2018, at 19:53, ApacheUser wrote: > > Hi, > > Is it possible to use Spark Structured

RE: Services not initializing in persistence enabled cluster nodes

2018-10-08 Thread PotatoGuo
Sir, Is there any way to add a new node in a persistent cluster? Because i want to expand the cluster for the server num may increase someday. PS: the ignite is embeded in project using Spring boot. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: INSERT INTO ... SELECT kills server nodes

2018-10-08 Thread Evgenii Zhuravlev
Hi Alberto, Can you share the full query, configured indexes and configs? Both JVM and Ignite. Thanks, Evgenii пт, 5 окт. 2018 г. в 22:00, Alberto Mancini : > Hi, > we are developing a poc using Ignite and we faced a scaring problem > that i suppose is due to some naive misconfiguration. > >

Re: Apache Ignite 2.6.0 JDBC Thin Client Multiple Endpoints Issues

2018-10-08 Thread Ilya Kasnacheev
Hello! The address list is comma-separated and should not contain any spaces: String igniteUrl="jdbc:ignite:thin:// 192.168.0.117:10800,192.168.0.62:10800,192.168.0.115:10800"; JDBC seems to be confused if spaces are used between entries. I think you should not expect to

Re: Affinity quesions

2018-10-08 Thread Pavel Vinokurov
James, Please pay attention to the following query configuration method Query#setLocal(true). It allows to return records located on only local node. Following code block iterates through cache entries located on each server node: ignite.compute(ignite.cluster().forServers()).broadcast(new

Re: Re-deploying a continuous query after all server nodes restart

2018-10-08 Thread Evgenii Zhuravlev
Hi, In this case, starting the new node B and restarting the node A are absolutely the same - it's just starting the new node, because node A will be started with the new node id. As javadoc for CQ says: Note that in case query is distributed and a new node joins, it will get the remote filter

Re: Cache.get() while read through enabled throws closed result set exception

2018-10-08 Thread Evgenii Zhuravlev
Hi, Can you share a small reproducer with your cache store implementation? Evgenii вс, 7 окт. 2018 г. в 9:53, the_palakkaran : > Hi, > > I have read through enabled. I clear a key from cache inside an ignite > service and invoke cache.get() so as to get the latest value from db (it > will