loadCache is not returning the same number of records for every restart of the server

2018-07-25 Thread okiesong
Hi, caheName.loadCache(null, "select * from sampledata") is not returning a correct number of records every time, the record is fetched from Cassandra table. My code generally looks like this; caheName.loadCache(null, "select * from sampledata") SqlFieldsQuery sqlQuery = new

RE: Does event listener keep the order of events as they occur on the cluster?

2018-07-25 Thread xero
Hi, It is not mandatory to provide a filter. For example, this will get all the events from "myCache" ContinuousQuery qry = new ContinuousQuery<>(); qry.setLocalListener(new MyEventListener()); myCache.withKeepBinary().query(qry); @IgniteAsyncCallback private class MyEventListener implements

RE: Batch insert into ignite

2018-07-25 Thread Sriveena Mattaparthi
Thanks Michael…I have a question here… 1. Will the set/copy options mentioned work for SQL Query fields? Something like . Cache.query(new SQLQueryFields(“SET STREAMING ON”)) 2. IgniteDataStreamer streams data and add to cache without using JDBC

How do I rename multiple clusters

2018-07-25 Thread hulitao198758
The ignite official console monitors multiple clusters, but all cluster names are uuid names, which are difficult to manage. How do you change multiple clusters to other names Ignite Web Control Like this: Cluster:0D8FC815 Cluster:0E30C03F When there are many clusters, it is not

Re: If the authenticationEnabled is true Ignite web control conneced failed

2018-07-25 Thread Denis Magda
Alexey K., Please shed some light on when the secured cluster support will be released? I know it's already ready and just waiting its time to see the world. -- Denis On Wed, Jul 25, 2018 at 6:34 AM ezhuravlev wrote: > As for now, web agent can't connect to the secure Ignite cluster, this >

Re: "Unable to await partitions release latch within timeout: ServerLatch" exception causing cluster freeze

2018-07-25 Thread Ray
Hello Pavel, Here's the log for for node ids = [429edc2b-eb14-414f-a978-9bfe35443c8c, 6783732c-9a13-466f-800a-ad4c8d9be3bf]. 6783732c-9a13-466f-800a-ad4c8d9be3bf.zip

***UNCHECKED*** Executing SQL on cache using affinnity key

2018-07-25 Thread Prasad Bhalerao
Hi, Is there any way to execute select query on cache using affinity key? As per this link: https://apacheignite.readme.io/docs/collocate-compute-and-data#section-affinity-call-and-run-methods It can be done as follows: compute.affinityCall(*CACHE_NAME*, *affinityKey*, () -> {

***UNCHECKED*** RE: odbc - conversion failed because data value overflowed

2018-07-25 Thread wt
thank i have that working. I am trying to be able to integrate sql server with ignite for ETL purposes. We are looking to build an EDW with ignite so would like to have it accessible by the underlying databases as a source of truth. Looking at .Net CLR integration now as a workaround. I think with

Can't write to Ignite cluster when one node in baseline is down

2018-07-25 Thread Ray
I'm running a 3 node Ignite 2.6 cluster with persistence store enabled. I tested this following use case. 1. Start all three nodes. 2. Activate the cluster 3. Stop one of the node 4. Start ingesting data But I got following exception in step 4. class

Re: What is the difference between TcpCommunicationSpi & TcpTcpDiscoverySpi ?

2018-07-25 Thread Evgenii Zhuravlev
>What is the difference between TcpCommunicationSpi & TcpTcpDiscoverySpi ? https://stackoverflow.com/questions/37936833/difference-between-tcpcommunicationspicommunicationspi-and-tcpdiscoveryspidis >Every node I have created has different tcp discovery local port but same tcp commication port.

Re: Can't write to Ignite cluster when one node in baseline is down

2018-07-25 Thread Evgenii Zhuravlev
Hi, Do you have configured backups for the cache? Are you sure that all 3 nodes in baseline? Could you check it using control.sh tool? Evgenii 2018-07-25 11:23 GMT+03:00 Ray : > I'm running a 3 node Ignite 2.6 cluster with persistence store enabled. > > I tested this following use case. > > 1.

RE: ***UNCHECKED*** Executing SQL on cache using affinnity key

2018-07-25 Thread Stanislav Lukyanov
What do you mean by “execute select query on cache using affinity key” and what is the problem you’re trying to solve? Stan From: Prasad Bhalerao Sent: 25 июля 2018 г. 10:03 To: user@ignite.apache.org Subject: ***UNCHECKED*** Executing SQL on cache using affinnity key Hi, Is there any way to

Re: What is the difference between TcpCommunicationSpi & TcpTcpDiscoverySpi ?

2018-07-25 Thread monstereo
Yes same machine ezhuravlev wrote >>What is the difference between TcpCommunicationSpi & TcpTcpDiscoverySpi ? > https://stackoverflow.com/questions/37936833/difference-between-tcpcommunicationspicommunicationspi-and-tcpdiscoveryspidis > >>Every node I have created has different tcp discovery

Re: ***UNCHECKED*** Executing SQL on cache using affinnity key

2018-07-25 Thread Evgenii Zhuravlev
When you run SQL query with filtering on Affinity key field, the SQL engine will detect a node where this key is placed and execute this query only on one node. What are you trying to achieve? Evgenii 2018-07-25 10:00 GMT+03:00 Prasad Bhalerao : > Hi, > > Is there any way to execute select

Re: ***UNCHECKED*** Executing SQL on cache using affinnity key

2018-07-25 Thread Ilya Kasnacheev
Hello! I hope that Ignite statement planner will make use of affinity key if you provide it in the request. I.e. it will not be broadcast if you provide affinity key. Regards, -- Ilya Kasnacheev 2018-07-25 10:58 GMT+03:00 Stanislav Lukyanov : > What do you mean by “execute select query on

Re: Ignite data can't be recovered after node fail

2018-07-25 Thread Evgenii Zhuravlev
Hi, Do you have daemon node started(i.e. visor) ? Message "Node with BaselineTopology cannot join mixed cluster running in compatibility mode" looks like related to the issue https://issues.apache.org/jira/browse/IGNITE-8774 Evgenii 2018-07-24 11:10 GMT+03:00 Ray : > Following node fail

Re: ***UNCHECKED*** Executing SQL on cache using affinnity key

2018-07-25 Thread akash shinde
Hi Evgenii, Are you saying that if the affinityKey column is present in WHERE clause of SQL statement, the SQL engine will detect a node where this key is placed and execute this query only on one node. I just want to make sure that SQL gets executed only on node where the affinity key is

Re: Can't write to Ignite cluster when one node in baseline is down

2018-07-25 Thread Ray
Hi, I tried two cases for backup, which is backup=1 and no backup. Both cases failed with the exception I attached. I'm sure all 3 nodes are in baseline. I checked using ./control.sh --baseline command. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: ***UNCHECKED*** Executing SQL on cache using affinnity key

2018-07-25 Thread Prasad Bhalerao
I want to get the data from multiple caches using SELECT query from client node. The affinity key for all the caches is same. Since I know that the data in all caches is collocated, I just want make sure that sql gets executed only on one of the node(which is primary or secondary for that data)

Re: What is the difference between TcpCommunicationSpi & TcpTcpDiscoverySpi ?

2018-07-25 Thread Evgenii Zhuravlev
>Do you have reproducer? 2018-07-25 12:25 GMT+03:00 monstereo : > Yes same machine > > ezhuravlev wrote > >>What is the difference between TcpCommunicationSpi & TcpTcpDiscoverySpi ? > > https://stackoverflow.com/questions/37936833/difference-between- >

"Unable to await partitions release latch within timeout: ServerLatch" exception causing cluster freeze

2018-07-25 Thread Ray
I have a three node Ignite 2.6 cluster setup with the following config.

Re: Composite Queries

2018-07-25 Thread Evgenii Zhuravlev
Hi, CacheStore.loadCache is used to load data to the one cache only, so, you should implement one CacheStore, in which you will request data from 3rd party DB using select with joins. After it, you have to create your objects from this data and insert it into cache. Evgenii 2018-07-24 16:42

Re: Batch insert into ignite

2018-07-25 Thread Michael Cherkasov
Hi again, One more option as pure sql solution: https://apacheignite-sql.readme.io/docs/copy https://apacheignite-sql.readme.io/docs/set However, IgniteDataStreamer should work faster, because as I know, these SQL commands have data streamer as underlying implementation. Thanks, Mike.

Re: Errors with TCPCommunicationSpi when using zookeeper discovery

2018-07-25 Thread Ilya Kasnacheev
Hello! This might happen when there's connectivity problems, i.e. when node A can connect to node B but not vice versa. You can also try increasing socketWriteTimeout on communicationSpi if communication connections die mid-flight. Regards, -- Ilya Kasnacheev 2018-07-25 0:16 GMT+03:00

Re: If the authenticationEnabled is true Ignite web control conneced failed

2018-07-25 Thread ezhuravlev
As for now, web agent can't connect to the secure Ignite cluster, this functionality should be available with version 2.7 Evgenii -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Waiting too long, to load 7k datas to cache.... And Client gets null value

2018-07-25 Thread Ilya Kasnacheev
Hello! You can try // Wait until cache is fully populated locally while (igniteCache.localSize(CachePeekMode.ALL) < 200) { } System.out.println("Now consumer has all backup " + igniteCache.size()); System.out.println("Now decrease the latch");

Re: ***UNCHECKED*** Executing SQL on cache using affinnity key

2018-07-25 Thread Prasad Bhalerao
Are you saying that if the affinityKey is present in WHERE clause of SQL statement, the SQL engine will detect a node where this key is placed and execute this query only on one node. I just want to make sure that SQL gets executed only on node where the affinity key is placed. I was trying to

Re: What is the difference between TcpCommunicationSpi & TcpTcpDiscoverySpi ?

2018-07-25 Thread monstereo
? ezhuravlev wrote >>Do you have reproducer? > > > 2018-07-25 12:25 GMT+03:00 monstereo > mehmetozanguven@ > : > >> Yes same machine >> >> ezhuravlev wrote >> >>What is the difference between TcpCommunicationSpi & TcpTcpDiscoverySpi >> ? >> >

Re: "Unable to await partitions release latch within timeout: ServerLatch" exception causing cluster freeze

2018-07-25 Thread Pavel Kovalenko
Hello Ray, According to your attached log, It seems that you have some network problems. Could you please also share logs from nodes with temporary ids = [429edc2b-eb14-414f-a978-9bfe35443c8c, 6783732c-9a13-466f-800a-ad4c8d9be3bf]. The root cause should be on those nodes. 2018-07-25 13:03

Re: Ignite Cluster with remote server + Cassandra Persistence

2018-07-25 Thread okiesong
Thanks in advance. (This may be duplicate, as I forgot to put few other details. ) I am basically using the sample xml provided for Ignite TcpDiscoveryVmIpFinder, but with Cassandra third party persistence. public Ignite startIgnite { IgniteConfiguration cfg = new IgniteConfiguration();

RE: ***UNCHECKED*** Executing SQL on cache using affinnity key

2018-07-25 Thread Stanislav Lukyanov
Yes, that’s exactly how Ignite SQL works by default. Stan From: Prasad Bhalerao Sent: 25 июля 2018 г. 15:35 To: user@ignite.apache.org Subject: Re: ***UNCHECKED*** Executing SQL on cache using affinnity key I want to get the data from multiple caches using SELECT query from client node. The

Re: ***UNCHECKED*** Executing SQL on cache using affinnity key

2018-07-25 Thread Prasad Bhalerao
Hi Evgenii, Are you saying that if the affinityKey column is present in WHERE clause of SQL statement, the SQL engine will detect a node where this key is placed and execute this query only on one node. I just want to make sure that SQL gets executed only on node where the affinity key is placed.

Starvation on FileWriteHandle. AwaitNext

2018-07-25 Thread Paul Anderson
Any ideas? [2018-07-17T20:17:57,167][WARN ]grid-timeout-worker-#23[G] >>> Possible starvation in striped pool. Thread name: sys-stripe-5-#6 Queue: [] Deadlock: false Completed: 33447 Thread name="sys-stripe-5-#6", id=40, state=WAITING, blockCnt=0, waitCnt=67889 Lock

Re: Starvation on FileWriteHandle. AwaitNext

2018-07-25 Thread Dmitry Pavlov
Hi Paul, It looks like we wait for the next segment available, but currently segment is being archived. I guess wal-file-archiver thread does I/O operations. Sincerely, Dmitriy Pavlov ср, 25 июл. 2018 г. в 19:14, Paul Anderson : > Any ideas? > > [2018-07-17T20:17:57,167][WARN

Re: What is the difference between TcpCommunicationSpi & TcpTcpDiscoverySpi ?

2018-07-25 Thread monstereo
?? ezhuravlev wrote >>Do you have reproducer? > > > 2018-07-25 12:25 GMT+03:00 monstereo > mehmetozanguven@ > : > >> Yes same machine >> >> ezhuravlev wrote >> >>What is the difference between TcpCommunicationSpi & TcpTcpDiscoverySpi >> ? >> >

Re: Composite Queries

2018-07-25 Thread musclesonvacation
so your suggesting one cachestore that represents the composite, so basically create an in memory view? is there no way to load the four tables into memory, then from my client application node use a query with joins to pull a binaryobject? -- Sent from:

RE: What is the difference between TcpCommunicationSpi ?

2018-07-25 Thread Stanislav Lukyanov
Please don’t send messages like “?”. Mailing list is not a chatroom, messages need to be complete and meaningful. Reproducer is a code snippet or project that can be run standalone to reproduce the problem. The behavior you see isn’t expected nor known, so we need to see it before we can

Re: Errors with TCPCommunicationSpi when using zookeeper discovery

2018-07-25 Thread Larry Mark
The logs do not indicate any connectivity problem, unless I am missing it, in which case please point it out to me. The messages seem to be getting through fine, but the server thinks there is a connection which does not exist, so it rejects it. This seems to happen because the communication SPI

Partitioned vs Replicated mode

2018-07-25 Thread siva
Hi, We need to test the Partitioned vs Replicated cache modes.Since as per the documentation Replicated use for small data sets and where read operations frequently,Partitioned mode use for large data sets and where updates are frequently. But in our scenario each message we end up with more

Re: Ignite Cluster with remote server + Cassandra Persistence

2018-07-25 Thread okiesong
Hi, so I have provided my code structures, just in case my POJOExample.java looks as below; this is used for key-value setting for persistence setting for Cassandra. Thanks once again! POJOExample.java public class POJOExample implements Serializable{ @QuerySqlField(index=true,

RE: What is the difference between TcpCommunicationSpi ?

2018-07-25 Thread monstereo
sorry, there is no reproducure Stanislav Lukyanov wrote > Please don’t send messages like “?”. Mailing list is not a chatroom, > messages need to be complete and meaningful. > > Reproducer is a code snippet or project that can be run standalone to > reproduce the problem. > The behavior you see

Re: Ignite Cluster with remote server + Cassandra Persistence

2018-07-25 Thread okiesong
Hi, so I have provided my code structures, just in case my POJOExample.java looks as below; this is used for key-value setting for persistence setting for Cassandra. Thanks once again! POJOExample.java public class POJOExample implements Serializable{ @QuerySqlField(index=true,

CacheMetrics does not show the correct results

2018-07-25 Thread monstereo
code that is generated cache values public static void populateCache(IgniteCache igniteCache){ for (int i = 0; i < 1; i++){ igniteCache.put(i, String.valueOf(i)); } } public static void main(String[] args) { Ignite node1 =

service deploy cluster singleton lock application

2018-07-25 Thread sergey.dolinkov
I try create spring java application with apache ignite inside. When application startup it deploy service(cluster singleton) to cluster. (it`s ok) But when i start second node which deploy this service too it is locked. why this hapends ? Apache Ignite 2.5.0 code of service class: public