How to check if key exists in DataStreamer buffer so that it can be flushed?

Hi, I have a data streamer to load data into a cache. While loading I might need to update value of a particular key in cache, so I need to check if it is already there in the streamer buffer. If so, either I need to update value against that key in the buffer or I need to flush the data in the

Re: ignte cluster hang with GridCachePartitionExchangeManager

I can reproduce the bug, above log is the server(first) node print when I stop other nodes . import java.io.IOException; import java.util.ArrayList; import java.util.Arrays; import java.util.concurrent.CompletableFuture; import java.util.concurrent.ExecutorService; import

Re: Affinity key in SQL execution

3. I did not understand your answer in point 3. I must join by userId to get the correct data. Are you saying that (c1.affinityId = c2.affinityId) condition should be included in on clause? If I rewrite SQL as follows, will it work? Select * from cache1 c1 join cache2 c2 on ( c1.userId =

Can Ignite.getOrCreateCache(CacheConfiguration) return null ?

Hi all, Is there any possibility for this to happen ? We're using Ignite 1.9.0 Following is the code we use to obtain the cache. And we call this line for every cache operation(unintentionally), but wanted to know if following line can return a null cache instance under any circumstance. Cache

Re: Affinity key in SQL execution

3. I did not understand your answer in point 3. My colocation strategy as follows: I have around 20 caches. These caches contains subscription's data. I have around 5000 subscriptions. Affinity key for all 20 caches in "subscriptionId". This is done to make sure that data in all 20 caches

keep old cache value than new value

Hi, Is there any feature in ignite through which I can decide whether to keep the old value or new value in a cache? We have few cases when the update comes from the persistence store we want do not want to update the cache value and want to keep the old one. Thanks, Luqman -- Sent from:

Re: unsubscribe

Ignite community is helpful even to those who leaves :) -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Affinity key in SQL execution

Prasad, 1. Yes, you will always see it in the execution plan because there are always two stages. Of course, if only one server node participates in the execution, the reduce stage is effectively no-op. 2. Yes, you need to put the annotation to make sure you can access it from queries. I would

Unable to create an index

Index query: CREATE INDEX IF NOT EXISTS DA_Something_Idx on DeviceAvailability(somethingUuid,blahId,blah2Id,blahDate,blah2Date,blahType,blah3Id); Error in logs (ive removed/fudged some values for privacy reasons):

Re: unsubscribe

Found it ironic that Murthy received support in his unsubscribe request. :D On Tue, Aug 28, 2018 at 3:50 PM Murthy Kakarlamudi wrote: > Thanks Alexey. > > On Tue, Aug 28, 2018 at 8:08 AM Alexey Goncharuk < > alexey.goncha...@gmail.com> wrote: > >> Hi Murthy, >> >> You should use

Re: unsubscribe

Thanks Alexey. On Tue, Aug 28, 2018 at 8:08 AM Alexey Goncharuk wrote: > Hi Murthy, > > You should use user-unsubscr...@ignite.apache.org in order to unsubscribe > from the list. > > Cheers, > Alexey > > вт, 28 авг. 2018 г. в 5:37, Murthy Kakarlamudi : > >> >>

BinaryMarshaller (micro) Benchmark

Hello, I am puzzled by a micro-benchmark I made and that you can find here: https://github.com/hostettler/IgnitePerfTest.git To reproduce the below results, just run: $ mvn clean install $ cd target $ java -Xmx512m -Xmx512m -XX:+UseG1GC -jar

ICacheEntryProcessor throws BinaryObjectException when WRITE_SYNCHRONIZATION_MODE=FULL_ASYNC

Hi, We are testing WRITE_SYNCHRONIZATION_MODE=FULL_ASYNC mode to compare performance to PRIMARY_SYNC.These same code works fine in PRIMARY_SYNC, but it throws BinaryObjectException on FULL_ASYNC mode. Would you please recommend any way to fix this issue ?Thanks!*Environment: * ignite 2.6 jdk 8

Re: Drop table taking more time for execution

Hello! This use case doesn't sound very real-time, so I have to repeat my question, why is it considered a problem by you? -- Ilya Kasnacheev вт, 28 авг. 2018 г. в 19:49, Sriveena Mattaparthi < sriveena.mattapar...@ekaplus.com>: > Hi Ilya.. > We load data from various data sources to ignite

Re: Drop table taking more time for execution

Hi Ilya.. We load data from various data sources to ignite as tables and run data join queries on ignite and sends the response back. Next time if there is change in the data from the data source in terms of addition of new column or delete column...Then we drop the table in ignite and

Re: Data Compresion in Ignite

Hello! 1. https://apacheignite.readme.io/docs/memory-architecture 2. No. 3. Roughly the same. Disk has more meta-data that is needed to swap data in and out, there's WAL, etc... But pages are the same. Regards, -- Ilya Kasnacheev вт, 28 авг. 2018 г. в 18:35, ApacheUser : > Hi Team, > > We

Re: What happens during network failure?

I mainly want to know whether the detached need would join the cluster automatically after the network is back or not? On Tue, Aug 28, 2018, 8:09 PM Lokesh Sharma wrote: > What is the expected behaviour of Ignite when a node is unreachable from > other nodes of the cluster due to *network

Data Compresion in Ignite

Hi Team, We are using persistent storage . Could you please answer the following. 1. What is the data format(Binary?) . 2. Is it compressed on Disc and in Memory? 3. Is the Data format in Memory on Disc same? Thanks -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: C++ affinity key set up

Hello! I have just ran your code with two nodes, and I could not observe any case where two Key()s will be on different nodes with same id but different flag. They're always on the same node Can you please elaborate how you got that result? Regards, -- Sent from:

Re: Difference between replicated and local cache mode regarding time execution of query

Hello! Can you try setting replicatedOnly(true) hint on SqlFieldsQuery, or ;replicatedOnly=true parameter for Ignite Thin JDBC Driver? This will prevent query to be distributed between nodes. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Drop table taking more time for execution

Hello! First of all, what is the problem that you are facing? Why DROP TABLE taking 15s while being ran infrequently is a cause for concern? Regards, -- Ilya Kasnacheev вт, 28 авг. 2018 г. в 17:42, Sriveena Mattaparthi < sriveena.mattapar...@ekaplus.com>: > Thanks Ilya for the quick reply..

Re: Drop table taking more time for execution

Thanks Ilya for the quick reply.. We have to drop the table in few cases where the table columns and datatypes changes ... I guess alter table to add/ drop columns may take same longer time. Any other alternative to drop table? Regards, Sriveena From: Ilya

What happens during network failure?

What is the expected behaviour of Ignite when a node is unreachable from other nodes of the cluster due to *network failure *(and not due to node failure), and after a while the node is again accessible from the cluster? In other words, one node gets dropped from the cluster due to network failure

Re: Cache Configuration Templates

I did a suggested edit adding the Spring configuration of templates.The rest of the current semantics seem a bit odd, so I was somewhat at a loss as to what to write. The wildcard approach means that I have to know the structure of the cache name a priori. Seems like there should be a Java

Re: Drop table taking more time for execution

Hello! As far as my understanding goes, DROP TABLE will usually destroy a cache, and that will require partition map exchange, which in turn will wait for all operations to finish. With increase of load and cluster size 15s does not seem excessive. The suggestion is to avoid dropping/creating

Re: ignte cluster hang with GridCachePartitionExchangeManager

Hello! Please check that there are no problems with connectivity in your cluster, i.e. that all nodes can open communication and discovery connections to all other nodes. >From what I observe in the log, there are massive problems with cluster stability: 23:48:44.624

Drop table taking more time for execution

Hi, Execution of drop table command is taking 15 sec on client node.Any suggestions to spewed up the execution. Thanks & Regards, Sriveena "Confidentiality Notice: The contents of this email message and any attachments are intended solely for the addressee(s) and may contain confidential

Simulate Read Only Caches

Hello, I do have a bunch of caches that I would like to have replicated but to keep them "read only" after a certain point. It is a fairly standard use case. There are master (exchange rates) that are fixed once and for all for a given (set of processes). Once loaded there is no reason to bother

Re: apache ignite cassandra persistentStore for enum fields

Hello! I think that VARCHAR option is only available when object is passed to cache store in deserialized (POJO) form. If it is passed in serialized (BinaryObject) form then it will always store ordinal. And, for some reason, after https://issues.apache.org/jira/browse/IGNITE-4949 for

Re: How many threads does ignite.executorService() have.

Hi, Executor service may be described as a distributed pool which executes it's tasks on any cluster node or any node from a given subset of nodes. If you feel any necessity to configure this thread pool, you may set up public thread pool size as described here:

Re: How many threads does ignite.executorService() have.

Hello, Usually, the size of a thread pool is max(8, total number of CPU's). The details about configuration particular thread pools can be found here: https://apacheignite.readme.io/docs/thread-pools Thanks, S. вт, 28 авг. 2018 г. в 15:49, begineer : > Hi Guys, > I have one simple query about

Re: Reaching Ignite's maximum throughput

Hello! I think that centralized databases will have more optimizations for cases when serializable transactions don't really ever affect each other, but as you will increase amount of work in transaction, making them eventually touching each other's data, I expect the performance will be rapidly

Re: Question on DiscoveryCustomEvent

Hello, StopRoutineDiscoveryMessage is sent when a continuous query is stopped (when query cursor is closed) to unregister listener on all nodes. DiscoveryCustomEvent is an internal API event, what for you listening to this type of events? вт, 28 авг. 2018 г. в 12:43, Sashika : > Hi, > > In one

How many threads does ignite.executorService() have.

Hi Guys, I have one simple query about ignite executor service. I know java executor service accepts the no of threads to be run, but there is no option to pass no of threads to ignite executor service. So how does it manage threads to be started. many thanks -- Sent from:

ignite multi thread stop bug

In my test case:see the attachment.I can reproduce the bug 1. testStartServer 2. testMultiClient 3. close testMultiClient 4. then testStartServer will Failed to wait for partition map exchang I need update cache in DiscoveryEvent. how to fix this?

Re: unsubscribe

Hi Murthy, You should use user-unsubscr...@ignite.apache.org in order to unsubscribe from the list. Cheers, Alexey вт, 28 авг. 2018 г. в 5:37, Murthy Kakarlamudi : > >

Data migration using persistent Queues

Let's imagine the following scenario. We have a queue (distributed in a cluster and partitioned) with a persistent storage. We add Person ( name : String ) to it. Then, because of business requirements we will add another field let's say address which is also o String. What options do we have to

Re: custom plugin question - jdbc client

Hi, You are absolutely right. In case you use thin JDBC driver (recommended): 1. You have to define SSLContext factory for client connector for Ignite node [1] 2. And setup SSL socket factory for Ignite thin JDBC driver [2] If you are going to use JDBCv2 driver please keep in mind that the

Question on DiscoveryCustomEvent

Hi, In one of our code segments, we evaluate a condition to check whether the event received by local listener is an instance of DiscoveryCustomEvent. Then if it is true we get the customMessage from it and check whether the message is an instance of StopRoutineDiscoveryMessage. Our

Difference between replicated and local cache mode regarding time execution of query

Hi, I have this query (used Explain on original query): SELECT COUNT(DISTINCT _1__Z3.IP) AS __X0 FROM ( SELECT ENDPOINT__Z0___KEY AS IP, ENDPOINT__Z0__ELEMENTID AS TARGET, CASEWHEN((ENDPOINT__Z0__STATUS IS NOT 'RULES_PENDING_ADD'), ENDPOINT__Z0__STATUS,

custom plugin question - jdbc client

i have finally managed to get a plugin working for a white list on ignite 2.6. I am now going to start working on an authorization for users connecting to the cluster. How can i get clients pass through a kerberos ticket to the cluster? I think i need to override the authorization context class

Re: apache ignite cassandra persistentStore for enum fields

Hi Ilya, Thank you for your advice. It does work now when I put my class as the javaFieldType. However one thing still does bother me. Previously you advised that Ignite will determine itself if the enum is ORDINAL or a STRING and store accordingly - either Ordinal or the Name. So I have

Re: How to run a job every 5 seconds in Ignite

Hi Lokesh, You could try out extended cron syntax implemented by Ignite [1]. [1] https://apacheignite.readme.io/docs/cron-based-scheduling#section-syntax-extension 2018-08-28 10:51 GMT+03:00 Lokesh Sharma : > Is it possible to run the job every few seconds? As far as I know, cron > API

Re: How to run a job every 5 seconds in Ignite

Is it possible to run the job every few seconds? As far as I know, cron API doesn't support scheduling in seconds. On Tue, Aug 28, 2018 at 11:27 AM Lokesh Sharma wrote: > This is what I was looking for. Many thanks! > > On Mon, Aug 27, 2018 at 3:01 PM Evgenii Zhuravlev < >