Re: Question regarding text search in ignite

2024-04-15 Thread Pavel Tupitsyn
Hi Satyajit, we (Ignite community members) are subscribed to Stackoverflow too. I don't have anything to add to the existing answer there. On Mon, Apr 15, 2024 at 8:09 AM wrote: > Hi Pavel/Team, > > > > Is the below explanation holds good from your side. Need some > confirmation on high

Question regarding text search in ignite

2024-04-14 Thread satyajit.mandal.barclays.com via user
Hi Pavel/Team, Is the below explanation holds good from your side. Need some confirmation on highlighted line in yellow. We are not using Native persistence. Our cluster is in memory with external cache store enabled. https://stackoverflow.com/questions/70232020/ignite-

RE: Re: Question about REST/C++ client

2024-02-20 Thread Louis C
latest/data-structures/atomic-types > > On Wed, 14 Feb 2024 at 17:38, Louis C wrote: > > > Hello, > > > > Thanks for your answers Igor and Stephen. > > Igor, to answer your question to the second point I used the same term as > > used in the Rest API, but ind

Re: Question about REST/C++ client

2024-02-19 Thread Stephen Darlington
your answers Igor and Stephen. > Igor, to answer your question to the second point I used the same term as > used in the Rest API, but indeed it more or less what you said (even if > in this API we do not have to retrieve explicitely the base value). > Best regards, > Louis >

RE: Question about REST/C++ client

2024-02-14 Thread Louis C
Hello, Thanks for your answers Igor and Stephen. Igor, to answer your question to the second point I used the same term as used in the Rest API[cid:ab48a0d9-3170-457d-a922-c37cacd9171f], but indeed it more or less what you said (even if in this API we do not have to retrieve explicitely the

Re: Question about REST/C++ client

2024-02-13 Thread Stephen Darlington
The easy answer to the "50 gets in parallel" is to use GetAll. On Tue, 13 Feb 2024 at 09:54, Igor Sapego wrote: > 1. There is no such API. Seems like a weird error in documentation. We > will fix it. If you want to make 50 gets in parallel, I think it's better > to run 50 clients with the curren

Re: Question about REST/C++ client

2024-02-13 Thread Igor Sapego
1. There is no such API. Seems like a weird error in documentation. We will fix it. If you want to make 50 gets in parallel, I think it's better to run 50 clients with the current API. You can use the same client too, but it may be slower, depending on how many nodes you have in a cluster. 2. What

Question about REST/C++ client

2024-02-08 Thread Louis C
Hello, I am trying to use/test Apache Ignite for a particular use case. For background reference, my use case of Ignite is to do 100Ks (to begin with) of "Gets" and of "increments" of values that will be stored in probably multiple caches in Apache Ignite. I read the Ignite documentation, but

Re: Question about JDBC polymorphism

2023-09-07 Thread Bram Biesbrouck
Hi Stephen, Your answer totally makes sense, thank you. greets, b. *Creative engineering & inventions* Check our latest projects! *Bram Biesbrouck* bram.biesbro...@reinvention.be +32 486 118280 <0032%20486%20118280> On Wed, Sep 6, 2023 at

Re: Question about JDBC polymorphism

2023-09-06 Thread Stephen Darlington
The most straightforward answer might just be to create views in your source database. Out of the box, the cache store is really designed for a 1:1 mapping between table and cache. You *can* do more complex mappings, but it may require coding. On Wed, 6 Sept 2023 at 09:46, Bram Biesbrouck < bram.b

Question about JDBC polymorphism

2023-09-06 Thread Bram Biesbrouck
Hi all, I've been experimenting with Ignite over the past months and took an unexpected (pleasant) deep dive. Right now, I'm fiddling around with write-through and read-through, but I'm stuck on one feature I'd really want to find a solution for database table discriminator values and mapping the

Re: Simple question relating to multiple data regions with persistence

2023-08-13 Thread Raymond Wilson
Actually, ignore that question. I was conflating storage and data region configurations so my question is invalid! On Mon, Aug 14, 2023 at 11:40 AM Raymond Wilson wrote: > I am looking at defining additional data regions with persistence to > support cache with some different settings (eg

Simple question relating to multiple data regions with persistence

2023-08-13 Thread Raymond Wilson
I am looking at defining additional data regions with persistence to support cache with some different settings (eg: page size, synchronization mode). After reading https://ignite.apache.org/docs/latest/persistence/native-persistence#enabling-persistent-storage I am not sure if I should specify di

Re: Ignite Affinity - sql join Question

2023-06-14 Thread MJ
Tested SqlQueriesExample.java of ignite 2.13.0 - the inside sqlQueryWithJoin method, it still prints out below warning message when executing the join sql on COLLOCATED_PERSON_CACHE. So that's a false positive ? [ WARN] - For join two partitioned tables join condition should contain the equality

Re: Ignite Affinity - sql join Question

2023-06-13 Thread Jiang Jacky
6733...@qq.com> Sent: Tuesday, June 13, 2023 1:24:48 AM To: user Subject: Re: Ignite Affinity - sql join Question No luck. With the change its throwing exception BinaryObjectImpl cannot be cast to java.lang.String when it tried to put a new entey into "companies" cache. B

Re: Ignite Affinity - sql join Question

2023-06-12 Thread MJ
No luck.  With the change its throwing exception BinaryObjectImpl cannot be cast to java.lang.String  when it tried to put a new entey into "companies" cache. Beside, there is already the @AffinityKeyMapped annotation on companyId field of PersioKey class.  AffinityKey needs to be marked on sq

Re: Ignite Affinity - sql join Question

2023-06-12 Thread Jiang Jacky
y, June 12, 2023 10:46:23 PM To: Chandranana Naik via user Subject: Ignite Affinity - sql join Question hi Igniters, Can you pls advise below ? It always prints out below WARN message in server side when I am trying to use the sql join . Anything wrong with my configuration or testing code ? Is

Ignite Affinity - sql join Question

2023-06-12 Thread MJ
hi Igniters, Can you pls advise below ? It always prints out below WARN message in server side when I am trying to use the sql join .  Anything wrong with my configuration or testing code ? Is it possible to eliminate that WARN message ?   [ WARN] org.apache.ignite.internal.processors.qu

Re: Question on BinaryObject

2023-01-17 Thread Pavel Tupitsyn
Hello, yes, your understanding is correct. On Tue, Jan 17, 2023 at 6:46 PM Peter wrote: > Hello, > > Do I understand correctly, that each BinaryObject that is returned by > IgniteCache.get() and IgniteCache.getAll() method calls on a local node > contains an internal on-heap byte array, and obj

Question on BinaryObject

2023-01-17 Thread Peter
Hello, Do I understand correctly, that each BinaryObject that is returned by IgniteCache.get() and IgniteCache.getAll() method calls on a local node contains an internal on-heap byte array, and object unmarshalling occurs from that array, and not from off-heap memory?

Question about Maintenance Action

2022-06-01 Thread Gary Ng Kwong Sang
Hi, I have a question. Is it possible to query Maintenance Action in a non-programmatic way, that is, without using the Java API? Or at least accessing the Maintenance Registry to know what Maintenance Actions need to be done? I am thinking that in the case of an unexpected event that would

Re: Question about the starting order of REPLICATED + Persist cluster

2022-05-06 Thread Maxim Muzafarov
eline-topology-in-persistent-clusters On Tue, 3 May 2022 at 05:42, 송인걸 wrote: > > Hello, I have a question while using Ignite. > > 3 nodes A, B, C are using persistent storage in REPLICATED mode. > > First, node A stops and other nodes work continues. > After a while node B stops

Question about the starting order of REPLICATED + Persist cluster

2022-05-02 Thread 송인걸
Hello, I have a question while using Ignite. 3 nodes A, B, C are using persistent storage in REPLICATED mode. First, node A stops and other nodes work continues. After a while node B stops, and node C stops The ideal drive sequence would be C -> B -> A. My Question is 1) Is there any

question about integration with spark dataframe

2022-04-14 Thread wilson
hello I am reading the docs, https://ignite.apache.org/docs/latest/extensions-and-integrations/ignite-for-spark/ignite-dataframe I am curious for what use scenario Ignite should read spark's dataframe? Thanks

Re: Question about Peer class loading

2022-01-21 Thread Stephen Darlington
Sadly it’s pretty simple: you can’t peer class load a service. The classes need to be deployed on the nodes before service is initiated. > On 21 Jan 2022, at 15:00, tore yang wrote: > > I have enabled Peer class loading feature in the cluster, it works find when > I run a task. However when I

Re: security issues question

2021-11-18 Thread Shishkov Ilya
Hi Timothy, > Does this have security issues since everyone can access the port and do cache reading/writing? In addition to iptables rules, you can disable Thin/JDBC/ODBC protocols. More information you can get from [1] and corresponding references (setThinClientEnabled/setOdbcEnabled/setJdbcEna

Re: security issues question

2021-11-18 Thread Gianluca Bonetti
Hello Timothy I usually add iptables rules on top of every deployment, to block access from unknown locations to Apache Ignite and other services (Tomcat to name one, and others) My typical iptables rules, embedded into /etc/rc.local looks like this: iptables -A INPUT -p tcp --match multiport --

security issues question

2021-11-17 Thread Timothy Peng
Hello, I saw Ignite is listening on all interfaces by default: tcp6 0 0 :::10800:::*LISTEN 3211/java Does this have security issues since everyone can access the port and do cache reading/writing? Thanks

The question about baseline、backup and Disaster recovery

2021-10-12 Thread 常鑫
Hi All, We are using Ignite 2.10.0 and we have a question about Partition Backups、baselineAutoAdjust and Disaster recovery. We have three nodes:A、B、C,and baseline auto adjustment enabled、no backup, if one of them is down,for example ,node C is down,then the baseline topology cannot

Question about ShutdownPolicy

2021-10-11 Thread 常鑫
Hi All, There is a sentence in the start and stop chapter of the developer's guide, "A graceful shutdown allows the node to finish critical operations and correctly complete its lifecycle", and I want to know the critical operations,so I read the source code.But I found that no matter what the

Help with my ignite stackoverflow question

2021-07-28 Thread obinna henry
Hi, please could someone take a look and help me with this? Ignite Jdbc SQL COPY FROM command executing but not importing data | | | | | | | | | | | Ignite Jdbc SQL COPY FROM command executing but not importing data I have a java code that exports data from postgresql into a csv fil

[Ignite Summit] The most popular question after Ignite Summit

2021-05-26 Thread Kseniya Romanova
, asked questions, and cheered up the speakers! I am getting back to the subject of the email. The most popular question to the Summit team is, “When are the videos available?”. So let me answer: everyone who registered for the Summit will get the email early next week. If you missed the event

Re: IA 2.8.1 C# Client ICacheAffinity question

2021-03-04 Thread Pavel Tupitsyn
> identify all backup partitions on a given clusternode which are backups of primary partitions on another cluster node > I am running on Node A and want to know which partitions from Node B does Node A have a backup for If I understood this correctly, the following should work: IClusterNode a, b

IA 2.8.1 C# Client ICacheAffinity question

2021-03-03 Thread Raymond Wilson
The ICacheAffinity interface provides a collection of methods to determine partitions from keys, and nodes from partitions. The GetBackupPartitions() method will return all partitions for which the given clusternode is a backup. This is handy if you want to identify backup partitions on a node.

[2.7.6] Question about BinaryObject/SQL schema

2021-01-26 Thread maxi628
Hello everyone. I'm creating a partitioned cache with persistence enabled. I use java's thin client to connect my app to ignite. I have a pool of reusable connections, as suggested in the documentation since IgniteClient isn't thread safe. After the cache is created, I'm using SQL "ALTER TABLE" t

Re: Question about baseline topology and cluster activation

2020-10-27 Thread akorensh
Hi, What I forgot is to put in a check if the cluster is already activated and do not do activation. If you don't activate the first time then the cluster will remain in an inactive state and will not process requests to store/read data: https://ignite.apache.org/docs/latest/clustering/base

Question about baseline topology and cluster activation

2020-10-27 Thread Sabyasachi Biswas
Hello All, While reading the documentation at https://apacheignite.readme.io/docs/baseline-topology#activating-the-cluster , there it is stated "you need to manually activate the cluster the first time". We are doing it via code thus, ignite.cluster().active(true);. Then we set the topology by cod

Re: Question about Ignite persistence disk space used after clearing cache

2020-09-26 Thread Scott Prater
5, 2020 at 1:52 PM Scott Prater wrote: > >> I have a question about how the off-heap usage is reported when Ignite >> persistence is configured. I have a single node set up. I stored about >> 1GB of items in the cache, then cleared the cache (remotely, using the Java >>

Re: Question about Ignite persistence disk space used after clearing cache

2020-09-25 Thread Denis Magda
/administrators-guide/monitoring-metrics/metrics#allocated-space-vs-actual-size-of-data - Denis On Fri, Sep 25, 2020 at 1:52 PM Scott Prater wrote: > I have a question about how the off-heap usage is reported when Ignite > persistence is configured. I have a single node set up. I stored about

Question about Ignite persistence disk space used after clearing cache

2020-09-25 Thread Scott Prater
I have a question about how the off-heap usage is reported when Ignite persistence is configured. I have a single node set up. I stored about 1GB of items in the cache, then cleared the cache (remotely, using the Java thin client: ClientCache.clear()). I then verified that the items were no

Re: question about collation with an ignite set

2020-08-04 Thread Ilya Kasnacheev
Hello! Why don't you set cacheMode to REPLICATED? Partitions in replicated caches should not be lost. Regards, -- Ilya Kasnacheev пн, 3 авг. 2020 г. в 08:35, scottmf : > hi, If I setup my *Ignite Set* as specified below what will happen when a > node leaves the cluster topology forever? Will

Re: Question in Continuous Query Remote Filter

2020-08-03 Thread Evgenii Zhuravlev
I believe Java doc should be enough for that: https://ignite.apache.org/releases/latest/javadoc/org/apache/ignite/cache/query/ContinuousQuery.html It says: To stop receiving updates call QueryCursor.close()

Re: question about collation with an ignite set

2020-08-03 Thread scottmf
thanks Vlad,It doesn't look like /CollectionConfiguration/ has the ability to set the partition loss policy you specified. So the / cacheConfiguration.setCollocated(true);/ setting will locate all the elements on one cluster node? My hope was that it would keep the elements created by the node lo

Re: question about collation with an ignite set

2020-08-02 Thread Vladislav Pyatkov
Scott, In my thought it has to depend of a partition lose policy on cluster[1]. Because a contains of distributed collection stored in system Ignite cache, that obeys rules of all cluster caches. [1]: https://apacheignite.readme.io/docs/partition-loss-policies On Mon, Aug 3, 2020 at 8:35 AM scot

question about collation with an ignite set

2020-08-02 Thread scottmf
hi,If I setup my /Ignite Set/ as specified below what will happen when a node leaves the cluster topology forever? Will I simply lose the elements which are stored locally - via collation = true - or will I run into problems? Overall I want the all cluster nodes to be aware of all elements in the

Re: Question in Continuous Query Remote Filter

2020-08-01 Thread Devakumar J
Hi, Thanks for the reply. Do we have any document reference for stopping/unsubscribing registered CQ listeners. Thanks & Regards, Devakumar J -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Question in Continuous Query Remote Filter

2020-07-31 Thread Evgenii Zhuravlev
Hi, You can just stop the CQ and then register it again if you don't want to get notifications for some period of time. Evgenii пт, 31 июл. 2020 г. в 01:51, Devakumar J : > Hi All, > > We have a setup of 2 servers and 1 client Node. Client node registers CQ on > set of caches. > > I just want t

Question in Continuous Query Remote Filter

2020-07-31 Thread Devakumar J
Hi All, We have a setup of 2 servers and 1 client Node. Client node registers CQ on set of caches. I just want to temporarily pause and resume CQ notifications based on certain action at client node. I was trying to achieve this through remote filter and ignite messaging. I mean client publish m

Re: A question regarding cluster groups

2020-07-24 Thread aealexsandrov
Hi, 1)No, at the moment there is no such implementation out of the box. You should create your own implementation of data moving tool. 2)At the moment there is no such implementation too. However, I see that there is the discussion about it on developer user list: http://apache-ignite-developers

Re: A question regarding cluster groups

2020-07-22 Thread adipro
Thanks for the reply denis. A few follow up questions. 1. Is there any way I can move the data from one cluster node to other cluster node. Like exporting work folder or something like that periodically. 2. Is there any snapshot of data concept that can be done periodically and push it to somewhe

Re: A question regarding cluster groups

2020-07-22 Thread Denis Magda
tya Harish < aditya.har...@zohocorp.com> wrote: > Hi Alex, I've an important question to ask. Can you please answer this. > > Let us say I've two server nodes in one data center DC1 and two more > server nodes in another data center DC2. Two data centers have some network &

Re: A question regarding cluster groups

2020-07-22 Thread adipro
Can someone please reply to this thread. It's kind of urgency. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

A question regarding cluster groups

2020-07-22 Thread adipro
Let us say I've two server nodes in one data center DC1 and two more server nodes in another data center DC2. Two data centers have some network delay. Now I'm using SQL select statements on caches which are replicated. Now those caches' write synchronization mode is FULL_SYNC. Now at a time we

A question regarding cluster groups

2020-07-22 Thread R S S Aditya Harish
Hi Alex, I've an important question to ask. Can you please answer this. Let us say I've two server nodes in one data center DC1 and two more server nodes in another data center DC2. Two data centers have some network delay. Now I'm using SQL select statements on caches which

Re: question about node segment and split brain

2020-07-15 Thread Ilya Kasnacheev
Hello! 1. if gc time > failureDetectionTimeout. 2. No, NODE_SEGMENTED is reserved for case where node is excluded from cluster, alone, and not able to function as a single-node cluster (explicitly removed from cluster). 3. I've never seen splitting into two clusters. 4. Perhaps, but see above. Re

question about node segment and split brain

2020-07-02 Thread bbweb
Hi,  we are considering ignite for mission critical system and concerning about node segmentation and split brain problem. I searched for current documents and suggestions but still have some questions in the following, please help and thanks in advance: 1、For long gc case , when a node has long gc

Re: Question on Key choice for an Ignite cache

2020-06-30 Thread Denis Magda
He Eugene, To elaborate on Ilya's answer, you can define a POJO for your key like as follows: public class AccountKey { String email; String phoneNumber; //don't forget to implement equals() and hashCode() so // that Ignite partitions and locates your records properly } and then

Re: Question on Key choice for an Ignite cache

2020-06-30 Thread Eugene McGowan
On Tue 30 Jun 2020, 13:51 Ilya Kasnacheev, wrote: > Hello! > > You can also use Binary Object (POJO) as a key, i.e., you can use an > Object with String email and String phone fields. > > I don't recommend mangling strings further than concatenation. String key > is no worse than numeric key. > >

Re: Question on Key choice for an Ignite cache

2020-06-30 Thread Ilya Kasnacheev
Hello! You can also use Binary Object (POJO) as a key, i.e., you can use an Object with String email and String phone fields. I don't recommend mangling strings further than concatenation. String key is no worse than numeric key. Regards, -- Ilya Kasnacheev вт, 30 июн. 2020 г. в 15:17, Eugene

Question on Key choice for an Ignite cache

2020-06-30 Thread Eugene McGowan
We would like to create an Ignite key by concatenating data. This is a standard distributed system pattern for key-value, and would allow the reader and writer consistently access the cache. The data is a combination of strings and integers. To simplify our use case, lets say its an email address

Re: Data Consistency Question

2020-06-19 Thread Ilya Kasnacheev
Hello! I'm not sure what you are trying to do and why you felt the need to over-complicate the solution. Regards, -- Ilya Kasnacheev пн, 15 июн. 2020 г. в 09:10, adipro : > Can you please suggest an efficient solution? > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >

Re: Data Consistency Question

2020-06-15 Thread adipro
Can you please suggest an efficient solution? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: UriDeployment Question

2020-06-09 Thread Ilya Kasnacheev
Hello! It's hard to say what happens here, especially considering 'osgi' in package name. I recommend putting all dependencies on all nodes as JARs and only peer loading your own code. Regards, -- Ilya Kasnacheev пт, 5 июн. 2020 г. в 06:05, marble.zh...@coinflex.com < marble.zh...@coinflex.co

Re: Question regarding topology

2020-06-08 Thread Alexandr Shapkin
Hello! It's not clear, whether the code snippet came from a client or a server. If it's a client, then I'd recommend you try sending the keys and additional data directly to a server node and perform the insertion directly on the node. The Compute API could be an option here [1] You might also wa

Re: Data Consistency Question

2020-06-08 Thread Ilya Kasnacheev
Hello! Why do you open connection inside the semaphore? You are supposed to open connection(s) in advance, only issue updates inside the semaphore. The whole approach is questionable (no sense to use thin JDBC if you already have Ignite node) but this one is a killer. You also seem to open a new

Re: UriDeployment Question

2020-06-05 Thread marble.zh...@coinflex.com
complete exception is like below, Exception in thread "grid-uri-scanner-#2" java.lang.NoClassDefFoundError: org/osgi/service/jdbc/DataSourceFactory at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:756) at java.secu

Re: UriDeployment Question

2020-06-04 Thread marble.zh...@coinflex.com
I tried even with the 2.8.1, but exception still there, I have already copied the ignite-osgi and ignite-osgi-paxlogging libs to the ./libs folder, java.lang.NoClassDefFoundError: org/osgi/service/jdbc/DataSourceFactory at java.lang.ClassLoader.defineClass1(Native Method) at java.

Re: UriDeployment Question

2020-06-04 Thread marble.zh...@coinflex.com
thanks, i am using 2.8.0 version. btw, when start the server, met below exception, I am not sure if due to this issue, Caused by: java.lang.ClassNotFoundException: org.osgi.framework.BundleActivator at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassL

Re: UriDeployment Question

2020-06-04 Thread Evgenii Zhuravlev
Hi, What version of Ignite do you use? It started to work with jar files only since version 2.8: https://issues.apache.org/jira/browse/IGNITE-11380. When it reads file, it prints message to the log: Found new or updated deployment unit Do you have it in your logs? Yes, you don't need to restart

UriDeployment Question

2020-06-04 Thread marble.zh...@coinflex.com
Hi Expert, I am trying the UriDeployment, the xml setting is, file:///home/myProjects/price-processor-ignite/target/ When ignite startup, I can find the something generated in

Re: Question regarding topology

2020-06-04 Thread adipro
Can someone please help with this case? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Question regarding topology

2020-06-03 Thread adipro
Also, In SQL query, we are having a semaphore lock where all the threads stay there and only one thread can execute the code. It's because in the code, we have jdbc connection query. And it's not thread safe. Sometimes we even get thread hanging here if we keep increasing client worker threads. Is

Re: Question regarding topology

2020-06-03 Thread adipro
Thanks for reply. Our clients are connected in both ways one is JCache way and other is SQL way each for various caches. -> For get/put we use normal getAll() and normal putAll(). The thing is here all the threads will have their own data and the data is not shared. So no need to worry about data

Question regarding topology

2020-06-03 Thread adipro
If I have a cache named "XYZ" with replication mode ON then what happens for the queries if the topology configuration is as below. 1) Two app servers (clients) which make total 100 connections (50 each) in parallel as it's multi-threaded application. Both are 64 core machines. 2) Two DB servers (

Re: Data Consistency Question

2020-06-03 Thread adipro
Can someone please help regarding this issue? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Question regarding topology

2020-06-03 Thread Stephen Darlington
How are your clients connected? Are they thick or thin clients? And what are the queries? Are they JCache (i.e., get/put) or SQL? > On 3 Jun 2020, at 08:54, adipro wrote: > > If I have a cache named "XYZ" with replication mode ON then what happens for > the queries if the topology configuration

Re: Data Consistency Question

2020-05-31 Thread adipro
Thanks for the reply. But I've two doubts here. 1. If you check the code, I used ignite semaphore and if i remove that sempahore checking, then I'm getting JDBC connection issues as multiple threads access that particular code. We run 100s of threads. Is there any way where we can run in paralle

Re: join question

2020-05-25 Thread Ilya Kasnacheev
Hello! Can you please share a runnable reproducer project exposing this issue? Regards, -- Ilya Kasnacheev пт, 22 мая 2020 г. в 19:54, narges saleh : > Sorry for the late reply. > I have defined the affinity via cacheKeyConfiguration in ignite config > file and it is working fine, if I use JD

Re: join question

2020-05-22 Thread narges saleh
Sorry for the late reply. I have defined the affinity via cacheKeyConfiguration in ignite config file and it is working fine, if I use JDBC connection. But it does seem the issue is with the affinity key population, not definition, in case of binary objects. I must be doing something wrong. I am tr

Re: Data Consistency Question

2020-05-20 Thread akorensh
Hi, A Streamer -- using IgniteDataStreamer.addData(..) does not guarantee consistency. from doc: Note that streamer will stream data concurrently by multiple internal threads, so the data may get to remote nodes in different order from which it was added to the streamer. see: https://ig

Data Consistency Question

2020-05-20 Thread adipro
Can anyone tell if this code guarantees all the rows to be inserted right after all the statements are executed? IgniteSemaphore semaphore = null; try { semaphore = cacheHolder.getJDBCSemaphore(IgniteLocks.JDBC_LOCK.getLockValue());

Re: join question

2020-05-19 Thread Ilya Kasnacheev
Hello! It is possible that Data Streamer is not actually aware of affinity column of your table. Can you try marking it with @AffinityKeyMapped? Regards, -- Ilya Kasnacheev вт, 19 мая 2020 г. в 01:48, narges saleh : > It seems the issue exist only if one uses data streamer with binaryobject >

Re: join question

2020-05-18 Thread narges saleh
It seems the issue exist only if one uses data streamer with binaryobject builder. If I use straight JDBC to insert data, the issue goes away. Any idea what one needs to do to get this working with binary objects? Everything else is the same between the two scenarios. On Mon, May 18, 2020 at 4:39

Re: join question

2020-05-18 Thread narges saleh
It turned out that I'd get partial results in some cases, when joining partitioned caches. But I still don't understand why I am not getting all the rows that the joined query should return. My assumption is that if you have caches with primary keys, containing the affinity key, then the related en

Re: join question

2020-05-18 Thread narges saleh
No error. Just no records is returned, as opposed to the join between the replicated and partitioned cache which returns ass applicable rows. Sorry, for not being clear. On Mon, May 18, 2020 at 9:00 AM Ilya Kasnacheev wrote: > Hello! > > Fails how? Is the result set incorrect? Any specific error

Re: join question

2020-05-18 Thread Ilya Kasnacheev
Hello! Fails how? Is the result set incorrect? Any specific error message? Please share details. Regards, -- Ilya Kasnacheev пн, 18 мая 2020 г. в 16:49, narges saleh : > Hi All, > I have encountered a puzzling join case. > I have 3 tables on a cluster of two ignite server nodes: > table-A (id

join question

2020-05-18 Thread narges saleh
Hi All, I have encountered a puzzling join case. I have 3 tables on a cluster of two ignite server nodes: table-A (id + org = primary), replicated id org. <-- affinity other fields table-B (id, org, add-id=primary key), partitioned id org <- affinity addr-id other fields table-C (id, org, comp-id

Re: Question on the log of public pool thread [pub-#14505].

2020-05-14 Thread Evgenii Zhuravlev
James, > But whether could I know the other threads are stopped and destroy? That's how it works, Here in the code: https://github.com/apache/ignite/blob/master/modules/core/src/main/java/org/apache/ignite/internal/IgnitionEx.java#L1763 you can see that Ignite create ThreadPoolExecutor with a max

Re: Basic Affinity Question

2020-05-14 Thread Stephen Darlington
No, it needs to be able to determine which node the data should be on without reference to anything else. This means that you’d need company-id in your address table. > On 13 May 2020, at 21:23, narges saleh wrote: > >  > My other question is whether affinity is transitiv

Re: Question on the log of public pool thread [pub-#14505].

2020-05-13 Thread James Yuan
Thank you for reply. It seems I should create custom thread pool for the business logics rather than use the public pool and reduce its size. So [pub-#14505] means the 14505th new created thread in public pool? But whether could I know the other threads are stopped and destroy? I am afraid that t

Re: Basic Affinity Question

2020-05-13 Thread narges saleh
My other question is whether affinity is transitive. Company (primary key: company-id) Employee(primary key: employee-id + company-id) <- company id = affinity key Address(Primary key: address-id + employee -id) <- employee id = affinity key Would the records related company, employ

Re: Question on the log of public pool thread [pub-#14505].

2020-05-13 Thread Evgenii Zhuravlev
James, This is a thread number. The public thread pool size can be reduced after idle timeout. After this, if needed, a new thread will be created with a new id. By the way, 640 is a pretty big size, how many cores do you have? So big thread pool can lead to performance degradation due to a lot o

Re: Basic Affinity Question

2020-05-13 Thread narges saleh
Thanks. If I try AffinityRun with collection of caches and the affinity key, I'd get NPE with cache.localpeek using the primary key of the dependent cache/table but the cache query itself succeeds. Is there a working example? On Wed, May 13, 2020 at 8:10 AM Stephen Darlington < stephen.darling...@

Re: Basic Affinity Question

2020-05-13 Thread Stephen Darlington
Yes, but you also need to make sure you use the correct affinityRun method. There’s one where you specify multiple caches and you need to use that one. > On 13 May 2020, at 12:50, narges saleh wrote: > > Hi All, > If I have these two caches/tables defined via query entities, in a config > fil

Basic Affinity Question

2020-05-13 Thread narges saleh
Hi All, If I have these two caches/tables defined via query entities, in a config file, Employee (partitioned) employee-id company-id name primary key(employee-id, company-id), affinity(company-id) Company (partitioned) company-id. name primary key(company-id) If I do AffinityRun or

Question on the log of public pool thread [pub-#14505].

2020-05-12 Thread James Yuan
Hi, I have the following log. [2020-05-13 09:33:49] [pub-#14505] INFO c.n.b.e.l.ActiveSyncServiceEventListener - Event [id=CommandEvent] has been handled on ContextKey{key='0021fc3b-b293-4f8a-b62d-25c51ec52586'}. What's does the [pub-#14505] mean? The number of thread in public pool? Or the num

Re: Continuous query setPageSize and setTimeInterval question

2020-04-30 Thread akorensh
It is likely entries are being quickly produced and filling up the buffer giving the effect of an immediate update. You can test it via specific delays and logging. Make the server print out the counter of the object. say: if the key is an integer and the value is too then print out the key as y

Re: Continuous query setPageSize and setTimeInterval question

2020-04-30 Thread crypto_ricklee
This was what I thought, however, no matter what number I set to the pageSize, e.g., 5, 20, 100, my local listener got the update immediately, 1 by 1, but not batching by the page size... -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Continuous query setPageSize and setTimeInterval question

2020-04-29 Thread akorensh
You are correct. Your local reciever will get an update every 100 entries. setPageSize sets the number of entries to batch together before sending. When the server has accumulated a number of entries larger than getPageSize it sends a message to the receiver. Like I mentioned before, setInterval

Re: Continuous query setPageSize and setTimeInterval question

2020-04-28 Thread crypto_ricklee
Thanks Alex, But I still not quite understand the expected behaviour. If I set the page size to 100 and interval to 0, should the local query be triggered for every 100 updates? Regards, Rick -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

  1   2   3   4   5   6   7   >